Robot Learning with Visual Predicted Force
Force-aware manipulation typically relies on specialized force or tactile sensors. We show that force-aware manipulation can instead be achieved through visual force prediction from the deformation of a compliant Fin Ray gripper. Our approach trains two models. First, we train a visual force estimator on calibration data and use it to annotate task demonstrations with force estimates. Second, we…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.