MIT engineers build soft 3D shape-sensing skin for gaming and VR

MIT engineers have developed a soft, wearable, shape-sensing sheet that tracks its own 3D shape using optical fibers. This technology has potential applications in gaming, virtual reality, and physical therapy, among other areas. The MIT team, led by mechanical engineering graduate student Qifan Yu, achieved an error margin of less than half a centimeter in lab tests, putting their design on par with existing technologies.

The sheet maintains functionality even after damage, thanks to the flexible optical fibers that make up the shape-sensing surface. The fibers are more robust than traditional glass fibers, and their intentional roughening allows for directional sensing. The sheet consists of 14 waveguides, each 160 mm long, arranged in two layers of seven within a 16 x 16 x 0.5 cm silicone sheet.

The electronics are located at the sheet's edge, with data collected and translated into a full 3D shape using an algorithm. The reconstruction process occurs about three times per second, involving sensor sampling, data logging, and plotting. The team simulated different waveguide arrangements to optimize the sensing surface, finding that angling the waveguides improved accuracy more than increasing the number of fibers.

The sheet was tested with diagonal folding, and despite the loss of several fibers, it still accurately reconstructed the overall shape. The shape-sensing surface is fully soft, making it safer for use around people. The researchers aim to develop thinner fibers and higher fiber counts to create smart garments with enhanced detail and resolution.

Potential future applications for this technology include teleoperation of robots and the creation of smart garments.