Recognition of Gestures over Textiles with Acoustic Signatures – ACM SIGGRAPH ASIA 2021, Emerging Technologies
Authors – Pui Chung Wong, Christian Sandor, Alvaro Cassinelli (CityU, HK)
Abstract – A method capable of turning textured surfaces into opportunistic input interfaces is demonstrated, thanks to a machine learning model pre-trained on acoustic signals generated by scratching different fabrics. It does not require intervention on the fabric. It is passive and works well using regular microphones. Preliminary results also show that the system recognizes the manipulation of Velcro straps, zippers, or the taping or scratching of plastic cloth buttons over the air when the microphone is in personal space.
