StructureSense: Inferring Constructive Assembly Structures from User Behaviors
Published in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. Volume 6, Issue 4., 2022
Recommended citation: Xincheng Huang, Keylonnie L Miller, Alanson P. Sample, and Nikola Banovic. 2022. StructureSense: Inferring Constructive Assembly Structures from User Behaviors. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 204 (December 2022), 25 pages. https://doi.org/10.1145/3570343
Abstract: Recent advancements in object-tracking technologies can turn mundane constructive assemblies into Tangible User Interfaces (TUI) media. Users rely on instructions or their own creativity to build both permanent and temporary structures out of such objects. However, most existing object-tracking technologies focus on tracking structures as monoliths, making it impossible to infer and track the user’s assembly process and the resulting structures. Technologies that can track the assembly process often rely on specially fabricated assemblies, limiting the types of objects and structures they can track. Here, we present StructureSense, a tracking system based on passive UHF-RFID sensing that infers constructive assembly structures from object motion. We illustrated StructureSense in two use cases (as guided instructions and authoring tool) on two different constructive sets (wooden lamp and Jumbo Blocks), and evaluated system performance and usability. Our results showed the feasibility of using StructureSense to track mundane constructive assembly structures.
Paper: DOWNLOAD PDF
Demo:
Talk: