Hardware & devices
Driving advances in hardware, devices and cyber-physical systems.
Video
CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association
Identifying and tracking people and mobile devices indoors has many applications, but is still a challenging problem. We introduce a cross-modal sensor fusion approach to track mobile devices and the users carrying them. The CrossMotion…
Microsoft Research Blog
A Strong Sense for Natural Interactions
This week, Microsoft researcher Hrvoje Benko (@hrvojebenko) is in Hawaii, but not on one of the islands’ beautiful beaches. As conference chair for UIST 2014—the 27th Association for Computing Machinery (ACM) Symposium on User Interface…
Video
Sensing Techniques for Tablet+Stylus Interaction
We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in…
Video
Sensing Techniques for Tablet+Stylus Interaction (short)
We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in…
Video
FlexSense: A Transparent Self-Sensing Deformable Surface
We present FlexSense, a new thin-film, transparent sensing surface based on printed piezoelectric sensors, which can reconstruct complex deformations without the need for any external sensing, such as cameras. Done in collaboration with Media Interaction…
Video
3D-Board: A Whole-body Remote Collaborative Whiteboard
Introducing 3D-Board, a digital whiteboard capable of capturing life-sized virtual embodiments of geographically distributed users. When using large-scale screens for remote collaboration, awareness for the distributed users’ gestures and actions is of particular importance. Our…
Video
RichReview: Blending Ink, Speech, and Gesture to Support Collaborative Document Review
This paper introduces a novel document annotation system that aims to enable the kinds of rich communication that usually only occur in face-to-face meetings. Our system, RichReview, lets users create annotations on top of digital…
