Natural User Interfaces (NUI) has started to evolve more rapidly in the past few years with the gesture-based interfaces that use touch or touch-less interactions or the full body to enable rich interactions with a computing device. But, none of these have changed the way of interacting with traditional desktop computing using keyboard and mouse. With this patent, Microsoft is describing a gesture based system for desktop which allows you to control elements of these tasks such as mode switches, window and task management, menu selection and certain types of navigation which are offloaded to shortcut and modifier keys or context menus. Summary: The following presents a simplified summary of the disclosure in order to provide a basic understanding to the reader. This summary is not an extensive overview of the disclosure and it does not identify key/critical elements or delineate the scope of the specification. Its sole purpose is to present a selection of ...

Read More →

The 2dn gen Microsoft Surface Touch Covers already supports gesture in them. But, you have to perform the gestures on the keyboard. This new project from Microsoft Research will allow you to perform gestures over the keyboard without even touching them. Such user experience is enabled by low-resolution matrix of infrared (IR) proximity sensors between the keys of the mechanical keyboard. Watch the video demo above. We present a new type of augmented mechanical keyboard, sensing rich and expressive motion gestures performed both on and directly above the device. A low-resolution matrix of infrared (IR) proximity sensors is interspersed with the keys of a regular mechanical keyboard. This results in coarse but high frame-rate motion data. We extend a machine learning algorithm, traditionally used for static classification only, to robustly support dynamic, temporal gestures. We propose the use of motion signatures a technique that utilizes pairs of motion history images and a random ...

Read More →

TouchMe Gesture Studio allows you to customize your very own Touchscreen gestures on your Windows 8 touch devices like Surface Pro, Dell Venue, etc. You can export your gesture file and use it with any gesture engine you like. Choose from over 30 gestures, roam your gestures between all your devices. You can even mimic keyboard shortcuts, change volume, switch between apps, and more using gestures. Touchscreens have improved the way we all interact with our computers! By using TouchMe Gesture Studio, you can create, edit, and export custom gesture files to take things one step further! Gestures available include: • 2/3/4/5 Finger Swipe up/down/left/right • 3/4/5 Finger Pinch in/out • 2/3/4/5 Finger TipTap left/right Actions currently available: • Show/Hide Touch Keyboard • Increase/Decrease Volume • Increase/Decrease Brightness • Open/Close/Switch Browser Tabs • Show the TaskBar • Sleep, hibernate, Sign Out, Lock, Shut down, and Restart • Mimic Keyboard Shortcut ...

Read More →

  As expected, Microsoft is already exploring the ways to navigate Windows using Kinect gestures. Even though Kinect had a official Windows SDK for a longtime, Microsoft never showed off a way to navigate Windows using air gestures. Today, The Verge revealed that Microsoft Research is already exploring the potential use of it. In this project, you will be mounting a Kinect camera above a desk and it detects a number of gestures above and around a keyboard and mouse. Microsoft Researcher Abigail Sellen says the following, “What we don’t want here is Tom Cruise in minority report,” “What gestures are good at are being very casual, expressive. What they’re not good at is being precise. Touch is good at that, mouse pointer is good at that. We don’t need to do that with gestures.” “We’re not doing anything precise, and nothing that requires you to hold your hands up ...

Read More →