Review Category : Research

MonoFusion is a Microsoft Research project that uses a camera that could be already available in a tablet or a phone for creating 3-D scans of arbitrary environments in real time, utilizing only a single RGB camera as the input sensor. You should note down that there is no additional input hardware like Depth sensor is required for this technology. If Microsoft uses this technology in Lumia devices, in seconds, a user can generate a compelling 3-D model, which can be used in augmented reality, for 3-D printing, or in computer-aided design. MonoFusion allows a user to build dense 3D reconstructions of their environment in real-time, utilizing only a single, off-the-shelf web camera as the input sensor. The camera could be one already available in a tablet, phone, or a standalone device. No additional input hardware is required. This removes the need for power intensive active sensors that do not work robustly in natural outdoor ...

Read More →

Microsoft Research FUSE labs today revealed a new project called Eventful. Eventful makes it possible for anyone to access the service of event reporting. The reporting process is executed behind the scenes through a crowd of people working online or at the event to produce a news report. Eventful system helps produce news reports by recruiting and guiding remote and locative crowd workers who attend events in person to perform information collection missions. Basically, journalism as a service. Here is how it works, Eventful makes requesting a report a one-step process: identify the event type, location, date, and duration. A few hours later and under $150 dollars, a multimedia event report is ready. Eventful hopes to prevent community groups that organize local events on a tight budget from scrambling to cover the event themselves (or risk getting no coverage). A city council could use the system to request reports of discussions that take place during ...

Read More →

  Microsoft has recently formed a cross-group Inking team between Office, Surface, and Windows groups. This team is now exploring a possibility of creating a unified Inking experience that will offer a great experience for Microsoft eco-system users. When you read the whole presentation embedded below, you will come to know that there is a possibility that Microsoft’s Courier UI vision may become true at least. You can select an area in a website, drag and drop it to Office apps, edit them and all these using your inking pen. In late 2013 and early 2014 Office, Surface, and Windows formed a Cross-Group Inking team to explore One Microsoft needs for a unified approach to inking. In this session Tucker Hatfield presents details about the Cross-Group effort and their conclusions of what is needed for first-class inking and Will Vong shows visionary ways in which these needs might be met with inking ...

Read More →

A Microsoft Research project titled ‘Great Inking’ became public on the web recently. It reveals that Microsoft has formed a cross-division inking team that will devise a unified inking strategy for Microsoft. The project has revealed no.of upcoming Office touch UI for Windows. You can see the Excel UI in the image above. In late 2013 and early 2014 Office, Surface, and Windows formed a Cross-Group Inking team to explore One Microsoft needs for a unified approach to inking. In this session Tucker Hatfield presents details about the Cross-Group effort and their conclusions of what is needed for first-class inking and Will Vong shows visionary ways in which these needs might be met with inking features. Check out Outlook and Word Touch UI below. Source: WalkingCat ...

Read More →

Microsoft Research has recently released Code Hunt, a browser-based game for anyone who is interested in coding. It is based on the fact that people can be more effective and sustainable when coding is fun. Codehunt uses puzzles, which players explore by means of clues presented as test cases. Players iteratively modify their code to match the functional behavior of secret solutions. Once their code matches, lights flash and sounds play, letting players know that they have “captured” the code. Players then get a score, which depends on how elegant their solution is, and are encouraged to move on to the next puzzle or level. Players can use either C# or Java to play this game. Code Hunt was developed by a team in Microsoft Research led by Principal Development Lead Nikolai Tillmann and Principal Research Software Engineer Peli de Halleux. It is based on Pex, Microsoft Research’s state-of-the-art implementation ...

Read More →

Two interesting job listings from Microsoft was revealed today. One of them is from the team which created Kinect which is working on revolutionizing consumer electronic devices. Their work involves developing ground-breaking hardware, software, and experiences across computer vision, machine learning, human-computer interaction, image and video processing, networking and graphics. I guess Alex Kipman, the creative head behind Kinect is leading this project now. Microsoft is working on revolutionizing consumer electronic devices, and you can be a part of that. The group that created Kinect and profoundly changed the way people interact with technology is forming a team to change the world again! We are a growing team of expert engineers working in an agile and high-energy environment to redefine experiences by making technology disappear. We are developing ground-breaking hardware, software, and experiences across computer vision, machine learning, human-computer interaction, image and video processing, networking and graphics. Are you an ...

Read More →

The Microsoft Applied Sciences Group in Research division has been investigating making devices that disconnect the apparent location of a displayed image from the location of the hardware so that the images appear to “float” in the air. In this way, you can allow one use is for allowing touch interfaces that don’t require physical contact. Floating Display: Visual Cues for Gestural Interactions Many people are working on near-field user-interface devices that detect hover, gesture, and pose. But there is nothing in the space in front of a device to show the user what to do. This project introduces a floating display that hovers over the device, providing visual cues for gestural interactions. Microsoft Research team has created a prototype for this project and demoed it at 2014 Silicon Valley TechFest. You can see the demo in the above video. ...

Read More →

We all often use a whiteboard at work with a marker in our hands. Have you ever thought of having a huge digital whiteboard which can recognize you, respond to your gestures, etc,.? Microsoft Research project ViiBoard uses vision techniques to significantly enhance the user experience on large touch displays (e.g. Microsoft Perceptive Pixel) in two areas: human computer interaction and immersive remote collaboration. ViiBoard is a system for remote collaboration through a digital whiteboard (PPI) that gives participants an immersive, 3-D experience with enhanced touch capability. ViiBoard emulates writing side by side on a physical whiteboard or, alternatively, on a mirror, through 3-D processing of depth images and life-sized rendering. Additional vision techniques, such as hand-gesture recognition, are integrated to understand users’ intentions before they touch the board, simplifying the interaction with a PPI, especially for content editing and presenting. Compared with standard video conferencing, the ViiBoard provides participants ...

Read More →

Microsoft Research is now exploring the area of ‘Emotional Intelligence” which could play a key factor in the future where Cortana might become the true personal assistants for people. Inspired by Spike Jonze’s slightly futuristic, boy-meets-artificial intelligence love story ‘HER’ last year, Microsoft designers came up with the question: How can human emotions inspire new interactions with technology and each other? They partnered with Motherboard, Warner Brothers Studio and design students in L.A. and NYC for a design experiment where their mission was to explore the impact of emotion on human machine interaction. You can watch the video above, giving you a glimpse of what they learned. “Her” is a love story, first and foremost. It inspired a wide community of designers in surprising ways. We hosted private screenings of the film followed by a 2-day design workshop. We asked one question: How can human emotions inspire new interactions with ...

Read More →

Back in February, Microsoft celebrated International Mother Language Day (IMLD) alongside UNESCO by announcing that the Welsh language has now joined a growing list of languages to benefit from translation services provided by Microsoft Translator. Developed by the National Assembly for Wales in partnership with Microsoft, the system will consist of tools, services and applications which will provide support across the suite of Microsoft products and services, including Word and Outlook, along with Bing Translator applications for Windows, Windows Phone and online at www.bing.com/translator. The National Assembly for Wales is a bilingual institution. Our Official Languages Scheme sets out our ambition to be recognised as a truly bilingual institution where Assembly Members, staff and the public can choose to work or communicate in either or both of our official languages and where the use of both languages is encouraged and facilitated. The introduction of Welsh in Microsoft Translator is a great step ...

Read More →

  Microsoft Research head Peter Lee spoke to Digital Trends and he discussed about the ongoing projects at MSR, people’s perception about Google X and more. Microsoft Research has 1,100 computer scientists, researchers, and engineers in labs all around the world and combining them with over 1,200 PhD student interns every year, it is one of the largest research organization in the world. When Peter was asked whether he is frustrated by the tech press focusing on Google X than MSR’s work, “Frustrating is not quite the right word,” Lee told Digital Trends, in an interview ahead of the ribbon-cutting ceremony for MSR’s New York City office. “I like Google X. The people there are good friends of mine. Astro [Teller, “Captain of Moonshots” with Google X] took classes from me at Carnegie Mellon, he’s a great guy doing great stuff. But the missions are different. We want to make things better and ship them. ...

Read More →

In addition to the project on mechanical keyboards that can detect gestures, Microsoft Research has also demoed another project at ACM CHI Conference on Human Factors in Computing Systems 2014 related to new vision based system. This project is called RetroDepth, and this system can accurately sense the 3D silhouettes of hands, styluses, and other objects, as they interact on and above physical surfaces. The main highlight is that it can be setup using cheap and simple methods. We present RetroDepth, a new vision-based system for accurately sensing the 3D silhouettes of hands, styluses, and other objects, as they interact on and above physical surfaces. Our setup is simple, cheap, and easily reproducible, comprising of two infrared cameras, diffuse infrared LEDs, and any off-the-shelf retro-reflective material. The retro-reflector aids image segmentation, creating a strong contrast between the surface and any object in proximity. A new highly efficient stereo matching algorithm ...

Read More →

The 2dn gen Microsoft Surface Touch Covers already supports gesture in them. But, you have to perform the gestures on the keyboard. This new project from Microsoft Research will allow you to perform gestures over the keyboard without even touching them. Such user experience is enabled by low-resolution matrix of infrared (IR) proximity sensors between the keys of the mechanical keyboard. Watch the video demo above. We present a new type of augmented mechanical keyboard, sensing rich and expressive motion gestures performed both on and directly above the device. A low-resolution matrix of infrared (IR) proximity sensors is interspersed with the keys of a regular mechanical keyboard. This results in coarse but high frame-rate motion data. We extend a machine learning algorithm, traditionally used for static classification only, to robustly support dynamic, temporal gestures. We propose the use of motion signatures a technique that utilizes pairs of motion history images and a random ...

Read More →

Microsoft revealed the Cortana digital assistant platform at BUILD developer conference earlier this month. Behind the scenes, its Microsoft’s Bing platform that powers Cortana. Even though Cortana responds based on your intent and behavior now, MSR expects it to interact in an increasingly anticipatory, natural manner in the future. Microsoft Research detailed some of the technologies involved in building Cortana. Even though many of us would just categorize them under Artificial Intelligence label, Microsoft Research has detailed all of those technologies involved. Speech recognition, Semantic/natural language processing, Dialogue modeling between human and machines, Spoken-language generation, Microsoft Research has used all of the above base technologies for a creating a virtual personal assistant based on the work they have done in different areas of personal-assistant technology. Cortana’s design philosophy is therefore entrenched in state-of-the-art machine-learning and data-mining algorithms. Furthermore both developers and researchers are able to use Microsoft’s broad assets across ...

Read More →

Microsoft Research today revealed about their new project called Holograph. Holograph is an interactive, 3-D data-visualization research platform that can render static and dynamic data above or below the plane of the display using a variety of 3-D stereographic techniques. The platform enables rapid exploration, selection, and manipulation of complex, multidimensional data to create and refine natural user-interaction techniques and technologies, with the goal of empowering everyone to understand the growing tide of large, complex data sets. During Microsoft Research’s Silicon Valley TechFair, Microsoft Research scientist Curtis Wong demonstrated this project. Watch the video above. Holograph enables users to examine various types of dynamic data sets—easily and naturally. “If you have 3-D data, you could move your head around and look at things as if they were physically there,” Wong suggests. “That’s a natural way of observing something. If you want to reach in and select something that’s interesting, you ...

Read More →

The future of computing interface is all about NUI, natural user interface (NUI) is the ability to interact with a computer using speech, gesture and touch, seamlessly and simultaneously. Microsoft’s Redmond campus has a Envisioning Center which showcases Microsoft’s devices and services strategy and what it could unlock in the future. It provides us a glimpse of the future on how our computing may get transformed in the next 5-10 years. Many of those futuristic scenarios are powered by two Microsoft technologies available today: Kinect for Windows and Perceptive Pixel (PPI) displays. The Envisioning Center team was halfway through designing scenarios when Microsoft acquired PPI. A light bulb went off, say Jonathan Cluts and Anton Andrews, who planned everything at the Center from the physical architecture to the code powering its innovative scenarios. “Immediately we put our heads together and started to think about how to put the two devices together because they ...

Read More →