Programming for Mixed Reality with Windows 10, Unity, Vuforia, and UrhoSharp

• Set up a mixed reality development environment with all the tools you’ll need, including HoloLens and Mixed Reality simulators
• Write Universal Windows 2D apps for all Windows 10 devices, and adjust their views and capabilities to specific hardware
• Acquire, display and process audio and video
• Send images from world-facing headset cameras to Microsoft’s computer vision machine learning modules
• Generate descriptions of what the user sees, and present them via text or speech
• Use mobile sensor readings to control content displayed through mixed reality headsets
• Master core concepts and techniques for building 3D mixed reality apps with Unity
• Format 3D objects with materials to create holograms
• Add interactions to holograms based on user input Integrate HoloLens-specific capabilities, including air gestures, spatial sound, and mapping
• Connect mixed reality experiences with real objects in the environment via the Vuforia Unity extension
• Write cross-platform 3D mixed reality apps with Xamarin UrhoSharp

This is a complete guide to programming AI-powered mixed reality apps with the Windows Mixed Reality platform. Step by step, Dawid Borycki guides you through every type of mixed reality development, from simple 2D to cutting-edge apps for Microsoft HoloLens and immersive headsets. First, you’ll learn to write UWP 2D apps that adapt for any Windows 10 device, transfer camera images to machine learning services, and use mobile sensor readings to control headset content. Then, building on these skills, you’ll master every facet of building cross-platform 3D apps that link augmented reality content to real objects. 

• Set up a mixed reality development environment with all the tools you’ll need, including HoloLens and Mixed Reality simulators 
• Write Universal Windows 2D apps for all Windows 10 devices, and adjust their views and capabilities to specific hardware 
• Render media streams, acquire video from world-facing cameras, and detect human faces in those images 
• Generate descriptions of what the user sees, and present them via text or speech 
• Build AI-powered voice-controlled apps with Microsoft Cognitive Services (MCS) 
• Master core concepts and techniques for building 3D mixed reality apps with Unity 
• Format 3D objects with materials to create holograms 
• Add interactions to holograms based on user input 
• Integrate HoloLens capabilities, including air gestures, spatial sound, and mapping