Microsoft AI Research Introduces SIGMA: An Open-Source Research Platform to Enable Research and Innovation at the Intersection of Mixed Reality and AI

Microsoft AI Research Introduces SIGMA: An Open-Source Research Platform to Enable Research and Innovation at the Intersection of Mixed Reality and AI

Practical AI Solutions for Your Business

Microsoft AI Research Introduces SIGMA: An Open-Source Research Platform

Recent advancements in generative AI and large language, vision, and multimodal models have paved the way for practical applications in open-domain knowledge, inference, and generation. These breakthroughs enable the development of AI systems that can work alongside humans in various real-world scenarios, such as mixed-reality task assistants, interactive robots, smart manufacturing floors, and autonomous vehicles.

Microsoft Research has introduced SIGMA, an interactive program that leverages mixed-reality and artificial intelligence technologies to walk users through procedural tasks using HoloLens 2. SIGMA can dynamically create tasks using a big language model like GPT-4 and can provide answers to open-ended questions using its extensive language model. Additionally, SIGMA can identify and highlight task-relevant objects in the user’s field of view using vision models such as Detic and SEEM.

The underlying architecture, Platform for Situated Intelligence (psi), provides performant streaming and logging infrastructure, fast prototyping, and support for visualization, debugging, tuning, and maintenance. SIGMA serves as a foundation for future research into the convergence of mixed reality and artificial intelligence, offering possibilities for expanding the program to additional mixed-reality devices.

For enterprise users, Microsoft also offers Dynamics 365 Guides, a mixed-reality solution that provides step-by-step procedural assistance and relevant information for frontline workers. This demonstrates the potential of AI and mixed reality to empower employees executing complex operations.

By making SIGMA publicly available, Microsoft aims to support researchers by alleviating the engineering tasks of building interactive applications, allowing them to focus on new frontiers in their field.

Evolve Your Company with AI

If you want to stay competitive and leverage AI for your company’s advantage, consider the practical solutions offered by Microsoft AI Research. Identify automation opportunities, define KPIs, select suitable AI solutions, and implement them gradually. For AI KPI management advice and insights into leveraging AI, connect with us at hello@itinai.com or stay tuned on our Telegram and Twitter channels.

Spotlight on a Practical AI Solution

Explore the AI Sales Bot from itinai.com/aisalesbot, designed to automate customer engagement 24/7 and manage interactions across all customer journey stages. Discover how AI can redefine your sales processes and customer engagement.

For more information, visit our website and join our newsletter, social media channels, and online communities.

List of Useful Links:

AI Products for Business or Try Custom Development

AI Sales Bot

Welcome AI Sales Bot, your 24/7 teammate! Engaging customers in natural language across all channels and learning from your materials, it’s a step towards efficient, enriched customer interactions and sales

AI Document Assistant

Unlock insights and drive decisions with our AI Insights Suite. Indexing your documents and data, it provides smart, AI-driven decision support, enhancing your productivity and decision-making.

AI Customer Support

Upgrade your support with our AI Assistant, reducing response times and personalizing interactions by analyzing documents and past engagements. Boost your team and customer satisfaction

AI Scrum Bot

Enhance agile management with our AI Scrum Bot, it helps to organize retrospectives. It answers queries and boosts collaboration and efficiency in your scrum processes.