Salesforce AI Research Proposes DEI: AI Software Engineering Agents Org, Achieving a 34.3% Resolve Rate on SWE-Bench Lite, Crushing Closed-Source Systems

Salesforce AI Research Proposes DEI: AI Software Engineering Agents Org, Achieving a 34.3% Resolve Rate on SWE-Bench Lite, Crushing Closed-Source Systems

Practical Solutions for Software Engineering Challenges

The Challenge

Debugging issues in large codebases like the ones on GitHub can be difficult due to the complexity of the software and the size of the codebase.

Fragmented Solutions from Individual AI Agents

Existing AI-driven agents often provide fragmented solutions to software engineering challenges, as their capabilities are usually limited to just one task.

Collaborative Framework for Unified Problem-Solving

The Diversity Empowered Intelligence (DEI) framework was developed to encompass multiple software engineering agents, enabling them to collaborate and offer unified, powerful solutions to complex software problems.

DEI Framework Performance

The DEI framework has been extensively tested and has shown remarkable results, achieving a 27.3% resolution rate across SWE-Bench Lite benchmarks, with the best-performing group achieving a resolution rate of 55%.

Benefits of DEI Framework

The DEI framework integrates the diverse capabilities of multiple SWE agents, enhancing performance through collaboration and re-ranking. It demonstrates the importance of diversity in AI systems, leading to greater innovation, efficiency, and problem-solving capabilities in software engineering.

Evolve Your Company with AI

Discover how AI can redefine your way of work, identify automation opportunities, define KPIs, select an AI solution, and implement gradually.

AI Solutions for Sales Processes and Customer Engagement

Explore AI solutions to redefine your sales processes and customer engagement at itinai.com.

List of Useful Links:

AI Products for Business or Try Custom Development

AI Sales Bot

Welcome AI Sales Bot, your 24/7 teammate! Engaging customers in natural language across all channels and learning from your materials, it’s a step towards efficient, enriched customer interactions and sales

AI Document Assistant

Unlock insights and drive decisions with our AI Insights Suite. Indexing your documents and data, it provides smart, AI-driven decision support, enhancing your productivity and decision-making.

AI Customer Support

Upgrade your support with our AI Assistant, reducing response times and personalizing interactions by analyzing documents and past engagements. Boost your team and customer satisfaction

AI Scrum Bot

Enhance agile management with our AI Scrum Bot, it helps to organize retrospectives. It answers queries and boosts collaboration and efficiency in your scrum processes.