MIT researchers have developed PockEngine, a technique that allows deep-learning models to be fine-tuned directly on edge devices. This eliminates the need for sending user data to cloud servers and improves privacy, customization options, and cost-effectiveness. PockEngine has shown impressive speed improvements and memory savings, making on-device fine-tuning more accessible.

Alibaba researchers have developed Qwen-Audio, a series of large-scale audio-language models that address the challenge of limited pre-trained audio models. Qwen-Audio achieves impressive performance across diverse benchmark tasks without task-specific fine-tuning. Qwen-Audio-Chat extends these capabilities to support multi-turn dialogues and diverse audio scenarios. The models demonstrate robust audio understanding and alignment with human intent. Further…

Claude.ai, developed by Anthropic, has released an upgraded version called Claude 2.1. The major improvement is the doubling of its context window, now at 200,000 tokens, making it the largest in the industry. While it performs well, accuracy in recalling information decreases as the context grows longer. Other features of Claude 2.1 include increased accuracy,…

A study by UC Berkeley and Shanghai Jiao Tong University highlights the challenges in evaluating language models due to contaminated datasets. Conventional decontamination techniques are flawed, prompting the researchers to propose a new approach using rephrased samples and embedding similarity search. The study emphasizes the need for more thorough decontamination procedures and suggests new tests…

Researchers from the University of Pennsylvania, the University of Washington, and Tencent AI Lab have developed a sub-sentence encoder, an embedding model that generates distinct embeddings for atomic propositions within a text sequence. The model focuses on fine-grained semantic representation and is effective in tasks like retrieving supporting facts and recognizing conditional semantic similarity. It…

Scientists have discovered that by imposing physical constraints on artificial intelligence systems, similar to how the human brain functions within physical and biological limits, these systems can develop characteristics found in the brains of complex organisms, helping them to solve tasks effectively.

US Ambassador to India, Eric Garcetti, emphasized the importance of deeper conversations between India and the US on artificial intelligence (AI). He called for a comprehensive regulatory framework to prevent catastrophic consequences and stressed the urgency of staying ahead in the AI field. Garcetti highlighted the need for bilateral efforts and collaboration on defense, technology,…

The decision to fire Sam Altam from OpenAI may have been influenced by the effective altruistic ideals of the board members. Interim CEO Emmett Shear shares concerns about AI. Some board members align with the concept of Effective Altruism (EA) and its fears regarding AI development. Shear supports the views of the EA community, including…

In a surprising turn of events, Sam Altman is set to be reinstated as the CEO of OpenAI. The drama started when Altman was removed for a lack of candor in his communications. This led to Altman and co-founder Greg Brockman planning to join Microsoft, while OpenAI employees threatened to leave. OpenAI has now formed…