The text discusses the introduction of multi-query attention (MQA) in large language models to expedite decoder inference, addressing the trade-offs in efficiency and quality. It emphasizes the benefits of uptraining language model checkpoints using MQA and proposes grouped-query attention (GQA) as an alternative approach. The objective is to enhance the efficiency of language models while…

Microsoft’s MetaOpt is a heuristic analyzer designed to evaluate and enhance heuristic performance before deployment in cloud environments. It offers insights, what-if analyses, and can learn from domains like traffic engineering and packet scheduling. Based on Stackelberg games, it simplifies heuristic input and aims to improve scalability and usability for cloud operators.

Microsoft’s deepening relationship with OpenAI has prompted scrutiny over competition within the AI sector. Civil society organizations, including Article 19, urge the EU and UK competition authorities to investigate the partnership’s potential anticompetitive impact. They emphasize the need for regulatory scrutiny to ensure fair competition and innovation in the AI domain.

A new pre-print study has shown GPT-4’s potential to aid in treating stroke patients. Analysing data from 100 patients, the AI’s treatment recommendations closely aligned with expert neurologists and real-world medical practice, demonstrated by a high Area Under the Curve (AUC) of 0.85 and 0.80, respectively. GPT-4 also accurately predicted 90-day post-stroke mortality risk.

SpeechGPT-Gen, developed by Fudan University researchers, revolutionizes speech generation using the Chain-of-Information Generation method. It separates semantic and perceptual processing, leading to significant improvements over traditional methods. The model excels in zero-shot text-to-speech, voice conversion, and speech-to-speech dialogue, showcasing its remarkable scalability and effectiveness in diverse applications. [49 words]

Language Agents are a groundbreaking development in computational linguistics, utilizing large language models to process information autonomously and tackle complex reasoning tasks. A critical challenge is managing uncertainty in language processing, which this research addresses through a novel method of integrating uncertainty estimation into agents’ decision-making process. The proposed Uncertainty-Aware Language Agent (UALA) method outperforms…

OpenAI CEO Sam Altman visited South Korea to meet with top Samsung Electronics and SK Group executives as part of efforts to bring AI chip production in-house. With plans to raise funds for chip fabrication plants and secure High Bandwidth Memory from Korean companies, OpenAI aims to reduce dependence on NVIDIA and Taiwan Semiconductor Manufacturing…

In November 2022, OpenAI’s ChatGPT saw rapid growth, reaching a million users in 5 days, then soaring to 100 million by January 2023. In April 2023, the user count hit 173 million, with over 1.5 billion monthly website visits by January 2024. The U.S. and India have the highest user bases. Additionally, the platform is…

Elon Musk announced the first successful human trial of Neuralink’s brain implant, “Telepathy,” allowing control of devices simply through thought. Targeting individuals with limited hand mobility, the implant aims to restore autonomy and unlock human potential. The fusion of AI and brain-machine interfaces could revolutionize communication speed and capability, paving the way for an inevitable…

IBM Research introduces Unitxt, a collaborative platform for processing unified textual data, offering a Python module with configurable pipelines for handling textual data in multiple languages. This facilitates collaboration, transparency, and reproducibility. Unitxt allows for over 100,000 recipe configurations, facilitates integration of datasets, and serves as a crucial data backbone for large language models.