Microsoft Research and Tsinghua University researchers have introduced a new approach called Skeleton-of-Thought (SoT) to address the sluggish processing speed of Large Language Models (LLMs) like GPT-4 and LLaMA. SoT refrains from making extensive changes to the LLMs themselves and focuses on optimizing the organization of their output content. By prompting LLMs to construct a…

A new AI software can accurately analyze complex cuneiform texts using 3D models of the tablets, leading to more reliable results compared to previous methods. This enables researchers to compare and search through multiple tablets and opens up new avenues for research.

Nvidia researchers have developed Tied-LoRA, a technique that enhances the parameter efficiency of the Low-rank Adaptation (LoRA) method. By using weight tying and selective training, Tied-LoRA achieves an optimal balance between performance and trainable parameters. Experimental results show trade-offs between efficiency and performance, with a specific Tied-LoRA configuration achieving comparable performance with only 13% of…

Researchers have developed a new method called Drivable 3D Gaussian Avatars (D3GA) for rendering realistic human bodies. Using Gaussian splats instead of radiance fields, the method accurately represents human appearance and deformations. It eliminates the need for extensive pre-processing and achieves high-quality results without requiring ground truth geometry. The research outperforms current methods and reduces…

The Federal Trade Commission (FTC) has expanded its powers to investigate the AI industry. This includes the use of civil investigative demands (CIDs) to gather information relevant to the investigation. Non-compliance with CIDs can lead to legal consequences. The FTC is also focusing on algorithmic fairness and transparency in AI systems. FTC chair Lina Khan…

“The Book of Why” Chapters 3&4 are part of the Read with Me series and can be found on Towards Data Science.

Meta has proposed a new approach called System 2 Attention (S2A) to address the issue of bias and irrelevant context in large language models (LLMs). S2A uses natural language processing to refine the original prompt, stripping out bias and irrelevant information before generating a response. The results show impressive improvements in accuracy, particularly in factual…

The value of data lies in its ability to bring about tangible positive change. Leveraging data can help solve complex business decisions and improve everyday routines. Here are some recent favorite articles that demonstrate the practical role of data in different areas, such as survival analysis, decision trees, personal habit tracking, customer lifetime value modeling,…

Lincoln Laboratory is focused on reducing energy consumption in AI models through improved transparency and more efficient training methods.