Researchers from ByteDance unveiled the Reinforced Fine-Tuning (ReFT) method to enhance the reasoning skills of LLMs, using math problem-solving as an example. By combining supervised fine-tuning and reinforcement learning, ReFT optimizes learning by exploring multiple reasoning paths, outperforming traditional methods and improving generalization in extensive experiments across different datasets. For more details, refer to the…

Researchers from the University of Washington and Allen Institute for AI propose a promising approach called Proxy-tuning, a decoding-time algorithm for fine-tuning large language models. It allows adjustments to model behavior without direct fine-tuning, addressing challenges in adapting proprietary models and enhancing model performance. The method offers more accessibility and efficiency, encouraging model-producing organizations to…

This work introduces the INTERS dataset to enhance the search capabilities of Large Language Models (LLMs) through instruction tuning. The dataset covers various search-related tasks and emphasizes query and document understanding. It demonstrates the effectiveness of instruction tuning in improving LLMs’ performance across different settings and tasks, shedding light on crucial aspects such as few-shot…

Stable AI’s new model, Stable-Code-3B, is a cutting-edge 3 billion parameter language model designed for code completion in various programming languages. It is 60% smaller than existing models and supports long contexts, employing innovative features such as Flash-Attention and Rotary Embedding kernels. Despite its power, users must carefully evaluate and fine-tune it for reliable performance.

“Large Language Models (LLMs) are powerful in AI but face challenges in efficiently using external tools. To address this, researchers introduce the ‘EASY TOOL’ framework, streamlining tool documentation for LLMs. It restructures, simplifies, and enhances tool instructions, leading to improved LLM performance and broader application potential. This marks a significant advancement in AI and LLM…

Mistral AI released Mixtral, an open-source Mixture-of-Experts (MoE) model outperforming GPT-3.5. Fireworks AI improved MoE model efficiency with FP16 and FP8-based FireAttention, greatly enhancing speed. Despite limitations of quantization methods, Fireworks FP16 and FP8 implementations show superior performance, reducing model size and improving requests/second. This research marks a significant advancement in efficient MoE model serving.

The Natural Language Generation (NLG) field, situated at the intersection of linguistics and artificial intelligence, has been revolutionized by Large Language Models (LLMs). Recent advancements have led to the need for robust evaluation methodologies, with an emphasis on semantic aspects. A comprehensive study by various researchers provides insights into NLG evaluation, formalization, generative evaluation methods,…

The emergence of large language models like GPT, Claude, and Gemini has accelerated natural language processing (NLP) advances. Parameter-Efficient Sparsity Crafting (PESC) transforms dense models into sparse ones, enhancing instruction tuning’s efficacy for general tasks. The method significantly reduces GPU memory needs and computational expenses, presenting outstanding performance. The researchers’ Camelidae-8Ï34B outperforms GPT-3.5.

The practical deployment of large neural rankers in information retrieval faces challenges due to their high computational requirements. Researchers have proposed the InRanker method, which effectively distills knowledge from large models to smaller, more efficient versions, improving their out-of-domain effectiveness. This represents a significant advancement in making large neural rankers more practical for real-world deployment.

In response to unethical data practices in the AI industry, a team of Chicago-based developers has created Nightshade, a tool to protect digital artwork from unauthorized use by introducing ‘poison’ samples. These alterations are imperceptible to the human eye but mislead AI models, preventing accurate learning or replication of artists’ styles. Nightshade aims to increase…