About
Research & Development
Unlocking Advanced Reasoning in Diffusion Language Models Through Amortized GRPO
TLDR: A new reinforcement learning algorithm, Amortized Group Relative Policy Optimization (AGRPO), has been developed for Diffusion Large Language Models (dLLMs). Unlike previous attempts,...
Research & Development
Unpacking the Scaling Behavior of Large Language Models: The Role of Error-Entropy
TLDR: A new research paper introduces a decomposition of cross-entropy loss into three components: Error-Entropy, Self-Alignment, and Confidence. The study reveals that only Error-Entropy...
Research & Development
Enhancing Recommendations: How AI Language Models Clean Up User Interaction Data
TLDR: IADSR is a new framework that improves sequential recommendation by effectively identifying and removing noisy user interactions. It combines traditional collaborative filtering with...
Research & Development
SliceMoE: Enhancing AI Models Through Sub-Token Routing
TLDR: SliceMoE is a novel transformer architecture that improves upon traditional Mixture-of-Experts (MoE) by routing contiguous 'slices' of a token's hidden vector to specialized...
Research & Development
Inoculation Prompting: A New Method to Control Unwanted Traits in Language Models
TLDR: Inoculation Prompting is a novel technique that modifies LLM fine-tuning data by prepending a system prompt that deliberately elicits an undesirable trait. When...
Research & Development
NegotiationGym: A Framework for Self-Optimizing AI in Social Simulations
TLDR: NegotiationGym is a new open-source framework and API designed for configuring and running multi-agent social simulations, particularly focusing on negotiation and cooperation. It...