The Archive

LLM-agent opinion simulations on Qwen3, Llama-3.2, Gemma-3 fail complement consistency: p + (1-p) ≠ 1 when agents reason over own vs. neighbor states.

Study reveals Theory of Mind benchmarks conflate explicit belief recognition with applied behavior prediction; Llama-3.1-8B shows 51.5% aggregate but uneven competencies.

Empirical study comparing LLM-based and classical feature selection on tabular data with GRPO-adapted Qwen and Llama models.

Halcyon achieves state-of-art text-to-image generation without language pretraining, using 18-275× less compute than LlamaGen and JiT-T2I on GPIC dataset.

TinyLlama-1.1B's tokenizer severely penalizes Indic scripts (22.6× subword bloat for Kannada vs. 1.34× for Latin), undermining reported efficiency metrics.

FuTransformer CUDA kernel for Hopper GPUs uses FP8 prefill, INT4 decode, and direct KV-cache placement for Llama inference.

EEG decoder analysis across Llama-3.1-8B layers reveals passage-level context structure in silent reading aligns with deep layer embeddings.

Token probability scoring method infers native language background from non-native English text using Llama 3.1 on three datasets.

Variance partitioning decomposes LLaMA2-7B brain alignment using SCRIBE's 65 neurocognitive semantic properties on Moth Radio Hour fMRI narratives.

Group Relative Policy Optimization trains Qwen2.5 and Llama3 on perception-to-action rules via reinforcement learning for Theory-of-Mind reasoning.

Ahmad Al-Dahle, ex-Meta Llama lead, applies AI to Airbnb's product development and guest experience.

LLM-based dimensional emotion evaluation in multimodal dialogue using VAD framework on IEMOCAP with LLaMA/GPT/Qwen models.

Empirical study of information retention in sliding-window KV inference across Qwen, Llama, Mistral models reveals cross-window state transmission.

Fine-tuning LLMs for translation causes catastrophic forgetting of MT-specific instructions; general mitigation methods fail to preserve formality/gender/length control on Llama 3.1/3.2.

Semantic similarity in frozen encoders is computed dynamically via shared forward pass, not statically from embedding geometry; BGE, E5, Llama 3 reach only 0.55–0.70 AUC on meaning identity.

Serving infrastructure (Ollama, Gemma, Phi) confounds tool-use evaluation results; model behavior inconsistency stems from serving layer gatekeeping.

Bonsai 2 27B achieves 9x model compression via ternary quantization, requiring Prism's llama.cpp fork for inference.

Plain Language Adaptation for medical texts using GPT-4o-mini, Gemini-1.5-pro, LLaMA via zero/few-shot learning to improve accessibility.

Study of counterfactual self-explanations across LLaMA-3 and Qwen-2.5 shows model scale predicts explanation faithfulness in sentiment analysis and NLI tasks.

Layerwise intervention study reveals how Qwen, Llama, Gemma route query info and retrieve internal knowledge across layers during QA.

Kernel-managed shared memory system for multi-agent personalization with privacy controls tested on GPT-4o, Llama-3.1, Qwen-2.5.

PRICE framework systematically studies LLM adaptation (fine-tuning, prompting, decoding) for Bitcoin price forecasting with quantized LLaMA-3 8B.

Nvidia is announcing its new Personal AI Router (PAIR), a free tool that syncs up your home computers for tackling local AI inference tasks with tools like Ollama and LM Studio. Let's get the obvious thing out of the way, despite what its name might imply: PAIR is not a hardware router. It's open-source software developed by Nvidia that discovers compatible PCs on a network, connects them, and prepares them for crunching numbers on agentic workflows. While the compatible devices are mostly Nvidia GeForce GPUs (PAIR works with RTX 20-series cards and newer, as well as RTX Pro GPUs and DGX Spar...

Comparative analysis of worldbuilding strategies in AI-generated vs. human fiction across GPT-4, LLaMA 3.3, Mistral 3.2, Gemma 3.

Empirical analysis of precomputed memory (KV caches, compressions) degradation in Llama-3.1-8B: assembly failures and rebuild costs nearing full computation.

Llama-Mobile compresses Llama 3.2 11B Vision to 3.7GB via 2.7-bit quantization for mobile deployment on Arm CPUs.

Introducing Muse Glimmer Meta are back in the open weights game! Muse Glimmer is a brand new 30B model under a clean Apache 2.0 license (a step up from the janky Llama licenses of old). They claim to have optimized it for exactly the kind of things I'm looking for in a local model: End-to-end Agentic Task Completion. Muse Glimmer achieves strong success rates on full-task benchmarks including DeepSearch QA, MCP-Atlas, 𝛕-Bench and SWE-Bench, which measure its ability to work within scaffolds, write and debug code, and resolve multi-turn requests from start to finish. Reliable Tool Use. The mo...

LLM inference accounts for over 90% of AI operational energy, scaling directly with input token count---a critical inefficiency for telecom network analytics and numerical time-series data analysis (NTSDA), where raw multivariate KPI windows from 4G/5G cell sites expand into thousands of floating-point tokens. Vision-Language Models (VLMs) eliminate this mismatch by encoding time-series as 2D plots, achieving 3.6-10.4x input token reduction across Llama-3.2-90B, Qwen2.5-VL-72B, and Pixtral-12B architectures. This translates to 1.8-2.5x measured inference energy reduction, saving approximately...

Microsecond-cost anomaly detection for LLM agent failures using one-class echo-state networks trained only on healthy runs; tested across Qwen, Llama, and Gemini agents.