Elucidating the Design Space of LM Data Attribution
CATT benchmark isolates LLM data attribution failures using fictitious knowledge with unambiguous ground truth.
arXiv · ACADEMIA
CATT benchmark isolates LLM data attribution failures using fictitious knowledge with unambiguous ground truth.
Propose-Filter-Release privately filters outliers to reduce noise scaling in differentially private mechanisms.
Output diversity, not weight perturbation geometry, explains Neural Thickets gains in reasoning tasks.
SpecSlot decouples pixel detail granularity from global attention sequence length via role-coupled tokenization.
KL-ball DRO hedges against distribution error without including impossible out-of-support realizations.
Computer vision study of luggage re-identification across camera views for surveillance and lost-item recovery.
WxCrop agent predicts crop loss by combining weather indices with causal analysis and agricultural data.
world2vec learns mechanistic latent dynamics models with 10x fewer parameters than DreamerV3/TD-MPC2.
Four-level probe of spatial persistence and actionability across ten frozen visual foundation models.
ShallowDefend exploits concentrated early safety tokens to defend against multi-turn jailbreaks in LLMs.
Benchmark for temporal reasoning in LLMs: testing whether models can ground causal claims (product recall → sales dip) with statistical rigor over records.
Exponential residual flows enable ODE-based sampling for discrete diffusion models, mirroring continuous probability-flow ODEs for faster decoding.
Membership inference attacks on diffusion models: difficulty calibration separates true memorization from inherent image-reconstruction ease.
TextSeal2 watermarking for LLMs: distortion-free, survives speculative decoding, uses copula mixing to merge token-routing keys without output latency.
Joint gating and hint generation for proactive assistants: end-to-end performance lags oracle by 3.5% exact match; compute savings degrade with smaller generators.
LLM-based agents autonomously conduct quantum-spin experiments with peer review and theory validation; agents cross-check findings to prevent unsupported conclusions.
Linear probes on agent activations predict collusion breakdowns: detect when one agent is about to surrender secrets to a peer before output generation.
Multistatic ISAC with deep learning clutter suppression for 5G: joint sensing and comms, distributed receivers, improved range and Doppler estimation.
VeriCUA: agentic verification for computer-using agents explores state space via VLM-guided navigation to reliably judge task completion across web/mobile/desktop.
Multi-view MoE: multiple routers per token improve expert selection over single-router MoE; dense ranking reveals weak agreement in mid/deep layers.
PIVOT combines trajectory and token-level intervention from teacher models to improve RL learning from sparse verifiable rewards on reasoning tasks.
Token-adaptive self-distillation framework assigns per-token teachers during on-policy LLM post-training rather than fixed or response-level teachers.
Gym-Anything for Robotics uses coding agents to automatically generate realistic physics simulations for embodied AI training at scale.
Unified training framework reduces foundation model pipeline (pretraining, SFT, RL) to single likelihood-based algorithm with flexible data scheduling.
Comparative study of Mixtral 8x7b vs. human role-players in counselling training simulations using communication pattern analysis.
FARMS framework transforms computational mathematics into AI-interpretable knowledge with formal guarantees, validated on 171 numerical linear algebra targets.
ClinGeX is an LLM agent with 105 genomic skills achieving 71.7% concordance on clinical variant interpretation via task-specific retrieval and orchestration.
Ramanujan Challenge evaluates AI models and computer algebra systems on research-level number theory problems with numerically verifiable formulas.
Value-indexed memory allows stateful long-context agents to traverse persisted address space, exploiting overlapping retrieval patterns across steps.
Standard ML classifiers (Naive Bayes, SVM, Random Forest) detect mobile money SMS fraud in Ghana with comparative benchmarking.
Study derives fundamental bounds on prefill-phase token decoding length prediction, showing current benchmarks conflate predictor quality with task hardness due to autoregressive stochasticity.
TRACER, a decoder-based EHR foundation model trained on 4.5M patient records, predicts 16 incident diseases at 1–5-year horizons across held-out health systems.
Introduces rewinding protocol for scalable oversight via relativizing interactive proofs, removing truthfulness assumption from debate-style verification with computational tradeoff.
Tutorial for training 11–12M parameter autoregressive and masked diffusion language models on consumer GPU in Portuguese with preregistered evaluation protocol.
BURGER benchmark evaluates vision-language-action model generalization via scalable prompt-driven robotic drawing in simulation and real robots.
NEOPIC framework learns field operators for particle-based kinetic plasma simulations using neural operators on empirical particle measures without mesh aliasing.
IndicIPR-QA: extractive QA benchmark with 4,462 pairs across seven Indian IPR statutory acts, addressing low-resource legal NLP task.
Template-based augmentation pipeline for multilingual safety alignment, generating culturally authentic harmful/benign refusal corpora across low-resource languages.
Ridge reduced-rank regression identifies brain-predictive subspace of LLM representations from naturalistic listening across intracranial EEG and fMRI datasets.
Sparse autoencoder and probing analysis of voice-cloning TTS models reveals interpretable acoustic features (pitch, energy, noise) across Qwen3-TTS and five architectures.
Algebraic World Model framework enables AI to autonomously discover and formalize mathematical laws from environment interactions, then verify via machine-checkable proofs.
Learned reflected diffusion samplers improve high-dimensional integration on bounded domains by respecting constraints while capturing integrand concentration.
EGI Federation reviews past AI deployments in digital twins and environmental imaging, shifts focus from training to domain-specific adaptation.
Agentic University deploys multi-agent organization with LLMs to coordinate personalized tutoring, content generation, and adaptive learning paths with capability tracking.
Neural triage decoder achieves fast, accurate decoding of high-rate quantum LDPC codes for fault-tolerant quantum computing with latency-accuracy tradeoff.
rTaste evaluates whether frontier LLM-based research agents can judge experiment value before execution; finds agents propose sound MVEs but lack novelty discrimination.
MetaRefine improves image quality assessment by preserving original geometry and aspect ratio while refining scores using multi-level visual features.
Analysis reveals numerical precision wall in low-rank matrix sensing under power-law measurement covariance limits optimizer convergence independent of landscape convexity.
Orthogonal projection method enables continual LLM unlearning of sensitive data without catastrophic utility decay across sequential deletion requests.
FIRME registry-anchored memory graph reconciles heterogeneous investor observations into persistent canonical relationships with provenance tracking for knowledge reuse.