… This reduced drift also preserves plasticity: after training on one task, FST trained models adapt more effectively to a subsequent task than parameter-only trained models. …
… The main takeaway: continual post-training should not only control how far an LLM moves, but whether each new update remains geometrically compatible with the evolving model state. 太强了~ nerding out on a detail, gcwm links layer-wise covariances with a gaussian wasserstein barycenter to build a shar… …
… Thanks! is the trained model now open source and / or available to the public? https://huggingface.co/blog/sionic-ai/claude-code-skills-training Nice work about the demo getting Claude Code to fine-tune an open LLM. But the researchers from Sionic AI already do most of their work with Claude Code. …
… Small typos if I'm not mistaken : : "While o1 comes very close to bronze, ultimately no model would reach the medal threshold 50th percentile of contestants ." - "While o3-mini comes very close to bronze, ultimately no model would reach the medal threshold 50th percentile of contestants ." "Our Oly… …
… In heterogeneous training systems , the total importance ratio should ideally be decomposed into two semantically distinct factors: a training--inference discrepancy term that aligns inference-side and training-side distributions at the same behavior-policy version, and a policy-staleness term that… …
… To enable stable and efficient training under this architecture, we propose to train MELT using chunk-wise training in a two phase procedure: interpolated transition, followed by attention-aligned distillation, both from the LoopLM starting model to MELT. …
Papers arxiv:2605.29801 AgentDoG 1.5: A Lightweight and Scalable Alignment Framework for AI Agent Safety and Security Published on May 28 Submitted by Dongrui Liu on May 29 1 Paper of the day shanghai ailab Authors: , , , , Guanxu Chen , , , , , , , , , , , , , , , , Qihan Ren , Junxiao Yang Abstra… …
… AI-generated summary We present StateSMix, a fully self-contained lossless compressor that couples an online-trained Mamba-style State Space Model SSM with sparse n-gram context mixing and arithmetic coding . …
Papers arxiv:2605.14386 Darwin Family: MRI-Trust-Weighted Evolutionary Merging for Training-Free Scaling of Language-Model Reasoning Published on May 14 Submitted by seawolf on May 15 FINAL Bench Authors: , , , , , , Abstract The Darwin Family framework enables training-free evolutionary merging of… …
Papers arxiv:2605.12492 Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation Published on May 12 Submitted by Weiyang Liu on May 13 The Chinese University of Hong Kong Authors: , , , , , Abstract Pion is a spectrum-preserving optimizer for large language model training th… …