…However, for high-resource non-English languages like German, French, or Japanese, aggressive filtering creates a strategic dilemma: should practitioners prioritize diversity by training once on large amounts of lightly filtered web…
…Abstract A 3-billion-parameter Sardinian language model was developed using continued pretraining and supervised fine-tuning on limited computational resources, showing superior performance in translation tasks compared to baseline models. AI…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct High-quality pretraining data is a central ingredient in modern language models, but German-language resources remain far less developed than their English counterparts…
…View arXiv page View PDF GitHub 0 Add to collection Community Training and scaling Large Language Models demand enormous computational resources, motivating both efficient sub-quadratic architectures and principled hyperparameter tuning methods…
…collection Community PianoCoRe is a large-scale piano MIDI dataset of annotated and note-aligned scores and performances. It unifies multiple open-source corpora into a single, ready-to-use resource for…
…However, training advanced pixel-space models from scratch demands prohibitive computational and data resources. To address this, we propose the Latent-to-Pixel (L2P) transfer paradigm, an efficient framework that directly harnesses…
…View arXiv page View PDF Project page Add to collection Community We present ChildVox, a novel benchmark for characterizing the diverse acoustic signals through which children communicate. Specifically, ChildVox follows the full…
…Generated by Qwen/Qwen2.5-Coder-32B-Instruct Weight-space model merging is usually formulated as an algebraic operation on checkpoints , yet at LLM scale the limiting resource is often the set…
…However, code-switching ASR (CS-ASR) remains particularly challenging due to the severe scarcity of multilingual CS speech resources across diverse language pairs. Existing approaches primarily improve CS-ASR performance through synthetic…
…View arXiv page View PDF Project page Add to collection Community Cell-type-specific marker genes are fundamental to plant biology, yet existing resources primarily rely on curated databases or high-throughput…