[dependabot]

Bumps transformers from 5.19.0 to 5.20.1.

Release notes

Sourced from transformers's releases.

Release v5.20.1

Special surprise including the new model Beam from Reflection AI 🥳

Beam is a token-efficient, frontier-scale model focused on coding and agentic use cases. It is built for teams that want to run a powerful model on their own hardware, infrastructure, or cloud, and customize it to their specific needs.

Links: Documentation

• Fix small bug in auto mappings (#49664) by @​yonigozlan in #49664

Some real patch fixes

We broke loading models on older torch versions 😢 should be fixed now. But here is the full list of fixes

• Fix HunYuan-VL image assignment during batched generation (#49557) by @​Arnav66692
• Fix DeepGEMM Mega MoE under expert parallelism(#49428) by @​IlyasMoutawwakil
• Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpointing (#49652) by @​naveecode
• Make DtensorShardOperation work on torch 2.6 and 2.7 (#49657) by @​hazelxue

Full Changelog: huggingface/transformers@v5.20.0...v5.20.1

Release v5.20.0

New Model additions

Muse Spark Open

Muse Spark Open is a multimodal mixture-of-experts model from Meta that takes text, images, audio, and video as input and generates text. It has 816B total parameters (42B active per token) and a context window of up to 1,048,576 tokens shared across modalities. It is trained for agentic coding tasks such as multi-file editing, debugging, and tool use. Checkpoints are available in BF16 and NVFP4 formats.

Links: Documentation | Blog Post

• Add Muse Spark Open (#49644) by @​guarin in #49644

Ling 3.0

Ling 3.0 Flash is a hybrid Mixture-of-Experts language model from InclusionAI. Its decoder groups five Kimi Delta Attention (KDA) layers with one Multi-head Latent Attention (MLA) layer. The MLA blocks use interleaved rotary embeddings and a head-wise output gate, and the feed-forward blocks combine routed and shared experts. It is natively supported in Transformers as BailingHybridForCausalLM, so it loads without trust_remote_code=True.

Links: Documentation

• [Model] Add native Ling 3.0 Flash support (#49446) by @​icavan in #49446

Kolibri1

Kolibri 1 is Aleph Alpha's mixture-of-experts reasoning model, focused on German and English. Each of its 50 layers routes every token to 6 of 384 experts using sigmoid routing, and adds one shared expert. Four sliding-window attention layers alternate with one full-attention layer, and RoPE is applied only in the sliding-window layers.

... (truncated)

Commits

• 0ea8779 v5.20.1
• de4f35f Fix small bug in auto mappings (#49664)
• 759c538 Make DtensorShardOperation work on torch 2.6 and 2.7 (#49657)
• c180e2d Fix from_pretrained on torch 2.7: require torch>=2.8 for distributed checkpoi...
• 10d36aa Fix DeepGEMM Mega MoE under expert parallelism (#49428)
• e45b214 Fix HunYuan-VL image assignment during batched generation (#49557)
• 48e4bcd v5.20.0
• 487dcfa Add Muse Spark Open (#49644)
• d2e102b [docs] Hardware docs template (#49575)
• 9d59c2c Add MOSS-Transcribe-Diarize model (#48386)
• Additional commits viewable in compare view