arrow_backBack to Blog
Hugging FacevLLMtransformersinferênciaIAopen-sourceperformance

Hugging Face makes transformers vLLM backend as fast as native implementations

personLab Desenvolvimento
schedule5 min

Hugging Face did the impossible: vLLM as fast as native without rewriting anything

If you've ever deployed LLMs, you know the pain: the model works in Hugging Face Transformers, but to run it in production with vLLM you need to manually reimplement the architecture. Hugging Face just killed that problem.

What changed

The transformers backend for vLLM now matches (or exceeds) native vLLM throughput. Tests with the Qwen3 family showed equivalent or superior performance across dense, MoE, single-GPU and multi-node configurations.

How to use

It's a single flag: --model-impl transformers. Your Transformers model runs in vLLM with continuous batching, optimized attention kernels, and parallelism — no porting required.

Why it matters

For model authors publishing on Hugging Face, this is a game-changer. No more maintaining parallel implementations. For model consumers, it means immediate access to any new architecture.


Just upgrade vllm: pip install --upgrade vllm and test with --model-impl transformers.