#speculative-decoding

1 post

1. 2026-09-22
   MTP speculative decoding @Ollama: 20 → 42 tok/s

   • #speculative-decoding
   • #ollama
   • #performance