采样 on k4i's bloghttps://k4i.top/zh/tags/%E9%87%87%E6%A0%B7/Recent content in 采样 on k4i's blogHugo -- gohugo.iozhsky_io@outlook.com (K4i)sky_io@outlook.com (K4i)All content is subject to the license of <a rel="license noopener" href="https://creativecommons.org/licenses/by-nc-sa/4.0/" target="_blank">CC BY-NC-SA 4.0</a> .Thu, 18 Jun 2026 21:20:00 +0800大模型推理采样：temperature、top-p、top-k 到底在控制什么https://k4i.top/zh/posts/llm-sampling-temperature-top-p-top-k/Thu, 18 Jun 2026 21:20:00 +0800sky_io@outlook.com (K4i)Thu, 18 Jun 2026 21:20:00 +0800https://k4i.top/zh/posts/llm-sampling-temperature-top-p-top-k/<p>同一个 prompt，为什么把 <code>temperature</code> 调低会更稳定，把 <code>top_p</code> 调低会更保守，把 <code>top_k</code> 调小会更像“只从前几个答案里挑”？这些参数不是三种魔法风格，而是在<strong>下一 token 的概率分布</strong>上做了三类很具体的操作。</p>K4ifeatured imagellm推理采样vllm源码阅读ai-infraAIvLLM and SGLang Source Reading