训练 on k4i's bloghttps://k4i.top/zh/tags/%E8%AE%AD%E7%BB%83/Recent content in 训练 on k4i's blogHugo -- gohugo.iozhsky_io@outlook.com (K4i)sky_io@outlook.com (K4i)All content is subject to the license of <a rel="license noopener" href="https://creativecommons.org/licenses/by-nc-sa/4.0/" target="_blank">CC BY-NC-SA 4.0</a> .Wed, 27 May 2026 22:00:00 +0800如何估算 LLM 训练和推理需要多少算力与显存https://k4i.top/zh/posts/llm-flops-memory-estimation/Wed, 27 May 2026 22:00:00 +0800sky_io@outlook.com (K4i)Thu, 28 May 2026 00:58:01 +0800https://k4i.top/zh/posts/llm-flops-memory-estimation/<h2 id="introduction">引言</h2> <p>如果我要训练一个 7B 模型，需要准备多少 GPU？训练 1T tokens 大概要多久？如果只是部署推理，一张 24GB 显卡能不能跑？上下文长度从 4K 增加到 32K，显存为什么突然不够了？</p>K4ifeatured imagellm训练推理flops显存transformerAI