mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-10-17 05:11:19 +08:00
deploy: 44fbb184d5
This commit is contained in:
+1
-1
@@ -238,7 +238,7 @@
|
||||
<li><strong>Feb 15, 2025</strong>: Longer Context (from 4K to 8K for 24GB VRAM) & Slightly Faster Speed (+15%, up to 16 Tokens/s), update <a href="./doc/en/DeepseekR1_V3_tutorial.html">docs</a> and <a href="https://kvcache-ai.github.io/ktransformers/">online books</a>.</li>
|
||||
<li><strong>Feb 10, 2025</strong>: Support Deepseek-R1 and V3 on single (24GB VRAM)/multi gpu and 382G DRAM, up to 3~28x speedup. For detailed show case and reproduction tutorial, see <a href="./doc/en/DeepseekR1_V3_tutorial.html">here</a>.</li>
|
||||
<li><strong>Aug 28, 2024</strong>: Decrease DeepseekV2’s required VRAM from 21G to 11G.</li>
|
||||
<li><strong>Aug 15, 2024</strong>: Update detailed <a href="doc/en/SFT/injection_tutorial.html">tutorial</a> for injection and multi-GPU.</li>
|
||||
<li><strong>Aug 15, 2024</strong>: Update detailed <a href="doc/en/injection_tutorial.html">tutorial</a> for injection and multi-GPU.</li>
|
||||
<li><strong>Aug 14, 2024</strong>: Support llamfile as linear backend.</li>
|
||||
<li><strong>Aug 12, 2024</strong>: Support multiple GPU; Support new model: mixtral 8*7B and 8*22B; Support q2k, q3k, q5k dequant on gpu.</li>
|
||||
<li><strong>Aug 9, 2024</strong>: Support windows native.</li>
|
||||
|
||||
+1
-1
@@ -237,7 +237,7 @@
|
||||
<li><strong>Feb 15, 2025</strong>: Longer Context (from 4K to 8K for 24GB VRAM) & Slightly Faster Speed (+15%, up to 16 Tokens/s), update <a href="doc/en/DeepseekR1_V3_tutorial.html">docs</a> and <a href="https://kvcache-ai.github.io/ktransformers/">online books</a>.</li>
|
||||
<li><strong>Feb 10, 2025</strong>: Support Deepseek-R1 and V3 on single (24GB VRAM)/multi gpu and 382G DRAM, up to 3~28x speedup. For detailed show case and reproduction tutorial, see <a href="doc/en/DeepseekR1_V3_tutorial.html">here</a>.</li>
|
||||
<li><strong>Aug 28, 2024</strong>: Decrease DeepseekV2’s required VRAM from 21G to 11G.</li>
|
||||
<li><strong>Aug 15, 2024</strong>: Update detailed <a href="doc/en/SFT/injection_tutorial.html">tutorial</a> for injection and multi-GPU.</li>
|
||||
<li><strong>Aug 15, 2024</strong>: Update detailed <a href="doc/en/injection_tutorial.html">tutorial</a> for injection and multi-GPU.</li>
|
||||
<li><strong>Aug 14, 2024</strong>: Support llamfile as linear backend.</li>
|
||||
<li><strong>Aug 12, 2024</strong>: Support multiple GPU; Support new model: mixtral 8*7B and 8*22B; Support q2k, q3k, q5k dequant on gpu.</li>
|
||||
<li><strong>Aug 9, 2024</strong>: Support windows native.</li>
|
||||
|
||||
Reference in New Issue
Block a user