This commit is contained in:
qiyuxinlin
2025-05-17 07:25:56 +00:00
parent d5a50ab494
commit c350679d2e
3 changed files with 1 additions and 5 deletions
-2
View File
@@ -283,13 +283,11 @@ git submodule update --init --recursive
<li>
<p>For Multi-concurrency with 500G RAM:</p>
<pre><code class="language-shell">USE_BALANCE_SERVE=1 bash ./install.sh
pip install third_party/custom_flashinfer/
</code></pre>
</li>
<li>
<p>For Multi-concurrency with two cpu and 1T RAM:</p>
<pre><code class="language-shell">USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
pip install third_party/custom_flashinfer/
</code></pre>
</li>
</ul>
-2
View File
@@ -314,13 +314,11 @@ git submodule update --init --recursive
<li>
<p>For Multi-concurrency with 500G RAM:</p>
<pre><code class="language-shell">USE_BALANCE_SERVE=1 bash ./install.sh
pip install third_party/custom_flashinfer/
</code></pre>
</li>
<li>
<p>For Multi-concurrency with two cpu and 1T RAM:</p>
<pre><code class="language-shell">USE_BALANCE_SERVE=1 USE_NUMA=1 bash ./install.sh
pip install third_party/custom_flashinfer/
</code></pre>
</li>
</ul>
+1 -1
View File
File diff suppressed because one or more lines are too long