dongjw 56a18ad02c change tag v0.2.4

2025-04-01 21:07:13 +08:00

..

configs

add balance-serve, support concurrence

2025-03-31 22:55:32 +08:00

ktransformers_ext

add balance-serve, support concurrence

2025-03-31 22:55:32 +08:00

models

add balance-serve, support concurrence

2025-03-31 22:55:32 +08:00

operators

Fix ktransformers-server flashinfer wrapper position arg issue;

2025-04-01 07:30:23 +00:00

optimize

rm KMoEGateDeepSeekV3, fall back to KMoEGate

2025-04-01 07:13:05 +00:00

server

fix top_p = 0 bug

2025-04-01 20:38:33 +08:00

tests

Merge branch 'main' into work-concurrent

2025-04-01 06:48:19 +00:00

util

add balance-serve, support concurrence

2025-03-31 22:55:32 +08:00

website

✨: refactor local_chat and fix message slice bug in server

2024-11-04 14:02:19 +08:00

__init__.py

change tag v0.2.4

2025-04-01 21:07:13 +08:00

local_chat_test.py

local chat for cicd test

2025-03-15 02:31:19 +08:00

local_chat.py

add balance-serve, support concurrence

2025-03-31 22:55:32 +08:00