 Azure
|
27475cf8a5
|
fix compile
|
2025-03-06 05:34:37 +00:00 |
|
|
Azure
|
8068018504
|
fix gcc compilation
|
2025-03-05 15:59:56 +00:00 |
|
|
ZiWei Yuan
|
6c35ca75b3
|
Merge pull request #809 from KMSorSMS/develop-0.2.3
⚡ release v0.2.3
|
2025-03-05 20:23:03 +08:00 |
|
|
liam
|
848fe8ab97
|
⚡ release v0.2.3
|
2025-03-05 20:21:04 +08:00 |
|
|
Azure
|
034a116365
|
update readme
|
2025-03-05 10:04:43 +00:00 |
|
|
Azure
|
d7becadcf7
|
Merge branch 'develop-0.2.3' of https://github.com/kvcache-ai/ktransformers into develop-0.2.3
|
2025-03-05 09:26:23 +00:00 |
|
|
Azure
|
662c1e4c14
|
small fix about max new token
|
2025-03-05 09:25:41 +00:00 |
|
|
Atream
|
52fa3003d1
|
Merge pull request #791 from KMSorSMS/develop-0.2.3
⚡ add humaneval support
|
2025-03-05 11:28:36 +08:00 |
|
|
liam
|
dc10480ef6
|
⚡ add humaneval support
|
2025-03-04 20:54:49 +08:00 |
|
|
Azure
|
5aee6c0446
|
Merge branch 'main' into develop-0.2.3
|
2025-03-03 12:19:47 +00:00 |
|
|
Azure
|
216a63b858
|
Merge pull request #754 from moonshadow-25/dev023
Support for IQ1_S(Dynamic 1.58-bit)
|
2025-03-03 14:19:33 +08:00 |
|
|
wang jiahao
|
48b9800790
|
Merge pull request #759 from 3wweiweiwu/fix_top_p_typo
fix typo for top_p
v0.2.2
|
2025-03-02 13:58:11 +08:00 |
|
|
wang jiahao
|
bb54b68e5c
|
Merge pull request #761 from kvcache-ai/fix-server-bug
fix ollama api temperature bug
|
2025-03-02 13:56:46 +08:00 |
|
|
1668068727@qq.com
|
7cdf8139f0
|
fix ollama api temperature bug
|
2025-03-02 13:55:26 +08:00 |
|
|
Wix Woo
|
3aa0cfc29d
|
fix typo for top_p
|
2025-03-01 20:15:36 +00:00 |
|
|
Atream
|
69382e58f9
|
Merge pull request #313 from MuWinds/main
Update:Solve `torch.backends.cuda.sdp_kernel()` is deprecated.
|
2025-03-01 23:24:44 +08:00 |
|
|
Atream
|
ca1dc1e7d1
|
Merge branch 'main' into main
|
2025-03-01 23:24:10 +08:00 |
|
|
Atream
|
505f4e2c35
|
Merge pull request #753 from ningpengtao-coder/main
Update local_chat.py
|
2025-03-01 23:22:13 +08:00 |
|
|
moonshadow-25
|
d24d369332
|
iq1s files
|
2025-03-01 22:44:06 +08:00 |
|
|
moonshadow-25
|
c513ae59c3
|
iq1s files
|
2025-03-01 22:38:04 +08:00 |
|
|
宁鹏涛
|
71286ec1c0
|
Update local_chat.py
修复config.architectures[0] == "DeepseekV2ForCausalLM" or "DeepseekV3ForCausalLM" 永远为真
|
2025-03-01 21:52:48 +08:00 |
|
|
moonshadow-25
|
9781d1e6f4
|
iq1s core
|
2025-03-01 21:48:25 +08:00 |
|
|
godrosev
|
93c5b75716
|
rem
|
2025-03-01 21:25:18 +08:00 |
|
|
godrosev
|
e6349eb240
|
iq1s
|
2025-03-01 21:00:11 +08:00 |
|
|
Atream
|
761de49843
|
Merge pull request #751 from kvcache-ai/Atream-patch-2
Update DeepseekR1_V3_tutorial.md
|
2025-03-01 19:57:00 +08:00 |
|
|
Atream
|
735873a32a
|
Update DeepseekR1_V3_tutorial.md
|
2025-03-01 19:56:46 +08:00 |
|
|
Atream
|
bd33a59ecf
|
Merge pull request #750 from kvcache-ai/feat-chunk-prefill-flashinfer
Support chunk prefill. Support 139K context for DeepSeek-R1 139K with in 24G VRAM.
|
2025-03-01 19:50:52 +08:00 |
|
|
Atream
|
fa03ea48dd
|
Merge branch 'main' into feat-chunk-prefill-flashinfer
|
2025-03-01 11:35:09 +00:00 |
|
|
Atream
|
f35e8d41d8
|
support chunk prefill, support 139K context for 24G VRAM
|
2025-03-01 11:28:25 +00:00 |
|
|
ZiWei Yuan
|
511958d49c
|
Merge pull request #743 from KMSorSMS/main
fix cache_lens bug in server and rm test prompt.txt
|
2025-03-01 00:17:53 +08:00 |
|
|
liam
|
80e0536fb0
|
Merge branch 'main' of https://github.com/KMSorSMS/ktransformers into main
|
2025-03-01 00:12:21 +08:00 |
|
|
liam
|
8ddc990668
|
⚡ fix server cache lens
|
2025-03-01 00:09:57 +08:00 |
|
|
Atream
|
494469d4c5
|
Merge pull request #722 from ZhangShuaiyi/remove_unused
Delete duplicate code
|
2025-02-28 15:04:21 +08:00 |
|
|
liam
|
71f4599dee
|
📝 rm test_prompt
|
2025-02-28 11:44:49 +08:00 |
|
|
ZiWei Yuan
|
1264f9407b
|
Merge pull request #732 from KMSorSMS/main
⚡ fox docker build
|
2025-02-28 11:28:06 +08:00 |
|
|
liam
|
a0e7afa432
|
⚡ fox docker build
|
2025-02-28 11:25:34 +08:00 |
|
|
Azure
|
add415124f
|
Merge pull request #731 from Azure-Tang/update-template
[fix] Fix template name
|
2025-02-28 11:19:52 +08:00 |
|
|
Azure
|
bc52969918
|
fix name
|
2025-02-28 03:17:33 +00:00 |
|
|
Azure
|
0439cb36d4
|
Merge pull request #730 from Azure-Tang/update-template
[UPDATE] Update ZH/EN issue template
|
2025-02-28 11:10:29 +08:00 |
|
|
Azure
|
31b01f5b99
|
update ZH/EN template
|
2025-02-28 03:09:06 +00:00 |
|
|
Shuaiyi
|
a34a25d5cc
|
Delete unused code
|
2025-02-27 13:18:19 +00:00 |
|
|
wang jiahao
|
7a19f3b781
|
Merge pull request #721 from kvcache-ai/fix_temperature
fix temperature
|
2025-02-27 21:01:21 +08:00 |
|
|
qiyuxinlin
|
22df52e94e
|
fix temperature
|
2025-02-27 21:00:44 +08:00 |
|
|
Atream
|
85e2cc7bf4
|
Merge pull request #719 from kvcache-ai/fix-use-generation-json
use generation config from json file in official repo
|
2025-02-27 19:49:41 +08:00 |
|
|
Atream
|
e645d84794
|
use generation config from json file in official repo
|
2025-02-27 11:48:34 +00:00 |
|
|
wang jiahao
|
5e3c6b4f97
|
Merge pull request #644 from wtdcode/temperature_top_p_from_request
Allow temperature and top_p from /v1/chat/completions
|
2025-02-27 18:13:13 +08:00 |
|
|
lazymio
|
b121ca4df8
|
Fix according to upstream changes
|
2025-02-27 18:11:35 +08:00 |
|
|
wang jiahao
|
26f7b4af11
|
Merge branch 'main' into temperature_top_p_from_request
|
2025-02-27 18:08:55 +08:00 |
|
|
Azure
|
1f28f75f55
|
Merge pull request #717 from kvcache-ai/issue-template
Update issue templates
|
2025-02-27 18:02:34 +08:00 |
|
|
Azure
|
c61805dd0a
|
Update issue templates
|
2025-02-27 17:53:27 +08:00 |
|