459 Commits
Author SHA1 Message Date
ZiWei Yuan 63b1c8525b Merge pull request #820 from kvcache-ai/develop-0.2.3
Develop 0.2.3 ready to release
v0.2.3
2025-03-06 14:46:09 +08:00
liam 407e1b9ab2 🚑 Merge branch 'develop-0.2.3' of https://github.com/kvcache-ai/ktransformers into develop-0.2.3 2025-03-06 13:52:01 +08:00
Azure 27475cf8a5 fix compile 2025-03-06 05:34:37 +00:00
liam 8eeb6dd432 ⚡ update compile option for avx512vpopcntdq 2025-03-06 12:18:04 +08:00
Azure dd390835ca Add compile condition 2025-03-06 03:25:39 +00:00
Azure 1bcfce8cad Merge pull request #815 from kvcache-ai/develop-0.2.3
[fix] fix gcc compilation
2025-03-06 00:07:17 +08:00
Azure 8068018504 fix gcc compilation 2025-03-05 15:59:56 +00:00
Atream 6f142a51e6 Merge pull request #813 from chenmz00/main
fix: list models API
2025-03-05 22:00:38 +08:00
chenmz00 b2ba795cfd fix: list models API
Fix the list models API to match the corresponding OpenAI API format.
2025-03-05 21:49:27 +08:00
ZiWei Yuan 2753a4a654 Merge pull request #810 from kvcache-ai/v0.2.3
V0.2.3
2025-03-05 20:32:53 +08:00
liam 9c343b4f71 🔖 release v0.2.3 2025-03-05 20:24:11 +08:00
ZiWei Yuan 6c35ca75b3 Merge pull request #809 from KMSorSMS/develop-0.2.3
⚡ release v0.2.3
2025-03-05 20:23:03 +08:00
liam 848fe8ab97 ⚡ release v0.2.3 2025-03-05 20:21:04 +08:00
Atream f03faa5376 Merge pull request #808 from kvcache-ai/Atream-patch-2
Update install.md
2025-03-05 19:02:45 +08:00
Atream f17fb9d8fe Update install.md 2025-03-05 19:02:32 +08:00
Atream 44dafa034b Merge pull request #781 from 3wweiweiwu/main
update documentation to fix error in numa enablement
2025-03-05 19:00:59 +08:00
Azure 034a116365 update readme 2025-03-05 10:04:43 +00:00
Azure d7becadcf7 Merge branch 'develop-0.2.3' of https://github.com/kvcache-ai/ktransformers into develop-0.2.3 2025-03-05 09:26:23 +00:00
Azure 662c1e4c14 small fix about max new token 2025-03-05 09:25:41 +00:00
Atream 52fa3003d1 Merge pull request #791 from KMSorSMS/develop-0.2.3
⚡ add humaneval support
2025-03-05 11:28:36 +08:00
Atream 3a3021502e Merge pull request #795 from hybcloud/main
fix minor typo
2025-03-05 11:27:26 +08:00
hybcloud 6b551a6ee3 fix minor typo 2025-03-05 11:09:29 +08:00
3wweiweiwu b936bcc72e use 'make dev_install' to make minimum change 2025-03-04 09:35:12 -05:00
liam dc10480ef6 ⚡ add humaneval support 2025-03-04 20:54:49 +08:00
Wix Woo bbcc5481bb update documentation to fix error in numa enablement 2025-03-03 15:49:00 +00:00
Azure 5aee6c0446 Merge branch 'main' into develop-0.2.3 2025-03-03 12:19:47 +00:00
Atream f46b3fd51c Merge pull request #778 from Conless/fix-shape
[Fix] Shape error in KLinearMarlin
2025-03-03 19:58:52 +08:00
Yi Pan 01755a60c0 fix: wrong shape in KLinearMarlin. 2025-03-03 17:34:45 +08:00
Atream 4e43e8a4ee Merge pull request #775 from kvcache-ai/Atream-patch-1
Update __init__.py
2025-03-03 16:50:02 +08:00
Atream 8963ae7817 Update __init__.py 2025-03-03 16:49:50 +08:00
Atream 659583a92c Merge pull request #770 from SkqLiao/main
Introduce Testing Jobs for kTransformers Setup on Self-Hosted Runner
2025-03-03 14:35:26 +08:00
Azure 216a63b858 Merge pull request #754 from moonshadow-25/dev023
Support for IQ1_S(Dynamic 1.58-bit)
2025-03-03 14:19:33 +08:00
Jiaqi Liao 7d96e2eeba fix environment name 2025-03-03 14:01:40 +08:00
Jiaqi Liao 3d62579a6a fix environment name 2025-03-03 13:55:40 +08:00
Jiaqi Liao 5fe0d138ca add install job for self-host testing 2025-03-03 13:52:13 +08:00
wang jiahao 48b9800790 Merge pull request #759 from 3wweiweiwu/fix_top_p_typo
fix typo for top_p
v0.2.2
2025-03-02 13:58:11 +08:00
wang jiahao bb54b68e5c Merge pull request #761 from kvcache-ai/fix-server-bug
fix ollama api temperature bug
2025-03-02 13:56:46 +08:00
1668068727@qq.com 7cdf8139f0 fix ollama api temperature bug 2025-03-02 13:55:26 +08:00
Wix Woo 3aa0cfc29d fix typo for top_p 2025-03-01 20:15:36 +00:00
Atream 69382e58f9 Merge pull request #313 from MuWinds/main
Update:Solve  `torch.backends.cuda.sdp_kernel()` is deprecated.
2025-03-01 23:24:44 +08:00
Atream ca1dc1e7d1 Merge branch 'main' into main 2025-03-01 23:24:10 +08:00
Atream 505f4e2c35 Merge pull request #753 from ningpengtao-coder/main
Update local_chat.py
2025-03-01 23:22:13 +08:00
moonshadow-25 d24d369332 iq1s files 2025-03-01 22:44:06 +08:00
moonshadow-25 c513ae59c3 iq1s files 2025-03-01 22:38:04 +08:00
宁鹏涛 71286ec1c0 Update local_chat.py
修复config.architectures[0] == "DeepseekV2ForCausalLM" or "DeepseekV3ForCausalLM" 永远为真
2025-03-01 21:52:48 +08:00
moonshadow-25 9781d1e6f4 iq1s core 2025-03-01 21:48:25 +08:00
godrosev 93c5b75716 rem 2025-03-01 21:25:18 +08:00
godrosev e6349eb240 iq1s 2025-03-01 21:00:11 +08:00
Atream 761de49843 Merge pull request #751 from kvcache-ai/Atream-patch-2
Update DeepseekR1_V3_tutorial.md
2025-03-01 19:57:00 +08:00
Atream 735873a32a Update DeepseekR1_V3_tutorial.md 2025-03-01 19:56:46 +08:00