Commit Graph

1215 Commits

Author SHA1 Message Date
ouqingliang 59c243d371 [fix]: fix cpu cores. 2026-02-03 09:17:30 +00:00
ouqingliang 2bcc0c8cb5 Merge branch 'main' into cli-dev-ljq
# Conflicts:
#	doc/zh/clawdbot_integration_guide.md
2026-02-03 08:10:53 +00:00
Jiaqi Liao 794c04fae4 Revert "[doc]: update kimi_k2.5 doc (#1823)" (#1825)
This reverts commit 2e6506535b.
2026-01-30 16:10:01 +08:00
Oql ccbb5b1cf8 [docs]: add clawd bot docs
add clawd bot docs
2026-01-30 15:51:30 +08:00
Jiaqi Liao 2e6506535b [doc]: update kimi_k2.5 doc (#1823) 2026-01-30 15:43:18 +08:00
skqliao 630a2734a5 [feat]: improve CLI table display, model verification, and chat experience
- Add sequence number (#) column to all model tables by default
- Filter kt edit to show only MoE GPU models (exclude AMX)
- Extend kt model verify to check *.json and *.py files in addition to weights
- Fix re-verification bug where repaired files caused false failures
- Suppress tokenizer debug output in kt chat token counting
2026-01-30 07:32:32 +00:00
skqliao b432e27d3a Merge branch 'main' into cli-dev-ljq 2026-01-30 07:32:03 +00:00
Jiaqi Liao db82d99fa6 feat: add fallback expert prefix lookup in loader.py from kimi_k2.5 (#1822) 2026-01-30 14:09:38 +08:00
ouqingliang 7f1b61e8e6 [docs]: 添加 Clawdbot 飞书接入教程链接 2026-01-29 12:50:54 +00:00
ouqingliang 7d6961c805 [docs]: 强调推荐使用 Kimi K2.5 作为核心模型,突出企业级推理能力 2026-01-29 12:45:33 +00:00
ouqingliang f5762391f2 [docs]: 添加 Clawdbot 集成指南 - KTransformers 企业级 AI 助手部署方案 2026-01-29 12:39:35 +00:00
skqliao 5d0fdfd34c [fix]: correct TTFT measurement in kt chat
- Move start_time initialization before API call
- Previously start_time was set when receiving first chunk, causing TTFT ≈ 0ms
- Now correctly measures time from request sent to first token received
2026-01-28 12:00:26 +00:00
skqliao 8268d9aeae [feat]: improve kt chat with performance metrics and better CJK support
- Add performance metrics display after each response
  * Total time, TTFT (Time To First Token), TPOT (Time Per Output Token)
  * Accurate input/output token counts using model tokenizer
  * Fallback to estimation if tokenizer unavailable
  * Metrics shown in dim style (not prominent)

- Fix Chinese character input issues
  * Replace Prompt.ask() with console.input() for better CJK support
  * Fixes backspace deletion showing half-characters

- Suppress NumPy subnormal warnings
  * Filter "The value of the smallest subnormal" warnings
  * Cleaner CLI output on certain hardware environments
2026-01-28 11:56:24 +00:00
skqliao 2d343e055a [feat]: unify model selection UI and enable shared experts fusion by default
- Unify kt run model selection table with kt model list display
  * Add Total size, MoE Size, Repo, and SHA256 status columns
  * Use consistent formatting and styling
  * Improve user decision-making with more information

- Enable --disable-shared-experts-fusion by default
  * Change default value from False to True
  * Users can still override with --enable-shared-experts-fusion
2026-01-28 11:36:28 +00:00
skqliao a052fc3809 [feat]: redesign kt run interactive configuration with i18n support
- Redesign kt run with 8-step interactive flow (model selection, inference method, NUMA/CPU, GPU experts, KV cache, GPU/TP selection, parsers, host/port)
- Add configuration save/load system (~/.ktransformers/run_configs.yaml)
- Add i18n support for kt chat (en/zh translations)
- Add universal input validators with auto-retry and Chinese comma support
- Add port availability checker with auto-suggestion
- Add parser configuration (--tool-call-parser, --reasoning-parser)
- Remove tuna command and clean up redundant files
- Fix: variable reference bug in run.py, filter to show only MoE models
2026-01-28 11:22:46 +00:00
Jiaqi Liao edc48aba37 [fix]: fix wrapper import issue (#1819) 2026-01-28 16:31:56 +08:00
Peilin Li 8321d00cc5 Add files via upload (#1814) 2026-01-27 17:44:50 +08:00
Jiaqi Liao 2f6f7f1921 Kimi k2.5 doc (#1812)
* [doc]: add Kimi-K2.5 deploy&sft guide

* [doc]: add Kimi-K2.5 deploy&sft guide
2026-01-27 13:33:25 +08:00
Jiaqi Liao 1da075a3fa Revert "[doc]: add Kimi-K2.5 deploy&sft guide (#1810)" (#1811)
This reverts commit a368140d76.
2026-01-27 10:05:13 +08:00
Jiaqi Liao a368140d76 [doc]: add Kimi-K2.5 deploy&sft guide (#1810) 2026-01-27 10:02:59 +08:00
Oql 5bd5c8f750 [fix]: fix experts-sched-Tutorial.md (#1808) 2026-01-23 18:06:24 +08:00
Oql bf4c8a690b Add Native Precision Tutorial, update worker strategy and README.md (#1807) 2026-01-23 18:00:13 +08:00
Jianwei Dong 8652346e69 [fix]: doc (#1805) 2026-01-23 11:17:08 +08:00
SCDESPERTATE b0f827d2a9 [chore](cuda): explicitly use ele_per_blk var for better readability (#1784) 2026-01-23 11:11:08 +08:00
Jianwei Dong 779bf14556 [doc]: add Experts sched tutorial (#1802)
* Change num gpu experts to gpu expert masks and add eplb statistics

* [feat]: update examples

* [fix]: fix fp8 perchannel

* Delete useless tests

* Delete useless tests

* add experts_sched tutorial

---------

Co-authored-by: ouqingliang <1692110604@qq.com>
v0.5.1
2026-01-22 15:40:07 +08:00
Peilin Li a4de664e62 Add AutoDL Tutorial (#1801) 2026-01-22 14:52:47 +08:00
ErvinXie d2305538f7 Modify installation steps in Kimi-K2-Thinking-Native.md (#1800)
Updated installation instructions for sglang repository.
2026-01-21 15:46:21 +08:00
mrhaoxx b27de4068b [fix]: fix exp_avx512 for act_fn (#1797) 2026-01-20 11:07:22 +08:00
Jianwei Dong 027832c590 [feat](kt-kernel): CPU-GPU experts sched (#1796) 2026-01-16 17:01:15 +08:00
Oql 6277da4c2b support GLM 4.7 (#1791)
support GLM 4.7
2026-01-13 17:36:25 +08:00
watamario15 667030d6e6 [kt-kernel]: Fix ignored build configurations in install.sh and CMakeLists.txt (#1789)
* Correct variable defaults

* Remove CMAKE_BUILD_TYPE setting in CMakeLists
2026-01-12 22:16:19 +08:00
Oql 5edc456749 support Native BF16 format MoE. (#1788)
support Native BF16 format MoE
2026-01-12 14:43:28 +08:00
Oql ddb957596f Fix moe bug. (#1783)
* [fix]: fix moe.hpp load from file bug.

* [fix]: fix all moe hpp init bug.

* [fix]: fix moe & awq-moe ug.
2026-01-05 17:02:24 +08:00
Oql dc6394e501 [fix]: fix moe hpp bug. (#1780)
fix moe hpp init bug.
2026-01-04 19:32:56 +08:00
ZiWei Yuan ad7674a6d5 [ci]: Patch ci (#1772)
* [docs]: add kt-cli doc and update corresponding website

* [feat]: update issue template
2025-12-31 12:10:20 +08:00
Jianwei Dong 6d2d7cb057 bump to 0.5.0.post1 (#1771) v0.5.0.post1 2025-12-30 11:09:54 +08:00
Jianwei Dong 47b1bfcff6 Update release-pypi.yml (#1770) 2025-12-30 10:47:28 +08:00
Jianwei Dong 9adc91714f Remove kt-kernel-cuda, kt-kernel uses the version with cuda (#1769) 2025-12-30 10:23:58 +08:00
ZiWei Yuan b096b01fbc [docs]: add kt-cli doc and update corresponding website (#1768) 2025-12-29 23:06:22 +08:00
ErvinXie 9539ab91eb Cli (#1765)
* [feat]: add custom option for kt run

* [feat]: depth 3
2025-12-29 15:18:42 +08:00
Jianwei Dong 4b235cdaa4 fix cuda wheel build (#1766) 2025-12-29 12:42:06 +08:00
Jianwei Dong 7c127d9fd0 Update release-pypi.yml (#1764) 2025-12-29 11:48:55 +08:00
Jianwei Dong 559a3ad4ac fix pypi cuda install (#1763) 2025-12-29 11:19:43 +08:00
Oql 63796374c1 [docs]: fix and add MiniMax-M2 tutorial images. (#1752) 2025-12-25 20:14:35 +08:00
Jiaqi Liao be668074de Update tutorial links in README.md (#1749) 2025-12-25 14:26:10 +08:00
Jiaqi Liao 46b0f36980 [feat](kt-kernel): Fix CPU instruction set variants for build & install (#1746)
* [feat]: Enhance CPU feature detection and support for AVX512 extensions

- Added cmake/DetectCPU.cmake for automatic CPU feature detection.
- Updated CMakeLists.txt to include auto-detection logic for AVX512 features.
- Modified install.sh to include new AVX512_VBMI option for FP8 MoE.
- Enhanced _cpu_detect.py to support progressive matching of CPU variants.
- Created scripts/check_cpu_features.py for manual CPU feature checks.
- Updated setup.py to reflect changes in CPU variant building and environment variables.

* [fix](kt-kernel): Add conditional inclusion of FP8 MoE for AVX512 BF16 support

* [chore](kt-kernel): update project version to 0.5.0 in CMakeLists.txt and version.py
2025-12-24 18:57:45 +08:00
ZiWei Yuan dc5feece8f [docs]: update doc link (#1745) 2025-12-24 18:00:47 +08:00
ZiWei Yuan 3315335fb1 [docs]: update docs to kt-kernel & add amd_blis doc (#1744) 2025-12-24 17:55:15 +08:00
Oql 1d7a476523 [fix]: fix version to 0.5.0 (#1743) v0.5.0 2025-12-24 17:33:22 +08:00
ErvinXie d8046e1bb4 Kt minimax (#1742)
[feat]: fp8 kernel and kt-cli support
2025-12-24 15:39:44 +08:00