yyj
e80614fc2d
[feat](kt-sft): Activation reuse & Int8 kernel refactor & native block-FP8 LoRA SFT ( #2141 )
...
* feat(sft): support distributed activation reuse policies
* feat(sft): add frozen-base INT8 LoRA training
* fix(sft): make INT8 expert LoRA rank-zero authoritative
* fix(sft): preserve DeepSeek router LoRA routing
* feat(sft): enable persistent INT8 LoRA training
* perf(sft): accelerate INT8 VNNI with oneDNN BRGEMM
* perf(int8): fuse oneDNN compensation into backward repack
* [feat]: support BF16 expert LoRA training
* [fix]: honor forwarded activation policy in SFT workers
* feat(sft): add native block-FP8 routed expert LoRA
* feat(sft): expose explicit expert placeholder ownership
* fix(sft): publish fused adapter artifacts atomically
* feat(sft): own artifact and adapter lifecycle contracts
* fix(sft): harden artifact and rank-local contracts
* fix(sft): auto-adapt owner before adapter restore
* style(sft): keep lifecycle comments concise
* fix(sft): require fused adapter manifests
* test(sft): use spawn for distributed workers
* fix(sft): preserve runtime checkpoint metadata
* fix(sft): validate wrapped runtime configuration
* fix(sft): preserve expert format provenance
* fix(sft): own routed experts during device dispatch
* test(sft): lock explicit quantization conflict
* fix(cpu): make shared memory buffers lifetime-safe
* release: prepare v0.7.0
2026-08-17 16:25:14 +08:00
Jianwei Dong
027832c590
[feat](kt-kernel): CPU-GPU experts sched ( #1796 )
2026-01-16 17:01:15 +08:00
ZiWei Yuan
53f6a6d6e1
[feat]: patch kml problem ( #1704 )
2025-12-11 14:40:29 +08:00
ZiWei Yuan and mrhaoxx
1374b98ee5
[feat](moe_kernel): add amd blis support (int8) ( #1600 )
...
* [feat]: init amd adaption
* [feat]: add blis support
* [fix]: fix setup and moe kernel warpper
* [fix](setup.py): support rebuild with cache and import kt_kernel works
fine
* [feat]: add moe_kernel converter for amd and implement the load
method(haven't tested yet)
* [feat](moe_kernel/moe.hpp): delete unused memory when using save
* [fix](moe_kernel): update PLAIN for pack
* [fix](moe_kernel): rm printf debug
* [fix](moe_kernel): skip gpu experts
* [fix](moe_kernel/moe.hpp): update include memory path
* [feat](moe_kernel/moe.hpp): support expert deferral
* [feat]: finish amd
---------
Co-authored-by: mrhaoxx <mr.haoxx@gmail.com >
2025-11-27 12:08:53 +08:00
ZiWei Yuan
aef6672dd8
[docs]: add contribuing guide and add hooks install ( #1613 )
...
* [feat]: update kt-kernel hooks and add contribution guide
* [docs]: add contributing guide
* [style]: format the python file and cpp file in kt-kernel
2025-11-15 18:26:49 +08:00
ovowei
f854d03bd7
update kt-kernel
2025-11-03 15:19:52 +08:00
yyj