Commit Graph

Select branches

Hide Pull Requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

ci/four-main-pypi-release

ci/model-e2e-acceptance

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

docs/kt-ft-figure2-single-column-20261010

docs/kt-ft-paper-20261008

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/glm53-index-share-sync

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

perf/bf16-grad-norm-20261010

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/0.7.0.post3-frozen-pypi

release/20260911-carrier-repair

release/20260911-ci-python

release/20260911-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#2068

#2069

#2070

#2071

#2074

#2075

#2079

#2080

#2082

#2085

#2085

#2086

#2088

#2089

#2091

#2092

#2093

#2093

#2094

#2095

#2095

#2096

#2096

#2097

#2097

#2101

#2101

#2102

#2102

#2103

#2103

#2104

#2105

#2111

#2111

#2112

#2114

#2116

#2117

#2119

#2119

#2120

#2120

#2121

#2121

#2122

#2122

#2123

#2123

#2124

#2124

#2125

#2125

#2126

#2126

#2129

#2129

#2130

#2130

#2131

#2131

#2132

#2132

#2133

#2133

#2134

#2134

#2135

#2135

#2136

#2137

#2137

#2138

#2138

#2140

#2141

#2142

#2142

#2152

#2153

#2153

#2154

#2155

#2155

#2156

#2157

#2158

#2159

#2160

#2161

#2161

#2162

#2163

#2164

#2165

#2166

#2167

#2168

#2168

#2169

#2170

#2171

#2173

#2174

#2174

#2175

#2176

#2177

#2180

#2181

#2182

#2185

#2186

#2187

#2188

#2190

#2190

#2191

#2193

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#220

#2200

#2201

#2201

#2202

#2203

#2204

#2205

#2206

#2207

#2209

#2210

#2211

#2212

#2212

#2215

#2215

#2216

#2217

#2217

#2219

#2219

#2220

#2223

#2224

#2225

#2228

#2229

#2229

#2231

#2231

#2232

#2233

#2234

#2235

#2236

#2236

#2237

#2237

#2238

#2238

#2239

#2239

#224

#2240

#2240

#2241

#2241

#2242

#2242

#2243

#2246

#2246

#2247

#2248

#2248

#2250

#2250

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

paper-ktft-v1

paper-ktft-v1.1

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

v0.7.0.post4

v0.7.1

v0.7.2

Mono Color

• dee1e211d5 [docs]: refine dpo tutorial (#1739) mrhaoxx 2025-12-22 18:44:24 +08:00
• 0bce173e3b [feat]: Release version to 0.4.4 (#1738) v0.4.4 Peilin Li 2025-12-22 11:20:40 +08:00
• 16d5d89f50 [docs]: Update Python version options in DPO tutorial (#1734) Peilin Li 2025-12-20 13:44:35 +08:00
• df998e0f36 [docs]: Add RL-DPO Tutorial (#1733) Peilin Li 2025-12-20 12:49:02 +08:00
• 83a3c7d94f deploy: 39449ed1af ovowei 2025-12-18 09:21:57 +00:00
• 39449ed1af update PyPI Install and readme (#1731) Jianwei Dong 2025-12-18 17:21:47 +08:00
• 180d2e0ca7 kernel ok, I think xwy-amd8 2025-12-18 03:58:55 +00:00
• 6d7bb6f8d1 nvfp4 impl xwy-amd8 2025-12-18 03:31:50 +00:00
• 8d6f465e33 deploy: 3c134359bc SkqLiao 2025-12-17 16:12:18 +00:00
• 3c134359bc Fix CPU Instruction Set and Installation (#1729) Jiaqi Liao 2025-12-18 00:11:57 +08:00
• a8667ddb58 [fix](test): fix import kt-kernel (#1728) ErvinXie 2025-12-17 19:46:32 +08:00
• 298c3a8c02 progress xwy-amd8 2025-12-17 10:40:10 +00:00
• 70739cefba [fix](test): fix import kt-kernel fix-import xwy-amd8 2025-12-17 10:00:13 +00:00
• 2c9a9acebc update docker push fix-deploy-djw djw 2025-12-17 08:20:09 +00:00
• 6fc4080a7d [fix](kt-kernel): fix typo in moe-tp's forward time-profiling (#1720) SCDESPERTATE 2025-12-17 12:06:33 +08:00
• 661e19a8e5 Update release-pypi.yml (#1726) Jianwei Dong 2025-12-16 20:37:20 +08:00
• 5ba3fb56d1 Update release-pypi.yml (#1725) Jianwei Dong 2025-12-16 20:30:03 +08:00
• 11cfe7ded1 [fix](kt-kernel): fix setup version issue cpu-fix SkqLiao 2025-12-16 19:24:27 +08:00
• 532c84af2a [feat](kt-kernel): AVX512 fallback kernel for RAW-INT4 SkqLiao 2025-12-16 18:15:28 +08:00
• 7a29a19900 [fix](kt-kernel): fix AVX512 cpu instruction set detection SkqLiao 2025-12-16 17:57:20 +08:00
• 3126b8deaa Update release-pypi.yml (#1724) Jianwei Dong 2025-12-16 17:45:29 +08:00
• 6dcacd9daf Update release-pypi.yml (#1723) Jianwei Dong 2025-12-16 17:42:28 +08:00
• fe8049d3a9 Update release-pypi.yml (#1722) Jianwei Dong 2025-12-16 17:35:29 +08:00
• 5ff0026fc1 Update release-pypi.yml (#1721) Jianwei Dong 2025-12-16 17:29:29 +08:00
• c1938fdbbb deploy: 1f79f6da92 ovowei 2025-12-16 07:20:29 +00:00
• 1f79f6da92 [feat](kt-kernel): Add automatic deployment workflow (#1719) Jianwei Dong 2025-12-16 15:20:06 +08:00
• f25e58ad69 fix: qwen3-npu bugs; update: add readme-for-qwen3-npu (#1717) Shaoxu Cheng 2025-12-16 14:27:04 +08:00
• 18fb8fc897 Npu revise benchmark results and prerequisites (#1716) RICHARDNAN 2025-12-16 14:26:44 +08:00
• 4b576bc559 deploy: 34230eaf44 KMSorSMS 2025-12-15 09:10:36 +00:00
• 34230eaf44 [docs]: Fix image link in README.md (#1718) ZiWei Yuan 2025-12-15 01:10:15 -08:00
• 008de19e16 [fix](kt-kernel): drop the weights held in Python for loading weights operation in C++ (#1695) SCDESPERTATE 2025-12-12 11:42:33 +08:00
• 1e69563363 update: add cache class and ascend ln mlp op for qwen3 adapt npu (#1708) Shaoxu Cheng 2025-12-11 17:08:35 +08:00
• cea490a326 update: add ascend attn and experts ops for npu qwen3moe adapt (#1707) Shaoxu Cheng 2025-12-11 17:08:15 +08:00
• adcfa9080f update: Qwen3 MoE model adaptation for NPU (framework) (#1706) Shaoxu Cheng 2025-12-11 17:07:57 +08:00
• 53f6a6d6e1 [feat]: patch kml problem (#1704) ZiWei Yuan 2025-12-10 22:40:29 -08:00
• c65febe05c [feat]: Automatically detect whether blis is installed on amd cpus (#1702) Jianwei Dong 2025-12-11 14:25:36 +08:00
• 6431888928 add deploy in docker image (#1691) RICHARDNAN 2025-12-11 14:11:27 +08:00
• f868154f84 deploy: 2f1b743050 KMSorSMS 2025-12-11 05:01:44 +00:00
• 2f1b743050 [docs]: update website doc png (#1696) ZiWei Yuan 2025-12-10 21:01:32 -08:00
• e87a042ef0 [fix](kt-kernel): fix write_buffer do numa job (#1699) Oql 2025-12-10 16:39:16 +08:00
• 8995378a91 update: add attention and ln ut for npu (#1698) Shaoxu Cheng 2025-12-10 16:12:26 +08:00
• 1e03e8b612 [docs](kt-kernel): add Docker usage guide for SGLang deployment ljq-dev-1 SkqLiao 2025-12-09 14:54:49 +08:00
• f992de55da [fix](kt-sft): fix peft adaptations for RL tasks (#1674) mrhaoxx 2025-12-09 14:28:51 +08:00
• 503295fc88 [feat](kt-kernel): refactor convert_cpu_weights.py to support conversation for GLM-4.6V (#1687) mrhaoxx 2025-12-09 14:24:41 +08:00
• ac69ea891e Fix K2 MoE decode bug in buffer management (#1686) Oql 2025-12-08 21:08:28 +08:00
• 8139c092bf Reduce CPU memory usage during large chunk prefill (Fixes #1676) (#1683) Oql 2025-12-08 20:19:07 +08:00
• eefc8cf98d 更新 Kimi-K2-Thinking-Native.md (#1684) ErvinXie 2025-12-08 19:58:20 +08:00
• 4662368606 sft_route_moe use openmp for parallel in backward (#1662) route-moe Pory 2025-12-06 20:38:50 +08:00
• f20e5d1da5 Revise prefill strategy and performance metrics (#1675) Jiaqi Liao 2025-12-06 15:36:04 +08:00
• 1d62ac21f7 Update Kimi-K2-Thinking-Native.md (#1673) Jiaqi Liao 2025-12-05 23:08:02 +08:00
• 69fa7b1a57 Revise installation steps in Kimi-K2 documentation (#1672) Jiaqi Liao 2025-12-05 23:05:24 +08:00
• 12ab6abef6 deploy: 721b6c4c94 SkqLiao 2025-12-05 14:46:31 +00:00
• 721b6c4c94 [docs] Update Native Kimi-K2-Thinking documentation and kt-kernel parameters (#1671) v0.4.3 Jiaqi Liao 2025-12-05 22:46:16 +08:00
• 47da806cde [doc](kt-kernel): add kimi-k2-thinking (#1670) Jiaqi Liao 2025-12-05 21:53:59 +08:00
• 71f683acec Support Native Kimi K2 Thinking (#1663) ErvinXie 2025-12-05 21:53:05 +08:00
• 53cdf1e50e deploy: 4850424345 KMSorSMS 2025-12-05 08:52:39 +00:00
• 4850424345 [docs]: add amd blis backend usage guide (#1669) ZiWei Yuan 2025-12-05 00:52:26 -08:00
• e2f2c77343 deploy: 1ca3a2662e SkqLiao 2025-12-05 07:44:18 +00:00
• 1ca3a2662e Add 9#AISoft to the list of contributors (#1668) Jiaqi Liao 2025-12-05 15:44:04 +08:00
• 0698252484 [fix](kt-kernel): gate RAWINT4 behind AVX512 and avoid AVX2 build break (#1660) Jiaqi Liao 2025-12-03 00:43:23 +08:00
• 670c488155 [docs]: Add deepseek-v3.2 run tutorial (#1659) Jianwei Dong 2025-12-02 20:04:10 +08:00
• fcf8882075 [Feature] Add avx-based kimi-k2 support (#1656) Jiaqi Liao 2025-12-02 16:01:07 +08:00
• c2b8c60c4e [ci]: add int4_1 & int4_1k (#1653) ZiWei Yuan 2025-12-02 15:58:14 +08:00
• fd78fe520a fix(scripts): resolve OOM when converting gpu weights and update README (#1640) Jianwei Dong 2025-12-01 14:15:14 +08:00
• fb787283f6 use amx for calculate of route-moe lora JimmyPeilinLi 2025-12-01 02:27:02 +00:00
• f0fe6b1b1c deploy: e637fedc65 JimmyPeilinLi 2025-11-29 07:47:45 +00:00
• c7924fed79 deploy: 7ee80bbc3d JimmyPeilinLi 2025-11-29 07:47:17 +00:00
• 7a209aa1ab deploy: e637fedc65 JimmyPeilinLi 2025-11-29 07:47:07 +00:00
• e637fedc65 [docs]: Add Full introduction of KT (#1636) Peilin Li 2025-11-29 15:46:55 +08:00
• 7ee80bbc3d [docs]: Update README with Python 3.12 and dependency changes (#1634) Peilin Li 2025-11-29 15:46:05 +08:00
• 47e6abcb11 remove debug info JimmyPeilinLi 2025-11-28 04:18:37 +00:00
• a11ad178de update unit test of sft_route_moe JimmyPeilinLi 2025-11-28 04:18:06 +00:00
• 76118a7d5c remove some debug info JimmyPeilinLi 2025-11-28 04:13:05 +00:00
• 637c49c83f [feat](kt-kernel): support qwen3-vl weights convert (#1648) mrhaoxx 2025-11-27 22:29:09 +08:00
• 0ccc96477e [debug]: pass the unit test of route moe and other modify, still shared memory problem JimmyPeilinLi 2025-11-27 09:11:52 +00:00
• c256150e08 update ci test (#1647) Jianwei Dong 2025-11-27 16:39:48 +08:00
• c25c1e49a5 deploy: 1374b98ee5 KMSorSMS 2025-11-27 04:09:05 +00:00
• 1374b98ee5 [feat](moe_kernel): add amd blis support (int8) (#1600) ZiWei Yuan 2025-11-27 12:08:53 +08:00
• fef6dd98a8 add accuracy and performance test (#1643) Jianwei Dong 2025-11-27 10:56:39 +08:00
• 4ad343afd6 deploy: e7d1c1de09 SkqLiao 2025-11-26 15:19:50 +00:00
• e7d1c1de09 fix(llamafile): resolve deferred experts data race and update README (#1646) Jiaqi Liao 2025-11-26 23:19:37 +08:00
• 51745a9ea1 add ci (#1642) Jianwei Dong 2025-11-25 20:52:08 +08:00
• b113e8714c add route moe sft-amx JimmyPeilinLi 2025-11-25 12:52:03 +00:00
• 2cffdf7033 [docs]: Update DeepseekR1_V3_tutorial_zh_for_Ascend_NPU.md (#1638) RICHARDNAN 2025-11-24 11:51:07 +08:00
• e657a648bc deploy: e72a4fb880 KMSorSMS 2025-11-22 04:00:29 +00:00
• e72a4fb880 [feat](kt-kernel): Add resume arg to CPU weight conversion (#1630) DocShotgun 2025-11-21 20:00:15 -08:00
• e10760ed4f deploy: e69c67713f SkqLiao 2025-11-20 05:56:08 +00:00
• e69c67713f [refactor] fix third_party issue (#1632) v0.4.2 Jiaqi Liao 2025-11-20 13:55:55 +08:00
• 3032a4cfa8 deploy: 46af8fcab5 SkqLiao 2025-11-19 08:42:10 +00:00
• 46af8fcab5 [doc] fix kt parameters (#1629) Jiaqi Liao 2025-11-19 16:41:57 +08:00
• c357958fce deploy: 171578a7ec KMSorSMS 2025-11-17 03:48:56 +00:00
• 171578a7ec [refactor]: Change named 'KT-SFT' to 'kt-sft' (#1626) Peilin Li 2025-11-17 11:48:42 +08:00
• 2887050ca1 [Feature] add Qwen3MoE models for KTransformers-FT (#1602) Pory 2025-11-16 16:39:19 +08:00
• d508615c72 deploy: ab8ad0a110 KMSorSMS 2025-11-16 06:40:34 +00:00
• ab8ad0a110 [docs]: update web doc (#1625) ZiWei Yuan 2025-11-16 14:40:22 +08:00
• d27834efaf deploy: be6db6f46b KMSorSMS 2025-11-16 05:21:55 +00:00
• be6db6f46b [docs]: improve structure for kt-kernel (#1624) ZiWei Yuan 2025-11-16 13:21:41 +08:00
• d19387ffb6 deploy: 133eea037c KMSorSMS 2025-11-16 04:41:13 +00:00
• 133eea037c [docs]: improve docs structure (#1623) ZiWei Yuan 2025-11-16 12:40:59 +08:00
• 5d2b4778ff deploy: c2d2edbeef KMSorSMS 2025-11-16 04:09:54 +00:00