Commit Graph

Select branches

Hide Pull Requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

ci/four-main-pypi-release

ci/model-e2e-acceptance

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

docs/kt-ft-figure2-single-column-20261010

docs/kt-ft-paper-20261008

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/glm53-index-share-sync

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

perf/bf16-grad-norm-20261010

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/0.7.0.post3-frozen-pypi

release/20260911-carrier-repair

release/20260911-ci-python

release/20260911-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#2068

#2069

#2070

#2071

#2074

#2075

#2079

#2080

#2082

#2085

#2085

#2086

#2088

#2089

#2091

#2092

#2093

#2093

#2094

#2095

#2095

#2096

#2096

#2097

#2097

#2101

#2101

#2102

#2102

#2103

#2103

#2104

#2105

#2111

#2111

#2112

#2114

#2116

#2117

#2119

#2119

#2120

#2120

#2121

#2121

#2122

#2122

#2123

#2123

#2124

#2124

#2125

#2125

#2126

#2126

#2129

#2129

#2130

#2130

#2131

#2131

#2132

#2132

#2133

#2133

#2134

#2134

#2135

#2135

#2136

#2137

#2137

#2138

#2138

#2140

#2141

#2142

#2142

#2152

#2153

#2153

#2154

#2155

#2155

#2156

#2157

#2158

#2159

#2160

#2161

#2161

#2162

#2163

#2164

#2165

#2166

#2167

#2168

#2168

#2169

#2170

#2171

#2173

#2174

#2174

#2175

#2176

#2177

#2180

#2181

#2182

#2185

#2186

#2187

#2188

#2190

#2190

#2191

#2193

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#220

#2200

#2201

#2201

#2202

#2203

#2204

#2205

#2206

#2207

#2209

#2210

#2211

#2212

#2212

#2215

#2215

#2216

#2217

#2217

#2219

#2219

#2220

#2223

#2224

#2225

#2228

#2229

#2229

#2231

#2231

#2232

#2233

#2234

#2235

#2236

#2236

#2237

#2237

#2238

#2238

#2239

#2239

#224

#2240

#2240

#2241

#2241

#2242

#2242

#2243

#2246

#2246

#2247

#2248

#2248

#2250

#2251

#2251

#2252

#2252

#2253

#2253

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

paper-ktft-v1

paper-ktft-v1.1

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

v0.7.0.post4

v0.7.1

v0.7.2

Mono Color

• cc367f5814 Merge pull request #1351 from kvcache-ai/load-DeepSeek-0528 Atream 2025-06-01 19:13:57 +08:00
• a6b3243a56 [Patch] lload DeepSeek-R1-0528 qiyuxinlin 2025-05-31 14:19:20 +00:00
• ac48a58cca Merge pull request #1350 from kvcache-ai/Update-WeChatGroup Atream 2025-05-31 13:34:14 +08:00
• 44143d972f Add files via upload Atream 2025-05-31 13:33:36 +08:00
• d8bc6402b5 raise exception on device error (#1342) Emmanuel Ferdman 2025-05-29 10:37:41 +03:00
• 00949d5e8d Mirror #1247 in server mode Ye Zhou 2025-05-29 15:30:26 +08:00
• 54197ec794 deploy: ce75fcd7dd aubreyli 2025-05-28 06:09:07 +00:00
• ce75fcd7dd Merge pull request #1337 from liu-shaojun/docker_xpu aubreyli 2025-05-28 14:08:46 +08:00
• 404ad39a04 docs: add Dockerfile.xpu and GPU driver setup instructions Shaojun Liu 2025-05-26 14:35:14 +08:00
• 0c44f2e211 Merge pull request #1331 from rnwang04/qwen3_xpu_support wang jiahao 2025-05-23 10:38:28 +08:00
• 71a5fc5770 fix local_chat.py chunk_size not effect experts qiyuxinlin 2025-05-23 02:35:01 +00:00
• adc0906967 add XPU support for qwen3moe local chat rnwang04 2025-05-21 18:33:41 +08:00
• 25893366b6 Merge pull request #1328 from chenht2022/main Chen Hongtao 2025-05-21 11:46:48 +08:00
• 66453981ff Fix NaN bug chenht2022 2025-05-21 03:39:49 +00:00
• 7d79735bd0 Merge pull request #1323 from kvcache-ai/Atream-patch-2 Atream 2025-05-19 23:21:56 +08:00
• 4f78e37625 Update version Atream 2025-05-19 23:21:23 +08:00
• 01311d251d Merge pull request #1320 from aubreyli/no_cuda_graph_err Atream 2025-05-18 02:45:05 -06:00
• d347aeb518 VLinearMarlin: padding to input.shape[0] to avoid CUDA error Aubrey Li 2025-05-18 15:11:37 +08:00
• c350679d2e deploy: 32f3d7befb qiyuxinlin 2025-05-17 07:25:56 +00:00
• 32f3d7befb Merge pull request #1307 from kvcache-ai/hyc v0.3.1 wang jiahao 2025-05-17 15:25:33 +08:00
• 5b08d5b07b fix Alisehen 2025-05-17 07:22:51 +00:00
• 551ebc91c7 Merge pull request #1313 from rnwang04/update_ipex_llm_version aubreyli 2025-05-16 13:28:12 +08:00
• a56aa45186 fix ipex-llm version to 2.3.0rc1 rnwang04 2025-05-16 12:19:37 +08:00
• a3346c9a41 Merge pull request #1311 from kvcache-ai/wx-csy-patch-1 aubreyli 2025-05-16 08:28:23 +08:00
• 5d194c5db0 Fix typos Shaoyuan CHEN 2025-05-15 22:15:55 +08:00
• f3b1e36b6a bug fix Alisehen 2025-05-15 10:01:51 +00:00
• d5a50ab494 deploy: 7faa776659 Atream 2025-05-15 07:58:13 +00:00
• 7faa776659 Merge pull request #1277 from Coekjan/patch-1 Atream 2025-05-15 01:58:00 -06:00
• edd9efa49e fix Alisehen 2025-05-15 07:28:50 +00:00
• 055680e26c add flashinfer to cuda device Alisehen 2025-05-15 07:03:45 +00:00
• f3be33a313 add xpu parameters to install.sh Alisehen 2025-05-15 06:39:02 +00:00
• af9472b518 Merge pull request #1306 from aubreyli/xpu-doc aubreyli 2025-05-15 14:18:47 +08:00
• 72f6d93ffd xpu.md: add device discovery tips Aubrey Li 2025-05-15 14:12:26 +08:00
• 8caecf37d8 Merge pull request #1305 from kvcache-ai/update-readme wang jiahao 2025-05-15 12:10:20 +08:00
• b40f13abeb fix deduplicate_and_sort cudagraphs qiyuxinlin 2025-05-15 04:09:34 +00:00
• a475aaae4a deploy: 09f0ddc00b aubreyli 2025-05-15 02:56:10 +00:00
• 09f0ddc00b Merge pull request #1303 from rnwang04/fix_typo_and_style aubreyli 2025-05-15 10:55:58 +08:00
• 2f6e14a54b fix md typo, fix code style, and update setup value error message rnwang04 2025-05-15 09:14:59 +00:00
• 07c5f23da5 Merge pull request #1304 from kvcache-ai/Atream-patch-1 Atream 2025-05-14 20:29:54 -06:00
• d051a14941 Update README.md Atream 2025-05-15 10:29:43 +08:00
• 4044e8c7fa deploy: 2d3aaef8b6 qiyuxinlin 2025-05-14 13:16:04 +00:00
• 2d3aaef8b6 Merge pull request #1301 from kvcache-ai/update-readme wang jiahao 2025-05-14 21:15:55 +08:00
• d35d61f6a1 update readme qiyuxinlin 2025-05-14 13:15:18 +00:00
• c3d0ac80c6 update readme qiyuxinlin 2025-05-14 13:13:10 +00:00
• ee524b0f41 Merge pull request #1300 from kvcache-ai/qiyuxinlin-patch-1 wang jiahao 2025-05-14 21:09:20 +08:00
• 9fe3f35c37 Update install.sh wang jiahao 2025-05-14 21:08:58 +08:00
• 34225e8c93 deploy: f7ee993fdc aubreyli 2025-05-14 12:58:47 +00:00
• f7ee993fdc Merge pull request #1295 from rnwang04/xpu_support aubreyli 2025-05-14 20:58:35 +08:00
• 142fb7ce6c Enable support for Intel XPU devices, add support for DeepSeek V2/V3 first rnwang04 2025-05-14 14:28:22 +00:00
• 333351c7c8 Merge pull request #1298 from kvcache-ai/fix-workspace-buffer wang jiahao 2025-05-14 17:50:40 +08:00
• ecc01cda17 update norm cpu kernel qiyuxinlin 2025-05-14 09:49:35 +00:00
• 8974cc9d75 Merge pull request #1297 from kvcache-ai/fix-workspace-buffer wang jiahao 2025-05-14 17:46:55 +08:00
• 64742bec83 update torch MLA kernel qiyuxinlin 2025-05-14 09:45:12 +00:00
• 4e015ccc65 Merge pull request #1296 from kvcache-ai/fix-workspace-buffer wang jiahao 2025-05-14 17:35:27 +08:00
• e8e83308a9 fix flashinfer float_workspace_buffer small qiyuxinlin 2025-05-14 09:33:52 +00:00
• 02948bc1b8 Merge pull request #1289 from kvcache-ai/update-default-config wang jiahao 2025-05-13 20:23:25 +08:00
• 697444905a update default config qiyuxinlin 2025-05-13 12:20:21 +00:00
• 8456222852 Merge pull request #1276 from kvcache-ai/support_load_safetensor wang jiahao 2025-05-12 11:10:26 +08:00
• 1edc6d9de0 Fix typo about GLIBCXX_3.4.32 Yip Coekjan 2025-05-09 20:34:45 +08:00
• c6aa379de2 support safetensor load, delete architectures argument qiyuxinlin 2025-05-09 10:38:29 +00:00
• 30eab48a75 Merge pull request #799 from aubreyli/cpu_offloading Atream 2025-05-09 00:38:54 -06:00
• 8025def197 Merge pull request #1246 from aubreyli/GenerationMixin Atream 2025-05-09 00:35:15 -06:00
• 900a7f7c3e Merge pull request #1271 from kvcache-ai/fix-AMX Atream 2025-05-07 05:12:38 -06:00
• b22cded890 fix AMX Atream 2025-05-07 19:12:19 +08:00
• 671151f6e7 deploy: 3f14e311cb Alisehen 2025-05-07 07:22:46 +00:00
• 3f14e311cb Merge pull request #1247 from aubreyli/_get_logits_warper Yaochen Han 2025-05-07 15:22:35 +08:00
• b3a1fcf471 ktransformers/utils: fix _get_logits_warper error Aubrey Li 2025-05-01 08:05:35 +08:00
• def1ec7683 modeling_deepseek_v3: fix GenerationMixin warning Aubrey Li 2025-05-01 07:48:15 +08:00
• 7530491f5b Merge pull request #1244 from kvcache-ai/update-custom-flashinfer Atream 2025-04-30 04:46:19 -06:00
• 753075728c update-custom-flashinfer Atream 2025-04-30 10:45:25 +00:00
• a4bd6818ed Merge pull request #1241 from kvcache-ai/fix-cache-lens Atream 2025-04-29 21:38:12 -06:00
• 7adb7281f4 fix-cache-lens Atream 2025-04-30 03:37:43 +00:00
• 8ba7e5d4b8 Merge pull request #1227 from kvcache-ai/change-yaml wang jiahao 2025-04-29 16:10:37 +08:00
• 48dfbc8f9f change inject yaml qiyuxinlin 2025-04-29 08:09:39 +00:00
• 2a224b256e Merge pull request #1225 from kvcache-ai/fix_typo_main ZiWei Yuan 2025-04-29 13:26:02 +08:00
• 0e8a36770a ✨ update ignore liam Yuan 2025-04-29 13:24:14 +08:00
• c519747f3c Merge pull request #1224 from kvcache-ai/fix_typo_main ZiWei Yuan 2025-04-29 13:22:27 +08:00
• 2762012039 ✨ fix typo liam Yuan 2025-04-29 13:20:03 +08:00
• ab26e7d7db Merge pull request #1223 from kvcache-ai/fix-client Atream 2025-04-28 22:35:04 -06:00
• 0f7a3e5fea fix-client Atream 2025-04-29 12:34:20 +08:00
• cc94a02ab5 Merge pull request #1222 from kvcache-ai/fix-compile Atream 2025-04-28 22:13:09 -06:00
• 08035a7cda Update requirements-local_chat.txt Atream 2025-04-29 12:12:35 +08:00
• fd9876049d Update pyproject.toml Atream 2025-04-29 12:11:11 +08:00
• 9d6e09efa6 Merge pull request #1221 from kvcache-ai/Atream-patch-5 Atream 2025-04-28 21:14:10 -06:00
• 28948aacc9 Update AMX.md Atream 2025-04-29 11:12:51 +08:00
• bee6291dc2 Merge pull request #1220 from kvcache-ai/fix-hopper-flashinfer Atream 2025-04-28 21:07:34 -06:00
• b0318fc01c fix-hopper-flashinfer Atream 2025-04-29 11:06:34 +08:00
• b703cc9c3d Merge pull request #1219 from kvcache-ai/Atream-patch-4 Atream 2025-04-28 21:04:12 -06:00
• 14efb15593 Update AMX.md Atream 2025-04-29 11:03:59 +08:00
• 38333cf129 Merge pull request #1218 from kvcache-ai/clean-up Atream 2025-04-28 20:36:25 -06:00
• 192746cf93 clean-up Atream 2025-04-29 10:32:42 +08:00
• e4538bc013 Merge pull request #1217 from kvcache-ai/Atream-patch-3 Atream 2025-04-28 20:31:03 -06:00
• 073ce601e0 Update AMX.md Atream 2025-04-29 10:29:51 +08:00
• 2bcdf10fbb Merge pull request #1216 from kvcache-ai/Atream-patch-2 Atream 2025-04-28 19:58:56 -06:00
• e8b2bf4f7b Update version info in __init__.py Atream 2025-04-29 09:58:40 +08:00
• 5599fef98f Merge pull request #1215 from kvcache-ai/Atream-patch-1 Atream 2025-04-28 19:43:29 -06:00
• 7ebf82a492 Update Qwen3 date Atream 2025-04-29 09:43:13 +08:00
• f27e4850f1 Merge pull request #1212 from kvcache-ai/support-amx-qwen wang jiahao 2025-04-29 07:09:53 +08:00
• e70db18b63 update AMX readme qiyuxinlin 2025-04-28 23:08:38 +00:00
• 2e905c8bd4 update AMX readme qiyuxinlin 2025-04-28 23:03:32 +00:00