Commit Graph

Select branches

Hide Pull Requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

ci/four-main-pypi-release

ci/model-e2e-acceptance

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

docs/kt-ft-figure2-single-column-20261010

docs/kt-ft-paper-20261008

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/glm53-index-share-sync

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

perf/bf16-grad-norm-20261010

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/0.7.0.post3-frozen-pypi

release/20260911-carrier-repair

release/20260911-ci-python

release/20260911-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#2068

#2069

#2070

#2071

#2074

#2075

#2079

#2080

#2082

#2085

#2085

#2086

#2088

#2089

#2091

#2092

#2093

#2093

#2094

#2095

#2095

#2096

#2096

#2097

#2097

#2101

#2101

#2102

#2102

#2103

#2103

#2104

#2105

#2111

#2111

#2112

#2114

#2116

#2117

#2119

#2119

#2120

#2120

#2121

#2121

#2122

#2122

#2123

#2123

#2124

#2124

#2125

#2125

#2126

#2126

#2129

#2129

#2130

#2130

#2131

#2131

#2132

#2132

#2133

#2133

#2134

#2134

#2135

#2135

#2136

#2137

#2137

#2138

#2138

#2140

#2141

#2142

#2142

#2152

#2153

#2153

#2154

#2155

#2155

#2156

#2157

#2158

#2159

#2160

#2161

#2161

#2162

#2163

#2164

#2165

#2166

#2167

#2168

#2168

#2169

#2170

#2171

#2173

#2174

#2174

#2175

#2176

#2177

#2180

#2181

#2182

#2185

#2186

#2187

#2188

#2190

#2190

#2191

#2193

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#220

#2200

#2201

#2201

#2202

#2203

#2204

#2205

#2206

#2207

#2209

#2210

#2211

#2212

#2212

#2215

#2215

#2216

#2217

#2217

#2219

#2219

#2220

#2223

#2224

#2225

#2228

#2229

#2229

#2231

#2231

#2232

#2233

#2234

#2235

#2236

#2236

#2237

#2237

#2238

#2238

#2239

#2239

#224

#2240

#2240

#2241

#2241

#2242

#2242

#2243

#2246

#2246

#2247

#2248

#2248

#2250

#2251

#2251

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

paper-ktft-v1

paper-ktft-v1.1

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

v0.7.0.post4

v0.7.1

v0.7.2

Mono Color

• d7811a4f32 Merge pull request #1211 from kvcache-ai/support-amx-qwen v0.3 wang jiahao 2025-04-29 06:44:48 +08:00
• a3ba63665a update readme qiyuxinlin 2025-04-28 22:38:41 +00:00
• 89823ccb1f update readme qiyuxinlin 2025-04-28 22:34:47 +00:00
• e7763a4b59 update readme qiyuxinlin 2025-04-28 22:32:35 +00:00
• d3ebdafd4b update readme qiyuxinlin 2025-04-28 22:31:09 +00:00
• 59b0631e33 update readme qiyuxinlin 2025-04-28 22:26:38 +00:00
• 84d1f62daa deploy: ffb1f7bf09 qiyuxinlin 2025-04-28 22:18:55 +00:00
• ffb1f7bf09 Merge pull request #1210 from kvcache-ai/support-amx-qwen wang jiahao 2025-04-29 06:18:45 +08:00
• 8f76c37d86 fix readme qiyuxinlin 2025-04-28 22:17:22 +00:00
• cb5617b479 update readme qiyuxinlin 2025-04-28 22:14:23 +00:00
• 063c5489b3 fix can not compile amx qiyuxinlin 2025-04-28 21:52:14 +00:00
• 27990dc6fb fix load bug qiyuxinlin 2025-04-28 21:08:13 +00:00
• 74bb7fdcf6 Merge remote-tracking branch 'dev/support-amx-2' qiyuxinlin 2025-04-28 18:46:51 +00:00
• be4b27e841 update doc qiyuxinlin 2025-04-28 18:24:15 +00:00
• 33cbd47086 support qwen3 djw 2025-04-28 18:15:35 +00:00
• 68c2b2e6e6 support qwen3 djw 2025-04-28 18:02:07 +00:00
• 0da3792b27 support qwen3 djw 2025-04-28 14:05:24 +00:00
• 3f9bbf1181 support qwen3, dont speak human language djw 2025-04-28 08:44:47 +00:00
• 48c5ae23de deploy: ba92cf1a3b qiuqiu10 2025-04-28 07:10:39 +00:00
• ba92cf1a3b Merge pull request #1204 from emmanuel-ferdman/main Chengyu Qiu 2025-04-28 15:10:14 +08:00
• 27e3b2b98d Merge pull request #1202 from PC-DOS/main Chen Hongtao 2025-04-27 14:36:37 +08:00
• cb80cb31a6 Update reference to optimize rules directory Emmanuel Ferdman 2025-04-26 01:43:18 -07:00
• 5379e68f19 Replaced Chinese comments with English to avoid breaking MSVC compiling PC-DOS 2025-04-26 03:20:23 +08:00
• 5b4d9c41ac Replaced Chinese comments with English to avoid breaking MSVC compiling PC-DOS 2025-04-26 03:18:01 +08:00
• f3d842a0ca support AMX chenht2022 2025-04-25 14:47:16 +00:00
• a7b995365e Merge pull request #1197 from jizhilong/jizhilong-patch-1 ZiWei Yuan 2025-04-25 14:50:58 +08:00
• 82920e7943 :spakles: update requirements for cpufeature liam 2025-04-25 06:49:56 +00:00
• b90362b5e6 Merge pull request #1198 from kvcache-ai/fix-max_new_tokens wang jiahao 2025-04-25 12:22:41 +08:00
• 7af83f9efb fix load default max_new_tokens qiyuxinlin 2025-04-25 04:20:12 +00:00
• 9a759e9fb8 fix: make cpufeature a local import jzl 2025-04-25 11:42:38 +08:00
• 67042d11e3 Merge pull request #1193 from kvcache-ai/fix-chat-template-encoding Atream 2025-04-23 22:44:46 -06:00
• 46493789eb fix chat template encoding Atream 2025-04-24 12:44:16 +08:00
• 449a83dff6 Merge pull request #1183 from kvcache-ai/check-para wang jiahao 2025-04-23 16:27:18 +08:00
• f7d939313b Merge remote-tracking branch 'origin/main' into check-para Alisehen 2025-04-23 02:40:14 +00:00
• 99540ad01f add check parameters Alisehen 2025-04-23 02:38:43 +00:00
• 7e4813e8ad Merge pull request #1184 from kvcache-ai/update_param wang jiahao 2025-04-22 20:55:11 +08:00
• 3a044e6b14 change test qiyuxinlin 2025-04-22 12:50:39 +00:00
• c995bdbbfa add check-para Alisehen 2025-04-22 09:30:08 +00:00
• 739358789e Merge pull request #1182 from kvcache-ai/fix-kill-balance_serve wang jiahao 2025-04-22 17:28:06 +08:00
• 4f9950e30c kill serve lead to kill sched and engine qiyuxinlin 2025-04-22 09:25:44 +00:00
• 4c41f3a35f Merge pull request #1180 from kvcache-ai/update_param wang jiahao 2025-04-22 15:39:57 +08:00
• b17ab8653c update speed test qiyuxinlin 2025-04-22 07:38:05 +00:00
• 485588017b Merge pull request #1177 from kvcache-ai/update_param wang jiahao 2025-04-22 10:14:36 +08:00
• f5287e908a fix no balance_serve import error qiyuxinlin 2025-04-22 02:11:18 +00:00
• 03a65d6bea roll back ktransformers backend, add max_tokens, max_completion_tokens param qiyuxinlin 2025-04-21 12:55:37 +00:00
• a1162eea01 Merge pull request #1158 from Creeper-MZ/function_call wang jiahao 2025-04-19 16:31:37 +08:00
• 133ba746e9 优化提示词，解决部分Deepseek r1的兼容性 Creeper-MZ 2025-04-18 07:12:50 -04:00
• 34c199403b Merge pull request #1170 from onepick/fix-cmake-error Atream 2025-04-18 07:51:03 -06:00
• 0892d37d2d Merge pull request #1172 from kvcache-ai/move_create_sched wang jiahao 2025-04-18 18:19:29 +08:00
• 38e841900d Move KV cache creation to balance_serve qiyuxinlin 2025-04-18 10:10:07 +00:00
• c5edd3fdf0 Fix cmake config error onepick 2025-04-18 15:43:03 +08:00
• e44c45e782 Merge pull request #1163 from cyhasuka/main Atream 2025-04-18 00:50:58 -06:00
• 08f0bd5e13 Merge pull request #1168 from kvcache-ai/Atream-patch-1 Atream 2025-04-17 22:40:28 -06:00
• e6fb4d5a58 remove hard code max_length Atream 2025-04-18 12:11:18 +08:00
• 22a30d707d Merge pull request #1167 from kvcache-ai/update-llama4-tutorial-patch-1 Jianwei Dong 2025-04-18 11:44:11 +08:00
• dfaf2b20fb update llama4 tutorial djw 2025-04-18 03:42:48 +00:00
• 62c4023160 Fixed #1155 Creeper-MZ 2025-04-17 10:21:51 -04:00
• eff5bbc202 Merge branch 'kvcache-ai:main' into main Yuhao Tsui 2025-04-17 22:01:31 +08:00
• 4fb19bfcae Update chat.py Creeper-MZ 2025-04-17 09:19:14 -04:00
• 8770b6d573 Merge pull request #1159 from onepick/fix-rocm-build-error ZiWei Yuan 2025-04-17 19:57:44 +08:00
• 6a7624fe4a Change the logic to build device since cuda is as default onepick 2025-04-17 19:44:05 +08:00
• 8ce34b3b5c Modify the performance calculation module Yuhao Tsui 2025-04-17 16:57:53 +08:00
• 6e4da83d4b Merge pull request #978 from cyhasuka/main wang jiahao 2025-04-17 14:34:35 +08:00
• b055132369 Merge pull request #1154 from 344303947/features/add-function-calling wang jiahao 2025-04-17 14:31:02 +08:00
• 97f1995696 Fix some build error for ROCM onepick 2025-04-17 11:33:01 +08:00
• cb266c98d4 Fix a bug Creeper-MZ 2025-04-16 23:31:33 -04:00
• 3efb66213b Merge pull request #1157 from jiangshibiao/dev-fix-bug wang jiahao 2025-04-17 10:11:01 +08:00
• 6bc2e85343 Update chat.py Creeper-MZ 2025-04-16 15:54:23 -04:00
• 88f688e2c8 更改token注入逻辑，减少token注入量，防止遗忘 Creeper-MZ 2025-04-16 14:55:30 -04:00
• 921061666c fix some bugs root 2025-04-17 00:48:09 +08:00
• c8db24d5eb Update config.py kevin 2025-04-16 17:32:08 +08:00
• badf7a1bb1 Merge branch 'kvcache-ai:main' into features/add-function-calling kevin 2025-04-16 17:21:27 +08:00
• d2cf81423f Merge pull request #1135 from Creeper-MZ/function_call Chengyu Qiu 2025-04-16 09:57:22 +08:00
• fcbd41e175 Merge pull request #1143 from jizhilong/improve-cmake-subprocess-output ZiWei Yuan 2025-04-15 17:37:44 +08:00
• 0638ea298d feat(build): display limited tail of subprocesses in real time jizhilong 2025-04-15 16:40:38 +08:00
• 8dc1ab9e04 Merge pull request #1108 from jizhilong/expose-cmake-logs ZiWei Yuan 2025-04-14 17:07:00 +08:00
• 8699109129 Refactor the chat interface to support tool calling and parameter processing sean.su 2025-04-14 15:23:37 +08:00
• a7e8d7c1af updata function_call Creeper-MZ 2025-04-13 23:48:51 -04:00
• 038db30ec9 Merge pull request #1132 from wangkuigang-yewu-cmss/long-prompt-crash wang jiahao 2025-04-13 22:06:11 +08:00
• 4538bdae97 prevent rpc process from crashing on long prompt wangkuigang-yewu-cmss 2025-04-13 16:12:18 +08:00
• 797dac7e31 Merge pull request #1109 from aubreyli/libxxhash-fPIC ErvinXie 2025-04-13 14:15:31 +08:00
• 77956822ce Merge pull request #1116 from ikawrakow/ik/add_copyright ZiWei Yuan 2025-04-13 11:53:12 +08:00
• 99a247e167 Spelling Iwan Kawrakow 2025-04-11 10:15:42 +03:00
• c46b0c59d0 Add missing references to ik_llama.cpp Iwan Kawrakow 2025-04-11 09:39:57 +03:00
• 63ca2fa84d xxHash: fix link error due to non-position-independent code Aubrey Li 2025-04-10 21:50:23 +08:00
• 690d4d42f9 chore: show cmake output in real time during build_ext jizhilong 2025-04-10 21:33:04 +08:00
• 35ba63e259 Merge pull request #1103 from kvcache-ai/Atream-patch-6 Atream 2025-04-09 19:50:57 +08:00
• 5f8cdc7640 Create SECURITY.md Atream 2025-04-09 19:50:38 +08:00
• 92a67ab549 Merge pull request #1101 from kvcache-ai/Atream-patch-5 Atream 2025-04-09 19:23:46 +08:00
• 98dbdcd66c Update llama4.md Atream 2025-04-09 19:23:35 +08:00
• 9fad782c1a Merge pull request #1100 from kvcache-ai/Atream-patch-4 Atream 2025-04-09 19:10:03 +08:00
• 346d202297 Update llama4.md Atream 2025-04-09 19:09:44 +08:00
• a46c43b2db Merge pull request #1099 from kvcache-ai/Atream-patch-3 Atream 2025-04-09 18:01:46 +08:00
• d1fcb208cc Update llama4.md Atream 2025-04-09 18:01:13 +08:00
• 0774fe4d62 Merge pull request #1098 from kvcache-ai/Atream-patch-2 Atream 2025-04-09 17:58:44 +08:00
• ed2b971e02 Update llama4.md Atream 2025-04-09 17:57:37 +08:00
• c689b23364 Merge pull request #1097 from kvcache-ai/update-llama4-tutorial Jianwei Dong 2025-04-09 17:40:58 +08:00
• 26798500bd update llama4 tutorial djw 2025-04-09 09:40:08 +00:00
• 1e0be68e51 Merge pull request #1096 from kvcache-ai/update-llama4-tutorial Jianwei Dong 2025-04-09 17:37:33 +08:00
• f73b4ca706 update llama4 tutorial djw 2025-04-09 09:36:30 +00:00