Commit Graph

Select branches

Hide Pull Requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

ci/four-main-pypi-release

ci/model-e2e-acceptance

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

docs/kt-ft-figure2-single-column-20261010

docs/kt-ft-paper-20261008

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/glm53-index-share-sync

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

perf/bf16-grad-norm-20261010

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/0.7.0.post3-frozen-pypi

release/20260911-carrier-repair

release/20260911-ci-python

release/20260911-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#2068

#2069

#2070

#2071

#2074

#2075

#2079

#2080

#2082

#2085

#2085

#2086

#2088

#2089

#2091

#2092

#2093

#2093

#2094

#2095

#2095

#2096

#2096

#2097

#2097

#2101

#2101

#2102

#2102

#2103

#2103

#2104

#2105

#2111

#2111

#2112

#2114

#2116

#2117

#2119

#2119

#2120

#2120

#2121

#2121

#2122

#2122

#2123

#2123

#2124

#2124

#2125

#2125

#2126

#2126

#2129

#2129

#2130

#2130

#2131

#2131

#2132

#2132

#2133

#2133

#2134

#2134

#2135

#2135

#2136

#2137

#2137

#2138

#2138

#2140

#2141

#2142

#2142

#2152

#2153

#2153

#2154

#2155

#2155

#2156

#2157

#2158

#2159

#2160

#2161

#2161

#2162

#2163

#2164

#2165

#2166

#2167

#2168

#2168

#2169

#2170

#2171

#2173

#2174

#2174

#2175

#2176

#2177

#2180

#2181

#2182

#2185

#2186

#2187

#2188

#2190

#2190

#2191

#2193

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#220

#2200

#2201

#2201

#2202

#2203

#2204

#2205

#2206

#2207

#2209

#2210

#2211

#2212

#2212

#2215

#2215

#2216

#2217

#2217

#2219

#2219

#2220

#2223

#2224

#2225

#2228

#2229

#2229

#2231

#2231

#2232

#2233

#2234

#2235

#2236

#2236

#2237

#2237

#2238

#2238

#2239

#2239

#224

#2240

#2240

#2241

#2241

#2242

#2242

#2243

#2246

#2246

#2247

#2248

#2248

#2250

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

paper-ktft-v1

paper-ktft-v1.1

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

v0.7.0.post4

v0.7.1

v0.7.2

Mono Color

• 24de607be4 Merge pull request #357 from kvcache-ai/qiyuxinlin-patch-2 wang jiahao 2025-02-16 15:05:19 +08:00
• b84524622e support bf16 read Atream 2025-02-16 06:43:27 +00:00
• 76554dd674 Update SUMMARY.md wang jiahao 2025-02-16 14:30:22 +08:00
• 56d19d6115 Update install.md wang jiahao 2025-02-16 14:23:56 +08:00
• 9f9c3738f9 Merge pull request #354 from Azure-Tang/fix-mockTritonMLA Azure 2025-02-16 14:06:54 +08:00
• ff6b265e53 Mock triton mla due to precision issue Azure 2025-02-16 06:03:12 +00:00
• 17d298b47a deploy: c5f036e8a4 Atream 2025-02-15 15:30:37 +00:00
• c5f036e8a4 Merge pull request #333 from kvcache-ai/feat_experts_gpu Atream 2025-02-15 23:30:24 +08:00
• 8ed8eb2a9e Update FAQ.md Atream 2025-02-15 23:27:35 +08:00
• c189d55bd1 toy support for experts on GPU, no CUDA Graph Atream 2025-02-15 15:16:00 +00:00
• ae8da019c1 Merge pull request #330 from hrz6976/fix-nonetype wang jiahao 2025-02-15 22:50:51 +08:00
• 56382aa869 Merge pull request #290 from ZhangShuaiyi/dev/check_gguf_path Azure 2025-02-15 22:48:57 +08:00
• 658a20cde7 deploy: c8bf250104 Azure-Tang 2025-02-15 14:23:21 +00:00
• c8bf250104 Merge pull request #324 from BiFangKNT/patch-2 Azure 2025-02-15 22:23:09 +08:00
• 4516282ccc Fix NoneType object has no attribute zero_ 12f23eddde 2025-02-15 22:04:45 +08:00
• d3b45d5704 Merge branch 'kvcache-ai:main' into main MuWinds 2025-02-15 21:57:08 +08:00
• 83e76d99d3 deploy: 3c6035aa8a KMSorSMS 2025-02-15 13:45:30 +00:00
• 3c6035aa8a Merge pull request #329 from kvcache-ai/fix_doc ZiWei Yuan 2025-02-15 21:45:19 +08:00
• 69b00753c2 📝 fix typo liam 2025-02-15 21:42:59 +08:00
• bd693b698f Update DeepseekR1_V3_tutorial.md 彼方 2025-02-15 19:43:18 +08:00
• 07bf3c5e94 deploy: 65d73ea3f8 UnicornChan 2025-02-15 10:56:45 +00:00
• 65d73ea3f8 Merge pull request #317 from kvcache-ai/develop-0.2.1 v0.2.1 UnicornChan 2025-02-15 16:19:18 +08:00
• 718a71b3a9 Merge pull request #316 from KMSorSMS/main ZiWei Yuan 2025-02-15 16:19:00 +08:00
• 13382f88ab 📝 update V0.2.1 Doc liam 2025-02-15 16:06:56 +08:00
• 0e4b7a3929 [feature] update docker image and entrypoint chenxl 2025-02-15 07:55:33 +00:00
• f9f9f746c0 Merge pull request #315 from kvcache-ai/Atream-add-adapted Atream 2025-02-15 15:45:34 +08:00
• 92399283b6 Update attention.py Atream 2025-02-15 15:43:35 +08:00
• d90749d35d Update triton_attention.py Atream 2025-02-15 15:41:01 +08:00
• 22280bf17f get dirname if gguf_path is a file Shuaiyi 2025-02-14 10:22:56 +00:00
• f74c2d1d17 Solve torch.backends.cuda.sdp_kernel() is deprecated. MuWinds 2025-02-15 12:41:51 +08:00
• d174183214 deploy: 1548c99234 Azure-Tang 2025-02-15 02:07:11 +00:00
• 1548c99234 Merge pull request #307 from Azure-Tang/main Azure 2025-02-15 10:06:56 +08:00
• 227e81b0d3 update zh readme Azure 2025-02-15 01:54:01 +00:00
• ef89b1520b * Reorganize documentation/README * Consolidate the installation section, as it's currently too cluttered * Move the Multi-GPU section to the top-level structure * Add a **detailed** tutorial on registering extra GPU memory with Marlin Azure 2025-02-14 19:57:09 +00:00
• 67a8070a71 deploy: b0b90270d8 Azure-Tang 2025-02-14 19:44:59 +00:00
• b0b90270d8 Merge pull request #306 from kvcache-ai/revert-305-main Azure 2025-02-15 03:44:42 +08:00
• 4f4ed36442 Revert "[update] Reorganize documentation/README" Azure 2025-02-15 03:43:48 +08:00
• 2e8539d5ec deploy: 19d4a50b1c Azure-Tang 2025-02-14 19:41:58 +00:00
• 19d4a50b1c [update] Reorganize documentation/README Azure 2025-02-15 03:41:43 +08:00
• 483182fc3a fix typo and detail Azure 2025-02-14 19:40:15 +00:00
• 823b25eec9 Reorganize documentation/README Azure 2025-02-14 19:08:17 +00:00
• cc8d627e32 Merge pull request #301 from kvcache-ai/fix-cuda-graph-bug Atream 2025-02-14 23:54:43 +08:00
• 1946493f2d warm_up before capture Atream 2025-02-14 15:52:21 +00:00
• cadd55078f Merge pull request #295 from kvcache-ai/update-wechatgroup Atream 2025-02-14 19:52:05 +08:00
• e153d78227 Add files via upload Atream 2025-02-14 19:51:11 +08:00
• 96e6dff7ac Delete WeChatGrouop.png Atream 2025-02-14 19:49:14 +08:00
• 885a91e7db Merge pull request #294 from kvcache-ai/feat-fast-MLA Atream 2025-02-14 19:40:36 +08:00
• 1084d4e4b4 linux support triton MLA kernel Atream 2025-02-14 11:38:55 +00:00
• 244db5b2ae deploy: 6738908699 Azure-Tang 2025-02-14 09:12:31 +00:00
• 6738908699 Merge pull request #280 from Azure-Tang/main Azure 2025-02-14 17:12:14 +08:00
• 1b1f417267 Fix incorrect image content in the document Azure 2025-02-14 09:04:22 +00:00
• f4bb374eaf Merge pull request #254 from Azure-Tang/main Azure 2025-02-14 11:54:14 +08:00
• 95c81eaf01 Merge branch 'kvcache-ai:main' into main Azure 2025-02-14 11:53:52 +08:00
• 0a9c59922a Merge pull request #255 from kvcache-ai/update-wechatgroup Atream 2025-02-14 11:08:59 +08:00
• ce7210321a Add files via upload Atream 2025-02-14 11:06:56 +08:00
• b7653b9c4f add V3/R1 8 gpu yaml example Azure 2025-02-14 02:56:13 +00:00
• d7e01af366 deploy: e612b14739 Azure-Tang 2025-02-14 02:37:43 +00:00
• e612b14739 Merge pull request #247 from liugddx/patch-1 Azure 2025-02-14 10:37:32 +08:00
• ae5d9e11a9 Merge pull request #227 from hrz6976/main Azure 2025-02-14 10:35:11 +08:00
• e65be580ab Fix dead link problem Guangdong Liu 2025-02-14 09:57:57 +08:00
• bb35dc5b0d init support for MLA using Attention kernel Atream 2025-02-13 15:01:14 +00:00
• a456e25a54 Merge pull request #200 from devin2255/main ZiWei Yuan 2025-02-13 22:22:25 +08:00
• e490265242 feat: add GitHub Actions workflow for building Docker image Hand Sonic 2025-02-13 22:09:49 +08:00
• d04b570fb5 edit README_ZH.md && add DeepseekR1_V3_tutorial_zh.md dhliu 2025-02-13 21:14:44 +08:00
• aa21edd2fe Merge pull request #230 from kvcache-ai/updata-wechatgroup-1 Atream 2025-02-13 19:33:51 +08:00
• 5fb9d65512 Add files via upload Atream 2025-02-13 19:33:01 +08:00
• ade346e09a Delete WeChatGrouop.png Atream 2025-02-13 19:31:46 +08:00
• 127965494c Merge pull request #229 from kvcache-ai/updata-wechatgroup Atream 2025-02-13 19:31:13 +08:00
• 30e8e6a32a Add files via upload Atream 2025-02-13 19:30:39 +08:00
• 2c3dcd9774 Add a lock to server inference() hrz6976 2025-02-13 10:05:22 +00:00
• 01d25d28b1 deploy: 76b081879a KMSorSMS 2025-02-13 09:28:21 +00:00
• 76b081879a Merge pull request #224 from kvcache-ai/server_support ZiWei Yuan 2025-02-13 17:28:08 +08:00
• 8d5ebe49ab 📝 ⚡ fix some debug output and update doc liam 2025-02-13 17:25:12 +08:00
• ad2c52d72a 📝 update doc liam 2025-02-13 17:16:27 +08:00
• 8324e7fd9b Merge pull request #220 from TensorBlock/main Azure 2025-02-13 16:41:39 +08:00
• d98dcbc5c7 deploy: c74453d8ca KMSorSMS 2025-02-13 08:38:04 +00:00
• c74453d8ca 📝 add doc support and fix bug in qwen2 liam 2025-02-13 16:26:31 +08:00
• aea4243712 Add optimization config for Deepseek V3/R1 with 4 GPUs MorphisZhang 2025-02-13 16:32:28 +08:00
• 318c88cbeb add README_ZH.md dhliu 2025-02-13 12:43:06 +08:00
• 8bad019ef2 Merge pull request #180 from lusipad/patch-1 Atream 2025-02-13 10:25:30 +08:00
• 0905d2e270 Merge pull request #189 from Kattos/main Atream 2025-02-13 10:24:01 +08:00
• 9b5fd55a3c Merge pull request #190 from kvcache-ai/KMSorSMS-patch-2 ZiWei Yuan 2025-02-13 10:18:08 +08:00
• 36ab3d7e6c Update README.md ZiWei Yuan 2025-02-13 10:17:56 +08:00
• 01655f7500 fix typo in README.md cuichengyi 2025-02-13 10:12:04 +08:00
• a0c16db352 Merge pull request #183 from kvcache-ai/update-WeChatgroup Atream 2025-02-13 09:16:30 +08:00
• 78cc219274 Delete WeChatGrouop.jpg Atream 2025-02-13 09:15:57 +08:00
• ea76f7910a Add files via upload Atream 2025-02-13 09:15:30 +08:00
• 8384badc69 doc: fix clerical error lusipad 2025-02-13 07:27:27 +08:00
• c1f13a69ed Correctly import compat layer from llama.cpp fxzjshm 2025-02-13 03:15:22 +08:00
• 38e5dbc895 Fix symbol lookup fxzjshm 2025-02-13 03:14:35 +08:00
• ae76a729d8 gptq_marlin: temporarily disable on AMD ROCm fxzjshm 2025-02-13 02:03:22 +08:00
• 4cda45433f Don't add CUDA version to version in case not for CUDA fxzjshm 2025-02-13 00:59:28 +08:00
• 21fca5a326 Add compat layer from llama.cpp fxzjshm 2025-02-13 00:58:59 +08:00
• 9a3d4c290c Merge pull request #170 from feeeei/main Atream 2025-02-12 18:27:11 +08:00
• e7dd5b250d Update release date info feeeei 2025-02-12 17:47:22 +08:00
• 9e42f33c29 Merge pull request #166 from kvcache-ai/update-yaml Azure 2025-02-12 17:00:04 +08:00
• 101db0e9de Merge branch 'main' into update-yaml Azure 2025-02-12 08:56:03 +00:00
• 3897f001f5 update FAQ Azure 2025-02-12 08:50:58 +00:00
• 7e58f9d254 Merge pull request #165 from kvcache-ai/KMSorSMS-patch-1 ZiWei Yuan 2025-02-12 16:44:10 +08:00
• 193d6300bf Update FAQ.md ZiWei Yuan 2025-02-12 16:43:57 +08:00