Commit Graph

Select branches

Hide Pull Requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

ci/four-main-pypi-release

ci/model-e2e-acceptance

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

docs/kt-ft-figure2-single-column-20261010

docs/kt-ft-paper-20261008

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/glm53-index-share-sync

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

perf/bf16-grad-norm-20261010

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/0.7.0.post3-frozen-pypi

release/20260911-carrier-repair

release/20260911-ci-python

release/20260911-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#2068

#2069

#2070

#2071

#2074

#2075

#2079

#2080

#2082

#2085

#2085

#2086

#2088

#2089

#2091

#2092

#2093

#2093

#2094

#2095

#2095

#2096

#2096

#2097

#2097

#2101

#2101

#2102

#2102

#2103

#2103

#2104

#2105

#2111

#2111

#2112

#2114

#2116

#2117

#2119

#2119

#2120

#2120

#2121

#2121

#2122

#2122

#2123

#2123

#2124

#2124

#2125

#2125

#2126

#2126

#2129

#2129

#2130

#2130

#2131

#2131

#2132

#2132

#2133

#2133

#2134

#2134

#2135

#2135

#2136

#2137

#2137

#2138

#2138

#2140

#2141

#2142

#2142

#2152

#2153

#2153

#2154

#2155

#2155

#2156

#2157

#2158

#2159

#2160

#2161

#2161

#2162

#2163

#2164

#2165

#2166

#2167

#2168

#2168

#2169

#2170

#2171

#2173

#2174

#2174

#2175

#2176

#2177

#2180

#2181

#2182

#2185

#2186

#2187

#2188

#2190

#2190

#2191

#2193

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#220

#2200

#2201

#2201

#2202

#2203

#2204

#2205

#2206

#2207

#2209

#2210

#2211

#2212

#2212

#2215

#2215

#2216

#2217

#2217

#2219

#2219

#2220

#2223

#2224

#2225

#2228

#2229

#2229

#2231

#2231

#2232

#2233

#2234

#2235

#2236

#2236

#2237

#2237

#2238

#2238

#2239

#2239

#224

#2240

#2240

#2241

#2241

#2242

#2242

#2243

#2246

#2246

#2247

#2248

#2248

#2250

#2251

#2251

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

paper-ktft-v1

paper-ktft-v1.1

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

v0.7.0.post4

v0.7.1

v0.7.2

Mono Color

• f46b3fd51c Merge pull request #778 from Conless/fix-shape Atream 2025-03-03 19:58:52 +08:00
• 01755a60c0 fix: wrong shape in KLinearMarlin. Yi Pan 2025-03-03 17:34:37 +08:00
• 4e43e8a4ee Merge pull request #775 from kvcache-ai/Atream-patch-1 Atream 2025-03-03 16:50:02 +08:00
• 8963ae7817 Update __init__.py Atream 2025-03-03 16:49:50 +08:00
• 659583a92c Merge pull request #770 from SkqLiao/main Atream 2025-03-03 14:35:26 +08:00
• 216a63b858 Merge pull request #754 from moonshadow-25/dev023 Azure 2025-03-03 14:19:33 +08:00
• 7d96e2eeba fix environment name Jiaqi Liao 2025-03-03 14:01:40 +08:00
• 3d62579a6a fix environment name Jiaqi Liao 2025-03-03 13:55:40 +08:00
• 5fe0d138ca add install job for self-host testing Jiaqi Liao 2025-03-03 13:52:13 +08:00
• 48b9800790 Merge pull request #759 from 3wweiweiwu/fix_top_p_typo v0.2.2 wang jiahao 2025-03-02 13:58:11 +08:00
• bb54b68e5c Merge pull request #761 from kvcache-ai/fix-server-bug wang jiahao 2025-03-02 13:56:46 +08:00
• 7cdf8139f0 fix ollama api temperature bug 1668068727@qq.com 2025-03-02 13:55:26 +08:00
• 3aa0cfc29d fix typo for top_p Wix Woo 2025-03-01 20:15:36 +00:00
• 69382e58f9 Merge pull request #313 from MuWinds/main Atream 2025-03-01 23:24:44 +08:00
• ca1dc1e7d1 Merge branch 'main' into main Atream 2025-03-01 23:24:10 +08:00
• 505f4e2c35 Merge pull request #753 from ningpengtao-coder/main Atream 2025-03-01 23:22:13 +08:00
• d24d369332 iq1s files moonshadow-25 2025-03-01 22:44:06 +08:00
• c513ae59c3 iq1s files moonshadow-25 2025-03-01 22:38:04 +08:00
• 71286ec1c0 Update local_chat.py 宁鹏涛 2025-03-01 21:52:48 +08:00
• 9781d1e6f4 iq1s core moonshadow-25 2025-03-01 21:48:25 +08:00
• 93c5b75716 rem godrosev 2025-03-01 21:25:18 +08:00
• e6349eb240 iq1s godrosev 2025-03-01 21:00:11 +08:00
• c7e05926e0 deploy: 761de49843 Atream 2025-03-01 11:57:13 +00:00
• 761de49843 Merge pull request #751 from kvcache-ai/Atream-patch-2 Atream 2025-03-01 19:57:00 +08:00
• 735873a32a Update DeepseekR1_V3_tutorial.md Atream 2025-03-01 19:56:46 +08:00
• bd33a59ecf Merge pull request #750 from kvcache-ai/feat-chunk-prefill-flashinfer Atream 2025-03-01 19:50:52 +08:00
• fa03ea48dd Merge branch 'main' into feat-chunk-prefill-flashinfer Atream 2025-03-01 11:35:09 +00:00
• f35e8d41d8 support chunk prefill, support 139K context for 24G VRAM Atream 2025-03-01 11:28:25 +00:00
• 9b41720d20 🔖 release 0.2.2rc2 v0.2.2rc2 liam 2025-03-01 13:36:01 +08:00
• 511958d49c Merge pull request #743 from KMSorSMS/main ZiWei Yuan 2025-03-01 00:17:53 +08:00
• 80e0536fb0 Merge branch 'main' of https://github.com/KMSorSMS/ktransformers into main liam 2025-03-01 00:12:21 +08:00
• 8ddc990668 ⚡ fix server cache lens liam 2025-03-01 00:09:57 +08:00
• 494469d4c5 Merge pull request #722 from ZhangShuaiyi/remove_unused Atream 2025-02-28 15:04:21 +08:00
• 71f4599dee 📝 rm test_prompt liam 2025-02-28 11:44:49 +08:00
• 1264f9407b Merge pull request #732 from KMSorSMS/main ZiWei Yuan 2025-02-28 11:28:06 +08:00
• a0e7afa432 ⚡ fox docker build liam 2025-02-28 11:25:34 +08:00
• add415124f Merge pull request #731 from Azure-Tang/update-template Azure 2025-02-28 11:19:52 +08:00
• bc52969918 fix name Azure 2025-02-28 03:17:33 +00:00
• 0439cb36d4 Merge pull request #730 from Azure-Tang/update-template Azure 2025-02-28 11:10:29 +08:00
• 31b01f5b99 update ZH/EN template Azure 2025-02-28 03:09:06 +00:00
• a34a25d5cc Delete unused code Shuaiyi 2025-02-27 13:18:19 +00:00
• 7a19f3b781 Merge pull request #721 from kvcache-ai/fix_temperature wang jiahao 2025-02-27 21:01:21 +08:00
• 22df52e94e fix temperature qiyuxinlin 2025-02-27 21:00:44 +08:00
• 85e2cc7bf4 Merge pull request #719 from kvcache-ai/fix-use-generation-json Atream 2025-02-27 19:49:41 +08:00
• e645d84794 use generation config from json file in official repo Atream 2025-02-27 11:48:34 +00:00
• 5e3c6b4f97 Merge pull request #644 from wtdcode/temperature_top_p_from_request wang jiahao 2025-02-27 18:13:13 +08:00
• b121ca4df8 Fix according to upstream changes lazymio 2025-02-27 18:11:35 +08:00
• 26f7b4af11 Merge branch 'main' into temperature_top_p_from_request wang jiahao 2025-02-27 18:08:55 +08:00
• 1f28f75f55 Merge pull request #717 from kvcache-ai/issue-template Azure 2025-02-27 18:02:34 +08:00
• c61805dd0a Update issue templates Azure 2025-02-27 17:53:27 +08:00
• 50c691297f Merge pull request #622 from akemimadoka/fix-msvc Atream 2025-02-27 17:42:00 +08:00
• 0422152cf3 Merge pull request #670 from akemimadoka/fix-win Atream 2025-02-27 17:40:27 +08:00
• 798e1d0cfa Merge pull request #532 from xv44586/fix-sse-formatting Atream 2025-02-27 12:19:23 +08:00
• f403cde6d4 Merge pull request #650 from ceerRep/main Atream 2025-02-27 12:16:53 +08:00
• 1d5d5faef6 Merge pull request #626 from cyhasuka/main Atream 2025-02-27 12:13:10 +08:00
• 8db6a4d402 Merge branch 'main' into main Atream 2025-02-27 12:12:32 +08:00
• 3c8c580580 Merge pull request #691 from swu-hyk/ollama_api_chat wang jiahao 2025-02-27 11:17:48 +08:00
• 74c92ee5c9 deploy: ca93cf7548 Azure-Tang 2025-02-26 15:45:38 +00:00
• ca93cf7548 Merge pull request #702 from Azure-Tang/update-readme Azure 2025-02-26 23:45:24 +08:00
• c05ebb74b1 Update fp8 doc; Update install.md broken link Azure 2025-02-26 15:43:08 +00:00
• df3866caa5 deploy: 3ebe17eb63 Atream 2025-02-26 14:05:02 +00:00
• 3ebe17eb63 Merge pull request #699 from kvcache-ai/Atream-patch-1 Atream 2025-02-26 22:04:45 +08:00
• 369f4d917d Update DeepseekR1_V3_tutorial.md Atream 2025-02-26 22:04:29 +08:00
• 9650893adc Merge pull request #697 from kvcache-ai/fix-yaml Atream 2025-02-26 21:54:01 +08:00
• 90eb87b3fc Update DeepSeek-V3-Chat-multi-gpu-marlin.yaml Atream 2025-02-26 21:53:50 +08:00
• ec7e912fee modify swu-hyk 2025-02-26 19:21:30 +08:00
• 68e7df3a25 implementation of chat routing for Ollama swu-hyk 2025-02-26 17:05:00 +08:00
• 9660b2cc1e Merge pull request #685 from vproxy-tools/main Chen Hongtao 2025-02-26 15:35:19 +08:00
• e7ebb26370 Merge pull request #684 from KMSorSMS/main ZiWei Yuan 2025-02-26 15:06:51 +08:00
• ffb86c66e3 ⚡ fix experts torch liam 2025-02-26 15:04:25 +08:00
• de082f141c ⚡ fix cd error liam 2025-02-26 14:54:47 +08:00
• b2bff17775 fix numa cpu distribution wkgcass 2025-02-26 14:48:22 +08:00
• 8817777e11 Fix RuntimeError on Windows caused by integer overflow in np.prod akemimadoka 2025-02-26 03:50:12 +08:00
• b9680cf5a4 deploy: 99f6e42113 Azure-Tang 2025-02-25 17:09:50 +00:00
• 312d29f24e deploy: 31bc990677 Azure-Tang 2025-02-25 16:27:53 +00:00
• 99f6e42113 Merge pull request #668 from KMSorSMS/main Azure 2025-02-26 00:21:09 +08:00
• 3ad12751cf 📝 update more detail and fix typo liam 2025-02-26 00:17:02 +08:00
• 31bc990677 Merge pull request #667 from Azure-Tang/update-readme Azure 2025-02-26 00:01:46 +08:00
• 05339ad0ef 📝 update benchmark.md liam 2025-02-25 23:56:19 +08:00
• bb6920ed72 update doc Azure 2025-02-25 15:46:15 +00:00
• 9c71bcb0bb Merge pull request #665 from KMSorSMS/v0.2.2rc1 v0.2.2rc1 ZiWei Yuan 2025-02-25 22:07:19 +08:00
• ddf3339339 ⚡ release v0.2.2rc1 liam 2025-02-25 22:06:36 +08:00
• ac8307a849 deploy: 8333a4d874 Azure-Tang 2025-02-25 13:47:57 +00:00
• 8333a4d874 Merge pull request #663 from kvcache-ai/develop-0.2.2 Azure 2025-02-25 21:47:36 +08:00
• c6e4e1c3c5 Merge pull request #662 from Azure-Tang/support-fp8 Azure 2025-02-25 21:45:19 +08:00
• 91c1619296 Merge branch 'develop-0.2.2' into support-fp8 Update README.md Azure 2025-02-25 13:36:21 +00:00
• 13974eb264 Update DeepseekR1_V3_tutorial.md Atream 2025-02-25 21:36:52 +08:00
• 03f8bc9f79 Update DeepseekR1_V3_tutorial.md add long context Atream 2025-02-25 21:35:31 +08:00
• 2c0cce90d0 add fp8 multi gpu yaml example Azure 2025-02-25 13:32:09 +00:00
• d9b2895bd3 Merge branch 'fix-update-flashinfer_wrapper_local_chat' into develop-0.2.2 Atream 2025-02-25 12:47:48 +00:00
• 477ac28a9c fix-update-flashinfer_wrapper_local_chat Atream 2025-02-25 12:47:31 +00:00
• 7e5962af3d fix fp8 multi gpu; update FQA Azure 2025-02-25 10:52:29 +00:00
• 89b55052b8 Merge pull request #659 from KMSorSMS/develop-0.2.2 ZiWei Yuan 2025-02-25 17:47:05 +08:00
• 1b5ac67fca 📝 add benchmark.md liam 2025-02-25 17:45:17 +08:00
• 1aa10e93b3 Merge pull request #658 from KMSorSMS/develop-0.2.2 ZiWei Yuan 2025-02-25 17:22:34 +08:00
• 0ca0b99fab ⚡ update git ignore add docker dev container liam 2025-02-25 17:19:19 +08:00
• 5474be5299 Merge branch 'main' into develop-0.2.2 Azure 2025-02-25 09:04:22 +00:00
• 021822dd01 update FAQ Azure 2025-02-25 09:02:32 +00:00
• b443c7dfa2 Merge pull request #657 from kvcache-ai/feat-absorb-for-long-prefill Atream 2025-02-25 16:53:21 +08:00
• f4c198bd42 support absorb for prefill long context Atream 2025-02-25 08:52:02 +00:00