Commit Graph

Select branches

Hide Pull Requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

ci/four-main-pypi-release

ci/model-e2e-acceptance

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

docs/kt-ft-figure2-single-column-20261010

docs/kt-ft-paper-20261008

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/glm53-index-share-sync

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

perf/bf16-grad-norm-20261010

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/0.7.0.post3-frozen-pypi

release/20260911-carrier-repair

release/20260911-ci-python

release/20260911-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#2068

#2069

#2070

#2071

#2074

#2075

#2079

#2080

#2082

#2085

#2085

#2086

#2088

#2089

#2091

#2092

#2093

#2093

#2094

#2095

#2095

#2096

#2096

#2097

#2097

#2101

#2101

#2102

#2102

#2103

#2103

#2104

#2105

#2111

#2111

#2112

#2114

#2116

#2117

#2119

#2119

#2120

#2120

#2121

#2121

#2122

#2122

#2123

#2123

#2124

#2124

#2125

#2125

#2126

#2126

#2129

#2129

#2130

#2130

#2131

#2131

#2132

#2132

#2133

#2133

#2134

#2134

#2135

#2135

#2136

#2137

#2137

#2138

#2138

#2140

#2141

#2142

#2142

#2152

#2153

#2153

#2154

#2155

#2155

#2156

#2157

#2158

#2159

#2160

#2161

#2161

#2162

#2163

#2164

#2165

#2166

#2167

#2168

#2168

#2169

#2170

#2171

#2173

#2174

#2174

#2175

#2176

#2177

#2180

#2181

#2182

#2185

#2186

#2187

#2188

#2190

#2190

#2191

#2193

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#220

#2200

#2201

#2201

#2202

#2203

#2204

#2205

#2206

#2207

#2209

#2210

#2211

#2212

#2212

#2215

#2215

#2216

#2217

#2217

#2219

#2219

#2220

#2223

#2224

#2225

#2228

#2229

#2229

#2231

#2231

#2232

#2233

#2234

#2235

#2236

#2236

#2237

#2237

#2238

#2238

#2239

#2239

#224

#2240

#2240

#2241

#2241

#2242

#2242

#2243

#2246

#2246

#2247

#2248

#2248

#2250

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

paper-ktft-v1

paper-ktft-v1.1

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

v0.7.0.post4

v0.7.1

v0.7.2

Mono Color

• e961adde15 docs: update long_context_introduction.md Ikko Eltociear Ashimine 2024-08-30 03:34:39 +09:00
• f536a7085f Merge pull request #62 from Azure-Tang/main UnicornChan 2024-08-29 23:40:21 +08:00
• 8747c099f2 update yaml example; update version idx; update docker file TangJingqi 2024-08-29 22:39:20 +08:00
• 6735beb5b6 Fix cannot offload whole layer in cpu TangJingqi 2024-08-29 19:10:14 +08:00
• 35d7aed207 Merge pull request #60 from sammcj/patch-1 Atream 2024-08-29 19:01:16 +08:00
• 0b57627bb9 fix(docs): fix broken link Sam 2024-08-29 20:00:55 +10:00
• 1dcb8dae5b Merge pull request #58 from Azure-Tang/main Azure 2024-08-29 14:39:58 +08:00
• 440d827e7c update readme TangJingqi 2024-08-29 12:04:56 +08:00
• abd4214b56 fix readme; adjust param TangJingqi 2024-08-29 10:40:08 +08:00
• 233bbb8c55 Merge pull request #57 from UnicornChan/develop-0.1.3 v0.1.3 UnicornChan 2024-08-29 01:57:34 +08:00
• 4d1d561d28 [feature] release 0.1.3 chenxl 2024-08-28 16:11:43 +00:00
• 67f8b370c3 Merge pull request #56 from hyx1999/patch-1 UnicornChan 2024-08-28 14:30:38 +08:00
• ea1143e54e Update README.md _HYX_ 2024-08-28 12:15:38 +08:00
• 0f054fe4ff Merge pull request #52 from UnicornChan/fix-bug-load-config UnicornChan 2024-08-22 23:54:17 +08:00
• b9f0819a86 None for load config chenxl 2024-08-22 15:52:25 +00:00
• 1f85db3d73 Merge pull request #51 from molamooo/fix-f16-dequantize-device UnicornChan 2024-08-22 16:31:45 +08:00
• 29f4151ebc [fix] f16 dequantize device ignored molamooo 2024-08-22 15:10:06 +08:00
• cbc47d0b68 Merge pull request #48 from Azure-Tang/main UnicornChan 2024-08-21 23:24:46 +08:00
• 170b7a6001 fix server don't accept yaml path as param; fix server static cache device problem TangJingqi 2024-08-21 14:19:43 +08:00
• 4358722891 Merge pull request #41 from Azure-Tang/main Azure 2024-08-16 15:27:01 +08:00
• 4a0f1cbbfa Update readme TangJingqi 2024-08-16 15:22:16 +08:00
• f681eb4a0f Merge branch 'kvcache-ai:main' into main Azure 2024-08-16 15:21:41 +08:00
• b25ad4ec32 Merge pull request #39 from Azure-Tang/develop-0.1.2 Azure 2024-08-16 11:29:11 +08:00
• 4f87756c2e fix broken link TangJingqi 2024-08-16 11:10:30 +08:00
• 7199699d78 Fix the broken link TangJingqi 2024-08-16 10:59:34 +08:00
• e81fc482ff update README Azure 2024-08-15 16:59:26 +00:00
• 6bcec86fa0 update README Azure 2024-08-15 16:54:31 +00:00
• 77a34c289c Merge pull request #36 from kvcache-ai/develop-0.1.2 v0.1.2 UnicornChan 2024-08-15 20:59:50 +08:00
• 395cd3e786 Merge pull request #35 from Azure-Tang/develop-0.1.2 UnicornChan 2024-08-15 20:56:22 +08:00
• de3faaf55d Update readme; add pipeline tutorial; add detailed inject tutorial TangJingqi 2024-08-15 20:42:54 +08:00
• c9bf79299b Merge pull request #34 from Azure-Tang/develop-0.1.2 UnicornChan 2024-08-15 11:28:19 +08:00
• c47205dce9 fix name TangJingqi 2024-08-15 11:25:12 +08:00
• 67043b4b5c [fix] format classes and files name TangJingqi 2024-08-15 10:44:59 +08:00
• 1db4a67dca [feature] add github action for pre compile chenxl 2024-08-14 16:54:50 +00:00
• 412055d450 [feature] experts can be injected using CPUInfer [fix] fix ktransformers interface when use new CUDAGraphRunner [fix] fix YAML and optimize logic, the top rule has the highest priority Atream 2024-08-14 16:10:54 +08:00
• 80815dbc50 Merge pull request #30 from BITcyman/feature-lc-dequantize_q2k_q3k_gpu UnicornChan 2024-08-12 21:02:32 +08:00
• 7c4cb520bd [feature] support q2_k & q3_k dequantize on gpu BITcyman 2024-08-12 12:53:12 +00:00
• 650c368c18 Merge remote-tracking branch 'upstream/main' into develop-0.1.2 chenxl 2024-08-12 12:31:49 +00:00
• 44f57270c9 Merge pull request #29 from kvcache-ai/fix]-fix-linux-mutex UnicornChan 2024-08-12 20:14:04 +08:00
• 3c675af61a Update task_queue.h Atream 2024-08-12 20:06:19 +08:00
• f5f79f5c0e [ADD] support multi-gpu qlen>1 q5_k chenxl 2024-08-12 11:17:29 +00:00
• f293803156 Merge pull request #27 from chenht2022/develop-0.1.2 UnicornChan 2024-08-09 17:57:27 +08:00
• cb7f8e7817 Merge pull request #26 from kvcache-ai/windows UnicornChan 2024-08-09 17:57:00 +08:00
• 782a17e4e6 [feature] add bat for windows, update readme chenxl 2024-08-09 09:39:42 +00:00
• c1cc7d2cd2 1) Linear and MLP operators support qlen>1; 2) All operators now share a single memory buffer; 3) Refactor CPUInfer submit/sync logic. chenht2022 2024-08-08 09:04:36 +00:00
• 1f92f7cc61 [fix] linux and windows can all find CPUInfer in current Directory Atream 2024-08-08 16:02:42 +08:00
• 11544ef2b0 Merge pull request #25 from kvcache-ai/windows UnicornChan 2024-08-08 16:01:54 +08:00
• 0e613b602d [fix] recover fp16 support Atream 2024-08-08 15:42:21 +08:00
• 1d9d397525 fix some bug in compile in linux chenxl 2024-08-08 04:26:58 +00:00
• 0a2fd52cea support windows support q4_0 and q5_0 dequant on cpu Add CopyRight from pygguf(It was added before, but disappear after merge). Add some TODO in the code. Atream 2024-08-07 12:19:06 +08:00
• 442e13bc97 Merge pull request #18 from UnicornChan/update-docker-readme UnicornChan 2024-08-01 15:40:47 +08:00
• 69fa2f4395 update docker.md support docker pull image chenxl 2024-08-01 07:39:48 +00:00
• 5e83bc0c82 Merge pull request #17 from UnicornChan/feature-support-multi-instruct v0.1.1 UnicornChan 2024-08-01 12:29:07 +08:00
• 86ba1336a9 [feature] add support for building docker image chenxl 2024-08-01 04:01:00 +00:00
• 112cb3c962 [feature] support python 310 and multi instruction chenxl 2024-07-31 13:58:17 +00:00
• 25620829ce Merge pull request #14 from UnicornChan/feature-support-pypi v0.1.0 UnicornChan 2024-07-29 19:58:18 +08:00
• dd18a11cab [feature] support for pypi install chenxl 2024-07-29 11:51:28 +00:00
• a25320b703 Update README.md Allen 2024-07-27 23:40:08 +08:00
• 8629301b7f Update README.md UnicornChan 2024-07-27 23:36:13 +08:00
• de13c3e7cd Update README.md UnicornChan 2024-07-27 23:27:32 +08:00
• 1ac7bfd75e Update README.md UnicornChan 2024-07-27 23:19:49 +08:00
• 6977ebb555 Merge pull request #7 from kvcache-ai/james0zan-patch-1 Mingxing Zhang 2024-07-27 23:12:59 +08:00
• 935c28c277 Update README.md Mingxing Zhang 2024-07-27 23:12:00 +08:00
• 01df4a6b3f Update README.md Mingxing Zhang 2024-07-27 23:07:31 +08:00
• 18c42e67df Initial commit chenxl 2024-07-27 16:06:58 +08:00