Commit Graph

Select branches

Hide Pull Requests

ErvinXie-patch-1

JimmyPeilinLi-patch-1

JimmyPeilinLi-patch-2

add-maintainers

archive-kt-sft

auto/sync-sglang

avx2

bump-sglang-pr31

chore/kt-layerwise-prefill-label

chore/kt-layerwise-prefill-main

chore/kt-run-numa-nodes-unified

ci/four-main-pypi-release

ci/model-e2e-acceptance

cli-dev-ljq

cpu-fix

debug_llama

doc-reorg-entrypoints-support-matrix

docs-v061-refresh

docs/deepseek-v4-flash-docker

docs/gosim-2026-and-roadmap-link

docs/kt-ft-figure2-single-column-20261010

docs/kt-ft-paper-20261008

experts_sched

feat/mistral-loader-support

fix-deploy-djw

fix-docker-build

fix-import

fix/avx2-wheel-feature-isolation

fix/glm53-index-share-sync

fix/release-self-hosted-runner

fix/sglang-kt-detection

flatten-ktransformers-shim

fp4-moe-amx

gh-pages

glm47_fp8

hotfix/0.7.0.post2-pypi-runtime

kimi_k2.5

ksft-llama

ksft-sglang

kt-kernel-torch-range-v061

layerwise-prefill-opt

ljq-cli-dev

ljq-cli-dev-new

ljq-dev-1

lut-nvfp4

main

minimax-m2.5

mtp

oql-dev

oql-doc

ovowei-patch-1

ovowei-patch-2

ovowei-patch-3

perf/bf16-grad-norm-20261010

qwen3.5

refactor_sft

refactor_sft_int4_debug

release/0.7.0.post2-frozen-pypi

release/0.7.0.post3-frozen-pypi

release/20260911-carrier-repair

release/20260911-ci-python

release/20260911-pypi

release/automate-kt-sft-pypi

release/v0.5.3

revert-1918-fix/rocm-cpuinfer-stream-bridge

route-moe

sft

sft-rel

sft-whl

sosp25-ae

support-glm5-next-djw

support-glm51-djw

support-glm52-djw

#1005

#1013

#1015

#1024

#1027

#1029

#1030

#1031

#1033

#1034

#1042

#1043

#1044

#1049

#106

#1060

#1063

#1064

#1069

#1079

#1084

#1085

#1090

#1091

#1095

#1096

#1097

#1098

#1099

#110

#1100

#1101

#1103

#1108

#1109

#1116

#1132

#1134

#1135

#1137

#1143

#115

#1154

#1157

#1158

#1159

#1160

#1163

#1165

#1167

#1168

#1170

#1172

#1177

#118

#1180

#1182

#1183

#1184

#1186

#1188

#1193

#1197

#1198

#1202

#1204

#1210

#1211

#1212

#1215

#1216

#1217

#1218

#1219

#122

#1220

#1221

#1222

#1223

#1224

#1225

#1227

#123

#124

#1241

#1244

#1245

#1246

#1247

#126

#1266

#127

#1270

#1271

#1276

#1277

#128

#1280

#1289

#1295

#1296

#1297

#1298

#1300

#1301

#1303

#1304

#1305

#1306

#1307

#1311

#1313

#1320

#1323

#1328

#1331

#1337

#1342

#1343

#135

#1350

#1351

#1358

#1361

#1366

#1372

#1379

#1398

#1399

#14

#1405

#1407

#1409

#141

#1410

#142

#1422

#1428

#143

#1431

#1432

#1434

#1435

#1436

#1437

#1438

#1439

#144

#1449

#1452

#1456

#1457

#1458

#1458

#1466

#1487

#1493

#1494

#1495

#1498

#1500

#1505

#1506

#151

#152

#1520

#1521

#1522

#1523

#1525

#1527

#1529

#153

#1530

#1531

#1535

#1538

#1540

#1542

#1543

#1545

#1547

#1548

#1549

#1550

#1551

#1552

#1554

#1557

#1558

#1559

#1560

#1561

#1562

#1564

#1568

#1569

#1571

#1572

#1573

#1574

#1576

#158

#1581

#1583

#1584

#1585

#1586

#1587

#1588

#1589

#1590

#1592

#1594

#1595

#1596

#1597

#1599

#160

#1600

#1602

#1603

#1604

#1606

#1607

#1609

#1613

#1614

#1615

#1616

#1617

#1619

#1621

#1622

#1623

#1624

#1625

#1626

#1629

#163

#1630

#1631

#1632

#1634

#1636

#1638

#1640

#1642

#1643

#1644

#1646

#1647

#1648

#165

#1653

#1656

#1659

#166

#1660

#1662

#1663

#1668

#1669

#1670

#1671

#1672

#1673

#1674

#1675

#1683

#1684

#1685

#1686

#1687

#1691

#1695

#1696

#1698

#1699

#17

#170

#1702

#1703

#1704

#1706

#1707

#1708

#1712

#1716

#1717

#1718

#1719

#1720

#1721

#1722

#1723

#1724

#1725

#1726

#1728

#1729

#1731

#1733

#1734

#1735

#1737

#1738

#1739

#1740

#1742

#1743

#1744

#1745

#1746

#1748

#1749

#1752

#1763

#1764

#1765

#1766

#1768

#1769

#1770

#1771

#1772

#178

#1780

#1783

#1784

#1788

#1789

#1791

#1796

#1797

#1798

#1799

#18

#180

#1800

#1801

#1802

#1805

#1807

#1808

#1810

#1811

#1812

#1814

#1819

#1821

#1822

#1823

#1824

#1825

#1828

#183

#1830

#1833

#1834

#1837

#1838

#1840

#1844

#1845

#1846

#1848

#1849

#1850

#1851

#1853

#1857

#1862

#1872

#1873

#1875

#1876

#1886

#1887

#189

#1890

#1891

#1892

#1899

#190

#1900

#1901

#1902

#1903

#1904

#1906

#1908

#1909

#1916

#1918

#1919

#1920

#1923

#1925

#1926

#1927

#1929

#1932

#1934

#1935

#1936

#1937

#1941

#1942

#1944

#1945

#1948

#1950

#1952

#1953

#1954

#1955

#1957

#1958

#1959

#1962

#1963

#1964

#1965

#1966

#1967

#1970

#1972

#1973

#1974

#1975

#1976

#1979

#1980

#1984

#1986

#1987

#1991

#1993

#1994

#1995

#1997

#2

#200

#2003

#2003

#2005

#2006

#2010

#2014

#2015

#2018

#2020

#2020

#2021

#2022

#2025

#2026

#2028

#2029

#2031

#2032

#2033

#2037

#2041

#2043

#2043

#2044

#2046

#2047

#2048

#2049

#2051

#2052

#2054

#2055

#2057

#2059

#2062

#2063

#2064

#2064

#2068

#2069

#2070

#2071

#2074

#2075

#2079

#2080

#2082

#2085

#2085

#2086

#2088

#2089

#2091

#2092

#2093

#2093

#2094

#2095

#2095

#2096

#2096

#2097

#2097

#2101

#2101

#2102

#2102

#2103

#2103

#2104

#2105

#2111

#2111

#2112

#2114

#2116

#2117

#2119

#2119

#2120

#2120

#2121

#2121

#2122

#2122

#2123

#2123

#2124

#2124

#2125

#2125

#2126

#2126

#2129

#2129

#2130

#2130

#2131

#2131

#2132

#2132

#2133

#2133

#2134

#2134

#2135

#2135

#2136

#2137

#2137

#2138

#2138

#2140

#2141

#2142

#2142

#2152

#2153

#2153

#2154

#2155

#2155

#2156

#2157

#2158

#2159

#2160

#2161

#2161

#2162

#2163

#2164

#2165

#2166

#2167

#2168

#2168

#2169

#2170

#2171

#2173

#2174

#2174

#2175

#2176

#2177

#2180

#2181

#2182

#2185

#2186

#2187

#2188

#2190

#2190

#2191

#2193

#2193

#2194

#2195

#2196

#2197

#2198

#2199

#220

#2200

#2201

#2201

#2202

#2203

#2204

#2205

#2206

#2207

#2209

#2210

#2211

#2212

#2212

#2215

#2215

#2216

#2217

#2217

#2219

#2219

#2220

#2223

#2224

#2225

#2228

#2229

#2229

#2231

#2231

#2232

#2233

#2234

#2235

#2236

#2236

#2237

#2237

#2238

#2238

#2239

#2239

#224

#2240

#2240

#2241

#2241

#2242

#2242

#2243

#2246

#2246

#2247

#2248

#2248

#2250

#227

#229

#230

#232

#237

#238

#24

#247

#25

#254

#255

#26

#27

#280

#284

#29

#290

#294

#295

#30

#301

#305

#306

#307

#313

#315

#316

#317

#324

#327

#329

#330

#333

#34

#341

#35

#354

#355

#357

#36

#38

#382

#384

#39

#40

#401

#406

#41

#412

#413

#421

#43

#442

#445

#450

#476

#48

#481

#487

#501

#506

#51

#52

#523

#532

#550

#56

#57

#577

#58

#582

#583

#597

#60

#608

#612

#62

#621

#622

#626

#638

#64

#640

#643

#644

#645

#650

#651

#654

#657

#658

#659

#662

#663

#664

#665

#667

#668

#67

#670

#684

#685

#691

#697

#699

#7

#702

#71

#717

#719

#72

#721

#722

#730

#731

#732

#743

#750

#751

#753

#754

#759

#761

#77

#770

#775

#778

#781

#787

#791

#795

#798

#799

#803

#808

#809

#81

#810

#813

#814

#815

#819

#820

#83

#835

#839

#840

#842

#847

#848

#852

#86

#88

#880

#886

#889

#891

#892

#893

#897

#898

#899

#902

#904

#906

#911

#913

#915

#916

#925

#926

#927

#931

#935

#936

#940

#943

#954

#956

#970

#974

#978

#99

#998

paper-ktft-v1

paper-ktft-v1.1

v0.1.0

v0.1.1

v0.1.2

v0.1.3

v0.1.4

v0.2.0

v0.2.1

v0.2.1.post1

v0.2.2

v0.2.2rc1

v0.2.2rc2

v0.2.3

v0.2.3post1

v0.2.3post2

v0.2.4

v0.2.4post1

v0.3

v0.3.1

v0.3.2

v0.4.1

v0.4.2

v0.4.3

v0.4.4

v0.5.0

v0.5.0.post1

v0.5.1

v0.5.2.post1

v0.5.3

v0.6.1

v0.6.1.post1

v0.6.2

v0.6.2.post1

v0.6.2.post2

v0.6.2.post3

v0.6.3

v0.6.3.post1

v0.6.4

v0.7.0

v0.7.0.post1

v0.7.0.post4

v0.7.1

v0.7.2

Mono Color

• 370b21e536 Merge pull request #163 from kvcache-ai/update-wechatgroup-1 Atream 2025-02-12 16:33:32 +08:00
• 9a9fd0167f Add files via upload Atream 2025-02-12 16:33:20 +08:00
• 62011fd63e Merge pull request #158 from jinmmd/patch-1 Atream 2025-02-12 15:58:40 +08:00
• 660730e55c Merge pull request #160 from kvcache-ai/updata-wechatgroup Atream 2025-02-12 15:58:08 +08:00
• 9c717651c5 Add files via upload Atream 2025-02-12 15:57:55 +08:00
• 6e0565a275 Update README.md jinmmd 2025-02-12 14:48:56 +08:00
• 2ad7fc19f0 Merge pull request #153 from kvcache-ai/update-wechatgroup Atream 2025-02-12 12:58:23 +08:00
• 696897dfe3 update-wechatgroup Atream 2025-02-12 12:57:59 +08:00
• 4ae2e81c38 Merge pull request #152 from kvcache-ai/server_support ZiWei Yuan 2025-02-12 12:45:13 +08:00
• 4385e85096 ⚡ support force thinking liam 2025-02-12 12:43:53 +08:00
• f30c6482a5 Merge pull request #151 from kvcache-ai/update-yaml Azure 2025-02-12 12:14:37 +08:00
• 0564ac8465 update marlin expert example Azure 2025-02-12 04:11:00 +00:00
• 6f3a39be08 ⚡ update force_think config liam 2025-02-12 12:10:16 +08:00
• e536e1420d ⚡ update force_think liam 2025-02-12 11:42:55 +08:00
• a2fc2a8658 Merge pull request #144 from kvcache-ai/KMSorSMS-patch-1 ZiWei Yuan 2025-02-11 22:07:37 +08:00
• cfbdb6656a Update README.md ZiWei Yuan 2025-02-11 22:07:10 +08:00
• c47368be3e Update README.md ZiWei Yuan 2025-02-11 22:01:34 +08:00
• e34df7608c Merge pull request #143 from kvcache-ai/add-wechat-group-1 Atream 2025-02-11 20:05:07 +08:00
• 6cfa125eb7 Update README.md Atream 2025-02-11 20:04:55 +08:00
• 75c141ebce Merge pull request #142 from kvcache-ai/wechat-group Atream 2025-02-11 19:55:27 +08:00
• 6d2e50ec9a Update README.md Atream 2025-02-11 19:55:13 +08:00
• 94affa6ec9 Merge pull request #141 from kvcache-ai/add-wechat-group Atream 2025-02-11 19:50:33 +08:00
• 5c0bbdc3d7 Add files via upload Atream 2025-02-11 19:49:37 +08:00
• 2136ad6636 Merge pull request #135 from kvcache-ai/add_R1_thinking ZiWei Yuan 2025-02-11 15:45:02 +08:00
• d07087a7e2 ⚡ support R1 force thinking liam 2025-02-11 14:02:19 +08:00
• a339f573f0 Merge pull request #127 from squik67/patch-1 UnicornChan 2025-02-11 09:44:55 +08:00
• dbaecd0ca5 Merge pull request #128 from kvcache-ai/doc_add ZiWei Yuan 2025-02-10 22:15:40 +08:00
• c6c83a62ef 📝 update liam 2025-02-10 22:14:36 +08:00
• 27d16ae0a4 Update README.md squik67 2025-02-10 15:06:22 +01:00
• b890a9894a Merge pull request #126 from kvcache-ai/update-readme-add-note-of-GGUF-Path Atream 2025-02-10 21:55:34 +08:00
• a8ac931fe2 Update README.md Atream 2025-02-10 21:54:30 +08:00
• cf598db95a Merge pull request #124 from kvcache-ai/feat-DeepSeekV3 ZiWei Yuan 2025-02-10 15:07:34 +08:00
• e45e757fc8 📝 fix doc liam 2025-02-10 14:42:22 +08:00
• 7527619f53 Merge pull request #122 from kvcache-ai/feat-DeepSeekV3 v0.2.0 UnicornChan 2025-02-10 13:54:46 +08:00
• f4903d549d Merge pull request #123 from RodriMora/add_models_endpoints UnicornChan 2025-02-10 13:54:13 +08:00
• 6f0fe953e1 ⚡ release v0.2.0 liam 2025-02-10 13:52:24 +08:00
• 83401dbb3b ⚡ ready to publish liam 2025-02-10 12:29:23 +08:00
• f892d22849 ⚡ update v3 liam 2025-02-10 11:45:46 +08:00
• aecb50f0d1 ⚡ fix typo readme liam 2025-02-10 11:36:46 +08:00
• 0f73f40da0 ⚡ add Summary part liam 2025-02-10 11:31:58 +08:00
• 323cff15d1 Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 liam 2025-02-10 11:17:57 +08:00
• 3d7dfd6151 ⚡ fix typo liam 2025-02-10 11:12:52 +08:00
• 402b71446b [fix] fix pyproject.toml unicornchan 2025-02-10 03:15:26 +00:00
• 107e4be417 ⚡ fix typo liam 2025-02-10 10:50:40 +08:00
• 910d8c842a Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 liam 2025-02-10 10:15:45 +08:00
• cff68532ce ⚡ fix typo liam 2025-02-10 09:52:48 +08:00
• e968fa8d72 [feature] add flash_attn to requirements unicornchan 2025-02-10 01:52:39 +00:00
• fd481af193 ⚡ update v0.3 preview liam 2025-02-10 09:48:14 +08:00
• 6dd4fa0e87 ⚡ improve readme liam 2025-02-10 09:38:26 +08:00
• fd8037cda1 Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktrans_v0.2_dev into feat-DeepSeekV3 unicornchan 2025-02-10 01:01:14 +00:00
• c7e6d09068 [feature] update version and github action jobs for package unicornchan 2025-02-10 01:00:57 +00:00
• 2d684ee96a Small fix chenht2022 2025-02-09 16:25:43 +00:00
• 6b33f41de4 Add V0.3-preview doc chenht2022 2025-02-09 16:08:16 +00:00
• 098602b08f ⚡ v0.2 ongoing liam 2025-02-09 22:39:01 +08:00
• bf1d413be0 Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3 liam 2025-02-08 13:17:10 +08:00
• c18ecd7b7f ⚡ add flush print in local_chat output and change default optimize yaml of deepseekv3 to single gpu liam 2025-02-08 13:15:52 +08:00
• b1bff2a405 Added simple /models endpoint to work with frontends that don't allow bypass check like Openweb-ui RodriMora 2025-02-07 10:30:39 +01:00
• c4d9bc6670 support KExpertsMarlin backend Azure 2025-02-07 05:57:40 +00:00
• 0262f954c7 Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3 liam 2025-02-06 22:39:48 +08:00
• 3dca28d23b ⚡ fix moe.cpp int overflow problem liam 2025-02-06 22:39:16 +08:00
• 027b11266c modify moeinfer param Azure 2025-02-06 14:07:38 +00:00
• ee24a27001 update v3 single gpu rule yaml; Azure 2025-02-04 16:14:35 +00:00
• 907251c743 done support deepseekv3 Azure 2025-02-04 15:53:38 +00:00
• f748cd29f0 fix rope; update moegate Azure 2025-02-01 18:05:45 +00:00
• f873558a89 update rope calculation; update modeling.py; update gate for moe Azure 2025-02-01 07:32:21 +00:00
• 5a50b34627 fix hard coding caused by rope dim calculation, load from config now Azure 2025-01-31 15:25:50 +00:00
• 476b1d8dc6 support deepseekv3; runable but have precition problem Azure 2025-01-31 08:27:24 +00:00
• de7e892f72 Merge pull request #115 from KMSorSMS/main UnicornChan 2024-11-14 20:07:12 +08:00
• 04cebec4bb ⚡ rm opt config path default value and fix some config logic bug liam 2024-11-14 19:32:28 +08:00
• dddc42038d Merge pull request #110 from KMSorSMS/main UnicornChan 2024-11-06 09:44:12 +08:00
• 28ae7e24ed ✨: finish patch liam 2024-11-04 14:04:17 +08:00
• c2b4dc805c 🚑️:roll back transformer.py and find that it's multiple chat hsitory have minor accurate error liam 2024-11-01 11:01:30 +08:00
• a148da2cfe ✨: rm sensitive info in config.yaml, add readme of makefile. support old model_path config liam 2024-10-31 21:28:17 +08:00
• 9a2e7057c8 wjh fix change anyanqilin 2024-10-30 10:50:25 +00:00
• a72dc6ed15 wjh change anyanqilin 2024-10-30 10:16:45 +00:00
• 2d67016d14 wjh-change anyanqilin 2024-10-29 03:35:05 +00:00
• 7c94df4bcf 🚑️: back transformer.py bugs version, and fix typo error in local_chat.py liam 2024-10-28 21:09:40 +08:00
• dd1d8667f3 ✨: refactor local_chat and fix message slice bug in server liam 2024-10-21 22:49:05 +08:00
• a6a1cc054f Merge pull request #106 from Azure-Tang/main UnicornChan 2024-10-30 16:36:59 +08:00
• c7d62a67db update supported models TangJingqi 2024-10-28 14:37:10 +08:00
• d8ddaf0ea0 fix readme TangJingqi 2024-10-28 14:21:12 +08:00
• 43fc7f44a6 Merge pull request #99 from chenht2022/main Chen Hongtao 2024-10-09 19:09:58 +08:00
• 14869b55ad Adapt Windows chenht2022 2024-10-09 11:08:32 +00:00
• a81a7ffe21 Merge pull request #77 from TKONIY/fix-prefill-and-generate UnicornChan 2024-10-09 19:04:27 +08:00
• b4904537e3 Merge pull request #83 from sayap/task-queue-cond-var Chen Hongtao 2024-10-09 18:57:17 +08:00
• 43e8848ddd Merge pull request #86 from xhedit/main UnicornChan 2024-09-19 10:37:55 +08:00
• 49539ac424 Merge pull request #88 from Azure-Tang/main UnicornChan 2024-09-15 15:17:05 +08:00
• 7953bd9c0d update readme Azure 2024-09-13 08:47:35 +00:00
• 3758afb526 fix some dequant function dosen't support multi gpu bug Azure 2024-09-13 08:34:23 +00:00
• 234faf7987 typo fix: KMisrtal -> KMistral xhedit 2024-09-12 15:58:01 +00:00
• 6666d62237 Use cond var to avoid busy loop Yap Sok Ann 2024-09-10 19:26:17 +07:00
• 3ed8a0437f Merge pull request #72 from sayap/dequantize-iq4-xs UnicornChan 2024-09-06 10:06:10 +08:00
• ee72cee050 Fix: the tokens return by prefill_and_generate yangshen 2024-09-05 05:29:23 +00:00
• be81269e38 Merge pull request #71 from Azure-Tang/main UnicornChan 2024-09-02 14:51:05 +08:00
• c55de02f7b fix qlen > 1000 mask is none error Azure 2024-09-02 02:58:10 +00:00
• be356c1b8d Support IQ4_XS dequantize Yap Sok Ann 2024-09-02 09:03:42 +07:00
• 022b893819 Merge pull request #67 from UnicornChan/main v0.1.4 UnicornChan 2024-08-30 17:57:49 +08:00
• 49cce0c437 [fix] bugs about Qwen57B, install requirement, Dockerfile chenxl 2024-08-30 03:24:26 +00:00
• 351698c3b5 Merge pull request #64 from eltociear/patch-1 UnicornChan 2024-08-30 09:03:47 +08:00
• c80490a95e [fix] some bugs while package in github action chenxl 2024-08-29 16:03:59 +00:00