mirror of
https://github.com/kvcache-ai/ktransformers.git
synced 2026-10-28 13:44:09 +08:00
74c92ee5c95cc0a3d8d0ddd463e39223ecfbeee8
Description
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
95 MiB
Languages
Python
56.8%
C++
35.2%
Cuda
4.2%
Shell
1.2%
CMake
0.8%
Other
1.5%