mirror of
https://github.com/xming521/WeClone.git
synced 2026-10-26 11:09:44 +08:00
Adds a call to empty the CUDA cache immediately after the LLM object is deleted, ensuring prompt release of GPU memory. This helps prevent out-of-memory issues and improves resource utilization for subsequent operations.