xming521 ab863cf134 refactor(infer): enhance guided decoding parameter handling ...

- Updated the guided decoding parameter logic to support dynamic imports, improving compatibility with different configurations.
- Simplified the creation of guided decoding parameters by introducing a helper function.
- Modified the retry mechanism in the OpenAI API call to retry on all exceptions, enhancing robustness in error handling.

2026-03-29 11:25:18 +08:00

..

offline_infer.py

refactor(infer): enhance guided decoding parameter handling

2026-03-29 11:25:18 +08:00

online_infer.py

refactor(infer): improve guided decoding error handling in online inference

2026-01-04 18:07:37 +08:00