 xming521
|
38113a2524
|
翻译注释日志为英文
|
2025-07-01 20:00:34 +08:00 |
|
|
pre-commit-ci[bot]
|
3e0f08c7cb
|
🎈 auto fixes by pre-commit hooks
|
2025-06-21 03:21:06 +00:00 |
|
|
xming521
|
7066730201
|
优化vllm_infer函数，移除无用的guided_decoding参数，并在length_cdf.py中添加计算文本token长度的功能。
|
2025-06-21 11:20:23 +08:00 |
|
|
xming521
|
6e1903ced6
|
修改数据集名称为chat-sft， 纯文字模型微调数据切换到sharegpt格式。
|
2025-06-11 15:34:27 +08:00 |
|
|
pre-commit-ci[bot]
|
d006cc1ae1
|
🎈 auto fixes by pre-commit hooks
|
2025-06-11 04:03:36 +00:00 |
|
|
pre-commit-ci[bot]
|
cf30258091
|
🎈 auto fixes by pre-commit hooks
|
2025-06-09 03:27:38 +00:00 |
|
|
xming521
|
a12a0671f0
|
更新pyproject.toml中的transformers版本，添加accelerate依赖；在mllm模板中增加media_dir和image_max_pixels配置；优化qa_generatorV2.py中的数据处理逻辑以支持image_max_pixels参数；更新length_cdf函数以支持image_max_pixels参数。
|
2025-05-31 22:19:01 +08:00 |
|
|
xming521
|
11b0e3fbd3
|
Update .gitignore to ignore the dataset/images directory, modify the transformers version in pyproject.toml, adjust the clean_dataset configuration in settings.template.jsonc, add media_dir to the mllm template, optimize data processing logic in qa_generatorV2.py and utils.py, update the length_cdf function to support the media_dir parameter.
|
2025-05-31 10:24:51 +08:00 |
|
|
xming521
|
3bdcb3b8ac
|
fixi 多卡length_cdf。
|
2025-05-06 22:35:10 +08:00 |
|
|
xming521
|
9827a24929
|
更新依赖项版本，提升torch和torchaudio至2.6.0，更新openai至1.52.0 相应更新test_model，调整pytorch源为cu124。
|
2025-04-29 22:47:02 +08:00 |
|
|
xming521
|
63fab6d20d
|
update
|
2025-04-26 21:17:38 +08:00 |
|
|
xming521
|
6ecf2c8144
|
添加计算cutoff_len
|
2025-04-26 21:03:10 +08:00 |
|