Commit Graph

  • 446df58a6c refactor(infer): streamline online model scoring and error handling xming521 2026-01-04 18:14:57 +08:00
  • 27d877aad3 refactor(infer): improve guided decoding error handling in online inference xming521 2026-01-04 18:07:37 +08:00
  • a02b23bb2f chore: update Python version in README files xming521 2026-01-04 16:24:19 +08:00
  • 1107500c41 chore: update dependencies and configuration xming521 2026-01-04 16:15:15 +08:00
  • fca6ca1c55 feat(data): enhance conversation message processing in QA generation xming521 2026-01-04 15:47:14 +08:00
  • 8ee9d05892 Merge branch 'master' into dev 小铭 2025-11-01 17:21:17 +08:00
  • bbe08f0c77 feat(data): enhance chat member relationship handling in QA generation xming521 2025-11-01 17:11:26 +08:00
  • 9eab753787 Update README.md 小铭 2025-10-11 17:42:26 +08:00
  • 30b9ca059e Add online fine-tuning section to README 小铭 2025-10-11 17:41:20 +08:00
  • 5669838a91 refactor(infer): improve LLM result parsing error logs xming521 2025-09-03 13:31:06 +08:00
  • c1c7530630 feat(infer): add guided decoding for online and offline models xming521 2025-08-29 16:03:57 +08:00
  • a887d122af feat(data): include new sticker types in skip list xming521 2025-08-28 22:12:59 +08:00
  • ac5afb83f9 Merge remote-tracking branch 'origin/master' into dev xming521 2025-08-28 21:31:16 +08:00
  • a0829d2098 feat(cleaning): add batch processing for online LLM xming521 2025-08-28 21:30:05 +08:00
  • 7a5bcb491e Merge pull request #198 from MapleWithered/patch-1 小铭 2025-08-27 21:31:46 +08:00
  • c384987b8a fix: fix triton source from cuda129 to 126 枫亚 2025-08-27 19:42:48 +08:00
  • a96996fcbf Merge pull request #196 from xming521/dev v0.3.02 小铭 2025-08-17 15:18:53 +08:00
  • 5dcaad0e10 perf(infer): clear cuda cache after inference xming521 2025-08-17 15:18:37 +08:00
  • e90f05c12a refactor(data): improve data cleaning robustness xming521 2025-08-17 14:30:17 +08:00
  • 41167f6d29 fix(dataset): fix #192 standardize dataset naming and cleaning workflow xming521 2025-08-16 22:51:29 +08:00
  • 1e8de85376 chore(config): Updates the project and configuration versions to 0.3.02. xming521 2025-08-15 22:55:41 +08:00
  • 8309c498d3 Merge branch 'dev' of https://github.com/xming521/WeClone into dev xming521 2025-08-15 16:53:06 +08:00
  • cdef4213cf chore(deps): update core dependencies xming521 2025-08-15 16:46:32 +08:00
  • c89dc8100c test(tests): update qwen3 test model to 0.6B xming521 2025-08-15 15:34:46 +08:00
  • cc34bea317 fix(data): classify gif as animated stickers xming521 2025-08-15 15:31:45 +08:00
  • a3f39495de feat(core): enable configurable thinking and cleaning xming521 2025-08-11 15:34:27 +08:00
  • 7e9886c020 perf(config): reduce default lora rank xming521 2025-08-11 11:23:37 +08:00
  • 6b134ea703 feat(dataset): handle image data in LLM cleaning xming521 2025-08-11 11:03:14 +08:00
  • a05bb7e856 Merge remote-tracking branch 'origin/master' into dev xming521 2025-08-10 10:30:49 +08:00
  • a0f6d0e9b0 chore(tests): include PII test data file xming521 2025-08-10 10:29:16 +08:00
  • ff0015a2ba performance : some improve xming521 2025-08-09 21:35:43 +08:00
  • f67d8d2145 Merge pull request #193 from xming521/pre-commit-ci-update-config 小铭 2025-08-05 16:58:49 +08:00
  • 8fea9c1f9b 🎈 pre-commit autoupdate hooks pre-commit-ci[bot] 2025-08-04 21:27:18 +00:00
  • 533b0fa678 refactor(data): converts QA item ID to string xming521 2025-07-29 11:28:23 +08:00
  • 4c20fc900c Update .gitkeep 小铭 2025-07-21 14:34:32 +08:00
  • f22556c74c Update README_zh.md 小铭 2025-07-19 16:37:43 +08:00
  • 758f3a04d4 Update README.md 小铭 2025-07-19 16:35:09 +08:00
  • 5a560adafb perf(train): optimize default training configs xming521 2025-07-17 22:21:54 +08:00
  • d65784f1dd Merge pull request #189 from xming521/dev v0.3.01 小铭 2025-07-17 15:19:07 +08:00
  • 98f506e14a Remove WC-exp submodule entry from remote repository xming521 2025-07-17 15:12:26 +08:00
  • 77752b6d36 docs: remove redundant multi-gpu training section xming521 2025-07-16 17:02:56 +08:00
  • 3bb4f04206 chore: remove WC-exp submodule xming521 2025-07-16 15:47:21 +08:00
  • 51cc0f7b42 Merge branch 'master' into dev 小铭 2025-07-16 15:42:22 +08:00
  • 6ffa7a64b7 docs: update WhatsApp support status xming521 2025-07-16 15:42:01 +08:00
  • 72bc75c9cb Remove WC-exp subproject xming521 2025-07-16 15:34:17 +08:00
  • a24b7f2714 test(dataset): add image tag count check for Qwen2.5-VL xming521 2025-07-16 15:30:56 +08:00
  • 09897a8daf fix(dataset): Data processing results have no images. xming521 2025-07-16 15:18:56 +08:00
  • 67232998fa chore: ignore WC-exp directory xming521 2025-07-16 14:16:47 +08:00
  • 323ed0077f 删除 WC-exp 子项目 xming521 2025-07-16 11:23:17 +08:00
  • 785ad1472a remove wechat xming521 2025-07-16 11:21:11 +08:00
  • 2a7cb5f30d refactor(data): simplify datetime format xming521 2025-07-14 17:31:54 +08:00
  • 66e7fdbeb4 test(PII) add tests for PII xming521 2025-07-14 17:26:44 +08:00
  • 7ce7fcd47a fix(dataset): fix blocked words filter xming521 2025-07-14 13:38:19 +08:00
  • 49d62b3fda performance(PII): add batch PII detection xming521 2025-07-14 12:55:01 +08:00
  • 3993d34a8e Revert "refactor(PII): Initializes engines in ChinesePIIDetector" xming521 2025-07-10 21:07:31 +08:00
  • 94402cfcc4 refactor(PII): Initializes engines in ChinesePIIDetector xming521 2025-07-10 21:00:06 +08:00
  • 3e7892fc76 feat(infer): add retry mechanism to API calls xming521 2025-07-10 19:29:23 +08:00
  • 73214f3217 chore(dataset): removes pt dataset info xming521 2025-07-10 15:45:03 +08:00
  • 05db183c05 chore: updates config version to 0.3.01 xming521 2025-07-10 15:21:28 +08:00
  • a24442b78d feat(PII): enhance PII detection for Chinese xming521 2025-07-10 12:10:09 +08:00
  • 18770bda1e Merge branch 'dev' of https://github.com/xming521/WeClone into dev xming521 2025-07-10 09:59:40 +08:00
  • 68ea3f2b90 update gitignore xming521 2025-07-10 09:59:30 +08:00
  • 5f34b4561e feat(dataset): adds option to include time xming521 2025-07-09 23:15:51 +08:00
  • 1a95fa3e53 Merge pull request #186 from RockChinQ/master 小铭 2025-07-09 22:26:38 +08:00
  • 4b887fc547 Update README_zh.md Junyan Qin (Chin) 2025-07-08 20:48:41 +08:00
  • cee47594f6 doc(README): update LangBot integration doc Junyan Qin (Chin) 2025-07-08 20:44:28 +08:00
  • e96853d0fb refactor(dataset): removes newline characters from messages xming521 2025-07-08 18:31:30 +08:00
  • 5b47d9b9ab refactor: unifies combined content separator xming521 2025-07-08 16:52:47 +08:00
  • c4fc9a867d Fix Regarding deepspeed version#184 xming521 2025-07-08 16:48:07 +08:00
  • 9a6f9eedc4 Merge pull request #183 from xming521/pre-commit-ci-update-config 小铭 2025-07-08 08:09:38 +08:00
  • 3f23be143e 🎈 pre-commit autoupdate hooks pre-commit-ci[bot] 2025-07-07 21:19:37 +00:00
  • 0a8f3e2c01 Merge pull request #179 from xming521/dev 小铭 2025-07-06 18:14:01 +08:00
  • 7c497ad012 docs: update documentation links xming521 2025-07-06 18:11:12 +08:00
  • 5baee42fff Merge remote-tracking branch 'origin/master' into dev xming521 2025-07-06 16:22:19 +08:00
  • e50a20d6d4 Update README.md 小铭 2025-07-06 11:08:48 +08:00
  • 72d597e861 Update README_zh.md 小铭 2025-07-06 11:05:20 +08:00
  • ed989d2bc7 Update README_zh.md 小铭 2025-07-06 11:04:03 +08:00
  • d068e8add9 Merge pull request #178 from xming521/dev 小铭 2025-07-06 10:53:32 +08:00
  • bbe4a26197 Rename test_full_pipe.py xming521 2025-07-06 10:51:52 +08:00
  • 0bcf6bdd18 chore(tests): improve test environment setup xming521 2025-07-06 10:50:50 +08:00
  • f0476b05e7 feat(tg): add sticker parameter to include_type xming521 2025-07-06 10:38:28 +08:00
  • 1d983d3960 Update README_zh.md 小铭 2025-07-05 20:43:25 +08:00
  • a45327be12 Update README.md 小铭 2025-07-05 20:42:54 +08:00
  • e4cb4ddff3 Update README.md 小铭 2025-07-05 20:17:52 +08:00
  • 12ff1bb4d6 Update README_zh.md 小铭 2025-07-05 20:05:56 +08:00
  • 3de74ac346 Update README.md v0.3.0 小铭 2025-07-05 15:47:35 +08:00
  • cace351f54 Merge pull request #171 from xming521/v0.3.0 小铭 2025-07-05 15:39:40 +08:00
  • a3120fca43 更新README文档,修正平台支持表格中的内容,调整评分标准的描述,增加逻辑性和相关性评判的说明;在online_infer.py中添加TODO注释以实现线程池并发处理。 xming521 2025-07-05 15:21:39 +08:00
  • d113218e42 更新README文档;修改清理策略中的评分解析逻辑。 xming521 2025-07-04 20:51:38 +08:00
  • f9718b8af0 更新README文档,调整链接格式,添加教程资源,并修复排版问题。 xming521 2025-07-03 20:08:13 +08:00
  • 9a26852c55 更新README文档。 xming521 2025-07-02 10:53:10 +08:00
  • 2b13b70b3e 更新README文档,添加Telegram数据导出说明,修改数据预处理配置说明,调整示例配置文件中的语言设置和参数 xming521 2025-07-01 21:35:58 +08:00
  • 4e1865d4a3 Merge branch 'master' into v0.3.0 小铭 2025-07-01 20:46:59 +08:00
  • 72314b1649 更新README文档 xming521 2025-07-01 20:17:23 +08:00
  • 38113a2524 翻译注释日志为英文 xming521 2025-07-01 20:00:34 +08:00
  • 256a601d9f 在qa_generator.py中设置VLLM_WORKER_MULTIPROC_METHOD环境变量为"spawn";删除train_pt.py文件。 xming521 2025-06-30 20:42:39 +08:00
  • 16ec7178d7 更新README文档,翻译部分内容为英文并调整格式; 翻译注释 和 日志。 xming521 2025-06-30 20:02:25 +08:00
  • c94f789868 更新README文档,替换测试数据路径为新的评估数据文件。 xming521 2025-06-29 20:27:52 +08:00
  • 1985ccdd1c 更新README文档,替换截图为更高质量的图像,并调整布局以提升可读性。 xming521 2025-06-29 16:37:18 +08:00
  • 4784e3968e 更新README文档,在settings.template.jsonc中添加media_dir字段。 xming521 2025-06-29 16:26:07 +08:00