Commit Graph

Select branches

Hide Pull Requests

codex/fix-issue-with-mediacrawler-functionality

codex/replace-argparse-with-typer-for-cli

docs/add-bloome-sponsor

docs/readme-formatting-sync

feature/config-refactor-20251018

feature/connect-existing-browser

feature/excel-export-and-tests

feature/test_new_rule_01

fix/proxy-20251125

fix/xhs-sign-20251127

main

#10

#112

#124

#136

#137

#142

#157

#177

#18

#182

#183

#184

#201

#202

#206

#209

#212

#213

#214

#216

#217

#223

#224

#226

#228

#228

#229

#234

#238

#24

#242

#243

#250

#251

#252

#253

#254

#255

#265

#273

#276

#278

#280

#281

#290

#292

#293

#294

#295

#298

#299

#300

#301

#303

#306

#307

#309

#314

#316

#318

#319

#32

#323

#325

#327

#328

#329

#330

#331

#332

#333

#336

#337

#343

#345

#346

#347

#348

#350

#353

#357

#360

#361

#370

#371

#374

#375

#376

#377

#378

#379

#380

#384

#385

#386

#387

#388

#389

#396

#399

#4

#40

#400

#401

#404

#405

#411

#413

#422

#425

#427

#433

#461

#462

#463

#477

#479

#506

#509

#513

#516

#519

#521

#528

#536

#538

#542

#547

#559

#572

#590

#592

#596

#599

#603

#607

#608

#616

#619

#621

#634

#635

#636

#637

#638

#639

#64

#641

#642

#649

#650

#652

#654

#655

#657

#658

#664

#674

#676

#680

#681

#684

#686

#687

#690

#699

#700

#704

#707

#716

#717

#718

#723

#726

#728

#729

#73

#738

#739

#74

#741

#743

#761

#764

#768

#772

#773

#780

#782

#783

#784

#785

#786

#787

#788

#789

#793

#802

#805

#807

#809

#814

#815

#816

#817

#82

#821

#824

#825

#827

#828

#829

#831

#838

#839

#845

#845

#847

#849

#849

#850

#854

#854

#864

#864

#867

#877

#877

#878

#878

#880

#880

#882

#883

#884

#886

#887

#887

#888

#889

#889

#89

#894

#898

#898

#899

#900

#901

#903

#905

#905

#909

#911

#911

#912

#912

#913

#917

#918

#918

#920

#921

#921

#923

#923

#925

#930

#931

#931

#932

#932

#933

#933

#934

#935

#935

#937

#937

#938

#94

#940

#940

#944

#944

#947

#947

#948

#948

#950

#952

#952

#957

#958

#96

#961

#961

#962

#962

#963

#963

#964

#964

#967

#967

#968

#968

#969

#969

#970

#970

#971

#971

#972

#972

#973

#973

#974

#974

#975

#975

#976

#976

#977

#977

#978

#978

#979

#979

#982

#982

#983

#983

#986

#986

#987

#987

#988

#988

#989

#989

#991

#993

#993

Mono Color

• 67d2b7cff8 Merge pull request #136 from jayeeliu/main relakkes 2024-02-22 21:32:19 +08:00
• c09f9fef68 fix: 增加db.close()，解决抓取命令执行完不退出的问题 ccgo 2024-02-22 00:11:41 +08:00
• 4f5f83d3fa feat: 增加sqlite配置示例 ccgo 2024-02-22 00:07:40 +08:00
• 03ca445221 docs: update README.md Relakkes 2024-02-18 13:06:12 +08:00
• 192e72588d fix: #123 Relakkes 2024-01-26 23:42:26 +08:00
• f1d3bc6e28 Merge pull request #124 from aa65535/patch-1 relakkes 2024-01-25 14:33:09 +08:00
• 79c0f3bd68 修复小红书评论重复插入 Jian Chang 2024-01-25 13:01:04 +08:00
• eb89a6ada8 docs: 添加赞赏者信息 relakkes 2024-01-21 16:42:37 +08:00
• e940a41033 refactor: 移除评论中指定数量和过滤特定关键词的逻辑 Relakkes 2024-01-17 23:02:05 +08:00
• e0f9a487e4 refactor: 代码优化 Relakkes 2024-01-16 00:40:07 +08:00
• e490123fcd Merge pull request #112 from NanmiCoder/feature/stored_in_json relakkes 2024-01-14 22:45:00 +08:00
• 4dfa0d3fbf feat: 数据保存支持JSON格式 Relakkes 2024-01-14 22:40:01 +08:00
• 894dabcf63 refactor: 数据存储重构，分离不同类型的存储实现 Relakkes 2024-01-14 22:06:31 +08:00
• e31aebbdfb fix: 修复代理Bug Relakkes 2024-01-13 15:50:02 +08:00
• 0240de7324 docs: 添加捐赠信息 Relakkes 2024-01-10 23:59:14 +08:00
• f85bd0c2b9 docs: 添加捐赠信息 Relakkes 2024-01-07 18:33:08 +08:00
• 4de14ad6a8 fix: 修复微博PC端登录后COOKIE在手机端无法使用的bug Relakkes 2024-01-06 19:18:07 +08:00
• fe073801f8 feat: 小红书增加获取图片地址的方法 Relakkes 2024-01-04 00:11:05 +08:00
• 80ecc53cd3 fix: #107 Relakkes 2024-01-03 23:08:30 +08:00
• 38d6f10bf0 feat: 微博二维码登录done Relakkes 2023-12-30 18:54:21 +08:00
• 27a2041929 doc: update README.md Relakkes 2023-12-30 15:16:33 +08:00
• eee81622ac feat: 微博支持评论 & 指定帖子 Relakkes 2023-12-25 00:02:11 +08:00
• b1441ab4ae feat: 微博帖子支持保存到数据库中 Relakkes 2023-12-24 18:19:26 +08:00
• c5b64fdbf5 feat: 微博爬虫帖子搜索完成 Relakkes 2023-12-24 17:57:48 +08:00
• 9785abba5d docs: update README.md Relakkes 2023-12-23 01:41:19 +08:00
• aba9f14f50 refactor: 规范日志打印 feat: B站指定视频ID爬取（bvid） Relakkes 2023-12-23 01:04:08 +08:00
• 273c9a316b fix: 修复日志打印时参数格式错误 Relakkes 2023-12-22 23:10:44 +08:00
• bced7f6802 doc: update README.md Relakkes 2023-12-22 23:04:08 +08:00
• 2e032d09dc refactor: xhs add log Relakkes 2023-12-19 23:05:12 +08:00
• e2aaf0e5c1 doc: update README.md Relakkes 2023-12-17 18:57:43 +08:00
• f85fd97d25 fix: #10 Relakkes 2023-12-16 00:12:20 +08:00
• 40cbd9f4d7 Merge pull request #96 from PeanutSplash/main relakkes 2023-12-14 00:57:17 +08:00
• 5c6a636352 fix-bug:修复抖音评论筛选 peanutsplash 2023-12-14 00:55:06 +08:00
• c4d68f868a Merge pull request #94 from PeanutSplash/main relakkes 2023-12-14 00:01:44 +08:00
• f17a85305e 添加功能:(哔哩哔哩,快手,小红书)每个视频/帖子抓取评论最大条数限制,评论关键词筛选 peanutsplash 2023-12-13 23:53:12 +08:00
• 5c42076ff8 doc: update README.md Relakkes 2023-12-09 23:50:33 +08:00
• 05016305e8 doc: update README.md Relakkes 2023-12-09 23:49:19 +08:00
• 97d7a0c38b feat: Bilibili comment done Relakkes 2023-12-09 21:10:01 +08:00
• a136ea2739 refactor: delete account_config.py Relakkes 2023-12-09 13:56:18 +08:00
• 2d0f12f058 doc: fixed pydantic version Relakkes 2023-12-09 13:31:53 +08:00
• fd640f2008 doc: update README.md Relakkes 2023-12-09 00:30:31 +08:00
• d37d5ccd12 doc: add SPONSORED BY text Relakkes 2023-12-09 00:28:29 +08:00
• 385662a7b6 doc: 新增代理IP使用文档 Relakkes 2023-12-09 00:06:57 +08:00
• a40a91d7f7 doc: update README.md Relakkes 2023-12-08 00:27:59 +08:00
• 72a68fbf1e doc:将文档拆出去 Relakkes 2023-12-08 00:25:06 +08:00
• 1cec23f73d feat: 代理IP功能 Done Relakkes 2023-12-08 00:10:04 +08:00
• c530bd4219 feat: 代理IP缓存到redis中 Relakkes 2023-12-06 23:49:56 +08:00
• f71d086464 fix: B站get_wbi_keys函数类型标注问题 Relakkes 2023-12-05 23:32:35 +08:00
• a6e877de42 fix: 修复B站搜索Field命名 bug refactor: ping接口统一更换为pong Relakkes 2023-12-05 22:47:36 +08:00
• 6ae511bb52 Merge pull request #89 from PeanutSplash/main relakkes 2023-12-05 12:42:32 +08:00
• ab1a10bac1 添加功能:抖音每个视频抓取评论最大条数限制,抖音评论关键词筛选 peanutsplash 2023-12-05 11:21:47 +08:00
• 8f04943105 feat: B站评论API Relakkes 2023-12-04 23:16:02 +08:00
• a790d72db9 fix: 修复小红书笔记获取时，不存在的笔记异常问题 Relakkes 2023-12-04 21:54:12 +08:00
• 519165ceec doc: 修改项目代码结构tree Relakkes 2023-12-04 00:11:01 +08:00
• 94b5030ef0 feat: B站二维码、Cookie登录实现 Relakkes 2023-12-04 00:02:00 +08:00
• a90b411e68 feat: B站爬虫搜索关键词实现 Relakkes 2023-12-03 23:19:02 +08:00
• 5aeee93fc5 feat: B站爬虫签名实现 Relakkes 2023-12-03 00:30:10 +08:00
• 5c920da288 feat: 快手二维码登录 Relakkes 2023-12-02 18:22:55 +08:00
• 986179b9c9 feat: 增加 IP 代理的最新实现 Relakkes 2023-12-02 16:14:36 +08:00
• a8a4d34d2a doc: update README.md Relakkes 2023-12-02 10:56:13 +08:00
• e7f68dd7e1 doc: 提供仓库功能列表表格 Relakkes 2023-12-01 23:58:35 +08:00
• 5affc8a600 Update README.md relakkes 2023-12-01 09:55:38 +08:00
• 6d743552f2 doc: update README.md Relakkes 2023-11-30 23:59:02 +08:00
• 33721e5fbd feat: 快手支持指定视频列表爬取 Relakkes 2023-11-27 23:07:04 +08:00
• 62534d7ee2 fix: 移出快手 client 多余的代码 Relakkes 2023-11-26 22:11:06 +08:00
• 609c3f0673 fix: 修复抖音数据库保存错误 Relakkes 2023-11-26 22:06:26 +08:00
• d59113668f doc: 增加快手爬虫的描述 Relakkes 2023-11-26 21:50:08 +08:00
• 9faa4f4eec Merge pull request #82 from NanmiCoder/feat/kuaishou_support relakkes 2023-11-26 21:44:36 +08:00
• dfb1788141 feat: 快手视频评论爬取done；数据保存到DB、CSV done Relakkes 2023-11-26 21:43:39 +08:00
• 2f8541a351 Merge branch 'main' into feat/kuaishou_support Relakkes 2023-11-26 15:44:26 +08:00
• 523c5f380e doc: add command usage Relakkes 2023-11-26 15:38:38 +08:00
• bdf36ccb09 feat: 快手关键词搜索存储CSV完成 Relakkes 2023-11-26 01:05:52 +08:00
• 253888980c doc: 增加如何更换账号的问题 Relakkes 2023-11-25 12:32:43 +08:00
• 512192a93e feat: 搜索接口调试完成 Relakkes 2023-11-25 00:02:33 +08:00
• f08b2ceb76 feat: 1、命令行支持快手 2、快手playwright 代码 done Relakkes 2023-11-24 00:04:33 +08:00
• 6908da6f70 fix: 修复小红书client中get请求中文bug Relakkes 2023-11-23 23:27:35 +08:00
• 95ca606938 feat: 快手文件目录建立 Relakkes 2023-11-23 23:13:54 +08:00
• 3790e8041e doc: update README.md Relakkes 2023-11-20 22:07:00 +08:00
• 81bc8b51e2 feat: 抖音支持指定视频列表爬去 Relakkes 2023-11-18 22:07:30 +08:00
• 098923d74d refactor: 优化代码-变量名 Relakkes 2023-11-18 15:53:10 +08:00
• ecf9a5e893 Merge pull request #74 from Akiqqqqqqq/bugfix-null-key relakkes 2023-11-18 15:05:16 +08:00
• 4c85355ebd Merge branch 'main' into bugfix-null-key leonardoqiuyu 2023-11-18 14:59:03 +08:00
• 700946b28a feat: 小红书增加指定帖子爬取功能 fix: 修复程序一些异常 bug refactor: 优化部分代码逻辑 Relakkes 2023-11-18 13:38:11 +08:00
• f24c892471 fix: 修复评论为空导致程序异常退出的 bug Relakkes 2023-11-18 11:18:54 +08:00
• 602e609115 fix null key Akiqqqqqqq 2023-11-14 21:11:18 +08:00
• cd3a0bdb6a doc: update README.md Relakkes 2023-11-11 20:49:32 +08:00
• 68c7139dd0 Merge pull request #64 from NanmiCoder/feat/article_url relakkes 2023-11-05 15:28:10 +08:00
• d0ded6689c feat: add article url for issue #63 Relakkes 2023-11-05 15:27:18 +08:00
• 7698c41d51 Merge pull request #40 from yangrq1018/pr relakkes 2023-08-31 08:09:06 -05:00
• ad69e63d5f fix: get phone from phone pool when ENABLE_IP_PROXY is False xiaoniu 2023-08-31 13:57:54 +08:00
• b7fe5b730a style: Change the import order in the code. Relakkes 2023-08-16 19:56:12 +08:00
• 9177c38521 feat: 支持数据保存到CSV中 Relakkes 2023-08-16 19:49:41 +08:00
• c1a3f06c7a fix: issue #32 Relakkes 2023-08-16 13:58:44 +08:00
• 99812b4669 Merge pull request #32 from renaissancezyc/main Relakkes 2023-08-14 09:32:48 +08:00
• 1556e1b8cd ✨ feat: orm添加Pydantic数据验证 zhoubang 2023-08-13 22:39:50 +08:00
• 3ae4c5f2f4 fix: issue #23 Relakkes 2023-08-03 22:26:31 +08:00
• defd8232da Merge pull request #24 from jayeeliu/main Relakkes 2023-08-01 13:35:00 +08:00
• 925f0a1bc4 去掉搜索结果列表中的推荐搜索词（mode_type in ['rec_query', 'hot_query']） JayeeLiu 2023-08-01 10:29:00 +08:00
• 1d3c2359e0 fix: 修复部分变量命名语义不明确 Relakkes 2023-07-30 21:30:26 +08:00
• bf659455bb fix: issue #22 Relakkes 2023-07-30 20:43:02 +08:00