1971 Commits

Author SHA1 Message Date
Karishma Shukla fd714e6bce fix: set fallback poll interval 1 hr 2026-05-22 01:00:07 +05:30
Rohit Rajan e266750000 fix: emit run started 2026-05-18 00:00:24 +05:30
Rohit Rajan 7c532ec0df fix: doc robot execution 2026-05-17 23:52:27 +05:30
Rohit Rajan 5bf1113bb8 fix: rm legacy pgboss client 2026-05-17 22:04:47 +05:30
Rohit Rajan c247b71312 fix: resolve merge conflicts 2026-05-17 21:30:11 +05:30
Rohit Rajan 8b1329f01d feat: add support for document robot 2026-05-14 20:16:01 +05:30
Rohit Rajan e9d58fd5ab feat: port from pgboss to graphile worker 2026-05-13 16:09:53 +05:30
Rohit Rajan a76aa1031e chore: move pgboss files to legacy 2026-05-13 16:08:05 +05:30
Rohit 29ce563aa5 Merge branch 'develop' into fast-md 2026-05-07 21:55:38 +05:30
Karishma Shukla 6ae7efae2a Merge pull request #1051 from getmaxun/link-format
feat: add support for links format
2026-05-07 21:47:11 +05:30
Karishma Shukla 954b41bd11 Merge pull request #1046 from getmaxun/conn-fix
fix: multiple socket connection bug
2026-05-07 21:30:44 +05:30
Rohit Rajan 1e8081a677 fix: improve markdown conversion speed 2026-05-06 20:01:02 +05:30
Rohit Rajan 6a068a1302 feat: add links scrape format 2026-05-03 22:32:27 +05:30
Rohit Rajan 5a53a73883 fix: add unified browser socket manager 2026-04-23 16:22:20 +05:30
Rohit Rajan 53207b6804 fix: fence detection code blocks 2026-04-23 14:41:58 +05:30
Rohit Rajan 399aac5047 fix: normalize href cleanup 2026-04-23 14:32:22 +05:30
Rohit Rajan eb4377d3cc fix: link structure and whitespace cleanup 2026-04-23 14:04:26 +05:30
Rohit 69d477970d Merge branch 'develop' into smart-query 2026-04-20 21:16:26 +05:30
Rohit d443fd3abc Merge branch 'develop' into smart-query 2026-04-20 21:09:56 +05:30
Rohit c86331b0cf Merge branch 'develop' into scrape-text 2026-04-20 21:03:41 +05:30
Rohit Rajan 27b7d0352e fix: query results naming convention 2026-04-20 20:57:22 +05:30
Karishma Shukla 02cf4146db Merge pull request #1039 from getmaxun/db-ssl
feat: ssl config for hosted db
2026-04-20 20:53:00 +05:30
Karishma Shukla f13ef194c3 Merge pull request #1038 from getmaxun/url-fix
fix: malformed URLs not being processed
2026-04-20 20:52:26 +05:30
Rohit Rajan ef7a0f09f4 chore: update llm defaults agent 2026-04-20 19:11:31 +05:30
Rohit Rajan b47d3e5f2e feat: post scraping smart queries 2026-04-20 19:07:22 +05:30
Rohit Rajan 61a78a274b feat: add text content support for scrape 2026-04-19 19:53:01 +05:30
Rohit Rajan 9dbf434336 fix: wait for images/network stability scrape capture 2026-04-19 19:23:10 +05:30
Rohit Rajan 2a44833c74 fix: move md/html before ss capture 2026-04-19 19:21:43 +05:30
Rohit Rajan 1c47809b3a feat: add ssl flag for hosted db conn 2026-04-19 17:32:45 +05:30
Rohit Rajan 3f6f164350 fix: duplication case-sensitive check 2026-04-18 14:51:55 +05:30
Rohit Rajan d547ea83f1 fix: harden robot URL extraction and duplication 2026-04-18 14:32:33 +05:30
Rohit Rajan b8e3b68ac3 fix: normalize robot urls 2026-04-18 12:26:58 +05:30
Rohit Rajan eee7c62a57 fix: improve markdown conversion 2026-04-16 19:26:37 +05:30
Rohit Rajan 214ac55860 chore: rm ignore deprecation 2026-04-10 22:53:44 +05:30
Rohit Rajan d9bfe5428a fix: ignore deprecation 2026-04-10 22:48:33 +05:30
Rohit Rajan 78e4652825 feat: add run status for cli and mcp 2026-04-03 14:38:11 +05:30
Rutetid cb54a6ff72 fixed issue with search robot 2026-03-30 01:04:31 +05:30
Rutetid 2443007ce9 applied all fixes 2026-03-29 20:29:02 +05:30
Rutetid 61e42b87ea Applied suggested fix by coderabbit 2026-03-29 19:22:04 +05:30
Rutetid bcfcaad2da Added Output Format Selection to Crawl and Search Robots 2026-03-29 19:17:21 +05:30
Karishma Shukla a5eb9b8203 Merge pull request #1010 from getmaxun/key-fix
fix: error handling apikey check
2026-03-24 20:25:50 +05:30
Karishma Shukla 64a16f687d Merge pull request #1005 from getmaxun/sdk-dup
feat: add sdk robot duplication
2026-03-24 20:24:54 +05:30
Karishma Shukla 4d6e934149 Merge pull request #998 from ritam1303/master
fix: enforce unique robot names across all creation flows and edit
2026-03-24 20:23:06 +05:30
Karishma Shukla d0e3048c05 Merge pull request #999 from ritam1303/fix/recording-session-timeout
fix(recorder): auto-discard recording session after 10-minute timeout
2026-03-24 17:28:40 +05:30
Rohit Rajan 36e51b562b fix: specify out formats 2026-03-24 16:47:25 +05:30
Rohit Rajan dfaf56f7b3 fix: outpuit display scrape 2026-03-24 15:09:10 +05:30
Rohit Rajan f88cc70b93 feat: add status check route sdk 2026-03-24 14:39:22 +05:30
ritamganguliac 95f40ffec7 fix(recorder): auto-discard recording session after 10-minute timeout
- Added RECORDING_TIMEOUT_MS and recordingTimeouts Map to track sessions
- Timer starts after browser is added to pool; emits recording-timeout
  socket event then destroys the remote browser after 1s delay (gives
  frontend time to handle the event before socket teardown)
- clearRecordingTimeout() exported and called in destroyRemoteBrowser
  and the /stop/:browserId route to cancel timer on normal save/discard
- RecordingPage listens for recording-timeout: broadcasts via
  BroadcastChannel then calls window.close(); falls back to
  navigate('/robots') if close is blocked by the browser
- PageWrapper (always mounted in original tab) listens on
  BroadcastChannel, navigates back to the page the recording was
  started from (stored in sessionStorage), and shows warning notification
- RobotCreate stores current pathname in sessionStorage before opening
  the recording tab so PageWrapper can navigate back on timeout
- Added timeout_discarded translation key to all 6 locale files

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-22 20:35:54 +05:30
ritamganguliac 833ece50be fix: address remaining coderabbit review comments
- Move LLM duplicate-name check before the expensive LLM call to avoid
  burning API time/cost on a name that will be rejected anyway
- Hoist trimmedName declaration in PUT endpoint to eliminate the
  redundant second name.trim() call outside the validation block
- Guard recording_meta.name type in Generator pre-check so legacy rows
  with missing/non-string names don't throw; normalize both sides to
  match the DB index semantics (lower + trim)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-21 13:44:13 +05:30
ritamganguliac 3953c724df fix: address PR review comments for unique robot names
- Reject whitespace-only names in all create endpoints (scrape, crawl,
  search, llm) using explicit string trim + fallback instead of ||.trim()
- Validate name type and emptiness in PUT endpoint with 400 responses
- Catch SequelizeUniqueConstraintError in all create/update/Generator
  paths and return 409/emit nameExists to close TOCTOU race window
- Add blank-name guard in Generator.saveNewWorkflow before DB write
- Propagate isDuplicate flag from updateRecording for i18n-aware error
  display in RobotEditPage

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-21 13:40:17 +05:30