aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers (unfollow)
Commit message (Expand)AuthorFilesLines
2025-10-06fix: round feed refresh hour for idempotency (#2013)Mohamed Bassem1-1/+6
2025-10-05feat: Restate-based queue plugin (#2011)Mohamed Bassem1-2/+8
2025-09-28feat: use jpegs for screenshots instead of pngsMohamed Bassem1-2/+3
2025-09-28feat: Stop downloading video/audio in playwrightMohamed Bassem1-0/+19
2025-09-28fix: Abort dangling processing when crawler is aborted (#1988)Mohamed Bassem1-27/+98
2025-09-28fix: Cleanup temp assets on monolith timeoutMohamed Bassem1-1/+17
2025-09-28feat: Add tag search and pagination (#1987)Mohamed Bassem1-1/+1
2025-09-14fix: fix bundling liteque in the workersMohamed Bassem2-0/+2
2025-09-14refactor: Move callsites to liteque to be behind a pluginMohamed Bassem13-123/+134
2025-09-07feat: Add cookie support for browser page accessMohamed Bassem1-0/+59
2025-09-07feat(workers): add worker enable/disable lists (#1885)Mohamed Bassem1-44/+49
2025-09-07fix: fix assets being marked as pending summarizationMohamed Bassem1-0/+7
2025-09-07feat: add gif asset type support (#1876)Drashi1-2/+8
2025-09-07fix: don't mark inferenace job as failed when there's no content. fixes #1666Mohamed Bassem2-7/+32
2025-09-07fix: fix pdf detection when the header contains charset. fix: #1677Mohamed Bassem1-2/+16
2025-09-06fix: Fix feed worker to fetch feeds with proxyMohamed Bassem3-50/+58
2025-09-06fix: Change the inferance working logging when disabled to be a debug log levelMohamed Bassem2-2/+2
2025-09-06fix: Dont attempt to fetch rss if the user if out of quotaMohamed Bassem1-0/+13
2025-09-06refactor: Extract quota logic into its own classMohamed Bassem3-15/+13
2025-09-06fix: Reduce polling interval on meilisearch tasksMohamed Bassem1-1/+1
2025-09-06fix: Don't enqueue video tasks when video downlaod is disabledMohamed Bassem1-8/+10
2025-08-30fix: fix long worker log lines when downloading base64 imagesMohamed Bassem1-1/+3
2025-08-30fix: Respect wal mode for the queue dbMohamed Bassem1-1/+1
2025-08-22fix: dangling assets created by changing crawling configMohamedBassem1-5/+6
2025-08-22fix(workers): Drop the withTimeout wrappersMohamedBassem2-10/+2
2025-08-22feat: Export prometheus metrics from the workersMohamedBassem14-5/+111
2025-07-27refactor: Refactor crawlerWorker to use tryCatchMohamedBassem1-123/+117
2025-07-27refactor: Extract meilisearch as a pluginMohamedBassem3-61/+45
2025-07-27chore: More turbo fixesMohamedBassem1-2/+2
2025-07-27fix: Ensure that all packages are ESM packagesMohamedBassem1-0/+1
2025-07-26deps: Upgrade viteMohamed Bassem1-1/+1
2025-07-19fix: Run workers in prod without tsx. Fixes #1673Mohamed Bassem2-2/+26
2025-07-19feat: Allow setting browserless crawling per userMohamed Bassem1-1/+19
2025-07-13Revert "fix: Fix the types of the bookmark types in the db query"Mohamed Bassem2-21/+1
2025-07-13fix: Fix the types of the bookmark types in the db queryMohamed Bassem2-1/+21
2025-07-13feat: Add proper proxy support. fixes #1265Mohamed Bassem2-9/+87
2025-07-12deps: Upgrade typescript to 5.8Mohamed Bassem1-1/+1
2025-07-12deps: Upgrade drizzleMohamed Bassem1-1/+1
2025-07-12fix: Prioritize crawling user added links over bulk imports. fixes #1717Mohamed Bassem5-24/+55
2025-07-06fix: Fix search indexing after content splitMohamed Bassem1-7/+4
2025-07-06feat: Store large html content in the asset dbMohamed Bassem5-9/+135
2025-07-06feat: Add per user storage quotaMohamed Bassem4-74/+182
2025-07-05feat(workers): Allow custmoizing max parallelism for a bunch of workers. Fixe...Mohamed Bassem5-5/+7
2025-07-04fix(workers): A more lenient JSON parsing for LLM responses. Fixes #1267Mohamed Bassem1-1/+39
2025-06-22fix(workers): Disable the metascraper readability as it's causing slowness in...Mohamed Bassem1-2/+0
2025-06-22fix(workers): Fix jsdom console logs leaking into worker logsMohamed Bassem1-2/+3
2025-06-22feat(workers): adding a local metascraper plugin for Reddit posts (#1302)David Woods3-13/+115
2025-06-22feat(workers): migrate from puppeteer to playwright (#1296)Mael2-34/+39
2025-06-22chore: More oxlint changesMohamed Bassem3-7/+4
2025-06-22chore: migrate away from eslint to oxlint (#1642)xuatz5-12/+27