aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers (follow)
Commit message (Expand)AuthorAgeFilesLines
* refactor: Allow runner functions to return results to onCompleteMohamed Bassem2025-11-091-1/+1
* feat: add failed_permanent metric for worker monitoring (#2107)Mohamed Bassem2025-11-099-0/+32
* fix: metascraper logo to go through proxy if one configured. fixes #1863Mohamed Bassem2025-11-031-1/+14
* fix: fix monolith to respect crawler proxyMohamed Bassem2025-11-021-0/+9
* feat(rss): Add import tags from RSS feed categories (#2031)Mohamed Bassem2025-11-021-0/+29
* feat: Make search job timeout configurableMohamed Bassem2025-11-021-1/+1
* fix: Stricter SSRF validation (#2082)Mohamed Bassem2025-11-027-98/+507
* fix: More memory optimizations for crawler worker. #1748Mohamed Bassem2025-10-261-26/+43
* fix: fix screenshot filepath in crawlerMohamed Bassem2025-10-261-1/+1
* fix: Respect abort signal in admin maintenance jobsMohamed Bassem2025-10-263-1/+11
* deps: Upgrade metascraper pluginsMohamed Bassem2025-10-261-11/+11
* deps: Upgrade metascraper-readability 5.49.6Mohamed Bassem2025-10-261-1/+1
* feat: Allow configuring inline asset size thresholdMohamed Bassem2025-10-263-7/+5
* feat: Add admin maintenance job to migrate large inline HTML (#2071)Mohamed Bassem2025-10-264-4/+200
* refactor: generalize tidy assets queue into admin maintenance (#2059)Mohamed Bassem2025-10-264-112/+154
* feat: Add source field to track bookmark creation sources (#2037)Mohamed Bassem2025-10-121-0/+1
* feat: support passing multiple proxy values (#2039)Mohamed Bassem2025-10-122-7/+14
* fix: round feed refresh hour for idempotency (#2013)Mohamed Bassem2025-10-061-1/+6
* feat: Restate-based queue plugin (#2011)Mohamed Bassem2025-10-051-2/+8
* feat: use jpegs for screenshots instead of pngsMohamed Bassem2025-09-281-2/+3
* feat: Stop downloading video/audio in playwrightMohamed Bassem2025-09-281-0/+19
* fix: Abort dangling processing when crawler is aborted (#1988)Mohamed Bassem2025-09-281-27/+98
* fix: Cleanup temp assets on monolith timeoutMohamed Bassem2025-09-281-1/+17
* feat: Add tag search and pagination (#1987)Mohamed Bassem2025-09-281-1/+1
* fix: fix bundling liteque in the workersMohamed Bassem2025-09-142-0/+2
* refactor: Move callsites to liteque to be behind a pluginMohamed Bassem2025-09-1413-123/+134
* feat: Add cookie support for browser page accessMohamed Bassem2025-09-071-0/+59
* feat(workers): add worker enable/disable lists (#1885)Mohamed Bassem2025-09-071-44/+49
* fix: fix assets being marked as pending summarizationMohamed Bassem2025-09-071-0/+7
* feat: add gif asset type support (#1876)Drashi2025-09-071-2/+8
* fix: don't mark inferenace job as failed when there's no content. fixes #1666Mohamed Bassem2025-09-072-7/+32
* fix: fix pdf detection when the header contains charset. fix: #1677Mohamed Bassem2025-09-071-2/+16
* fix: Fix feed worker to fetch feeds with proxyMohamed Bassem2025-09-063-50/+58
* fix: Change the inferance working logging when disabled to be a debug log levelMohamed Bassem2025-09-062-2/+2
* fix: Dont attempt to fetch rss if the user if out of quotaMohamed Bassem2025-09-061-0/+13
* refactor: Extract quota logic into its own classMohamed Bassem2025-09-063-15/+13
* fix: Reduce polling interval on meilisearch tasksMohamed Bassem2025-09-061-1/+1
* fix: Don't enqueue video tasks when video downlaod is disabledMohamed Bassem2025-09-061-8/+10
* fix: fix long worker log lines when downloading base64 imagesMohamed Bassem2025-08-301-1/+3
* fix: Respect wal mode for the queue dbMohamed Bassem2025-08-301-1/+1
* fix: dangling assets created by changing crawling configMohamedBassem2025-08-221-5/+6
* fix(workers): Drop the withTimeout wrappersMohamedBassem2025-08-222-10/+2
* feat: Export prometheus metrics from the workersMohamedBassem2025-08-2214-5/+111
* refactor: Refactor crawlerWorker to use tryCatchMohamedBassem2025-07-271-123/+117
* refactor: Extract meilisearch as a pluginMohamedBassem2025-07-273-61/+45
* chore: More turbo fixesMohamedBassem2025-07-271-2/+2
* fix: Ensure that all packages are ESM packagesMohamedBassem2025-07-271-0/+1
* deps: Upgrade viteMohamed Bassem2025-07-261-1/+1
* fix: Run workers in prod without tsx. Fixes #1673Mohamed Bassem2025-07-192-2/+26
* feat: Allow setting browserless crawling per userMohamed Bassem2025-07-191-1/+19