aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers (unfollow)
Commit message (Expand)AuthorFilesLines
2025-12-10feat: make asset preprocessing worker timeout configurableClaude1-1/+1
2025-12-08fix: migrate to metascraper-x from metascraper-twitterMohamed Bassem2-3/+3
2025-12-08feat: spread feed fetch scheduling deterministically over the hour (#2227)Mohamed Bassem1-0/+31
2025-12-07fix: better extraction for youtube thumbnails. #2204Mohamed Bassem2-0/+14
2025-11-29feat: Add automated bookmark backup feature (#2182)Mohamed Bassem4-0/+573
2025-11-28fix: lazy load js-tiktoken in prompts module (#2176)Mohamed Bassem2-4/+4
2025-11-27fix: Propagate group ids in queue calls (#2177)Mohamed Bassem5-4/+18
2025-11-22fix: add a way to allowlist all domains from ip validationMohamed Bassem1-0/+4
2025-11-16deps: upgrade hono and playwrightMohamed Bassem1-2/+2
2025-11-16deps: Upgrade typescript to 5.9Mohamed Bassem1-1/+1
2025-11-15feat: add Prometheus counter for HTTP status codes (#2117)Mohamed Bassem2-1/+13
2025-11-10feat: correct default prom metrics from web and worker containersMohamed Bassem1-0/+1
2025-11-10fix: fix crash in crawler on invalid URL in matchesNoProxyMohamed Bassem1-3/+9
2025-11-09feat: add crawler domain rate limiting (#2115)Mohamed Bassem1-4/+80
2025-11-09refactor: Allow runner functions to return results to onCompleteMohamed Bassem1-1/+1
2025-11-09feat: add failed_permanent metric for worker monitoring (#2107)Mohamed Bassem9-0/+32
2025-11-03fix: metascraper logo to go through proxy if one configured. fixes #1863Mohamed Bassem1-1/+14
2025-11-02fix: fix monolith to respect crawler proxyMohamed Bassem1-0/+9
2025-11-02feat(rss): Add import tags from RSS feed categories (#2031)Mohamed Bassem1-0/+29
2025-11-02feat: Make search job timeout configurableMohamed Bassem1-1/+1
2025-11-02fix: Stricter SSRF validation (#2082)Mohamed Bassem7-98/+507
2025-10-26fix: More memory optimizations for crawler worker. #1748Mohamed Bassem1-26/+43
2025-10-26fix: fix screenshot filepath in crawlerMohamed Bassem1-1/+1
2025-10-26fix: Respect abort signal in admin maintenance jobsMohamed Bassem3-1/+11
2025-10-26deps: Upgrade metascraper pluginsMohamed Bassem1-11/+11
2025-10-26deps: Upgrade metascraper-readability 5.49.6Mohamed Bassem1-1/+1
2025-10-26feat: Allow configuring inline asset size thresholdMohamed Bassem3-7/+5
2025-10-26feat: Add admin maintenance job to migrate large inline HTML (#2071)Mohamed Bassem4-4/+200
2025-10-26refactor: generalize tidy assets queue into admin maintenance (#2059)Mohamed Bassem4-112/+154
2025-10-12feat: Add source field to track bookmark creation sources (#2037)Mohamed Bassem1-0/+1
2025-10-12feat: support passing multiple proxy values (#2039)Mohamed Bassem2-7/+14
2025-10-06fix: round feed refresh hour for idempotency (#2013)Mohamed Bassem1-1/+6
2025-10-05feat: Restate-based queue plugin (#2011)Mohamed Bassem1-2/+8
2025-09-28feat: use jpegs for screenshots instead of pngsMohamed Bassem1-2/+3
2025-09-28feat: Stop downloading video/audio in playwrightMohamed Bassem1-0/+19
2025-09-28fix: Abort dangling processing when crawler is aborted (#1988)Mohamed Bassem1-27/+98
2025-09-28fix: Cleanup temp assets on monolith timeoutMohamed Bassem1-1/+17
2025-09-28feat: Add tag search and pagination (#1987)Mohamed Bassem1-1/+1
2025-09-14fix: fix bundling liteque in the workersMohamed Bassem2-0/+2
2025-09-14refactor: Move callsites to liteque to be behind a pluginMohamed Bassem13-123/+134
2025-09-07feat: Add cookie support for browser page accessMohamed Bassem1-0/+59
2025-09-07feat(workers): add worker enable/disable lists (#1885)Mohamed Bassem1-44/+49
2025-09-07fix: fix assets being marked as pending summarizationMohamed Bassem1-0/+7
2025-09-07feat: add gif asset type support (#1876)Drashi1-2/+8
2025-09-07fix: don't mark inferenace job as failed when there's no content. fixes #1666Mohamed Bassem2-7/+32
2025-09-07fix: fix pdf detection when the header contains charset. fix: #1677Mohamed Bassem1-2/+16
2025-09-06fix: Fix feed worker to fetch feeds with proxyMohamed Bassem3-50/+58
2025-09-06fix: Change the inferance working logging when disabled to be a debug log levelMohamed Bassem2-2/+2
2025-09-06fix: Dont attempt to fetch rss if the user if out of quotaMohamed Bassem1-0/+13
2025-09-06refactor: Extract quota logic into its own classMohamed Bassem3-15/+13