aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers (follow)
Commit message (Expand)AuthorAgeFilesLines
* feat(ai): Support restricting AI tags to a subset of existing tags (#2444)Mohamed Bassem2 days1-1/+33
* feat(crawler): Split bookmark metadata updates into two phases for faster fee...Mohamed Bassem2 days1-22/+32
* fix: treat bookmark not found as a no-op in rule engine instead of a failure ...Mohamed Bassem3 days1-2/+9
* feat: Add separate queue for import link crawling (#2452)Mohamed Bassem3 days3-35/+51
* feat(metrics): add prometheus metric for bookmark crawl latency (#2461)Mohamed Bassem3 days3-2/+28
* fix(ci): fix missing format errorMohamed Bassem6 days1-1/+1
* feat: add extra instrumentation in the otel traces (#2453)Mohamed Bassem7 days4-26/+178
* fix(import): sanitize error messages to prevent backend detail leakage (#2455)Mohamed Bassem7 days1-1/+26
* fix(import): skip counting pending items for paushed sessionsMohamedBassem7 days1-7/+16
* fix(import): register improt metrics to the prom registryMohamed Bassem7 days2-1/+9
* fix(import): propagate crawling/tagging failure to import statusMohamed Bassem7 days1-18/+50
* fix: extra logging for the import workerMohamed Bassem7 days1-13/+39
* fix: backfill old sessions and do queue backpressure (#2449)Mohamed Bassem7 days1-21/+54
* feat: Import workflow v3 (#2378)Mohamed Bassem7 days2-1/+579
* feat: Add LLM-based OCR as alternative to Tesseract (#2442)Mohamed Bassem9 days1-9/+58
* feat: batch meilisearch requests (#2441)Mohamed Bassem9 days1-7/+18
* fix(web): don't bundle tiktoken in client bundlesMohamed Bassem9 days2-2/+3
* refactor: lazy init background queuesMohamed Bassem10 days1-10/+50
* fix: Accept more permissive RSS feed content types and Fix User-Agent key (#...E.T.2026-01-111-2/+2
* chore: add a note about hostname allowlists in the validation error messageMohamed Bassem2026-01-021-1/+1
* chore: worker tracing (#2321)Mohamed Bassem2025-12-3012-821/+1030
* fix: reset tagging status on crawl failure (#2316)Mohamed Bassem2025-12-291-15/+37
* feat: add customizable tag styles (#2312)Mohamed Bassem2025-12-272-7/+37
* feat: support archiving as pdf (#2309)Mohamed Bassem2025-12-272-3/+110
* deps: upgrade tesseract to v7Mohamed Bassem2025-12-261-1/+1
* fix: preserve failure count when rescheduling rate limited domains (#2303)Mohamed Bassem2025-12-251-38/+13
* feat: Add user settings to disable auto tagging/summarization (#2275)Mohamed Bassem2025-12-222-1/+32
* fix: optimize tagging db queries (#2287)Mohamed Bassem2025-12-221-18/+18
* fix: Fix Amazon product image extraction on amazon.com URLs (#2108)Randall Hand2025-12-142-0/+79
* feat: use reddit API for metadata extraction. Fixes #1853 #1883Mohamed Bassem2025-12-133-33/+343
* fix: use GET requests for the content type requestMohamed Bassem2025-12-131-1/+1
* feat: make asset preprocessing worker timeout configurableClaude2025-12-101-1/+1
* fix: migrate to metascraper-x from metascraper-twitterMohamed Bassem2025-12-082-3/+3
* feat: spread feed fetch scheduling deterministically over the hour (#2227)Mohamed Bassem2025-12-081-0/+31
* fix: better extraction for youtube thumbnails. #2204Mohamed Bassem2025-12-072-0/+14
* feat: Add automated bookmark backup feature (#2182)Mohamed Bassem2025-11-294-0/+573
* fix: lazy load js-tiktoken in prompts module (#2176)Mohamed Bassem2025-11-282-4/+4
* fix: Propagate group ids in queue calls (#2177)Mohamed Bassem2025-11-275-4/+18
* fix: add a way to allowlist all domains from ip validationMohamed Bassem2025-11-221-0/+4
* deps: upgrade hono and playwrightMohamed Bassem2025-11-161-2/+2
* deps: Upgrade typescript to 5.9Mohamed Bassem2025-11-161-1/+1
* feat: add Prometheus counter for HTTP status codes (#2117)Mohamed Bassem2025-11-152-1/+13
* feat: correct default prom metrics from web and worker containersMohamed Bassem2025-11-101-0/+1
* fix: fix crash in crawler on invalid URL in matchesNoProxyMohamed Bassem2025-11-101-3/+9
* feat: add crawler domain rate limiting (#2115)Mohamed Bassem2025-11-091-4/+80
* refactor: Allow runner functions to return results to onCompleteMohamed Bassem2025-11-091-1/+1
* feat: add failed_permanent metric for worker monitoring (#2107)Mohamed Bassem2025-11-099-0/+32
* fix: metascraper logo to go through proxy if one configured. fixes #1863Mohamed Bassem2025-11-031-1/+14
* fix: fix monolith to respect crawler proxyMohamed Bassem2025-11-021-0/+9
* feat(rss): Add import tags from RSS feed categories (#2031)Mohamed Bassem2025-11-021-0/+29