aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers (follow)
Commit message (Collapse)AuthorAgeFilesLines
...
* feat: Add support for 'ai tagged' as a webhook trigger. Fixes #1092Mohamed Bassem2025-03-071-0/+4
|
* fix(workers): Fix webhook events being sent regardless of selected user ↵Mohamed Bassem2025-03-071-46/+50
| | | | operation. Fixes #1092
* fix(workers): Fix pdf screenshotting not working when a text is extracted. ↵Mohamed Bassem2025-03-071-5/+9
| | | | Fixes #1096
* fix: Validate the output of the feed xml parser. Fixes #1085Mohamed Bassem2025-03-021-8/+19
|
* fix: Fix fixMode preventing images from getting taggedMohamed Bassem2025-03-021-1/+1
|
* fix: Move away from JSON outputs to structured outputs. Fixes #1047Mohamed Bassem2025-03-021-3/+6
|
* feat: Add PDF screenshot generation and display (#995)Ahmad Mujahid2025-02-173-40/+179
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Updated pdf2json to 3.1.5 * Extract and store a screenshot from PDF files using pdf2pic * Installing graphicsmagick and ghostscript * Generate Missing PDF screenshot with tidyAssets worker for backward support * Display PDF screenshot instead of the PDF in web if it exists. * Display PDF screenshot in mobile app if exists. * Updated pnpm-lock.yaml * Removed console.log * Revert the unnecessary changes in package.json * Revert pnpm-lock changes * Prevent rendering PDF files if the screenshot is not generated * refactor: replace useEffect with useMemo for section initialization * feat: show PDF file download button and handle large PDFs by defaulting to screenshot view * feat: add file size to openapi spec * feature: Add Assets preprocessing in fix mode to admin actions * i18n: add reprocess_assets_fix_mode translation * i18n: Add missing ar translations * A bunch of fixes * Fix openspec schema --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* fix: Fix node22 error in worker container. Fixes #962Mohamed Bassem2025-02-021-1/+1
|
* fix: Dont rearchive singlefile uploads and consider them as archivesMohamed Bassem2025-02-021-2/+6
|
* fix: Abort all IO when workers timeout instead of detaching. Fixes #742Mohamed Bassem2025-02-014-22/+92
|
* deps: Upgrade typescript to 5.7Mohamed Bassem2025-02-012-4/+3
|
* build: Fix CI error because of mismatched cmdk versionMohamed Bassem2025-01-191-1/+2
|
* feat: Change webhooks to be configurable by usersMohamed Bassem2025-01-192-11/+14
|
* chore: set firefox user-agent for rss reader (#908)Meysam2025-01-191-1/+1
| | | fixes #906
* feat(webhook): Implement webhook functionality for bookmark events (#852)玄猫2025-01-193-11/+163
| | | | | | | | | | | | | | | | | | | | | | | | | * feat(webhook): Implement webhook functionality for bookmark events - Added WebhookWorker to handle webhook requests. - Integrated webhook triggering in crawlerWorker after video processing. - Updated main worker initialization to include WebhookWorker. - Enhanced configuration to support webhook URLs, token, and timeout. - Documented webhook configuration options in the documentation. - Introduced zWebhookRequestSchema for validating webhook requests. * feat(webhook): Update webhook handling and configuration - Changed webhook operation type from "create" to "crawled" in crawlerWorker and documentation. - Enhanced webhook retry logic in WebhookWorker to support multiple attempts. - Updated Docker configuration to include new webhook environment variables. - Improved validation for webhook configuration in shared config. - Adjusted zWebhookRequestSchema to reflect the new operation type. - Updated documentation to clarify webhook configuration options and usage. * minor modifications --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* feat: Support customizing the summarization prompt. Fixes #731Mohamed Bassem2025-01-121-1/+1
|
* feat: Add support for singlefile extension uploads. #172Mohamed Bassem2025-01-112-6/+33
|
* chore: add format:fix and lint:fix scripts to all packagesMohamed Bassem (aider)2024-12-311-0/+2
|
* deps: Upgrade drizzle-orm to 0.38.3Mohamed Bassem2024-12-291-1/+1
|
* refactor: Move asset preprocessing to its own worker out of the inference workerMohamed Bassem2024-12-265-118/+231
|
* feature: Store crawling status code and allow users to find broken links. ↵Mohamed Bassem2024-12-081-4/+6
| | | | Fixes #169
* feature(workers): Allow running hoarder without chrome as a hard dependency. ↵Mohamed Bassem2024-11-301-11/+35
| | | | Fixes #650
* fix(workers): Add spaces in tag placeholders for better tokenizationMohamed Bassem2024-11-241-3/+3
|
* feature: Add support for tag placeholders in custom prompts. #111 (#612)kamtschatka2024-11-241-1/+42
| | | | | | | | | | * PR for #111 added a $tags,$aiTags and $userTags placeholder that will be replaced with all tags, ai tags or user tags during inference * Use the new buildImpersonatingTRPCClient util --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* fix(workers): Set a timeout on the screenshot call and completely skip it if ↵Mohamed Bassem2024-11-231-13/+32
| | | | screenshotting is disabled
* fix(workers): Don't block connection to chrome when failing to download ↵Mohamed Bassem2024-11-212-7/+24
| | | | adblock list. #674
* chore(workers): Add extra logging for browser connection errorsMohamed Bassem2024-11-211-1/+1
|
* fix: Stop erroring in video download when there's no media foundMohamed Bassem2024-11-091-1/+5
|
* fix: Improve the robustness of the feed workerMohamed Bassem2024-11-091-4/+27
|
* fix: Remove old downloaded video when it gets refreshedMohamed Bassem2024-11-091-0/+2
|
* fix: Only update bookmark tagging/crawling status when worker is out of retriesMohamed Bassem2024-11-095-19/+26
|
* fix: Feed refreshes were not getting re-enqueued for failed jobsMohamed Bassem2024-11-091-1/+1
|
* fix: Pass arguments to monolith and yt-dlp as array for better escapingMohamed Bassem2024-11-032-2/+2
|
* fix: Fix bug in tag normalization regex. Fixes #595Mohamed Bassem2024-11-031-1/+1
|
* feature: Schedule RSS feed refreshes every hourMohamed Bassem2024-11-033-3/+37
|
* feature: Add support for subscribing to RSS feeds. Fixes #202Mohamed Bassem2024-11-034-2/+190
|
* feature: Archive videos using yt-dlp. Fixes #215 (#525)kamtschatka2024-10-284-52/+272
| | | | | | | | | | | | | | | | | | | | | * Allow downloading more content from a webpage and index it #215 Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation * Some tweaks * Drop the dependency on the yt-dlp wrapper * Update openapi specs * Dont log an error when the url is not supported * Better handle supported websites that dont download anything --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* deps: Extract the queue implementation into its own reposMohamed Bassem2024-10-275-5/+5
|
* fix: Index the summary in searchMohamed Bassem2024-10-271-0/+1
|
* feature: Add a summarize with AI button for linksMohamed Bassem2024-10-271-3/+6
|
* refactor: Move inference to the shared packageMohamed Bassem2024-10-263-159/+2
|
* feature: Add OCR support for images. Fixes #296Mohamed Bassem2024-10-203-1/+44
|
* fix(workers): Pin execa to avoid ERR_PACKAGE_PATH_NOT_EXPORTED errorYour Name2024-10-191-1/+1
|
* feature: Allow reseting user password, change their roles and create new ↵kamtschatka2024-10-191-1/+1
| | | | | | | | | | | | | | | users. Fixes #495 (#567) * How do I set the variable "user" or "system" for AI inference #262 changed from system to user * Make Myself an Admin #560 added user management functionality to the admin page * A bunch of UI fixes and simplifications --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* deps: Upgrade metascraper for faster docker buildsMohamedBassem2024-10-121-10/+10
|
* feature: Allow customizing the inference's context lengthMohamedBassem2024-10-124-19/+11
|
* feature: Introduce a mechanism to cleanup dangling assetsMohamedBassem2024-10-122-3/+116
|
* refactor: Start tracking bookmark assets in the assets tableMohamedBassem2024-10-061-60/+83
|
* refactor: Include userId in the assets tableMohamedBassem2024-10-061-0/+5
|
* deps: Upgrade openai packageMohamedBassem2024-10-051-1/+1
|