aboutsummaryrefslogtreecommitdiffstats
path: root/packages/shared/queues.ts (follow)
Commit message (Collapse)AuthorAgeFilesLines
* refactor: Move callsites to liteque to be behind a pluginMohamed Bassem2025-09-141-222/+0
|
* fix: Respect wal mode for the queue dbMohamed Bassem2025-08-301-1/+3
|
* fix: Prioritize crawling user added links over bulk imports. fixes #1717Mohamed Bassem2025-07-121-36/+29
|
* fix: Fix webhook not firing on deletion. Fixes #1613Mohamed Bassem2025-06-211-0/+3
|
* feat: Add "deleted" webhook event (#1464)Salvatore Gentile2025-05-241-1/+1
|
* feat: Add AI auto summarization. Fixes #1163Mohamed Bassem2025-05-181-2/+3
|
* feat: Implement generic rule engine (#1318)Mohamed Bassem2025-04-271-0/+28
| | | | | | | | | | | | | | | | | * Add schema for the new rule engine * Add rule engine backend logic * Implement the worker logic and event firing * Implement the UI changesfor the rule engine * Ensure that when a referenced list or tag are deleted, the corresponding event/action is * Dont show smart lists in rule engine events * Add privacy validations for attached tag and list ids * Move the rules logic into a models
* feat: Add support for 'ai tagged' as a webhook trigger. Fixes #1092Mohamed Bassem2025-03-071-1/+1
|
* feat: Add PDF screenshot generation and display (#995)Ahmad Mujahid2025-02-171-0/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Updated pdf2json to 3.1.5 * Extract and store a screenshot from PDF files using pdf2pic * Installing graphicsmagick and ghostscript * Generate Missing PDF screenshot with tidyAssets worker for backward support * Display PDF screenshot instead of the PDF in web if it exists. * Display PDF screenshot in mobile app if exists. * Updated pnpm-lock.yaml * Removed console.log * Revert the unnecessary changes in package.json * Revert pnpm-lock changes * Prevent rendering PDF files if the screenshot is not generated * refactor: replace useEffect with useMemo for section initialization * feat: show PDF file download button and handle large PDFs by defaulting to screenshot view * feat: add file size to openapi spec * feature: Add Assets preprocessing in fix mode to admin actions * i18n: add reprocess_assets_fix_mode translation * i18n: Add missing ar translations * A bunch of fixes * Fix openspec schema --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* feat: Change webhooks to be configurable by usersMohamed Bassem2025-01-191-4/+4
|
* feat(webhook): Implement webhook functionality for bookmark events (#852)玄猫2025-01-191-0/+27
| | | | | | | | | | | | | | | | | | | | | | | | | * feat(webhook): Implement webhook functionality for bookmark events - Added WebhookWorker to handle webhook requests. - Integrated webhook triggering in crawlerWorker after video processing. - Updated main worker initialization to include WebhookWorker. - Enhanced configuration to support webhook URLs, token, and timeout. - Documented webhook configuration options in the documentation. - Introduced zWebhookRequestSchema for validating webhook requests. * feat(webhook): Update webhook handling and configuration - Changed webhook operation type from "create" to "crawled" in crawlerWorker and documentation. - Enhanced webhook retry logic in WebhookWorker to support multiple attempts. - Updated Docker configuration to include new webhook environment variables. - Improved validation for webhook configuration in shared config. - Adjusted zWebhookRequestSchema to reflect the new operation type. - Updated documentation to clarify webhook configuration options and usage. * minor modifications --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* refactor: Move asset preprocessing to its own worker out of the inference workerMohamed Bassem2024-12-261-0/+19
|
* fix: Feed refreshes were not getting re-enqueued for failed jobsMohamed Bassem2024-11-091-0/+6
|
* feature: Add support for subscribing to RSS feeds. Fixes #202Mohamed Bassem2024-11-031-0/+17
|
* feature: Archive videos using yt-dlp. Fixes #215 (#525)kamtschatka2024-10-281-0/+23
| | | | | | | | | | | | | | | | | | | | | * Allow downloading more content from a webpage and index it #215 Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation * Some tweaks * Drop the dependency on the yt-dlp wrapper * Update openapi specs * Dont log an error when the url is not supported * Better handle supported websites that dont download anything --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* deps: Extract the queue implementation into its own reposMohamed Bassem2024-10-271-2/+1
|
* feature: Introduce a mechanism to cleanup dangling assetsMohamedBassem2024-10-121-0/+16
|
* feature(web): Add ability to manually trigger full page archives. Fixes #398 ↵kamtschatka2024-09-301-1/+2
| | | | | | | | | | | | | (#418) * [Feature Request] Ability to select what to "crawl full page archive" #398 Added the ability to start a full page crawl for links and also in bulk operations added the ability to refresh links as a bulk operation as well * minor icon and wording changes --------- Co-authored-by: MohamedBassem <me@mbassem.com>
* fix: async/await issues with the new queue (#319)kamtschatka2024-07-211-4/+4
|
* refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309)Mohamed Bassem2024-07-211-33/+27
|
* fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210)kamtschatka2024-06-091-0/+14
| | | | | | | | | | | | * re-index of database is not scanning all places when bookmark tags are changed. Manual indexing is working as workaround #208 introduced a new function to trigger a reindex to reduce copy/paste added missing reindexes when tags are deleted/bookmarks are updated * give functions a bit more descriptive name --------- Co-authored-by: kamtschatka <simon.schatka@gmx.at> Co-authored-by: MohamedBassem <me@mbassem.com>
* feature(worker): Allow configuring redis with a passwordMohamedBassem2024-05-151-0/+1
|
* feature: Allow recrawling bookmarks without running inference jobsMohamedBassem2024-04-201-0/+1
|
* fix: Increase default navigation timeout to 30s, make it configurable and ↵MohamedBassem2024-04-111-1/+10
| | | | add retries to crawling jobs
* fix: Attempt to increase the reliability of the ollama inferenceMohamedBassem2024-03-271-0/+8
|
* feature: Allow specifying a specific redis db to use. Fixes #13MohamedBassem2024-03-271-0/+1
|
* feature: Add full text search supportMohamedBassem2024-03-011-0/+22
|
* chore: Consolidate all config vars in one fileMohamedBassem2024-02-141-2/+3
|
* feature: Add ability to refresh bookmark detailsMohamedBassem2024-02-141-1/+0
|
* [refactor] Extract the bookmark model to be a high level model to support ↵MohamedBassem2024-02-091-2/+2
| | | | other type of bookmarks
* [refactor] Move the different packages to the package subdirMohamedBassem2024-02-081-0/+29