aboutsummaryrefslogtreecommitdiffstats
path: root/packages/shared/queues.ts (follow)
Commit message (Collapse)AuthorAgeFilesLines
* refactor: Move asset preprocessing to its own worker out of the inference workerMohamed Bassem2024-12-261-0/+19
|
* fix: Feed refreshes were not getting re-enqueued for failed jobsMohamed Bassem2024-11-091-0/+6
|
* feature: Add support for subscribing to RSS feeds. Fixes #202Mohamed Bassem2024-11-031-0/+17
|
* feature: Archive videos using yt-dlp. Fixes #215 (#525)kamtschatka2024-10-281-0/+23
| | | | | | | | | | | | | | | | | | | | | * Allow downloading more content from a webpage and index it #215 Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation * Some tweaks * Drop the dependency on the yt-dlp wrapper * Update openapi specs * Dont log an error when the url is not supported * Better handle supported websites that dont download anything --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* deps: Extract the queue implementation into its own reposMohamed Bassem2024-10-271-2/+1
|
* feature: Introduce a mechanism to cleanup dangling assetsMohamedBassem2024-10-121-0/+16
|
* feature(web): Add ability to manually trigger full page archives. Fixes #398 ↵kamtschatka2024-09-301-1/+2
| | | | | | | | | | | | | (#418) * [Feature Request] Ability to select what to "crawl full page archive" #398 Added the ability to start a full page crawl for links and also in bulk operations added the ability to refresh links as a bulk operation as well * minor icon and wording changes --------- Co-authored-by: MohamedBassem <me@mbassem.com>
* fix: async/await issues with the new queue (#319)kamtschatka2024-07-211-4/+4
|
* refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309)Mohamed Bassem2024-07-211-33/+27
|
* fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210)kamtschatka2024-06-091-0/+14
| | | | | | | | | | | | * re-index of database is not scanning all places when bookmark tags are changed. Manual indexing is working as workaround #208 introduced a new function to trigger a reindex to reduce copy/paste added missing reindexes when tags are deleted/bookmarks are updated * give functions a bit more descriptive name --------- Co-authored-by: kamtschatka <simon.schatka@gmx.at> Co-authored-by: MohamedBassem <me@mbassem.com>
* feature(worker): Allow configuring redis with a passwordMohamedBassem2024-05-151-0/+1
|
* feature: Allow recrawling bookmarks without running inference jobsMohamedBassem2024-04-201-0/+1
|
* fix: Increase default navigation timeout to 30s, make it configurable and ↵MohamedBassem2024-04-111-1/+10
| | | | add retries to crawling jobs
* fix: Attempt to increase the reliability of the ollama inferenceMohamedBassem2024-03-271-0/+8
|
* feature: Allow specifying a specific redis db to use. Fixes #13MohamedBassem2024-03-271-0/+1
|
* feature: Add full text search supportMohamedBassem2024-03-011-0/+22
|
* chore: Consolidate all config vars in one fileMohamedBassem2024-02-141-2/+3
|
* feature: Add ability to refresh bookmark detailsMohamedBassem2024-02-141-1/+0
|
* [refactor] Extract the bookmark model to be a high level model to support ↵MohamedBassem2024-02-091-2/+2
| | | | other type of bookmarks
* [refactor] Move the different packages to the package subdirMohamedBassem2024-02-081-0/+29