aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers (follow)
Commit message (Expand)AuthorAgeFilesLines
* fix(workers): Shutdown workers on SIGTERMMohamedBassem2024-07-282-0/+9
* fix: async/await issues with the new queue (#319)kamtschatka2024-07-212-3/+3
* refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309)Mohamed Bassem2024-07-215-72/+75
* fix: monolith not embedding SVG files correctly. Fixes #289 (#306)kamtschatka2024-07-141-5/+2
* refactor: added the bookmark type to the database (#256)kamtschatka2024-07-011-0/+6
* refactor: remove redundant code from crawler worker and refactor handling of ...kamtschatka2024-06-291-32/+49
* feature: Automatically transfer image urls into bookmared assets. Fixes #246MohamedBassem2024-06-231-6/+16
* refactor: extract assets into their own database table. #215 (#220)kamtschatka2024-06-231-29/+71
* feature: add support for PDF links. Fixes #28 (#216)kamtschatka2024-06-221-57/+163
* fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210)kamtschatka2024-06-092-10/+4
* fix(workers): AI infered tags can contain " " at the beginning. Fixes #184 (#...kamtschatka2024-06-071-3/+5
* fix(crawler): Only update the database if full page archival is enabledMohamedBassem2024-05-261-19/+19
* feature: Full page archival with monolith. Fixes #132MohamedBassem2024-05-262-1/+66
* feature(inference): Improve ollama tagging (#162)kamtschatka2024-05-181-5/+12
* feature(crawler): Allow connecting to browser's websocket address and launchi...MohamedBassem2024-05-151-28/+55
* feature: Take full page screenshots #143 (#148)kamtschatka2024-05-121-1/+2
* fix(inference): Attempt to reuse existing identical tagsMohamedBassem2024-04-261-22/+62
* feature(crawler): Allow increasing crawler concurrency and configure storing ...MohamedBassem2024-04-261-0/+13
* fix(crawler): Better extraction for amazon imagesMohamedBassem2024-04-232-0/+3
* fix(workers): Increase robustness of search worker and add extra logging. Fix...MohamedBassem2024-04-231-24/+45
* fix(workers): Set a modern user agent and update the default viewport sizeMohamedBassem2024-04-231-0/+7
* feature: Allow recrawling bookmarks without running inference jobsMohamedBassem2024-04-201-7/+29
* feature: Download images and screenshotsMohamedBassem2024-04-201-28/+130
* fix: Fix slice call in the content truncation logic which was resulting in ex...MohamedBassem2024-04-151-1/+1
* feature: Add title to bookmarks and allow editing them. Fixes #27MohamedBassem2024-04-151-1/+2
* fix: Differentiate between pending in db and in redis in admin job statsMohamedBassem2024-04-121-1/+1
* feature: Recrawl failed links from admin UI (#95)Ahmad Mujahid2024-04-111-0/+20
* fix: Increase default navigation timeout to 30s, make it configurable and add...MohamedBassem2024-04-112-2/+1
* feature: Add PDF support (#88)Ahmad Mujahid2024-04-114-12/+98
* feature(inference): Upgrade the default vision model to the new gpt-4-turboMohamedBassem2024-04-091-0/+1
* fix(crawler): Skip validating URLs in metascrapper as it was already being va...MohamedBassem2024-04-091-0/+3
* fix(workers): Increase default timeout to 60s, make it configurable and impro...MohamedBassem2024-04-061-11/+21
* feature: Include server version in the admin UI. Fixes #66MohamedBassem2024-04-021-0/+4
* fix(workers): Add a timeout to the crawling job to prevent it from getting st...MohamedBassem2024-04-022-1/+18
* feat(workers): Allow configuring the language in which the tags are generated...MohamedBassem2024-04-021-5/+5
* chore(workers): Remove unused configuration optionsMohamedBassem2024-03-311-2/+0
* format: Add missing lint and format, and format the entire repoMohamedBassem2024-03-307-25/+37
* fix: Sort search results by relevanceMohamedBassem2024-03-301-0/+1
* feature(web): Add support for attaching notes to bookmarksMohamedBassem2024-03-301-0/+1
* fix: Drop the 2k char limit on notes. Fixes #25MohamedBassem2024-03-271-6/+11
* fix: Attempt to increase the reliability of the ollama inferenceMohamedBassem2024-03-272-16/+40
* feature: Add support for local models using ollamaMohamedBassem2024-03-274-76/+168
* refactor: Validate env variables using zodMohamedBassem2024-03-272-12/+12
* docker: Use external chrome docker containerMohamedBassem2024-03-241-10/+40
* fix(workers): Fix the leaky browser instances in workers during developmentMohamedBassem2024-03-213-29/+46
* fix: Simple validations for crawled URLsMohamedBassem2024-03-211-1/+17
* fix(workers): Drop the restriction of the tags being lowercase and without sp...MohamedBassem2024-03-191-2/+2
* refactor: Change asset storage to be the filesystem instead of sqliteMohamedBassem2024-03-192-11/+9
* Feature: Add support for uploading images and automatically inferring their t...Mohamed Bassem2024-03-192-19/+90
* docker: Fix dockerfiles to adapt to the new repo structureMohamedBassem2024-03-141-5/+4