| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | chore: add format:fix and lint:fix scripts to all packages | Mohamed Bassem (aider) | 2024-12-31 | 1 | -0/+2 |
| | | |||||
| * | deps: Upgrade drizzle-orm to 0.38.3 | Mohamed Bassem | 2024-12-29 | 1 | -1/+1 |
| | | |||||
| * | refactor: Move asset preprocessing to its own worker out of the inference worker | Mohamed Bassem | 2024-12-26 | 5 | -118/+231 |
| | | |||||
| * | feature: Store crawling status code and allow users to find broken links. ↵ | Mohamed Bassem | 2024-12-08 | 1 | -4/+6 |
| | | | | | Fixes #169 | ||||
| * | feature(workers): Allow running hoarder without chrome as a hard dependency. ↵ | Mohamed Bassem | 2024-11-30 | 1 | -11/+35 |
| | | | | | Fixes #650 | ||||
| * | fix(workers): Add spaces in tag placeholders for better tokenization | Mohamed Bassem | 2024-11-24 | 1 | -3/+3 |
| | | |||||
| * | feature: Add support for tag placeholders in custom prompts. #111 (#612) | kamtschatka | 2024-11-24 | 1 | -1/+42 |
| | | | | | | | | | | | * PR for #111 added a $tags,$aiTags and $userTags placeholder that will be replaced with all tags, ai tags or user tags during inference * Use the new buildImpersonatingTRPCClient util --------- Co-authored-by: Mohamed Bassem <me@mbassem.com> | ||||
| * | fix(workers): Set a timeout on the screenshot call and completely skip it if ↵ | Mohamed Bassem | 2024-11-23 | 1 | -13/+32 |
| | | | | | screenshotting is disabled | ||||
| * | fix(workers): Don't block connection to chrome when failing to download ↵ | Mohamed Bassem | 2024-11-21 | 2 | -7/+24 |
| | | | | | adblock list. #674 | ||||
| * | chore(workers): Add extra logging for browser connection errors | Mohamed Bassem | 2024-11-21 | 1 | -1/+1 |
| | | |||||
| * | fix: Stop erroring in video download when there's no media found | Mohamed Bassem | 2024-11-09 | 1 | -1/+5 |
| | | |||||
| * | fix: Improve the robustness of the feed worker | Mohamed Bassem | 2024-11-09 | 1 | -4/+27 |
| | | |||||
| * | fix: Remove old downloaded video when it gets refreshed | Mohamed Bassem | 2024-11-09 | 1 | -0/+2 |
| | | |||||
| * | fix: Only update bookmark tagging/crawling status when worker is out of retries | Mohamed Bassem | 2024-11-09 | 5 | -19/+26 |
| | | |||||
| * | fix: Feed refreshes were not getting re-enqueued for failed jobs | Mohamed Bassem | 2024-11-09 | 1 | -1/+1 |
| | | |||||
| * | fix: Pass arguments to monolith and yt-dlp as array for better escaping | Mohamed Bassem | 2024-11-03 | 2 | -2/+2 |
| | | |||||
| * | fix: Fix bug in tag normalization regex. Fixes #595 | Mohamed Bassem | 2024-11-03 | 1 | -1/+1 |
| | | |||||
| * | feature: Schedule RSS feed refreshes every hour | Mohamed Bassem | 2024-11-03 | 3 | -3/+37 |
| | | |||||
| * | feature: Add support for subscribing to RSS feeds. Fixes #202 | Mohamed Bassem | 2024-11-03 | 4 | -2/+190 |
| | | |||||
| * | feature: Archive videos using yt-dlp. Fixes #215 (#525) | kamtschatka | 2024-10-28 | 4 | -52/+272 |
| | | | | | | | | | | | | | | | | | | | | | | * Allow downloading more content from a webpage and index it #215 Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation * Some tweaks * Drop the dependency on the yt-dlp wrapper * Update openapi specs * Dont log an error when the url is not supported * Better handle supported websites that dont download anything --------- Co-authored-by: Mohamed Bassem <me@mbassem.com> | ||||
| * | deps: Extract the queue implementation into its own repos | Mohamed Bassem | 2024-10-27 | 5 | -5/+5 |
| | | |||||
| * | fix: Index the summary in search | Mohamed Bassem | 2024-10-27 | 1 | -0/+1 |
| | | |||||
| * | feature: Add a summarize with AI button for links | Mohamed Bassem | 2024-10-27 | 1 | -3/+6 |
| | | |||||
| * | refactor: Move inference to the shared package | Mohamed Bassem | 2024-10-26 | 3 | -159/+2 |
| | | |||||
| * | feature: Add OCR support for images. Fixes #296 | Mohamed Bassem | 2024-10-20 | 3 | -1/+44 |
| | | |||||
| * | fix(workers): Pin execa to avoid ERR_PACKAGE_PATH_NOT_EXPORTED error | Your Name | 2024-10-19 | 1 | -1/+1 |
| | | |||||
| * | feature: Allow reseting user password, change their roles and create new ↵ | kamtschatka | 2024-10-19 | 1 | -1/+1 |
| | | | | | | | | | | | | | | | | users. Fixes #495 (#567) * How do I set the variable "user" or "system" for AI inference #262 changed from system to user * Make Myself an Admin #560 added user management functionality to the admin page * A bunch of UI fixes and simplifications --------- Co-authored-by: Mohamed Bassem <me@mbassem.com> | ||||
| * | deps: Upgrade metascraper for faster docker builds | MohamedBassem | 2024-10-12 | 1 | -10/+10 |
| | | |||||
| * | feature: Allow customizing the inference's context length | MohamedBassem | 2024-10-12 | 4 | -19/+11 |
| | | |||||
| * | feature: Introduce a mechanism to cleanup dangling assets | MohamedBassem | 2024-10-12 | 2 | -3/+116 |
| | | |||||
| * | refactor: Start tracking bookmark assets in the assets table | MohamedBassem | 2024-10-06 | 1 | -60/+83 |
| | | |||||
| * | refactor: Include userId in the assets table | MohamedBassem | 2024-10-06 | 1 | -0/+5 |
| | | |||||
| * | deps: Upgrade openai package | MohamedBassem | 2024-10-05 | 1 | -1/+1 |
| | | |||||
| * | feature(web): Add ability to manually trigger full page archives. Fixes #398 ↵ | kamtschatka | 2024-09-30 | 1 | -3/+5 |
| | | | | | | | | | | | | | | (#418) * [Feature Request] Ability to select what to "crawl full page archive" #398 Added the ability to start a full page crawl for links and also in bulk operations added the ability to refresh links as a bulk operation as well * minor icon and wording changes --------- Co-authored-by: MohamedBassem <me@mbassem.com> | ||||
| * | feature(web): Add the ability to customize the inference prompts. Fixes #170 | MohamedBassem | 2024-09-29 | 1 | -39/+42 |
| | | |||||
| * | fix(workers): Log stacktrace on worker error. #424 (#429) | kamtschatka | 2024-09-26 | 3 | -3/+7 |
| | | | | extended logging when an exception occurrs, so it is possible to see the stacktrace of a failed execution | ||||
| * | deps: Upgrade drizzle and next auth drizzle adapter | MohamedBassem | 2024-09-15 | 1 | -1/+1 |
| | | |||||
| * | feature(worker): Allow configuring inference job timeout and ollama keep ↵ | MohamedBassem | 2024-09-15 | 2 | -1/+2 |
| | | | | | alive. Fixes #389 #224 | ||||
| * | build: Fix sherif failures by sorting deps | MohamedBassem | 2024-08-31 | 1 | -1/+1 |
| | | |||||
| * | fix(workers): Shutdown workers on SIGTERM | MohamedBassem | 2024-07-28 | 2 | -0/+9 |
| | | |||||
| * | fix: async/await issues with the new queue (#319) | kamtschatka | 2024-07-21 | 2 | -3/+3 |
| | | |||||
| * | refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309) | Mohamed Bassem | 2024-07-21 | 5 | -72/+75 |
| | | |||||
| * | fix: monolith not embedding SVG files correctly. Fixes #289 (#306) | kamtschatka | 2024-07-14 | 1 | -5/+2 |
| | | | | passing in the URL of the page to have the proper URL for resolving relative paths | ||||
| * | refactor: added the bookmark type to the database (#256) | kamtschatka | 2024-07-01 | 1 | -0/+6 |
| | | | | | | | | | | | | | | | | | | * refactoring asset types Extracted out functions to silently delete assets and to update them after crawling Generalized the mapping of assets to bookmark fields to make extending them easier * Added the bookmark type to the database Introduced an enum to have better type safety cleaned up the code and based some code on the type directly * add BookmarkType.UNKNWON * lint and remove unused function --------- Co-authored-by: MohamedBassem <me@mbassem.com> | ||||
| * | refactor: remove redundant code from crawler worker and refactor handling of ↵ | kamtschatka | 2024-06-29 | 1 | -32/+49 |
| | | | | | | | | | | | | | | asset types (#253) * refactoring asset types Extracted out functions to silently delete assets and to update them after crawling Generalized the mapping of assets to bookmark fields to make extending them easier * revert silentDeleteAsset and hide better-sqlite3 --------- Co-authored-by: MohamedBassem <me@mbassem.com> | ||||
| * | feature: Automatically transfer image urls into bookmared assets. Fixes #246 | MohamedBassem | 2024-06-23 | 1 | -6/+16 |
| | | |||||
| * | refactor: extract assets into their own database table. #215 (#220) | kamtschatka | 2024-06-23 | 1 | -29/+71 |
| | | | | | | | | | | | | | | | | | | | | * Allow downloading more content from a webpage and index it #215 added a new table that contains the information about assets for link bookmarks created migration code that transfers the existing data into the new table * Allow downloading more content from a webpage and index it #215 removed the old asset columns from the database updated the UI to use the data from the linkBookmarkAssets array * generalize the assets table to not be linked in particular to links * fix migrations post merge * fix missing asset ids in the getBookmarks call --------- Co-authored-by: MohamedBassem <me@mbassem.com> | ||||
| * | feature: add support for PDF links. Fixes #28 (#216) | kamtschatka | 2024-06-22 | 1 | -57/+163 |
| | | | | | | | | | | | | | | | | | | * feature request: pdf support #28 Added a new sourceUrl column to the asset bookmarks Added transforming a link bookmark pointing at a pdf to an asset bookmark made sure the "View Original" link is also shown for asset bookmarks that have a sourceURL updated gitignore for IDEA * remove pdf parsing from the crawler * extract the http logic into its own function to avoid duplicating the post-processing actions (openai/index) * Add 5s timeout to the content type fetch --------- Co-authored-by: MohamedBassem <me@mbassem.com> | ||||
| * | fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210) | kamtschatka | 2024-06-09 | 2 | -10/+4 |
| | | | | | | | | | | | | | * re-index of database is not scanning all places when bookmark tags are changed. Manual indexing is working as workaround #208 introduced a new function to trigger a reindex to reduce copy/paste added missing reindexes when tags are deleted/bookmarks are updated * give functions a bit more descriptive name --------- Co-authored-by: kamtschatka <simon.schatka@gmx.at> Co-authored-by: MohamedBassem <me@mbassem.com> | ||||
| * | fix(workers): AI infered tags can contain " " at the beginning. Fixes #184 ↵ | kamtschatka | 2024-06-07 | 1 | -3/+5 |
| | | | | | | | | (#194) added a trim to tags to prevent whitespaces at the beginning/end of tags Co-authored-by: kamtschatka <simon.schatka@gmx.at> | ||||
 |
index : karakeep | |
| Unnamed repository; edit this file 'description' to name the repository. |
| aboutsummaryrefslogtreecommitdiffstats |