aboutsummaryrefslogtreecommitdiffstats
path: root/packages (follow)
Commit message (Collapse)AuthorAgeFilesLines
* build: Fix sherif failures by sorting depsMohamedBassem2024-08-312-6/+6
|
* feature(mobile): Allow editing notes from the mobile appMohamedBassem2024-08-251-0/+29
|
* feat: Upgrade default openai models to gpt-4o-mini which are 3x cheaperMohamedBassem2024-07-271-2/+2
|
* feature(cli): Allow updating tags/lists from CLI (#211)kamtschatka2024-07-272-17/+62
| | | | | | | | | | | | * Improve the CLI #209 added the possibility to assign tags to bookmarks while creating added the possibility to assign a newly created to a list right away added the possibility to add and remove tags from bookmarks * minor tweaks --------- Co-authored-by: MohamedBassem <me@mbassem.com>
* fix: async/await issues with the new queue (#319)kamtschatka2024-07-214-22/+24
|
* refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309)Mohamed Bassem2024-07-215-60/+44
|
* chore: Add a new sqlite based queue packageMohamedBassem2024-07-1415-0/+1023
|
* fix: Fix TRPC batchign failure because of long URLs. Fixes #281 (#291)kamtschatka2024-07-131-0/+1
| | | limiting the length of the URL for batched requests to prevent 431 errors
* chore: added a new table to store the config in the database (#279)kamtschatka2024-07-084-0/+1106
|
* fix: Renaming full page archive asset file doesn't work inside docker. Fixes ↵MohamedBassem2024-07-051-1/+4
| | | | #273
* refactor: fixed typos in BookmarkTypes (#268)kamtschatka2024-07-012-5/+5
|
* fix: Increase list name size to max 40 chars up from 20. Fixes #254MohamedBassem2024-07-011-1/+1
|
* fix: Fix duplicate bookmarks in links with assetsMohamedBassem2024-07-011-1/+5
|
* refactor: added the bookmark type to the database (#256)kamtschatka2024-07-018-69/+1184
| | | | | | | | | | | | | | | | | * refactoring asset types Extracted out functions to silently delete assets and to update them after crawling Generalized the mapping of assets to bookmark fields to make extending them easier * Added the bookmark type to the database Introduced an enum to have better type safety cleaned up the code and based some code on the type directly * add BookmarkType.UNKNWON * lint and remove unused function --------- Co-authored-by: MohamedBassem <me@mbassem.com>
* refactor: remove redundant code from crawler worker and refactor handling of ↵kamtschatka2024-06-292-33/+31
| | | | | | | | | | | | | asset types (#253) * refactoring asset types Extracted out functions to silently delete assets and to update them after crawling Generalized the mapping of assets to bookmark fields to make extending them easier * revert silentDeleteAsset and hide better-sqlite3 --------- Co-authored-by: MohamedBassem <me@mbassem.com>
* feature: Automatically transfer image urls into bookmared assets. Fixes #246MohamedBassem2024-06-231-3/+7
|
* refactor: extract assets into their own database table. #215 (#220)kamtschatka2024-06-235-23/+1200
| | | | | | | | | | | | | | | | | | | * Allow downloading more content from a webpage and index it #215 added a new table that contains the information about assets for link bookmarks created migration code that transfers the existing data into the new table * Allow downloading more content from a webpage and index it #215 removed the old asset columns from the database updated the UI to use the data from the linkBookmarkAssets array * generalize the assets table to not be linked in particular to links * fix migrations post merge * fix missing asset ids in the getBookmarks call --------- Co-authored-by: MohamedBassem <me@mbassem.com>
* feature: add support for PDF links. Fixes #28 (#216)kamtschatka2024-06-227-34/+1082
| | | | | | | | | | | | | | | | | * feature request: pdf support #28 Added a new sourceUrl column to the asset bookmarks Added transforming a link bookmark pointing at a pdf to an asset bookmark made sure the "View Original" link is also shown for asset bookmarks that have a sourceURL updated gitignore for IDEA * remove pdf parsing from the crawler * extract the http logic into its own function to avoid duplicating the post-processing actions (openai/index) * Add 5s timeout to the content type fetch --------- Co-authored-by: MohamedBassem <me@mbassem.com>
* fix: Remove the bookmark update text limit (#244)Ahmad Mujahid2024-06-221-1/+1
|
* fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210)kamtschatka2024-06-094-45/+37
| | | | | | | | | | | | * re-index of database is not scanning all places when bookmark tags are changed. Manual indexing is working as workaround #208 introduced a new function to trigger a reindex to reduce copy/paste added missing reindexes when tags are deleted/bookmarks are updated * give functions a bit more descriptive name --------- Co-authored-by: kamtschatka <simon.schatka@gmx.at> Co-authored-by: MohamedBassem <me@mbassem.com>
* feature: Full page archival with monolith. Fixes #132MohamedBassem2024-05-268-1/+1064
|
* fix: Fix missing bookmarks during pagination if they got created in the same ↵MohamedBassem2024-05-193-8/+102
| | | | second. Fixes #140
* fix: Add the missing bookmark URL index migrationMohamedBassem2024-05-183-0/+1016
|
* feature(inference): Upgrade the default vision model to the new ↵MohamedBassem2024-05-161-1/+1
| | | | gpt-4o-2024-05-13 which is faster and 2x cheaper
* feature(crawler): Allow connecting to browser's websocket address and ↵MohamedBassem2024-05-151-0/+4
| | | | launching the browser on demand. This enables support for browserless
* feature(worker): Allow configuring redis with a passwordMohamedBassem2024-05-152-0/+3
|
* tests: Add tests for bookmark deduplicationMohamedBassem2024-05-121-0/+38
|
* feature: Take full page screenshots #143 (#148)kamtschatka2024-05-121-0/+2
| | | | | | Added the fullPage flag to take full screen screenshots updated the UI accordingly to properly show the screenshots instead of scaling it down Co-authored-by: kamtschatka <simon.schatka@gmx.at>
* feature: Dedup links on creation. Fixes #49MohamedBassem2024-05-064-101/+138
|
* fix(cli): Remove limit from array length when listing bookmarks. Fixes #135MohamedBassem2024-05-051-1/+2
|
* fix: Allow zod to coerce the crawler timeout from strings. Fixes #134MohamedBassem2024-05-031-2/+2
|
* feature: Allow users to delete all unused tags in one goMohamedBassem2024-04-262-2/+38
|
* fix: Fix error when merging empty tagsMohamedBassem2024-04-261-9/+11
|
* fix: Change tag listing API to return unused tagsMohamedBassem2024-04-261-31/+28
|
* fix: Re-index affected bookmarks when one of their tags gets updatedMohamedBassem2024-04-261-30/+78
|
* feature(crawler): Allow increasing crawler concurrency and configure storing ↵MohamedBassem2024-04-261-0/+6
| | | | images and screenshots
* feature(web): Add ability to rename, merge and fast delete tags. Fixes #105 ↵Mohamed Bassem2024-04-252-33/+204
| | | | | | | (#125) * feature(web): Allow deleting tags from the all tags page * feature(web): Add ability to rename, merge and fast delete tags. Fixes #105
* ui(web): Show bookmark URL when maximizing a bookmarkMohamedBassem2024-04-241-0/+1
|
* feature(extension): Allow adding tags and lists to newly hoarded bookmarksMohamedBassem2024-04-234-1/+52
|
* fix: Ensure that downloaded asset images are from the allowed content typesMohamedBassem2024-04-201-0/+10
|
* feature: Allow recrawling bookmarks without running inference jobsMohamedBassem2024-04-202-0/+3
|
* feature: Download images and screenshotsMohamedBassem2024-04-209-4/+1096
|
* fix(mobile): Fix flicker on sign in pageMohamedBassem2024-04-191-5/+1
|
* feature: Nested lists (#110). Fixes #62Mohamed Bassem2024-04-198-38/+1187
| | | | | * feature: Add support for nested lists * prevent moving the parent to a subtree
* refactor: Move the shared types to the shared packageMohamedBassem2024-04-1811-11/+16
|
* feature: Add title to bookmarks and allow editing them. Fixes #27MohamedBassem2024-04-157-0/+989
|
* feature(web): Allow changing the bookmark grid layout (#98)Mohamed Bassem2024-04-142-0/+26
|
* fix: Differentiate between pending in db and in redis in admin job statsMohamedBassem2024-04-121-18/+52
|
* feature: Recrawl failed links from admin UI (#95)Ahmad Mujahid2024-04-115-19/+1025
| | | | | * feature: Retry failed crawling URLs * fix: Enhancing visuals and some minor changes.
* fix: Increase default navigation timeout to 30s, make it configurable and ↵MohamedBassem2024-04-112-1/+12
| | | | add retries to crawling jobs