rcgit

/ karakeep
follow (on) | order: default date topo
Age Commit message Author Files +/-
feat: Add support for 'ai tagged' as a webhook trigger. Fixes #1092 Mohamed Bassem 4 -4/+12
feat: Add PDF screenshot generation and display (#995)
* Updated pdf2json to 3.1.5
* Extract and store a screenshot from PDF files using pdf2pic
* Installing graphicsmagick and ghostscript
* Generate Missing PDF screenshot with tidyAssets worker for backward support
* Display PDF screenshot instead of the PDF in web if it exists.
* Display PDF screenshot in mobile app if exists.
* Updated pnpm-lock.yaml
* Removed console.log
* Revert the unnecessary changes in package.json
* Revert pnpm-lock changes
* Prevent rendering PDF files if the screenshot is not generated
* refactor: replace useEffect with useMemo for section initialization
* feat: show PDF file download button and handle large PDFs by defaulting to screenshot view
* feat: add file size to openapi spec
* feature: Add Assets preprocessing in fix mode to admin actions
* i18n: add reprocess_assets_fix_mode translation
* i18n: Add missing ar translations
* A bunch of fixes
* Fix openspec schema
---------
Co-authored-by: Mohamed Bassem <me@mbassem.com>
Ahmad Mujahid 34 -101/+545
feat: Change webhooks to be configurable by users Mohamed Bassem 23 -28/+4272
feat(webhook): Implement webhook functionality for bookmark events (#852)
* feat(webhook): Implement webhook functionality for bookmark events
- Added WebhookWorker to handle webhook requests.
- Integrated webhook triggering in crawlerWorker after video processing.
- Updated main worker initialization to include WebhookWorker.
- Enhanced configuration to support webhook URLs, token, and timeout.
- Documented webhook configuration options in the documentation.
- Introduced zWebhookRequestSchema for validating webhook requests.
* feat(webhook): Update webhook handling and configuration
- Changed webhook operation type from "create" to "crawled" in crawlerWorker and documentation.
- Enhanced webhook retry logic in WebhookWorker to support multiple attempts.
- Updated Docker configuration to include new webhook environment variables.
- Improved validation for webhook configuration in shared config.
- Adjusted zWebhookRequestSchema to reflect the new operation type.
- Updated documentation to clarify webhook configuration options and usage.
* minor modifications
---------
Co-authored-by: Mohamed Bassem <me@mbassem.com>
玄猫 6 -11/+237
refactor: Move asset preprocessing to its own worker out of the inference worker Mohamed Bassem 7 -120/+258
fix: Feed refreshes were not getting re-enqueued for failed jobs Mohamed Bassem 4 -9/+15
feature: Add support for subscribing to RSS feeds. Fixes #202 Mohamed Bassem 16 -3/+2280
feature: Archive videos using yt-dlp. Fixes #215 (#525)
* Allow downloading more content from a webpage and index it #215
Added a worker that allows downloading videos depending on the environment variables
refactored the code a bit
added new video asset
updated documentation
* Some tweaks
* Drop the dependency on the yt-dlp wrapper
* Update openapi specs
* Dont log an error when the url is not supported
* Better handle supported websites that dont download anything
---------
Co-authored-by: Mohamed Bassem <me@mbassem.com>
kamtschatka 17 -71/+403
deps: Extract the queue implementation into its own repos Mohamed Bassem 23 -1336/+65
feature: Introduce a mechanism to cleanup dangling assets MohamedBassem 10 -8/+351
feature(web): Add ability to manually trigger full page archives. Fixes #398…
* [Feature Request] Ability to select what to "crawl full page archive" #398
Added the ability to start a full page crawl for links and also in bulk operations
added the ability to refresh links as a bulk operation as well
* minor icon and wording changes
---------
Co-authored-by: MohamedBassem <me@mbassem.com>
kamtschatka 5 -6/+89
fix: async/await issues with the new queue (#319) kamtschatka 6 -25/+27
refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309) Mohamed Bassem 13 -344/+128
fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210)
* re-index of database is not scanning all places when bookmark tags are changed. Manual indexing is working as workaround #208
introduced a new function to trigger a reindex to reduce copy/paste
added missing reindexes when tags are deleted/bookmarks are updated
* give functions a bit more descriptive name
---------
Co-authored-by: kamtschatka <simon.schatka@gmx.at>
Co-authored-by: MohamedBassem <me@mbassem.com>
kamtschatka 6 -55/+41
feature(worker): Allow configuring redis with a password MohamedBassem 3 -0/+4
feature: Allow recrawling bookmarks without running inference jobs MohamedBassem 4 -9/+46
fix: Increase default navigation timeout to 30s, make it configurable and add… MohamedBassem 5 -6/+17
fix: Attempt to increase the reliability of the ollama inference MohamedBassem 4 -17/+49
feature: Allow specifying a specific redis db to use. Fixes #13 MohamedBassem 3 -14/+18
feature: Add full text search support MohamedBassem 17 -12/+440
chore: Consolidate all config vars in one file MohamedBassem 7 -33/+61
feature: Add ability to refresh bookmark details MohamedBassem 5 -4/+76
[refactor] Extract the bookmark model to be a high level model to support other… MohamedBassem 22 -308/+396
[refactor] Move the different packages to the package subdir MohamedBassem 128 -2716/+2713
[feature] Add openAI integration for extracting tags from articles MohamedBassem 9 -19/+239
Implement metadata fetching logic in the crawler MohamedBassem 29 -264/+439
Init package and start bullmq workers MohamedBassem 12 -8/+91