| Age | Commit message | Author | Files | +/- |
|---|---|---|---|---|
| feat: Add support for 'ai tagged' as a webhook trigger. Fixes #1092 | Mohamed Bassem | 4 | -4/+12 | |
feat: Add PDF screenshot generation and display (#995) …* Updated pdf2json to 3.1.5 * Extract and store a screenshot from PDF files using pdf2pic * Installing graphicsmagick and ghostscript * Generate Missing PDF screenshot with tidyAssets worker for backward support * Display PDF screenshot instead of the PDF in web if it exists. * Display PDF screenshot in mobile app if exists. * Updated pnpm-lock.yaml * Removed console.log * Revert the unnecessary changes in package.json * Revert pnpm-lock changes * Prevent rendering PDF files if the screenshot is not generated * refactor: replace useEffect with useMemo for section initialization * feat: show PDF file download button and handle large PDFs by defaulting to screenshot view * feat: add file size to openapi spec * feature: Add Assets preprocessing in fix mode to admin actions * i18n: add reprocess_assets_fix_mode translation * i18n: Add missing ar translations * A bunch of fixes * Fix openspec schema --------- Co-authored-by: Mohamed Bassem <me@mbassem.com> |
Ahmad Mujahid | 34 | -101/+545 | |
| feat: Change webhooks to be configurable by users | Mohamed Bassem | 23 | -28/+4272 | |
feat(webhook): Implement webhook functionality for bookmark events (#852) …* feat(webhook): Implement webhook functionality for bookmark events - Added WebhookWorker to handle webhook requests. - Integrated webhook triggering in crawlerWorker after video processing. - Updated main worker initialization to include WebhookWorker. - Enhanced configuration to support webhook URLs, token, and timeout. - Documented webhook configuration options in the documentation. - Introduced zWebhookRequestSchema for validating webhook requests. * feat(webhook): Update webhook handling and configuration - Changed webhook operation type from "create" to "crawled" in crawlerWorker and documentation. - Enhanced webhook retry logic in WebhookWorker to support multiple attempts. - Updated Docker configuration to include new webhook environment variables. - Improved validation for webhook configuration in shared config. - Adjusted zWebhookRequestSchema to reflect the new operation type. - Updated documentation to clarify webhook configuration options and usage. * minor modifications --------- Co-authored-by: Mohamed Bassem <me@mbassem.com> |
玄猫 | 6 | -11/+237 | |
| refactor: Move asset preprocessing to its own worker out of the inference worker | Mohamed Bassem | 7 | -120/+258 | |
| fix: Feed refreshes were not getting re-enqueued for failed jobs | Mohamed Bassem | 4 | -9/+15 | |
| feature: Add support for subscribing to RSS feeds. Fixes #202 | Mohamed Bassem | 16 | -3/+2280 | |
feature: Archive videos using yt-dlp. Fixes #215 (#525) …* Allow downloading more content from a webpage and index it #215 Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation * Some tweaks * Drop the dependency on the yt-dlp wrapper * Update openapi specs * Dont log an error when the url is not supported * Better handle supported websites that dont download anything --------- Co-authored-by: Mohamed Bassem <me@mbassem.com> |
kamtschatka | 17 | -71/+403 | |
| deps: Extract the queue implementation into its own repos | Mohamed Bassem | 23 | -1336/+65 | |
| feature: Introduce a mechanism to cleanup dangling assets | MohamedBassem | 10 | -8/+351 | |
feature(web): Add ability to manually trigger full page archives. Fixes #398… …* [Feature Request] Ability to select what to "crawl full page archive" #398 Added the ability to start a full page crawl for links and also in bulk operations added the ability to refresh links as a bulk operation as well * minor icon and wording changes --------- Co-authored-by: MohamedBassem <me@mbassem.com> |
kamtschatka | 5 | -6/+89 | |
| fix: async/await issues with the new queue (#319) | kamtschatka | 6 | -25/+27 | |
| refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309) | Mohamed Bassem | 13 | -344/+128 | |
fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210) …* re-index of database is not scanning all places when bookmark tags are changed. Manual indexing is working as workaround #208 introduced a new function to trigger a reindex to reduce copy/paste added missing reindexes when tags are deleted/bookmarks are updated * give functions a bit more descriptive name --------- Co-authored-by: kamtschatka <simon.schatka@gmx.at> Co-authored-by: MohamedBassem <me@mbassem.com> |
kamtschatka | 6 | -55/+41 | |
| feature(worker): Allow configuring redis with a password | MohamedBassem | 3 | -0/+4 | |
| feature: Allow recrawling bookmarks without running inference jobs | MohamedBassem | 4 | -9/+46 | |
| fix: Increase default navigation timeout to 30s, make it configurable and add… | MohamedBassem | 5 | -6/+17 | |
| fix: Attempt to increase the reliability of the ollama inference | MohamedBassem | 4 | -17/+49 | |
| feature: Allow specifying a specific redis db to use. Fixes #13 | MohamedBassem | 3 | -14/+18 | |
| feature: Add full text search support | MohamedBassem | 17 | -12/+440 | |
| chore: Consolidate all config vars in one file | MohamedBassem | 7 | -33/+61 | |
| feature: Add ability to refresh bookmark details | MohamedBassem | 5 | -4/+76 | |
| [refactor] Extract the bookmark model to be a high level model to support other… | MohamedBassem | 22 | -308/+396 | |
| [refactor] Move the different packages to the package subdir | MohamedBassem | 128 | -2716/+2713 | |
| [feature] Add openAI integration for extracting tags from articles | MohamedBassem | 9 | -19/+239 | |
| Implement metadata fetching logic in the crawler | MohamedBassem | 29 | -264/+439 | |
| Init package and start bullmq workers | MohamedBassem | 12 | -8/+91 |