rcgit

/ karakeep
follow (on) | order: default date topo
Age Commit message Author Files +/-
fix: Trim trailing slashes from nextauth urls. Fixes #1799 MohamedBassem 1 -1/+5
fix: fix hidden env variable parse error. fixes #1790 MohamedBassem 1 -167/+164
feat: Support NO_COLOR for logging. Fixes #1778 MohamedBassem 3 -3/+10
refactor: Extract meilisearch as a plugin MohamedBassem 26 -155/+524
feat: Hide AI settings tab if inference is not configured. #1781 Mohamed Bassem 2 -22/+21
feat: Add a max output tokens env variable Mohamed Bassem 3 -1/+6
feat: Allow setting browserless crawling per user Mohamed Bassem 10 -6/+2399
feat: Allow enabling journaling mode on the db Mohamed Bassem 3 -18/+36
fix: Rename the proxy settings such that they don't interfer with other requests Mohamed Bassem 2 -9/+9
feat: Add stripe based subscriptions Mohamed Bassem 18 -60/+4351
feat: Add proper proxy support. fixes #1265 Mohamed Bassem 5 -9/+118
feat: Add API ratelimits Mohamed Bassem 7 -13/+173
feat: Add support for email verification Mohamed Bassem 12 -157/+748
feat: Add prometheus monitoring. Fixes #758 Mohamed Bassem 10 -55/+331
feat(workers): Allow custmoizing max parallelism for a bunch of workers. Fixes… Mohamed Bassem 9 -15/+45
feat: Add support for S3 as an asset storage layer (#1703)
* feat: Add support for S3 as an asset storage layer. Fixes #305
* some minor fixes
* use bulk deletion api
* stream the file to s3
Mohamed Bassem 14 -109/+3194
feat: Add support for public lists (#1511)
* WIP: public lists
* Drop viewing modes
* Add the public endpoint for assets
* regen the openapi spec
* proper handling for different asset types
* Add num bookmarks and a no bookmark banner
* Correctly set page title
* Add a not-found page
* merge the RSS and public list endpoints
* Add e2e tests for the public endpoints
* Redesign the share list modal
* Make NEXTAUTH_SECRET not required
* propery render text bookmarks
* rebase migration
* fix public token tests
* Add more tests
Mohamed Bassem 36 -147/+3286
feat: Generate RSS feeds from lists (#1507)
* refactor: Move bookmark utils from shared-react to shared
* Expose RSS feeds for lists
* Add e2e tests
* Slightly improve the look of the share dialog
* allow specifying a limit in the rss endpoint
Mohamed Bassem 26 -293/+3131
feat: Disable the AI summary button if AI is not configured. Fixes #649 Mohamed Bassem 3 -0/+8
feat: Add AI auto summarization. Fixes #1163 Mohamed Bassem 34 -2639/+4843
feat: Change default text model to 4.1-mini Mohamed Bassem 3 -4/+4
fix: Allow using JSON mode for ollama users. Fixes #1160 Mohamed Bassem 3 -18/+59
feat: Allow storing assets in a separate directory. Fixes #1091 Mohamed Bassem 3 -4/+8
feat(workers): Add CRAWLER_SCREENSHOT_TIMEOUT_SEC (#1155) Chang-Yen Tseng 3 -10/+21
feat(auth): Added env variable for OAuth timeout (#1136)
* feat(auth): add configurable OAuth timeout option
* fix(config): change OAUTH_TIMEOUT to use z.coerce.number for better type handling
* docs: Added instructions for OAUTH_TIMEOUT flag
Kaio Cesar 3 -0/+6
feat(workers): allows videoWorker to use ytdlp command line arguments specified… erik-nilcoast 3 -1/+8
fix: Move away from JSON outputs to structured outputs. Fixes #1047 Mohamed Bassem 7 -39/+74
fix: custom fetch wrapper for ollama inference. Fixes #656 (#1032)
* Add configurable fetch timeout for Ollama client
* Worker service needs access to the .env file
* repair typescript types
* Update customFetch.ts
* update the config docs
---------
Co-authored-by: sbarbett <shane@barbetta.me>
Co-authored-by: Mohamed Bassem <me@mbassem.com>
Gavin Mogan 5 -12/+34
fix: Loosen the restriction about the browser address env variable. Fixes #1000 Mohamed Bassem 1 -2/+2
feat: Change default max upload size to 50MB up from 4MB Mohamed Bassem 2 -6/+6
feat: Change webhooks to be configurable by users Mohamed Bassem 23 -28/+4272
feat(webhook): Implement webhook functionality for bookmark events (#852)
* feat(webhook): Implement webhook functionality for bookmark events
- Added WebhookWorker to handle webhook requests.
- Integrated webhook triggering in crawlerWorker after video processing.
- Updated main worker initialization to include WebhookWorker.
- Enhanced configuration to support webhook URLs, token, and timeout.
- Documented webhook configuration options in the documentation.
- Introduced zWebhookRequestSchema for validating webhook requests.
* feat(webhook): Update webhook handling and configuration
- Changed webhook operation type from "create" to "crawled" in crawlerWorker and documentation.
- Enhanced webhook retry logic in WebhookWorker to support multiple attempts.
- Updated Docker configuration to include new webhook environment variables.
- Improved validation for webhook configuration in shared config.
- Adjusted zWebhookRequestSchema to reflect the new operation type.
- Updated documentation to clarify webhook configuration options and usage.
* minor modifications
---------
Co-authored-by: Mohamed Bassem <me@mbassem.com>
玄猫 6 -11/+237
feat: Add support for embeddings in the inference interface (#403)
* support embeddings generation in inference.ts
(cherry picked from commit 9ae8773ad13ed87af8f72f167bdd56e02ea66f15)
* make AI worker generate embeddings for text bookmark
* make AI worker generate embeddings for text bookmark
* fix unintentional change -- inference image model
* support embeddings for PDF bookmarks
* Upgrade drizzle-kit
Existing version is not working with the upgraded version of drizzle-orm.
I removed the "driver" to the match the new schema of the Config.
Quoting from their Config:
* `driver` - optional param that is responsible for explicitly providing a driver to use when accessing a database
 * *Possible values*: `aws-data-api`, `d1-http`, `expo`, `turso`, `pglite`
 * If you don't use AWS Data API, D1, Turso or Expo - ypu don't need this driver. You can check a driver strategy choice here: https://orm.
* fix formatting and lint
* add comments about truncate content
* Revert "Upgrade drizzle-kit"
This reverts commit 08a02c8df4ea403de65986ed1265940c6c994a20.
* revert keep alive field in Ollama
* change the interface to accept multiple inputs
* docs
---------
Co-authored-by: Mohamed Bassem <me@mbassem.com>
Mohammed Farghal 3 -11/+48
fix(workers): Don't block connection to chrome when failing to download adblock… Mohamed Bassem 5 -117/+120
fix: Fix type in the separate container env variable Mohamed Bassem 2 -4/+4
feature: Archive videos using yt-dlp. Fixes #215 (#525)
* Allow downloading more content from a webpage and index it #215
Added a worker that allows downloading videos depending on the environment variables
refactored the code a bit
added new video asset
updated documentation
* Some tweaks
* Drop the dependency on the yt-dlp wrapper
* Update openapi specs
* Dont log an error when the url is not supported
* Better handle supported websites that dont download anything
---------
Co-authored-by: Mohamed Bassem <me@mbassem.com>
kamtschatka 17 -71/+403
docker: Add a flag to detect apps running in legacy container setup Mohamed Bassem 2 -0/+6
feature: Add OCR support for images. Fixes #296 Mohamed Bassem 8 -2/+139
feature: Allow customizing the inference's context length MohamedBassem 9 -36/+51
feature: Allow to disable default password login after SSO is configured. Fixes…
* [Feature Request] Allow to disable default password log in after SSO is configured #406
changed the flag to also disallow logging in via password
The extensions will also no longer be allowed to log in via username/password then
* [Feature Request] Allow to disable default password log in after SSO is configured #406
added the error message for OAuth
kamtschatka 8 -14/+37
feature: Allow disabling password signups (#413)
* [Feature Request] Allow to disable default password log in after SSO is configured #406
Added the DISABLE_LOCAL_SIGNUPS that can be used to force OAuth signups only
* rename local signups to password signups
---------
Co-authored-by: MohamedBassem <me@mbassem.com>
kamtschatka 5 -3/+15
feature(web): Add the ability to customize the inference prompts. Fixes #170 MohamedBassem 13 -39/+1764
feature: Added support for custom OIDC providers to set up authentication.…
* https://github.com/hoarder-app/hoarder/issues/92
Added support for custom OIDC providers to set up authentication
* Added support for custom OIDC providers to set up authentication #92
Showing OAuth errors in the signin page
* Added support for custom OIDC providers to set up authentication #92
Added the possibility to log in using an API key in case OAuth is used
* Added support for custom OIDC providers to set up authentication #92
improved the code to also promote the first user to admin if OAuth is used
* revert extension changes
* Simplify admin checks
---------
Co-authored-by: MohamedBassem <me@mbassem.com>
kamtschatka 4 -11/+133
feature(worker): Allow configuring inference job timeout and ollama keep alive.… MohamedBassem 4 -19/+26
feat: Upgrade default openai models to gpt-4o-mini which are 3x cheaper MohamedBassem 3 -6/+6
refactor: Replace the usage of bullMQ with the hoarder sqlite-based queue (#309) Mohamed Bassem 13 -344/+128
feature: Full page archival with monolith. Fixes #132 MohamedBassem 14 -7/+1259
feature(inference): Upgrade the default vision model to the new… MohamedBassem 2 -2/+2
feature(crawler): Allow connecting to browser's websocket address and launching… MohamedBassem 3 -36/+70
feature(worker): Allow configuring redis with a password MohamedBassem 3 -0/+4
feature: Take full page screenshots #143 (#148)
Added the fullPage flag to take full screen screenshots
updated the UI accordingly to properly show the screenshots instead of scaling it down
Co-authored-by: kamtschatka <simon.schatka@gmx.at>
kamtschatka 4 -3/+9
fix: Allow zod to coerce the crawler timeout from strings. Fixes #134 MohamedBassem 1 -2/+2
feature(crawler): Allow increasing crawler concurrency and configure storing… MohamedBassem 3 -4/+26
fix: Increase default navigation timeout to 30s, make it configurable and add… MohamedBassem 5 -6/+17
feature(inference): Upgrade the default vision model to the new gpt-4-turbo MohamedBassem 4 -10/+11
fix(workers): Increase default timeout to 60s, make it configurable and improve… MohamedBassem 3 -11/+29
feature: Include server version in the admin UI. Fixes #66 MohamedBassem 8 -14/+92
feat(workers): Allow configuring the language in which the tags are generated.… MohamedBassem 4 -28/+8
chore(workers): Remove unused configuration options MohamedBassem 2 -6/+0
feature: Change maximum asset size to be configurable. Fixes #33 MohamedBassem 3 -12/+16
feature: Allow specifying a specific redis db to use. Fixes #13 MohamedBassem 3 -14/+18
feature: Add support for local models using ollama MohamedBassem 10 -81/+206
refactor: Validate env variables using zod MohamedBassem 7 -46/+91
fix: Allow setting demo mode creds when demo mode is enabled MohamedBassem 7 -23/+39
docker: Use external chrome docker container MohamedBassem 8 -33/+61
feature: Add an option to disable new signups MohamedBassem 6 -26/+23
feature(web): Add support for demo mode MohamedBassem 13 -19/+89
refactor: Change asset storage to be the filesystem instead of sqlite MohamedBassem 16 -75/+2006
feature: Add full text search support MohamedBassem 17 -12/+440
feature: Basic support for demo mode MohamedBassem 4 -12/+13
build: Fix docker images MohamedBassem 7 -20/+34
fix: Let the crawler wait a bit more for page load MohamedBassem 3 -3/+18
chore: Consolidate all config vars in one file MohamedBassem 7 -33/+61
refactor: Migrating to trpc instead of next's route handers MohamedBassem 28 -521/+343
[chore] Linting and formating tweaking MohamedBassem 24 -67/+157
[refactor] Move the different packages to the package subdir MohamedBassem 128 -2716/+2713
[ui] Very first draft of the link grid MohamedBassem 14 -52/+248
[Auth] Fix authentication config MohamedBassem 1 -5/+6
Linting and formatting MohamedBassem 15 -128/+134
Move the web app into a subdir MohamedBassem 64 -820/+821
Init NextAuth MohamedBassem 12 -105/+194