aboutsummaryrefslogtreecommitdiffstats
path: root/packages/shared/config.ts (follow)
Commit message (Collapse)AuthorAgeFilesLines
* feat: add support for turnstile on signupMohamed Bassem2025-11-301-0/+22
|
* fix: making serverConfig readonlyMohamed Bassem2025-11-281-1/+3
|
* feat: add crawler domain rate limiting (#2115)Mohamed Bassem2025-11-091-0/+10
|
* feat: Make search job timeout configurableMohamed Bassem2025-11-021-0/+2
|
* fix: Stricter SSRF validation (#2082)Mohamed Bassem2025-11-021-1/+24
| | | | | | | | | | | | | | | | | | | * fix: Stricter SSRF validation * skip dns resolution if running in proxy context * more fixes * Add LRU cache * change the env variable for internal hostnames * make dns resolution timeout configerable * upgrade ipaddr * handle ipv6 * handle proxy bypass for request interceptor
* feat: Allow configuring inline asset size thresholdMohamed Bassem2025-10-261-0/+2
|
* fix: update OpenAI API to use max_completion_tokens instead of max_tokens ↵Benjamin Michaelis2025-10-251-0/+2
| | | | | | | | | | (#2000) * fix: update OpenAI API to use max_completion_tokens instead of max_tokens The OpenAI API has deprecated max_tokens in favor of max_completion_tokens for newer models. This change updates both text and image model calls. * feat: add support for max_completion_tokens in OpenAI inference configuration
* feat: support passing multiple proxy values (#2039)Mohamed Bassem2025-10-121-2/+18
| | | | | | | * feat: support passing multiple proxy values * fix typo * trim and filter
* feat: Add cookie support for browser page accessMohamed Bassem2025-09-071-0/+2
| | | | | | | | | | | * feat: Add cookie support for browser page access Implemented cookie functionality for browser page access, including BROWSER_COOKIE_PATH configuration to specify the cookies JSON file path. * fix the docs --------- Co-authored-by: lizz <lizong1204@gmail.com>
* feat(workers): add worker enable/disable lists (#1885)Mohamed Bassem2025-09-071-0/+20
|
* feat: Export prometheus metrics from the workersMohamedBassem2025-08-221-0/+8
|
* feat: generate a random prometheus token on startupMohamedBassem2025-08-221-1/+3
|
* fix: Trim trailing slashes from nextauth urls. Fixes #1799MohamedBassem2025-08-031-1/+5
|
* fix: fix hidden env variable parse error. fixes #1790MohamedBassem2025-07-271-167/+164
|
* feat: Support NO_COLOR for logging. Fixes #1778MohamedBassem2025-07-271-0/+2
|
* refactor: Extract meilisearch as a pluginMohamedBassem2025-07-271-8/+0
|
* feat: Hide AI settings tab if inference is not configured. #1781Mohamed Bassem2025-07-261-3/+2
|
* feat: Add a max output tokens env variableMohamed Bassem2025-07-201-0/+2
|
* feat: Allow setting browserless crawling per userMohamed Bassem2025-07-191-4/+8
|
* feat: Allow enabling journaling mode on the dbMohamed Bassem2025-07-191-0/+6
|
* fix: Rename the proxy settings such that they don't interfer with other requestsMohamed Bassem2025-07-191-6/+6
|
* feat: Add stripe based subscriptionsMohamed Bassem2025-07-131-0/+28
|
* feat: Add proper proxy support. fixes #1265Mohamed Bassem2025-07-131-0/+10
|
* feat: Add API ratelimitsMohamed Bassem2025-07-101-0/+6
|
* feat: Add support for email verificationMohamed Bassem2025-07-101-117/+151
|
* feat: Add prometheus monitoring. Fixes #758Mohamed Bassem2025-07-061-0/+6
|
* feat(workers): Allow custmoizing max parallelism for a bunch of workers. ↵Mohamed Bassem2025-07-051-6/+22
| | | | Fixes #724
* feat: Add support for S3 as an asset storage layer (#1703)Mohamed Bassem2025-07-041-0/+21
| | | | | | | | | * feat: Add support for S3 as an asset storage layer. Fixes #305 * some minor fixes * use bulk deletion api * stream the file to s3
* feat: Add support for public lists (#1511)Mohamed Bassem2025-06-011-0/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * WIP: public lists * Drop viewing modes * Add the public endpoint for assets * regen the openapi spec * proper handling for different asset types * Add num bookmarks and a no bookmark banner * Correctly set page title * Add a not-found page * merge the RSS and public list endpoints * Add e2e tests for the public endpoints * Redesign the share list modal * Make NEXTAUTH_SECRET not required * propery render text bookmarks * rebase migration * fix public token tests * Add more tests
* feat: Generate RSS feeds from lists (#1507)Mohamed Bassem2025-05-311-0/+5
| | | | | | | | | | | * refactor: Move bookmark utils from shared-react to shared * Expose RSS feeds for lists * Add e2e tests * Slightly improve the look of the share dialog * allow specifying a limit in the rss endpoint
* feat: Disable the AI summary button if AI is not configured. Fixes #649Mohamed Bassem2025-05-181-0/+3
|
* feat: Add AI auto summarization. Fixes #1163Mohamed Bassem2025-05-181-0/+4
|
* feat: Change default text model to 4.1-miniMohamed Bassem2025-04-151-1/+1
|
* fix: Allow using JSON mode for ollama users. Fixes #1160Mohamed Bassem2025-04-131-2/+17
|
* feat: Allow storing assets in a separate directory. Fixes #1091Mohamed Bassem2025-03-291-0/+3
|
* feat(workers): Add CRAWLER_SCREENSHOT_TIMEOUT_SEC (#1155)Chang-Yen Tseng2025-03-271-0/+2
|
* feat(auth): Added env variable for OAuth timeout (#1136)Kaio Cesar2025-03-221-0/+2
| | | | | | | * feat(auth): add configurable OAuth timeout option * fix(config): change OAUTH_TIMEOUT to use z.coerce.number for better type handling * docs: Added instructions for OAUTH_TIMEOUT flag
* feat(workers): allows videoWorker to use ytdlp command line arguments ↵erik-nilcoast2025-03-161-0/+5
| | | | specified in the config. Fixes #775 #792 (#1117)
* fix: Move away from JSON outputs to structured outputs. Fixes #1047Mohamed Bassem2025-03-021-0/+2
|
* fix: custom fetch wrapper for ollama inference. Fixes #656 (#1032)Gavin Mogan2025-02-161-0/+2
| | | | | | | | | | | | | | | | * Add configurable fetch timeout for Ollama client * Worker service needs access to the .env file * repair typescript types * Update customFetch.ts * update the config docs --------- Co-authored-by: sbarbett <shane@barbetta.me> Co-authored-by: Mohamed Bassem <me@mbassem.com>
* fix: Loosen the restriction about the browser address env variable. Fixes #1000Mohamed Bassem2025-02-091-2/+2
|
* feat: Change default max upload size to 50MB up from 4MBMohamed Bassem2025-02-021-1/+1
|
* feat: Change webhooks to be configurable by usersMohamed Bassem2025-01-191-8/+0
|
* feat(webhook): Implement webhook functionality for bookmark events (#852)玄猫2025-01-191-0/+14
| | | | | | | | | | | | | | | | | | | | | | | | | * feat(webhook): Implement webhook functionality for bookmark events - Added WebhookWorker to handle webhook requests. - Integrated webhook triggering in crawlerWorker after video processing. - Updated main worker initialization to include WebhookWorker. - Enhanced configuration to support webhook URLs, token, and timeout. - Documented webhook configuration options in the documentation. - Introduced zWebhookRequestSchema for validating webhook requests. * feat(webhook): Update webhook handling and configuration - Changed webhook operation type from "create" to "crawled" in crawlerWorker and documentation. - Enhanced webhook retry logic in WebhookWorker to support multiple attempts. - Updated Docker configuration to include new webhook environment variables. - Improved validation for webhook configuration in shared config. - Adjusted zWebhookRequestSchema to reflect the new operation type. - Updated documentation to clarify webhook configuration options and usage. * minor modifications --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* feat: Add support for embeddings in the inference interface (#403)Mohammed Farghal2024-12-291-0/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * support embeddings generation in inference.ts (cherry picked from commit 9ae8773ad13ed87af8f72f167bdd56e02ea66f15) * make AI worker generate embeddings for text bookmark * make AI worker generate embeddings for text bookmark * fix unintentional change -- inference image model * support embeddings for PDF bookmarks * Upgrade drizzle-kit Existing version is not working with the upgraded version of drizzle-orm. I removed the "driver" to the match the new schema of the Config. Quoting from their Config: * `driver` - optional param that is responsible for explicitly providing a driver to use when accessing a database * *Possible values*: `aws-data-api`, `d1-http`, `expo`, `turso`, `pglite` * If you don't use AWS Data API, D1, Turso or Expo - ypu don't need this driver. You can check a driver strategy choice here: https://orm. * fix formatting and lint * add comments about truncate content * Revert "Upgrade drizzle-kit" This reverts commit 08a02c8df4ea403de65986ed1265940c6c994a20. * revert keep alive field in Ollama * change the interface to accept multiple inputs * docs --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* fix(workers): Don't block connection to chrome when failing to download ↵Mohamed Bassem2024-11-211-0/+2
| | | | adblock list. #674
* fix: Fix type in the separate container env variableMohamed Bassem2024-10-281-2/+2
|
* feature: Archive videos using yt-dlp. Fixes #215 (#525)kamtschatka2024-10-281-0/+6
| | | | | | | | | | | | | | | | | | | | | * Allow downloading more content from a webpage and index it #215 Added a worker that allows downloading videos depending on the environment variables refactored the code a bit added new video asset updated documentation * Some tweaks * Drop the dependency on the yt-dlp wrapper * Update openapi specs * Dont log an error when the url is not supported * Better handle supported websites that dont download anything --------- Co-authored-by: Mohamed Bassem <me@mbassem.com>
* docker: Add a flag to detect apps running in legacy container setupMohamed Bassem2024-10-261-0/+4
|
* feature: Add OCR support for images. Fixes #296Mohamed Bassem2024-10-201-0/+11
|