aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers/utils.ts (follow)
Commit message (Collapse)AuthorAgeFilesLines
* fix: Stricter SSRF validation (#2082)Mohamed Bassem2025-11-021-61/+0
| | | | | | | | | | | | | | | | | | | * fix: Stricter SSRF validation * skip dns resolution if running in proxy context * more fixes * Add LRU cache * change the env variable for internal hostnames * make dns resolution timeout configerable * upgrade ipaddr * handle ipv6 * handle proxy bypass for request interceptor
* feat: support passing multiple proxy values (#2039)Mohamed Bassem2025-10-121-4/+10
| | | | | | | * feat: support passing multiple proxy values * fix typo * trim and filter
* fix: Fix feed worker to fetch feeds with proxyMohamed Bassem2025-09-061-0/+55
|
* refactor: Move asset preprocessing to its own worker out of the inference workerMohamed Bassem2024-12-261-44/+0
|
* feature: Add OCR support for images. Fixes #296Mohamed Bassem2024-10-201-0/+22
|
* feature: Allow customizing the inference's context lengthMohamedBassem2024-10-121-9/+0
|
* fix: Fix slice call in the content truncation logic which was resulting in ↵MohamedBassem2024-04-151-1/+1
| | | | excessive usage of context tokens. Fixes #94
* fix: Increase default navigation timeout to 30s, make it configurable and ↵MohamedBassem2024-04-111-1/+0
| | | | add retries to crawling jobs
* feature: Add PDF support (#88)Ahmad Mujahid2024-04-111-0/+32
| | | | | | | | | | | | | | | | | | | * feature: Add PDF support * fix: PDF feature enhancements * fix: Freeze expo-share-intent version to prevent breaking changes * fix: set endOfLine to auto for cross-platform development * fix: Upgrading eslint/parser and eslint-plugin to 7.6.0 to solve the linting issues * fix: enhancing PDF feature * fix: Allowing null in fiename for backward compatibility * fix: update pnpm file with pnpm 9.0.0-alpha-8 * fix:(web): PDF Preview for web
* fix(workers): Add a timeout to the crawling job to prevent it from getting ↵MohamedBassem2024-04-021-0/+16
stuck. Fixes #63