aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers/crawlerWorker.ts (follow)
Commit message (Expand)AuthorAgeFilesLines
* feature: Allow recrawling bookmarks without running inference jobsMohamedBassem2024-04-201-7/+29
* feature: Download images and screenshotsMohamedBassem2024-04-201-28/+130
* feature: Recrawl failed links from admin UI (#95)Ahmad Mujahid2024-04-111-0/+20
* fix: Increase default navigation timeout to 30s, make it configurable and add...MohamedBassem2024-04-111-1/+1
* fix(crawler): Skip validating URLs in metascrapper as it was already being va...MohamedBassem2024-04-091-0/+3
* fix(workers): Increase default timeout to 60s, make it configurable and impro...MohamedBassem2024-04-061-11/+21
* fix(workers): Add a timeout to the crawling job to prevent it from getting st...MohamedBassem2024-04-021-1/+2
* chore(workers): Remove unused configuration optionsMohamedBassem2024-03-311-2/+0
* format: Add missing lint and format, and format the entire repoMohamedBassem2024-03-301-5/+6
* refactor: Validate env variables using zodMohamedBassem2024-03-271-1/+1
* docker: Use external chrome docker containerMohamedBassem2024-03-241-10/+40
* fix(workers): Fix the leaky browser instances in workers during developmentMohamedBassem2024-03-211-28/+30
* fix: Simple validations for crawled URLsMohamedBassem2024-03-211-1/+17
* structure: Create apps dir and copy tooling dir from t3-turbo repoMohamedBassem2024-03-141-0/+201
generated by cgit v1.2.3-70-g09d2 (git 2.46.0) at 2026-01-29 21:33:32 +0000