aboutsummaryrefslogtreecommitdiffstats
path: root/apps/workers/crawlerWorker.ts (unfollow)
Commit message (Expand)AuthorFilesLines
2024-03-27refactor: Validate env variables using zodMohamedBassem1-1/+1
2024-03-24docker: Use external chrome docker containerMohamedBassem1-10/+40
2024-03-21fix(workers): Fix the leaky browser instances in workers during developmentMohamedBassem1-28/+30
2024-03-21fix: Simple validations for crawled URLsMohamedBassem1-1/+17
2024-03-14structure: Create apps dir and copy tooling dir from t3-turbo repoMohamedBassem1-0/+0
2024-03-05feature: Store html content of links in the databaseMohamedBassem1-0/+1
2024-03-05fix: Use puppeteer adblocker to block cookies noticesMohamedBassem1-0/+6
2024-03-02feature: Store full link content and index themMohamedBassem1-1/+12
2024-03-01feature: Add full text search supportMohamedBassem1-0/+8
2024-02-23db: Migrate from prisma to drizzleMohamedBassem1-10/+10
2024-02-20branding: Rename app to HoarderMohamedBassem1-4/+4
2024-02-17build: Fix docker imagesMohamedBassem1-1/+5
2024-02-17fix: Let the crawler wait a bit more for page loadMohamedBassem1-2/+12
2024-02-14fix: Harden puppeteer against browser disconnections and exceptionsMohamedBassem1-16/+33
2024-02-14feature: Add ability to refresh bookmark detailsMohamedBassem1-1/+13
2024-02-11fix: Fix build for workers package and add it to CIMohamedBassem1-8/+42
2024-02-09[feature] Use puppeteer for fetching websitesMohamedBassem1-4/+32
2024-02-09[chore] Linting and formating tweakingMohamedBassem1-5/+11
2024-02-09[refactor] Extract the bookmark model to be a high level model to support oth...MohamedBassem1-23/+9
2024-02-08[refactor] Move the different packages to the package subdirMohamedBassem1-0/+0
2024-02-07[feature] Add openAI integration for extracting tags from articlesMohamedBassem1-0/+6
2024-02-07[refactor] Rename the crawlers package to workersMohamedBassem1-0/+0
2024-02-06Implement metadata fetching logic in the crawlerMohamedBassem1-2/+68
2024-02-06Init package and start bullmq workersMohamedBassem1-0/+6
generated by cgit v1.3-1-g0d28 (git 2.53.0) at 2026-02-27 12:48:47 +0000