aboutsummaryrefslogtreecommitdiffstats
path: root/packages/workers/crawler.ts (unfollow)
Commit message (Expand)AuthorFilesLines
2024-02-11fix: Fix build for workers package and add it to CIMohamedBassem1-8/+42
2024-02-09[feature] Use puppeteer for fetching websitesMohamedBassem1-4/+32
2024-02-09[chore] Linting and formating tweakingMohamedBassem1-5/+11
2024-02-09[refactor] Extract the bookmark model to be a high level model to support oth...MohamedBassem1-23/+9
2024-02-08[refactor] Move the different packages to the package subdirMohamedBassem1-0/+0
2024-02-07[feature] Add openAI integration for extracting tags from articlesMohamedBassem1-0/+6
2024-02-07[refactor] Rename the crawlers package to workersMohamedBassem1-0/+0
2024-02-06Implement metadata fetching logic in the crawlerMohamedBassem1-2/+68
2024-02-06Init package and start bullmq workersMohamedBassem1-0/+6