| Commit message (Collapse) | Author | Age | Files | Lines | |
|---|---|---|---|---|---|
| * | fix: Trigger search re-index on bookmark tag manual updates. Fixes #208 (#210) | kamtschatka | 2024-06-09 | 1 | -5/+2 |
| | | | | | | | | | | | | | * re-index of database is not scanning all places when bookmark tags are changed. Manual indexing is working as workaround #208 introduced a new function to trigger a reindex to reduce copy/paste added missing reindexes when tags are deleted/bookmarks are updated * give functions a bit more descriptive name --------- Co-authored-by: kamtschatka <simon.schatka@gmx.at> Co-authored-by: MohamedBassem <me@mbassem.com> | ||||
| * | fix(crawler): Only update the database if full page archival is enabled | MohamedBassem | 2024-05-26 | 1 | -19/+19 |
| | | |||||
| * | feature: Full page archival with monolith. Fixes #132 | MohamedBassem | 2024-05-26 | 1 | -1/+65 |
| | | |||||
| * | feature(crawler): Allow connecting to browser's websocket address and ↵ | MohamedBassem | 2024-05-15 | 1 | -28/+55 |
| | | | | | launching the browser on demand. This enables support for browserless | ||||
| * | feature: Take full page screenshots #143 (#148) | kamtschatka | 2024-05-12 | 1 | -1/+2 |
| | | | | | | | Added the fullPage flag to take full screen screenshots updated the UI accordingly to properly show the screenshots instead of scaling it down Co-authored-by: kamtschatka <simon.schatka@gmx.at> | ||||
| * | feature(crawler): Allow increasing crawler concurrency and configure storing ↵ | MohamedBassem | 2024-04-26 | 1 | -0/+13 |
| | | | | | images and screenshots | ||||
| * | fix(crawler): Better extraction for amazon images | MohamedBassem | 2024-04-23 | 1 | -0/+2 |
| | | |||||
| * | fix(workers): Set a modern user agent and update the default viewport size | MohamedBassem | 2024-04-23 | 1 | -0/+7 |
| | | |||||
| * | feature: Allow recrawling bookmarks without running inference jobs | MohamedBassem | 2024-04-20 | 1 | -7/+29 |
| | | |||||
| * | feature: Download images and screenshots | MohamedBassem | 2024-04-20 | 1 | -28/+130 |
| | | |||||
| * | feature: Recrawl failed links from admin UI (#95) | Ahmad Mujahid | 2024-04-11 | 1 | -0/+20 |
| | | | | | | * feature: Retry failed crawling URLs * fix: Enhancing visuals and some minor changes. | ||||
| * | fix: Increase default navigation timeout to 30s, make it configurable and ↵ | MohamedBassem | 2024-04-11 | 1 | -1/+1 |
| | | | | | add retries to crawling jobs | ||||
| * | fix(crawler): Skip validating URLs in metascrapper as it was already being ↵ | MohamedBassem | 2024-04-09 | 1 | -0/+3 |
| | | | | | validated. Fixes #22 | ||||
| * | fix(workers): Increase default timeout to 60s, make it configurable and ↵ | MohamedBassem | 2024-04-06 | 1 | -11/+21 |
| | | | | | improve logging | ||||
| * | fix(workers): Add a timeout to the crawling job to prevent it from getting ↵ | MohamedBassem | 2024-04-02 | 1 | -1/+2 |
| | | | | | stuck. Fixes #63 | ||||
| * | chore(workers): Remove unused configuration options | MohamedBassem | 2024-03-31 | 1 | -2/+0 |
| | | |||||
| * | format: Add missing lint and format, and format the entire repo | MohamedBassem | 2024-03-30 | 1 | -5/+6 |
| | | |||||
| * | refactor: Validate env variables using zod | MohamedBassem | 2024-03-27 | 1 | -1/+1 |
| | | |||||
| * | docker: Use external chrome docker container | MohamedBassem | 2024-03-24 | 1 | -10/+40 |
| | | |||||
| * | fix(workers): Fix the leaky browser instances in workers during development | MohamedBassem | 2024-03-21 | 1 | -28/+30 |
| | | |||||
| * | fix: Simple validations for crawled URLs | MohamedBassem | 2024-03-21 | 1 | -1/+17 |
| | | |||||
| * | structure: Create apps dir and copy tooling dir from t3-turbo repo | MohamedBassem | 2024-03-14 | 1 | -0/+201 |
