diff options
| author | Mohamed Bassem <me@mbassem.com> | 2026-02-08 21:07:37 +0000 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2026-02-08 21:07:37 +0000 |
| commit | c8464e303f6e7fba6b88c7f29c0570c2b49a494d (patch) | |
| tree | f9d7a9f94c9ac0030402b9b13f0210b9ca916e08 /apps/mcp | |
| parent | 08f1a7973294777db5950d6f973590bdceeb1259 (diff) | |
| download | karakeep-c8464e303f6e7fba6b88c7f29c0570c2b49a494d.tar.zst | |
feat(crawler): Split bookmark metadata updates into two phases for faster feedback (#2467)
* feat(crawler): write metadata to DB early for faster user feedback
Split the single DB transaction in crawlAndParseUrl into two phases:
- Phase 1: Write metadata (title, description, favicon, author, etc.)
immediately after extraction, before downloading assets
- Phase 2: Write content and asset references after all assets are
stored (banner image, screenshot, pdf, html content)
This gives users near-instant feedback with bookmark metadata while
the slower asset downloads and uploads happen in the background.
https://claude.ai/code/session_013vKTXDcb5CEve3WMszQJmZ
* fix(crawler): move crawledAt to phase 2 DB write
crawledAt should only be set once all assets are fully stored, not
during the early metadata write.
https://claude.ai/code/session_013vKTXDcb5CEve3WMszQJmZ
---------
Co-authored-by: Claude <noreply@anthropic.com>
Diffstat (limited to 'apps/mcp')
0 files changed, 0 insertions, 0 deletions
