| Age | Commit message | Author | Files | +/- |
|---|---|---|---|---|
| release: cli, mcp and sdk | Mohamed Bassem | 3 | -3/+3 | |
feat: Add automated bookmark backup feature (#2182) …* feat: Add automated bookmark backup system
Implements a comprehensive automated backup feature for user bookmarks with the following capabilities:
Database Schema:
- Add backupSettings table to store user backup preferences (enabled, frequency, retention)
- Add backups table to track backup records with status and metadata
- Add BACKUP asset type for storing compressed backup files
- Add migration 0066_add_backup_tables.sql
Background Workers:
- Implement BackupSchedulingWorker cron job (runs daily at midnight UTC)
- Create BackupWorker to process individual backup jobs
- Deterministic scheduling spreads backup jobs across 24 hours based on user ID hash
- Support for daily and weekly backup frequencies
- Automated retention cleanup to delete old backups based on user settings
Export & Compression:
- Reuse existing export functionality for bookmark data
- Compress exports using Node.js built-in zlib (gzip level 9)
- Store compressed backups as assets with proper metadata
- Track backup size and bookmark count for statistics
tRPC API:
- backups.getSettings - Retrieve user backup configuration
- backups.updateSettings - Update backup preferences
- backups.list - List all user backups with metadata
- backups.get - Get specific backup details
- backups.delete - Delete a backup
- backups.download - Download backup file (base64 encoded)
- backups.triggerBackup - Manually trigger backup creation
UI Components:
- BackupSettings component with configuration form
- Enable/disable automatic backups toggle
- Frequency selection (daily/weekly)
- Retention period configuration (1-365 days)
- Backup list table with download and delete actions
- Manual backup trigger button
- Display backup stats (size, bookmark count, status)
- Added backups page to settings navigation
Technical Details:
- Uses Restate queue system for distributed job processing
- Implements idempotency keys to prevent duplicate backups
- Background worker concurrency: 2 jobs at a time
- 10-minute timeout for large backup exports
- Proper error handling and logging throughout
- Type-safe implementation with Zod schemas
* refactor: simplify backup settings and asset handling
- Move backup settings from separate table to user table columns
- Update BackupSettings model to use static methods with users table
- Remove download mutation in favor of direct asset links
- Implement proper quota checks using QuotaService.checkStorageQuota
- Update UI to use new property names and direct asset downloads
- Update shared types to match new schema
Key changes:
- backupSettingsTable removed, settings now in users table
- Backup downloads use direct /api/assets/{id} links
- Quota properly validated before creating backup assets
- Cleaner separation of concerns in tRPC models
* migration
* use zip instead of gzip
* fix drizzle
* fix settings
* streaming json
* remove more dead code
* add e2e tests
* return backup
* poll for backups
* more fixes
* more fixes
* fix test
* fix UI
* fix delete asset
* fix ui
* redirect for backup download
* cleanups
* fix idempotency
* fix tests
* add ratelimit
* add error handling for background backups
* i18n
* model changes
---------
Co-authored-by: Claude <noreply@anthropic.com>
|
Mohamed Bassem | 32 | -8/+5697 | |
| fix(api): Return 200 when bookmark already exists instead of 200 | Mohamed Bassem | 4 | -4/+31 | |
| fix(api): Document the API for getting lists of a bookmark. fixes #2030 | Mohamed Bassem | 8 | -108/+268 | |
feat: Add tag search and pagination (#1987) …* feat: Add tag search and use in the homepage * use paginated query in the all tags view * wire the load more buttons * add skeleton to all tags page * fix attachedby aggregation * fix loading states * fix hasNextPage * use action buttons for load more buttons * migrate the tags auto complete to the search api * Migrate the tags editor to the new search API * Replace tag merging dialog with tag auto completion * Merge both search and list APIs * fix tags.list * add some tests for the endpoint * add relevance based sorting * change cursor * update the REST API * fix review comments * more fixes * fix lockfile * i18n * fix visible tags |
Mohamed Bassem | 32 | -493/+1731 | |
| release(sdk): Release the 0.27 sdk | Mohamed Bassem | 1 | -1/+1 | |
| chore: More turbo fixes | MohamedBassem | 28 | -57/+107 | |
| deps: Upgrade vite | Mohamed Bassem | 18 | -1064/+847 | |
| release(sdk): Release the 0.26 sdk | Mohamed Bassem | 2 | -4/+240 | |
| chore: More oxlint changes | Mohamed Bassem | 23 | -87/+24 | |
chore: migrate away from eslint to oxlint (#1642) …* chore: migrate away from eslint to oxlint * revert turbo task name lint * it seems like we can remove the seemingly default globals |
xuatz | 70 | -1695/+1174 | |
| feat(api): Expose the endpoint to create a new tag | Mohamed Bassem | 7 | -49/+172 | |
feat(api): enable ?sortOrder= for relevant resources (#1398) …* feat(api): enable `?sortOrder=` for relevant resources * fix tests |
xuatz | 14 | -34/+126 | |
chore: rename missing files/conf from Hoarder to Karakeep (#1280) …* refactor: Rename remaining project configuration from Hoarder to Karakeep * some fixes --------- Co-authored-by: Mohamed Bassem <me@mbassem.com> |
adripo | 126 | -5080/+5080 | |
| fix: Add includeContent to search endpoint and document it in the docs | Mohamed Bassem | 11 | -22/+122 | |
| feat: Allow editing the extracted content of an asset bookmark | Mohamed Bassem | 6 | -6/+66 | |
| fix(mcp): Reduce token usage of the MCP server | Mohamed Bassem | 6 | -10/+167 | |
| feat: Add an MCP server for karakeep | Mohamed Bassem | 28 | -139/+2512 | |
| chore: Rename hoarder packages to karakeep | MohamedBassem | 230 | -644/+654 | |
| build: Regenerate the openapi specs and sdk | MohamedBassem | 2 | -0/+40 | |
| release(sdk): Release the 0.23 sdk | Mohamed Bassem | 1 | -1/+1 | |
| feat: Add endpoints for whoami and user stats. Fixes #1113 | Mohamed Bassem | 9 | -9/+455 | |
| fix: Revert the accidental upgrade of deps. #1107 | Mohamed Bassem | 9 | -7148/+837 | |
| fix: Resync the openapi spec | Mohamed Bassem | 2 | -8/+61 | |
build(deps-dev): bump vite from 5.1.4 to 5.4.12 (#1103) …Bumps [vite](https://github.com/vitejs/vite/tree/HEAD/packages/vite) from 5.1.4 to 5.4.12. - [Release notes](https://github.com/vitejs/vite/releases) - [Changelog](https://github.com/vitejs/vite/blob/v5.4.12/packages/vite/CHANGELOG.md) - [Commits](https://github.com/vitejs/vite/commits/v5.4.12/packages/vite) --- updated-dependencies: - dependency-name: vite dependency-type: direct:development ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> |
dependabot[bot] | 4 | -175/+458 | |
| release(sdk): Release the 0.22 sdk | Mohamed Bassem | 1 | -1/+1 | |
| ci: Fix build by regenerating the open API spec | Mohamed Bassem | 2 | -0/+5 | |
| fix: Fix node22 error in worker container. Fixes #962 | Mohamed Bassem | 5 | -23/+17 | |
| feat(api): Expose the modifiedAt date in the bookmarks API | Mohamed Bassem | 3 | -0/+13 | |
| feat: Add support for singlefile extension uploads. #172 | Mohamed Bassem | 14 | -37/+275 | |
| release(sdk): Re-release the 0.21 sdk | Mohamed Bassem | 2 | -17/+23 | |
| fix(sdk): Fix the module type of the sdk package | Mohamed Bassem | 2 | -2/+4 | |
| docs: Add readme to SDK | Mohamed Bassem | 1 | -0/+57 | |
| fix(sdk): Publish both esm and cjs modules for the sdk | Mohamed Bassem | 3 | -6/+14 | |
| release(sdk): Release the 0.21 sdk | Mohamed Bassem | 1 | -1/+1 | |
| ci: Fix build by using the workspace sdk package | Mohamed Bassem | 3 | -13/+8 | |
| feat: Expose the search functionality in the REST API | Mohamed Bassem | 8 | -20/+299 | |
| feat: Expose asset manipulation endpoints in the REST API | Mohamed Bassem | 6 | -0/+630 | |
feat: Add support for smart lists (#802) …* feat: Add support for smart lists * i18n * Fix update list endpoint * Add a test for smart lists * Add header to the query explainer * Hide remove from lists in the smart context list * Add proper validation to list form --------- Co-authored-by: Deepak Kapoor <41769111+orthdron@users.noreply.github.com> |
Mohamed Bassem | 26 | -100/+2045 | |
| chore: add format:fix and lint:fix scripts to all packages | Mohamed Bassem (aider) | 10 | -2/+22 | |
| fix(api): Return 201 from highlights creation and fix docs for PATCH… | Mohamed Bassem | 4 | -21/+3 | |
| feat: Introduce a typescript sdk | Mohamed Bassem | 8 | -54/+1742 |