diff options
| author | MohamedBassem <me@mbassem.com> | 2024-08-31 17:44:11 +0000 |
|---|---|---|
| committer | MohamedBassem <me@mbassem.com> | 2024-08-31 17:44:11 +0000 |
| commit | 621c32961d9be77decf5997324d654dbcbf85947 (patch) | |
| tree | 1b893dd10e329748614b14cf7a7e0f6886be439f /docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md | |
| parent | 2fb85590271476a40c3d0d6a9cc4683576ff6074 (diff) | |
| download | karakeep-621c32961d9be77decf5997324d654dbcbf85947.tar.zst | |
docs: Publish the docs for version 0.16.0
Diffstat (limited to 'docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md')
| -rw-r--r-- | docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md b/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md new file mode 100644 index 00000000..df69376a --- /dev/null +++ b/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md @@ -0,0 +1,10 @@ +# Architecture + + + +- Webapp: NextJS based using sqlite for data storage. +- Redis: Used with BullMQ for scheduling background jobs for the workers. +- Workers: Consume the jobs from redis and executes them, there are three job types: + 1. Crawling: Fetches the content of links using a headless chrome browser running in the workers container. + 2. OpenAI: Uses OpenAI APIs to infer the tags of the content. + 3. Indexing: Indexes the content in meilisearch for faster retrieval during search. |