From 43e01d55d8fee2f2d517dd9f5e8adb2c143333dd Mon Sep 17 00:00:00 2001 From: Mohamed Bassem Date: Sun, 5 Jan 2025 16:45:17 +0000 Subject: docs: Release the 0.21 docs --- .../version-v0.21.0/07-Development/04-architecture.md | 9 +++++++++ 1 file changed, 9 insertions(+) create mode 100644 docs/versioned_docs/version-v0.21.0/07-Development/04-architecture.md (limited to 'docs/versioned_docs/version-v0.21.0/07-Development/04-architecture.md') diff --git a/docs/versioned_docs/version-v0.21.0/07-Development/04-architecture.md b/docs/versioned_docs/version-v0.21.0/07-Development/04-architecture.md new file mode 100644 index 00000000..5a864034 --- /dev/null +++ b/docs/versioned_docs/version-v0.21.0/07-Development/04-architecture.md @@ -0,0 +1,9 @@ +# Architecture + +![Architecture Diagram](/img/architecture/arch.png) + +- Webapp: NextJS based using sqlite for data storage. +- Workers: Consume the jobs from sqlite based job queue and executes them, there are three job types: + 1. Crawling: Fetches the content of links using a headless chrome browser running in the workers container. + 2. OpenAI: Uses OpenAI APIs to infer the tags of the content. + 3. Indexing: Indexes the content in meilisearch for faster retrieval during search. -- cgit v1.2.3-70-g09d2