From 621c32961d9be77decf5997324d654dbcbf85947 Mon Sep 17 00:00:00 2001 From: MohamedBassem Date: Sat, 31 Aug 2024 17:44:11 +0000 Subject: docs: Publish the docs for version 0.16.0 --- .../version-v0.16.0/07-Development/04-architecture.md | 10 ++++++++++ 1 file changed, 10 insertions(+) create mode 100644 docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md (limited to 'docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md') diff --git a/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md b/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md new file mode 100644 index 00000000..df69376a --- /dev/null +++ b/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md @@ -0,0 +1,10 @@ +# Architecture + +![Architecture Diagram](/img/architecture/arch.png) + +- Webapp: NextJS based using sqlite for data storage. +- Redis: Used with BullMQ for scheduling background jobs for the workers. +- Workers: Consume the jobs from redis and executes them, there are three job types: + 1. Crawling: Fetches the content of links using a headless chrome browser running in the workers container. + 2. OpenAI: Uses OpenAI APIs to infer the tags of the content. + 3. Indexing: Indexes the content in meilisearch for faster retrieval during search. -- cgit v1.2.3-70-g09d2