From 83bc5bdab4127b5bdbee708fcbf57297fff62fc0 Mon Sep 17 00:00:00 2001 From: MohamedBassem Date: Sat, 31 Aug 2024 21:08:52 +0000 Subject: docs: Remove references to redis and workers from docs --- docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) (limited to 'docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md') diff --git a/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md b/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md index df69376a..5a864034 100644 --- a/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md +++ b/docs/versioned_docs/version-v0.16.0/07-Development/04-architecture.md @@ -3,8 +3,7 @@ ![Architecture Diagram](/img/architecture/arch.png) - Webapp: NextJS based using sqlite for data storage. -- Redis: Used with BullMQ for scheduling background jobs for the workers. -- Workers: Consume the jobs from redis and executes them, there are three job types: +- Workers: Consume the jobs from sqlite based job queue and executes them, there are three job types: 1. Crawling: Fetches the content of links using a headless chrome browser running in the workers container. 2. OpenAI: Uses OpenAI APIs to infer the tags of the content. 3. Indexing: Indexes the content in meilisearch for faster retrieval during search. -- cgit v1.2.3-70-g09d2