diff options
Diffstat (limited to 'docs/versioned_docs/version-v0.15.0/07-Development/04-architecture.md')
| -rw-r--r-- | docs/versioned_docs/version-v0.15.0/07-Development/04-architecture.md | 10 |
1 files changed, 10 insertions, 0 deletions
diff --git a/docs/versioned_docs/version-v0.15.0/07-Development/04-architecture.md b/docs/versioned_docs/version-v0.15.0/07-Development/04-architecture.md new file mode 100644 index 00000000..df69376a --- /dev/null +++ b/docs/versioned_docs/version-v0.15.0/07-Development/04-architecture.md @@ -0,0 +1,10 @@ +# Architecture + + + +- Webapp: NextJS based using sqlite for data storage. +- Redis: Used with BullMQ for scheduling background jobs for the workers. +- Workers: Consume the jobs from redis and executes them, there are three job types: + 1. Crawling: Fetches the content of links using a headless chrome browser running in the workers container. + 2. OpenAI: Uses OpenAI APIs to infer the tags of the content. + 3. Indexing: Indexes the content in meilisearch for faster retrieval during search. |