diff options
| author | MohamedBassem <me@mbassem.com> | 2024-04-11 15:03:31 +0300 |
|---|---|---|
| committer | MohamedBassem <me@mbassem.com> | 2024-04-11 15:03:31 +0300 |
| commit | 238c2967b269ca0f66d8e759c6a0234107e1fd1e (patch) | |
| tree | 1e8590a829bd6b24950ac56eb0a21450c8ce3332 /docs | |
| parent | be622e5594ecb21c82bb6066a82c86e0917bcc35 (diff) | |
| download | karakeep-238c2967b269ca0f66d8e759c6a0234107e1fd1e.tar.zst | |
fix: Increase default navigation timeout to 30s, make it configurable and add retries to crawling jobs
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/docs/03-configuration.md | 7 |
1 files changed, 4 insertions, 3 deletions
diff --git a/docs/docs/03-configuration.md b/docs/docs/03-configuration.md index 5bf1612c..28ead2f1 100644 --- a/docs/docs/03-configuration.md +++ b/docs/docs/03-configuration.md @@ -37,6 +37,7 @@ Either `OPENAI_API_KEY` or `OLLAMA_BASE_URL` need to be set for automatic taggin ## Crawler Configs -| Name | Required | Default | Description | -| ----------------------- | -------- | ------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------- | -| CRAWLER_JOB_TIMEOUT_SEC | No | 60 | How long to wait for the crawler job to finish before timing out. If you have a slow internet connection or a low powered device, you might want to bump this up a bit | +| Name | Required | Default | Description | +| ---------------------------- | -------- | ------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| CRAWLER_JOB_TIMEOUT_SEC | No | 60 | How long to wait for the crawler job to finish before timing out. If you have a slow internet connection or a low powered device, you might want to bump this up a bit | +| CRAWLER_NAVIGATE_TIMEOUT_SEC | No | 30 | How long to spend navigating to the page (along with its redirects). Increase this if you have a slow internet connection | |