diff options
| author | MohamedBassem <me@mbassem.com> | 2024-05-16 23:05:09 +0100 |
|---|---|---|
| committer | MohamedBassem <me@mbassem.com> | 2024-05-16 23:05:53 +0100 |
| commit | 168aed0a85745d2550407a005cb8195a05fcc276 (patch) | |
| tree | 817bf1f3e43e5bcc885e7e31e16fe8843ce82dfa | |
| parent | c0aa6d5e7339e27d159a9ab4da0965fb4c05df39 (diff) | |
| download | karakeep-168aed0a85745d2550407a005cb8195a05fcc276.tar.zst | |
feature(inference): Upgrade the default vision model to the new gpt-4o-2024-05-13 which is faster and 2x cheaper
| -rw-r--r-- | docs/docs/03-configuration.md | 2 | ||||
| -rw-r--r-- | packages/shared/config.ts | 2 |
2 files changed, 2 insertions, 2 deletions
diff --git a/docs/docs/03-configuration.md b/docs/docs/03-configuration.md index 08405a0f..f777731f 100644 --- a/docs/docs/03-configuration.md +++ b/docs/docs/03-configuration.md @@ -33,7 +33,7 @@ Either `OPENAI_API_KEY` or `OLLAMA_BASE_URL` need to be set for automatic taggin | OPENAI_BASE_URL | No | Not set | If you just want to use OpenAI you don't need to pass this variable. If, however, you want to use some other openai compatible API (e.g. azure openai service), set this to the url of the API. | | OLLAMA_BASE_URL | No | Not set | If you want to use ollama for local inference, set the address of ollama API here. | | INFERENCE_TEXT_MODEL | No | gpt-3.5-turbo-0125 | The model to use for text inference. You'll need to change this to some other model if you're using ollama. | -| INFERENCE_IMAGE_MODEL | No | gpt-4-turbo | The model to use for image inference. You'll need to change this to some other model if you're using ollama and that model needs to support vision APIs (e.g. llava). | +| INFERENCE_IMAGE_MODEL | No | gpt-4o-2024-05-13 | The model to use for image inference. You'll need to change this to some other model if you're using ollama and that model needs to support vision APIs (e.g. llava). | | INFERENCE_LANG | No | english | The language in which the tags will be generated. | ## Crawler Configs diff --git a/packages/shared/config.ts b/packages/shared/config.ts index 388a6660..8bb4e830 100644 --- a/packages/shared/config.ts +++ b/packages/shared/config.ts @@ -14,7 +14,7 @@ const allEnv = z.object({ OPENAI_BASE_URL: z.string().url().optional(), OLLAMA_BASE_URL: z.string().url().optional(), INFERENCE_TEXT_MODEL: z.string().default("gpt-3.5-turbo-0125"), - INFERENCE_IMAGE_MODEL: z.string().default("gpt-4-turbo"), + INFERENCE_IMAGE_MODEL: z.string().default("gpt-4o-2024-05-13"), REDIS_HOST: z.string().default("localhost"), REDIS_PORT: z.coerce.number().default(6379), REDIS_DB_IDX: z.coerce.number().optional(), |