git: ba338beba4a6 - main - misc/ollama: Add environment variables to 'ollama start' to work around memory allocation issues
- Go to: [ bottom of page ] [ top of archives ] [ this month ]
Date: Tue, 27 Aug 2024 17:44:29 UTC
The branch main has been updated by yuri: URL: https://cgit.FreeBSD.org/ports/commit/?id=ba338beba4a6165268a78ea58fde862c2fc03465 commit ba338beba4a6165268a78ea58fde862c2fc03465 Author: Yuri Victorovich <yuri@FreeBSD.org> AuthorDate: 2024-08-27 17:43:01 +0000 Commit: Yuri Victorovich <yuri@FreeBSD.org> CommitDate: 2024-08-27 17:44:27 +0000 misc/ollama: Add environment variables to 'ollama start' to work around memory allocation issues --- misc/ollama/pkg-message | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/misc/ollama/pkg-message b/misc/ollama/pkg-message index 936a3494000a..a3b6614a58b1 100644 --- a/misc/ollama/pkg-message +++ b/misc/ollama/pkg-message @@ -5,7 +5,7 @@ You installed ollama: the AI model runner. To run ollama, plese open 2 terminals. 1. In the first terminal, please run: - $ ollama start + $ OLLAMA_NUM_PARALLEL=1 OLLAMA_DEBUG=1 LLAMA_DEBUG=1 ollama start 2. In the second terminal, please run: $ ollama run mistral