running a model with llama.cpp:
./main -m models/mistral-v0.1-7b-q4_0.gguf --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -i --n-predict -2 --interactive-first --color -r "User:" --in-prefix " "
running a model with llama.cpp:
./main -m models/mistral-v0.1-7b-q4_0.gguf --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -i --n-predict -2 --interactive-first --color -r "User:" --in-prefix " "