프로그램 사용/ai 프로그램
llama.cpp prompt 옵션
구차니
2026. 6. 10. 12:12
시스템 프롬프트를 (role:system) 웹으로는 해봤는데 cli 에서도 가능한지 찾아보는 중
파일에도 넣을수 있고, 미리 넣을수도 있지만 런타임 중에 변경은 불가능 한건가?
| llama-b9553$ ./llama-cli --help | grep -i sys -p, --prompt PROMPT prompt to start generation with; for system message, use -sys --mlock force system to keep model in RAM rather than swapping or compressing --numa TYPE attempt optimizations that help on some NUMA systems if run without this previously, it is recommended to drop the system -sys, --system-prompt PROMPT system prompt to use with model (if applicable, depending on chat -sysf, --system-prompt-file FNAME a file containing the system prompt (default: none) hunyuan-vl, kimi-k2, llama2, llama2-sys, llama2-sys-bos, llama2-sys-strip, llama3, llama4, megrez, minicpm, mistral-v1, hunyuan-vl, kimi-k2, llama2, llama2-sys, llama2-sys-bos, llama2-sys-strip, llama3, llama4, megrez, minicpm, mistral-v1, |
| llama-b9553$ ./llama-cli --help | grep -i prom -tb, --threads-batch N number of threads to use during batch and prompt processing (default: -c, --ctx-size N size of the prompt context (default: 0, 0 = loaded from model) --keep N number of tokens to keep from the initial prompt (default: 0, -1 = -p, --prompt PROMPT prompt to start generation with; for system message, use -sys -f, --file FNAME a file containing the prompt (default: none) -bf, --binary-file FNAME binary file containing the prompt (default: none) number of threads to use during batch and prompt processing (default: --verbose-prompt print a verbose prompt before generation (default: false) --display-prompt, --no-display-prompt whether to print prompt at generation (default: true) -co, --color [on|off|auto] Colorize output to distinguish prompt and user input from generations -sys, --system-prompt PROMPT system prompt to use with model (if applicable, depending on chat -sysf, --system-prompt-file FNAME a file containing the system prompt (default: none) -r, --reverse-prompt PROMPT halt generation at PROMPT, return control in interactive mode will not be interactive if first turn is predefined with --prompt |