시스템 프롬프트를 (role:system) 웹으로는 해봤는데 cli 에서도 가능한지 찾아보는 중
파일에도 넣을수 있고, 미리 넣을수도 있지만 런타임 중에 변경은 불가능 한건가?
| llama-b9553$ ./llama-cli --help | grep -i sys -p, --prompt PROMPT prompt to start generation with; for system message, use -sys --mlock force system to keep model in RAM rather than swapping or compressing --numa TYPE attempt optimizations that help on some NUMA systems if run without this previously, it is recommended to drop the system -sys, --system-prompt PROMPT system prompt to use with model (if applicable, depending on chat -sysf, --system-prompt-file FNAME a file containing the system prompt (default: none) hunyuan-vl, kimi-k2, llama2, llama2-sys, llama2-sys-bos, llama2-sys-strip, llama3, llama4, megrez, minicpm, mistral-v1, hunyuan-vl, kimi-k2, llama2, llama2-sys, llama2-sys-bos, llama2-sys-strip, llama3, llama4, megrez, minicpm, mistral-v1, |
| llama-b9553$ ./llama-cli --help | grep -i prom -tb, --threads-batch N number of threads to use during batch and prompt processing (default: -c, --ctx-size N size of the prompt context (default: 0, 0 = loaded from model) --keep N number of tokens to keep from the initial prompt (default: 0, -1 = -p, --prompt PROMPT prompt to start generation with; for system message, use -sys -f, --file FNAME a file containing the prompt (default: none) -bf, --binary-file FNAME binary file containing the prompt (default: none) number of threads to use during batch and prompt processing (default: --verbose-prompt print a verbose prompt before generation (default: false) --display-prompt, --no-display-prompt whether to print prompt at generation (default: true) -co, --color [on|off|auto] Colorize output to distinguish prompt and user input from generations -sys, --system-prompt PROMPT system prompt to use with model (if applicable, depending on chat -sysf, --system-prompt-file FNAME a file containing the system prompt (default: none) -r, --reverse-prompt PROMPT halt generation at PROMPT, return control in interactive mode will not be interactive if first turn is predefined with --prompt |
'프로그램 사용 > ai 프로그램' 카테고리의 다른 글
| exllama (0) | 2026.06.10 |
|---|---|
| stable diffusion train (0) | 2026.06.10 |
| gemma4-e4b it qat / gemma4-12b mtp on 1080 ti 11GB (0) | 2026.06.08 |
| nvidia 3070 8GB 테스트 gemma4-e4b (0) | 2026.06.08 |
| sigLIP, CLIP (0) | 2026.06.05 |
