Language and instructions
Set the target language and concise project-wide guidance for names, terminology, tone, pronouns, formatting, or text that should remain untranslated. Test the instructions on several pages and correct OCR first.Local quantization
GGUF models may offer multiple quantizations. Smaller files need less download space and memory, usually at a quality cost. Larger files can be slower or exceed available memory. Hosted providers control their own serving precision.Generation controls
Thinking can increase latency and token use. Unsupported options may be ignored or rejected by a provider or model.