Hermes — direct connection
Settings checked against Hermes 0.21.0. Install Hermes using its official guide and create a separate profile. No private wrapper, GPU or server Docker image is required.
Create a profile and merge the downloaded YAML
hermes --version
hermes profile create flash
hermes -p flash config editPrimary profile
Download hermes-primary.yamlMerge into ~/.hermes/profiles/flash/config.yaml; preserve other settings.
Hermes 0.21 ignores legacy model.max_tokens and HERMES_MAX_TOKENS. This config sends extra_body.max_tokens: 32768 and sets compression.threshold_tokens: 172032 separately. The compressor does not infer output headroom from the wire parameter. See the provider reference.
View hermes-primary.yaml
# Teralor Flash as the PRIMARY model in Hermes 0.21 (verified against 0.21.0).
# Apply to a NEW profile so existing settings are never overwritten:
# hermes profile create flash
# hermes -p flash config edit # merge this YAML, do not replace other settings
# hermes -p flash chat
# The key is read from the TERALOR_API_KEY environment variable — never paste a
# key literal into this file, a prompt, or source control.
providers:
teralor-flash:
api: https://api.teralor.com/v1
key_env: TERALOR_API_KEY
transport: chat_completions
default_model: Flash
discover_models: true
models:
Flash:
context_length: 262144
extra_body:
max_tokens: 32768
model:
provider: custom:teralor-flash
default: Flash
context:
engine: compressor
compression:
enabled: true
threshold_tokens: 172032
Confirm settings, then start a fresh session
hermes -p flash config get providers.teralor-flash.models.Flash.context_length
hermes -p flash config get compression.threshold_tokens
hermes -p flash chat