Hey all, I'm new to honcho and am trying to spin up a local docker container using a local model. I've followed the directions here:
https://docs.honcho.dev/v3/contributing/self-hosting#llm-setup
The 4 docker containers spin up, but the API container doesn't start the local service. I see this error in the logs:
pydantic_core._pydantic_core.ValidationError: 10 validation errors for DialecticSettings
LEVELS.max.thinking_budget_tokens
Field required [type=missing, input_value={'model': 'glm-flash-30B-...', 'provider': 'custom'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.12/v/missing
I'm not sure if this is related to a larger issue but though I'd ask in case someone has any tips.
Thanks in advance!
Hey all, I'm new to honcho and am trying to spin up a local docker container using a local model. I've followed the directions here:
https://docs.honcho.dev/v3/contributing/self-hosting#llm-setup
The 4 docker containers spin up, but the API container doesn't start the local service. I see this error in the logs:
I'm not sure if this is related to a larger issue but though I'd ask in case someone has any tips.
Thanks in advance!