Skip to content

Issue spinning up docker container with local model #553

@ceinstaller

Description

@ceinstaller

Hey all, I'm new to honcho and am trying to spin up a local docker container using a local model. I've followed the directions here:

https://docs.honcho.dev/v3/contributing/self-hosting#llm-setup

The 4 docker containers spin up, but the API container doesn't start the local service. I see this error in the logs:

pydantic_core._pydantic_core.ValidationError: 10 validation errors for DialecticSettings
LEVELS.max.thinking_budget_tokens
  Field required [type=missing, input_value={'model': 'glm-flash-30B-...', 'provider': 'custom'}, input_type=dict]
    For further information visit https://errors.pydantic.dev/2.12/v/missing

I'm not sure if this is related to a larger issue but though I'd ask in case someone has any tips.

Thanks in advance!

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions