Skip to content

cmg: Auto deploy throws "Failed to deploy model" #6

Description

@lawrencelai

cmg throw exception when calling /[models/{mode_name}/tasks/{tasks}]not running on-demand model

{
    "detail": "Model 'medcat-icd10-20260116' is not available. Running models: ['medcat-icd10']. On-demand models: ['medcat-icd10-20260116']. List all models at /models"
}

In the server log in gateway:

INFO:cmg.gateway.auto_deploy:Model 'medcat-icd10-20260116' is not currently running
2026-01-16T11:44:52.991784417Z INFO:cmg.gateway.auto_deploy:Model 'medcat-icd10-20260116' not available, initiating auto-deployment
2026-01-16T11:44:53.061906110Z INFO:cmg.gateway.auto_deploy:Starting deployment of on-demand model: medcat-icd10-20260116
2026-01-16T11:44:53.077672977Z ERROR:cmg.gateway.auto_deploy:Failed to deploy model 'medcat-icd10-20260116': 'DeployResources' object has no attribute 'get'
2026-01-16T11:44:53.082762167Z ERROR:cmg.gateway.auto_deploy:Failed to deploy model 'medcat-icd10-2026011

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions