Skip to content

GPU passthrough for IMBE-ASR container #2

@LumenPrima

Description

@LumenPrima

Problem

IMBE-ASR runs on CPU in the docker-compose stack. Production deployments need CUDA for real-time performance.

Scope

  • nvidia-container-toolkit integration in compose
  • GPU device reservation
  • Fallback to CPU when no GPU available
  • Document GPU requirements

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions