Skip to content

fix: add GPU Docker runtime support - #180

Open
Artavazd Balaian (REASY) wants to merge 2 commits into
microsoft:mainfrom
REASY:fix/docker-gpu-runtime
Open

fix: add GPU Docker runtime support#180
Artavazd Balaian (REASY) wants to merge 2 commits into
microsoft:mainfrom
REASY:fix/docker-gpu-runtime

Conversation

@REASY

Copy link
Copy Markdown

Summary

Adds a Docker/Compose runtime for GPU-backed TRELLIS.2 inference.

  • Adds a CUDA 12.4 image with PyTorch 2.6 and the required CUDA extensions.
  • Adds a Compose service with NVIDIA GPU access, Gradio port forwarding, persistent Hugging Face cache, and output mounts.
  • Documents Docker usage, Hugging Face token forwarding, and DINOv3 gated-model access.
  • Pins compatible OpenCV and Pillow releases for EXR environment-map loading and Gradio WebP support.
  • Updates DINOv3 feature extraction to support both legacy and Transformers 5 encoder layouts.
  • Keeps generated models and outputs out of Git.

Validation

  • Built the Docker image successfully.
  • Verified CUDA access from the container on an RTX 4090.
  • Verified FlashAttention, nvdiffrast, and O-Voxel imports.
  • Verified OpenEXR decoding of the bundled HDR environment map.
  • Verified DINOv3 feature extraction on cuda:0.

@REASY

Copy link
Copy Markdown
Author

@microsoft-github-policy-service agree

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant