⚙️ Image setup¶
Image¶
| Component | Version |
|---|---|
| OS | Ubuntu 22.04 x86_64 |
| Python | 3.11.x |
| PyTorch | 2.9.1 |
| CUDA | 12.8 |
| Triton | 3.5.1 |
| onnxruntime-gpu | 1.22.x |
| ComfyUI | 0.25.0 |
| Code Server | latest |
Wheels¶
| Package | Version |
|---|---|
| flash_attn | 2.8.3 |
| sageattention | 2.2.0 |
| torch_generic_nms | 0.1 |
| llama-cpp-python | 0.3.16 |
Optimized¶
| Processor example | Compute Capability | Family | SM |
|---|---|---|---|
| A40 | 8.6 | Ampere | sm_86 |
| L40S | 8.9 | Ada Lovelace | sm_89 |