You can use GPUs to accelerate your app even further. A common pattern might look like this:
- Use an officially supported CUDA image
- Add your GPU dependencies to your Image
- Attach a GPU to your function with
gpu="A10G"
Click Run to see it in action!
You can use GPUs to accelerate your app even further. A common pattern might look like this:
gpu="A10G"Click Run to see it in action!
Previous
3. Scale out horizontallyNext
5. Run LLM inferencePress the Run button to start.