Miscellaneous examples
Looking for how to make a popular model or library work with Modal? There’s a guide for that:
- Benchmark the Tokasaurus high-throughput LLM server
- Deploy ControlNet demos with Gradio
- Deploy ollama
- FastHTML: Deploy 100,000 multiplayer checkboxes
- Fine-tune Flan-T5 and monitor with TensorBoard
- Generate video clips with Mochi
- MultiOn: Create an agent for AI news
- Profile PyTorch code
- Real-time object detection with webcam input
- Run batched Whisper transcription
- Run continuous integration (CI) tests on Modal
- Run OpenAI’s gpt-oss model
- Run OpenCV to detect faces
- Run SAM 2 video segmentation model
- Run Text Embedding Inference (TEI)
- Serve TensorRT-LLM at maximum throughput
You can find even more examples on the modal-examples GitHub repository or find larger projects built by Modal users at the awesome-modal GitHub repository.