Batch Processing with Burst
Process images, videos, and large datasets without managing infrastructure. Run compute-intensive batch jobs in isolated VMs.
The Problem
Batch processing jobs are resource-intensive and time-consuming:
- Processing thousands of images ties up your local machine
- Video transcoding can take hours
- Large dataset operations need dedicated compute
- Lambda timeouts at 15 minutes — not enough for real batch work
You need compute that can run for hours without babysitting.
How Burst Solves It
Submit your batch job and let it run in an isolated VM. Process thousands of files while you do other things.
$
burst run ./process-images.py
Uploading... done.
Running in vm-2k9m.
You can close this terminal.
Check back to see progress or wait for completion:
$
burst logs
[15:32:18] Processing image 2,847 of 10,000...
[15:45:33] Processing image 5,412 of 10,000...
[16:12:07] Processing image 10,000 of 10,000...
Done. 52m 14s
Why Burst for Batch Processing
- No timeout limits — Process for minutes or hours
- Full VM resources — CPU, memory, disk space as needed
- Isolated execution — Each job gets its own environment
- Fire and forget — Submit and walk away
- Any language — Python, shell scripts, whatever you need
Use Cases
- Image processing — Resize, convert, or apply filters to thousands of images
- Video transcoding — Convert video formats, extract frames, generate thumbnails
- PDF generation — Generate reports, invoices, or documents in bulk
- Data transformation — Parse, clean, and transform large datasets
- File conversion — Convert between formats at scale
Comparison
| Feature | Burst | Lambda | EC2 |
|---|---|---|---|
| Max runtime | Unlimited | 15 min | Unlimited |
| Setup time | 1 min | 30+ min | 1+ hour |
| Maintenance | None | IAM, configs | Full server |
| Cost model | Per job | Per request | Hourly |
Ready to process at scale without infrastructure?
Get early access