White paper · 2025
End-to-End Data Movement: Paradigm Reexamination and Principles for Efficiency.
Zettar founder Chin Fang's in-depth paper on holistic hardware–software co-design for petascale movement — burst buffers, the data-movement layer, and the architecture behind the zx Appliance. Tell us where to send it and download the full PDF.
What's inside
Get the paper
- Why the network isn't the bottleneck — storage I/O, host architecture, and software are.
- The co-design principle and the "Drainage Basin Pattern."
- Burst buffers (NVMe staging) as the key architectural component.
- Real results: 1 PB in 29 hours at 96% link utilization, and the KEK cryo-EM cloud case.
Open access (CC BY 4.0). Also available on arXiv →
Download
