Zettar Inc. delivers a production-ready, scale-out (i.e. cluster-oriented), petascale-proven, highly available data transfer solution capable of multi-100+Gbps for distributed data-intensive engineering and science applications. The solution consists of 1) the data transfer software, Zettar zx, 2) a multi-node (i.e. cluster) data transfer system reference design, and 3) an HPC all-NVMe storage tier (aka "burst buffer") reference design. Zettar zx is capable of scale-out encryption for data transfers. The solution's capabilities enable the use of existing storage and transfer setup to transparently gain higher throughput with each additional transfer node, with high reliability, and strong privacy for data-in-motion (if encryption is enabled). This Intel blog Transferring data at 100Gbps and beyond for distributed data-intensive engineering and sciences explains the overall co-design approach of the solution. Zettar is a US National Science Foundation funded startup in Palo Alto, California.
As of 2016, the solution is in its third generation. Each generation has been developed, tested, and verified on best-of-breed hardware provided by various tier 1 vendor partners in the storage, compute, and networking spaces.
Zettar collaborates with the US Department of Energy (DOE) Office of Science (SC) National Laboratories and its Energy Science Network (ESNet), which runs a state-of-the-art national 100Gbps network infrastructure. As a result, Zettar's software and data transfer system reference design are both proven in this demanding production environment. For example, in early April 2017, more than once Zettar zx was used to transfer 1PiB files in 1.4day over a 5000-mile ESNet shared production network (120+ms latency, capped at 80Gbps) - but still 5X faster than using Amazon AWS' Snowball.
Zettar is a founding member of the exclusive and elite "Exascale-ready Club". To be admitted in the first half of 2017, an organization/team MUST be capable of using a shared, production, point-to-point WAN link to attain a production data transfer rate >= 270PB-km/hour. Matching the progress of the current members, the admission standard will go up to 600PB-km/hour in the 2nd half of 2017.
Zettar demoed an earlier version of its solution at the Supercomputing 2014 conference (SC14) and showcased its third generation solution at various vendor partners' booths and the DOE's booth at the Supercomputing 2016 conference (SC16). All presentations included a 100Gbps real-time live demo of production preparation runs (with and without TLS encryption) using an innovative and unique 100Gbps 5000-mile loop provided by ESnet (120+ms latency).
Zettar is deploying its solution at a well-known research university, a US DOE Exascale Computing Project (ECP) project, and a hyperscale Web property. Many use cases involve the moving of multiple petabytes of data over distance.