VirtualiZarr: Create virtual Zarr stores using xarray syntax

The Kerchunk idea solves an incredibly important problem: accessing big archival datasets via a cloud-optimized pattern, but without copying or modifying the original data in any way; it’s just one of the many kinds of tools currently being used to develop software at [C]Worthy.

However, kerchunk’s current design (especially MultiZarrToZarr) is limited.

[C]Worthy staff scientist Tom Nicholas, Ph.D., who currently focuses on data analytics, leads a discussion with Pangeo about the motivation for, current status of, and future plans for the VirtualiZarr package as a means of gaining the power of kerchunk in a fully Zarr-native way.

Watch the full session and demonstration on YouTube here.