THE FUTURE OF DATA DISCOVERY AT CEDA

Speaker: Daniel Westwood, CEDA, RAL Space, United KingdomA paradigm shift is underway among many data storage centres as the need for cloud-accessible analysis-ready data increases. There are significant issues relating to findability and accessibility with current storage formats, and the existing archives of data which are not suited for aggregation and use in cloud applications. Several technologies are available such as so-called cloud-optimised data formats such as Zarr and Icechunk, and more traditional formats such as NetCDF.