At MeteoSwiss, we produce and work with a diverse range of grid data products, including climate data, radar images, satellite information, and numerical weather predictions. Currently, we utilize various solutions to handle and store these datasets, each tailored to specific functionalities such as customer supply or performance.

Although these existing solutions were developed out of necessity, they present certain issues that require long-term resolution. This project aims to develop a unified grid data management and storage solution by leveraging cloud technologies to achieve scalability, resilience, and cost-efficiency.

Our objectives include the following:

• Implement scalable pipelines capable of handling high-volume bulk data ingestion, as well as continuous data ingestion or data replacement.
• Develop a unified schema for context data to ensure efficient data handling and retrieval.
• Provide consistent, high-performance access to the diverse datasets through APIs.
• Develop storage solution considering the various components of the different data sets (formats, resolutions, lead times, end-users)
• Determine the extent of data integration within the system, including GIS functionalities.

This project aligns with MeteoSwiss's strategic goals by enhancing digitalization, operational robustness, and collaboration.