Shaping the Future of Open Geospatial ScienceInsights from Pangeo Collaboration Meeting 2024Annef·Added Dec 12, 2024·4 min readAnnef·Added Dec 12, 2024·4 min read
Using Kerchunk with uncompressed NetCDF 64-bit offset files: Cloud-optimized access to HYCOM Ocean…By Rich Signell (Open Science Computing, LLC) and Martin Durant (Anaconda)Richard Signell·Added Jul 19, 2024·4 min readRichard Signell·Added Jul 19, 2024·4 min read
Zarr pyramids at scale(by Raphael Hagen and Max Jones)Raphael Hagen·Added Jul 17, 2024·2 min readRaphael Hagen·Added Jul 17, 2024·2 min read
Toward Zarr-Python 3.0We released Zarr-Python 2.18.0 this week. Although this release was quite light in terms of user-facing changes, it represents the…Joe Hamman·Added May 10, 2024·3 min readJoe Hamman·Added May 10, 2024·3 min read
Optimizing CubedWe implemented a number of optimizations in Cubed to give a 4.8x performance improvement on the “Quadratic Means” problem when running on…Tom White·Added Apr 3, 2024·10 min readTom White·Added Apr 3, 2024·10 min read
Cubed: Bounded-memory serverless array processing in xarrayWednesday, June 28th, 2023 (5 months ago) (Reposted from https://tom-nicholas.com/blog/cubed-xarray/)Tom Nicholas·Added Nov 17, 2023·14 min readTom Nicholas·Added Nov 17, 2023·14 min read
Pangeo Forge is all in on Apache BeamAs of the latest 0.10.0 release, Pangeo Forge, a modular Python toolkit for reproducibile and scalable production of analysis ready cloud…Charles Stern·Added Jul 13, 2023·7 min readCharles Stern·Added Jul 13, 2023·7 min read
Dask.distributed and Pangeo: Better performance for everyone thanks to science / software…Improvements to dask’s performance at scale are a success story for pangeo tooTom Nicholas·Added Jan 4, 2023·10 min readTom Nicholas·Added Jan 4, 2023·10 min read
Accessing NetCDF and GRIB file collections as cloud-native virtual datasets using KerchunkFor the past 4 months I’ve been a Google Summer Of Code Contributor working on the open source Python package Kerchunk with the mentorship…Peter Marsh·Added Sep 11, 2022·6 min readPeter Marsh·Added Sep 11, 2022·6 min read
Easy IPCC Part 1: Multi-Model DatatreeHandling heterogenous climate model data with xarray-datatreeTom Nicholas·Added Aug 29, 2022·10 min readTom Nicholas·Added Aug 29, 2022·10 min read