Pangeo Guide for AGU 2019
Headed to the 2019 AGU Fall Meeting in San Francisco in December? Here’s your Pangeo guide to tutorials, presentations, and meetups for this years meeting. See this discourse post for up to date discussion on this year’s AGU happenings.
Tutorials
Scott Henderson, Amanda Tan Lehr, Joe Hamman, and Jessica Scheick will be running a 4-hour Pangeo Tutorial on Sunday December 8th at 13:40–18:00. Details are below. Note that there are only a few slots available so sign up now if you are interested in attending.
Abstract: Bring your laptop to this hands-on workshop sponsored by the Pangeo project! Pangeo is first and foremost a community promoting open, reproducible, and scalable science (read more at https://pangeo.io). Participants will learn about Python and several open-source software packages for analytic workflows with big data in Earth Science. Particular emphasis will be given to Jupyter, Xarray, and Dask software libraries for analysis of multidimensional modeling and remote sensing data sets. In this half-day workshop, participants will familiarize themselves with writing code in Jupyter Notebooks that can be run on scalable computing clusters running on the Cloud, bypassing a common bottleneck of downloading ever-increasing volumes of remote sensing or modeling data. We will have both introductory tutorials and advanced examples used in peer-reviewed research in the fields of oceanography, hydrology, and solid earth geophysics. For those interested in building JupyterHub infrastructure for research groups we briefly discuss how your research group can deploy Pangeo on local servers, HPC systems, or commercial Clouds.
Agenda:
- 1 hr: Introduction to Pangeo project, JupyterHubs, software ecosystem, and data access
- 1.5 hr: Hands-on interactive tutorial of python tools: xarray, dask, geopandas
- 1.5 hr: Example scientific workflows with satellite imagery, climate, and hydrologic modeling
Other Tutorials
There are also a few other tutorials that you may be interested in:
- SCIWS5 Best Practices for Developing and Sustaining Your Open-Source Research Software
- SCIWS3 Applications of Big Data and High-Performance Computing in Earth Sciences
Presentations
Of course there will be lots of talks and posters at AGU that use Pangeo or related tools. The list is certainly too long to post here but we’ve grabbed a few obvious ones that we think many Pangeans will be interested in. See this discourse post for an up to date, crowd sourced version of this list.
- ED52A-01 Interactive geophysics: GeoSci.xyz, Lindsey Heagy
- IN11A-01 Analysis Ready Data in Analytics Optimized Data Stores for Analysis of Big Earth Data in the Cloud, Chris Lynnes
- IN11D-0689 OOICloud: Building a Pangeo System for the OOI CamHD Video Data using the Azure Cloud, Tim Crone
- IN11D-0693 The Pangeo Platform: a community-driven open-source big data environment, Joe Hamman
- IN12A-03 The Big Climate Data Pipeline (BCDP): A tool to facilitate server-side processing of NASA-NEX data on Amazon Cloud, Huikyo Lee
- IN12A-08 NCAR CESM Large Ensemble Numerical Simulation Data on AWS, Jeff de la Beaujardiere
- IN13B-0720 The Earth Data Analytic Services Framework, Thomas Maxwell
- IN13C-0729 PARGEO: Cloud-Ready Pervasively Parallel Analytics and Climate Science, Brian Wilson
- IN23B-07 The Open-source software ecosystem for leveraging public datasets in Spatio-Temporal Asset Catalogs (STAC), Matt Hanson
- IN31B-0792 Using Big Data Technologies with Earth Science Data in HDF5, Larry Knox
- IN31B-0800 NetCDF in the Cloud: modernizing storage options for the netCDF Data Model with Zarr, Ward Fisher
- NS21A-01 ANXCOR: Ambient Noise Cross-Correlation with Python, Kevin Mendoza
- NS21A A Tour of Open-Source Software Packages for the Geosciences I (session) Lindsey Heagy
- SH41C-3317 The Sun at Scale: Interactive Analysis of High Resolution EUV Imaging Data on HPC Platforms with Dask, Will Barnes
Meetups
AGU is all about meeting up with colleagues from across the world, right? Well here’s a short list of events and meetups that you may want to attend:
- Pangeo Dinner (Tuesday, 6:45p, ThirstyBear Organic Brewery)
- TH25I Update and Future Directions of the Open-Source Software Initiative (Tuesday)
- ESIP Ignite (Wednesday, register here)
