DATAR
12.11.2018 I DOMENICO TARABORRELLI (IEK-8)
Data science Aspects and Tools in Atmospheric Research
MOTIVATION
•Observational data sets are sparse either in time and space or in terms of chemical composition, e.g. airborne field campaigns.
MOTIVATION
•Observational data sets are sparse either in time and space or in terms of chemical composition, e.g. airborne field campaigns.
•Quantitative assessment of the interplay between atmospheric composition and weather/climate requires the use of multiple complementary datasets, e.g.
simulation output and trace gas retrievals.
MOTIVATION
•Observational data sets are sparse either in time and space or in terms of chemical composition, e.g. airborne field campaigns.
•Quantitative assessment of the interplay between atmospheric composition and weather/climate requires the use of multiple complementary datasets, e.g.
simulation output and trace gas retrievals.
•This requirement poses certain demands on the data science abilities of next- generation atmospheric scientists.
MOTIVATION
A dramatization
Yerkes-Dodson law
Automation
Information underload
↓
Erosion of talent Shallow thinking
Little automation Information overload
↓
Divided attention Shallow thinking
flow
CONCEPT
A short-course introducing to:
•the basics of data and their lifecycle
•common tools for the analysis of atmospheric data
•various large datasets in environmental sciences
•various applications in atmospheric sciences
•a glossary comprising many relevant definitions and concepts
DATA BASICS AND LIFECYCLE
•Kinds of data (Schröder, IEK-8)
•Data standards (Schröder/Rosanka, IEK-8)
•Data lifecycle (PD Dr. Schultz)
DATA PROCESSING AND ANALYSIS
•Data quality assurance and control (Dr. Rohs, IEK-8)
•Tools for data analysis (Schröder/Rosanka, IEK-8)
LARGE DATASETS AND DATA ANALYTICS
•Large datasets in atmospheric sciences (PD Dr. Schultz, JSC)
•Databases of atmospheric kinetic data (Dr. Vereecken, IEK-8)
•Large data infrastructures in environmental sciences (PD Dr. Petzold, IEK-8)
•Web services for data distribution (Dr. Stein, JSC)
APPLICATIONS IN ATMOSPHERIC SCIENCE
•Field campaign planning (Dr. Grooß, IEK-7)
•Satellite retrievals 1 (Dr. Ungermann, IEK-7)
•Satellite retrievals 2(PD Dr. von Clarmann, KIT)
•Visualization of climate data with ParaView (Dr. Zilken, JSC)
STAY ON TOP!
flow