GTN-P borehole data management
towards global assessment of permafrost temperature change
Contact:
boris.biskaborn@awi.de Telegrafenberg A43 14473 Potsdam
Phone: +49 331 288 2194 www.awi.de
References
Streletskiy D, Biskaborn B, Nötzli J, Lanckman J, Romanovsky V, Schoeneich P, et al. Permafrost thermal state. State of the Climate in 2016 Bull. Amer. Meteor. Soc.; 2017.
Biskaborn, B.K., Lanckman, J.P., Lantuit, H., Elger, K., Streletskiy, D.A., Cable, W.L., Romanovsky, V.E., 2015. The new database of the Global Terrestrial Network for Permafrost (GTN-P).
Earth Syst. Sci. Data 7, 245-259.
Biskaborn, B.K., Lantuit, H., Dreßler, A., Lanckman, J.-P., Jóhannsson, H., Romanovsky, V., Cable, W., Sergeev, D., Vieira, G., Pogliotti, P., Nötzli, J., Christiansen, H.H., 2015. Quality assessment of permafrost thermal state and active layer thickness data in GTN-P. GEOQuébec2015 Conference paper, Québec, p. 7 pages.
Elger K, Biskaborn BK, Pampel H, Lantuit H. (2016): Open Research Data, Data Portals and Data Publication – an introduction to the data curation landscape. Polarfoschung, 85, 2, pp.
119-133. doi: http://doi.org/10.2312/polfor.2016.009
1
Alfred Wegener Institute Helmholtz Centre for Polar and Marine Research, Potsdam, Germany;
2Geophysical Institute, University of Alaska Fairbanks, Fairbanks, USA;
3Geological Survey of Canada, Natural Resources Canada, Ottawa, Canada;
4George Washington University, Washington, USA;
5
WSL Institute for Snow and Avalanche Research SLF, Davos, Switzerland;
6Instituto de Geografia e Ordenamento do Território, University of Lisbon, Lisbon, Portugal;
7Institut de Géographie Alpine, Université de Grenoble Alpes, France;
8Arctic Portal, Akureyri, Iceland;
9University of Potsdam, Potsdam, Germany
Permafrost stores tremendous amounts of organic matter.
Increasing temperatures will result in the release of additional
greenhouse gases, which will in turn accelerate climate-warming.
The Global Terrestrial Network for Permafrost (GTN-P) provides
systematic long-term measure- ments of permafrost temperature and active layer thickness (ALT), and is part of the Global Climate Observing System (GCOS).
GTN-P
Global Terrestrial Network for Permafrost
File Repository
TSP or ALT Metadata
&
Citation
Data file CSVin PGPOOL-II
for Database Replication Mirror
Replication Streaming
GTNP DMS Back-Up
Cron Tasks Compute
- Metadata Completeness - Mesurement site active Y/N - Dataset embargo 2 years
Cron Tasks PostgreSQL Database
Charts/Graphs Statistiques &
Interpolation Data
Control Vocabulary
Meta- data
METADATA & DATA CREATE/UPDATE GTN-P DATABASE METADATA /DATA VIEW & RETRIEVAL USER INTERFACE
DISTRIBUTED DATA MANAGEMENT GTN-P DMS API
Remote Sensing
Interface for Online Feed
Distant Database
Global Terrestrial Network for Permafrost Data Management System
Due Permafrost
Live Feed
Metadata input form Loged inUSER
Error Report
Visual Control QUALITY
CONTROL
Distant Server
Postgresql DB
for Indexing Norperm Fluxnet ...
GEMET Thesaurus, Semantic Web
SEMANTIC WEB / ONTOLOGIES DISSEMINATION INTEROPERABILITE
Map Interface
Metadata XML
Schema Other Repository
NASA, NOAA, NSIDC ...
Publication
CSV Reader Collections CSV
Uploader Max (should be put in chunk load )
Methods:
- Index - Reader - Uploader - Download - Login/Logout - Album -
Pending
Methods
Tasks
PermafrostML
Arctic Portal Server
Thematic cartography
Map Search Mapping, visualization
Cross Layers
View metadata and datasets
Datasets Not indexed
Create/Update Metadata:
- Boreholes - Active layer - Citation - Organization - Contact - Sites
Create/Update Dataset with single variable
setting Load collection
of data Bulk Submission
Bulk Submission
Python Script
Security
CREATE/UPDATE Priviledges By Country
Retrieval Priviledges Login
Visualization templates
One location:
(-Ground temp., -Surface temp., -Air temp., -Soil moisture, -Snow depth, -Active layer depth Boreholes and thaw tube.)
Grid:
(-Active layer depth grid, -Active layer depth transect, -Soil moisture, -Snow depth.)
Satellite:
(Soil Moisture) Satellite:
(Surface Temp) One location:
Ground temp.
Annual Data
GTN-P data model Schema
OPEN LAYER
Map Control of measurement sites - Search update markers on the map - Can select area on the map, update the search - Zoom and map position update from the search - Reset button
- Add layers On/Off on the map (Permafrost zones)
Validation / Publication Charts creation
Statistics Calculation Min/Max/Avg/Count/Null Business
Rules
Dataset Compiler for download
19115-2ISO GTN-P
Data Policy
&
Citation
TSP or ALT Metadata
&
Citation
Data file CSVin Archives
Selected DATA
Server Caching
Caching
On Create/Update - Boreholes - Active Layer - Citation - Organization - Contact GoogleMap API
longitude latitude elevation defintion Ajax should be used
for citation/contact organization creation on-the-fly
JQuery should be used drag/drop citations/contacts organization and sort them ---define main 1st order
-0(*/
Permafrost Data minning Tutorial
About us FAQ News
GTN-P WEBSITE
documentation DMS
Data files creation on create/update collections/datasets:
- Dataset Opened/Closed - Collections Published Y/N
Business
Rules Data Policy Data Quality
Validation / Publication Validation / Publication Validation / Publication
Login Interface for retreive/update Password
Password Update Interface
Live feed logger
Data Aggregations
Data aggregation:- Minimum value - Maximum value - Avgerage - StDeviation - Variance - Count
- First measure date - Last measure date
Global
Annual
Monthly Daily
Sensors Annual
Python Script Query
Scripts
Algorithm
ZAA depth
(x)
Linear regression
Cubic Spline interpolation
computedMAGT
(x)
Quadratic Spline interpolation
Rules:
- ...
- ...
- ...
NetCDF Generation
TSP
ALT LIbrairies
Index Query Result
Search Engine
Metadata Form indexed
BH/ AL Selection Search criteria:
- Elevation range - Depth range - Name - Site name - Country name - GTN-P code - Permafrost Zone - Vegetation Type - Responsible person - Variable type - Data Y/N
Search Interface
COMPONENTS
$JJUHJDWLRQRQXSGDWHFUHDWH
Weekly
Charts for Profiles measures Freq.< annual
Charts for Annual
measures Charts for Ground
temperature stats Heatmap for Active layer thawing View:
- Boreholes - Active layer - Citation - Organization - Contact
DMS USERS
NetCDF Template Timeseries profile
ZAA and MAGT Calculation
Cubic Spline interpolation at constant depth
0,1,2,3,5,10 (m)
Data and Metadata files templates
One location:
(-Ground temp., -Surface temp., -Air temp., -Soil moisture, -Snow depth, -Active layer depth Boreholes and thaw tube.)
Grid:
(-Active layer depth grid,
-Active layer depth transect, -Soil moisture, -Snow depth.)
Satellite:
(Soil Moisture)
Aggregation files Satellite:
(Surface Temp) BH/ALT Metadata Template
Mean Aggregate over the grid
ALT Mean Annual Interpolated depths
TSP
NetCDF Template Timeseries
Mean Annual TSP NetCDF Template
Timeseries profile Variables
(x)
View datasets open session
Variables
(x)
Variables
(x)
Datasets Form Datasets Form Datasets Form Datasets Form
DyChart Plugin CanvasXpress
Plugin
Data visualization plugin
Python plugin for Heatmap
CREDITS
XML Mapping
Insert/create/delete API Restfull API
Web Services XML Mapping
TECHNOLOGIES
GEOSERVER OpenLayer
Stream Sensor Data
MAPPING SYSTEM LEGEND
Sites Bounding box Calculation
Component Validation Refusal
Action Flow Pending Action Flow
User Flow
View DMS Objects USERNO
LOGIN REQUIRED
DMS USERS GTN-P Network
NCs
Permafrost Ontology
Ressources
Publications
LINUX PYTHON
GeoServer WMS
- Query special views for WMS
- Database, gis schema, gt_pk_metadata_table for objects id - Description file for popup window template
KML CSV SHP
Download
WMS Services
GTN-P DB