CCGlite Data Processing Package

Tools for Processing and Reprocessing CCG/CCL Raw Files

NOAA Global Monitoring Laboratory
Carbon Cycle Greenhouse Gases (CCGG)
Long-term Observations of Greenhouse gases and Ozone-depleting Substances (LOGOS)

A set of Python tools and database scripts for processing (or reprocessing) CCG/CCL "raw files" data. The package includes our pre-processed raw files and QC data, the database tables that hold mole fraction results and calibration tank data, and the utilities that process it all. It currently covers CO2 and CO (flask and calibration data), and runs on macOS and Linux.

The package walks you through installing conda python and mariadb if needed and then copies in python source code, pre-processed raw files and QC data.

Download

CCGlite

Each archive is named with its build date, and ships with a .sha256 checksum file. Verify the download before installing:

shasum -a 256 -c ccg_dataProcessing_<date>.zip.sha256 (macOS)
sha256sum -c ccg_dataProcessing_<date>.zip.sha256 (Linux)

What is included

Pre-processed raw files and QC data for the gases and date range shown in the archive's lib/build_info.txt.
Database dumps for the ccgg, gmd and reftank schemas, holding mole fraction results, calibration tank data, scales and response curves.
The flask and calibration processing code (flpro.py, calpro.py and supporting modules).
An installer and a session script that starts the environment.

Requirements

Available on macOS or Linux only.
Miniconda, for the Python environment. The installer downloads and runs the official Miniconda installer if conda is not already present.
MariaDB. On macOS this comes from Homebrew; on Linux, from your distribution's package manager.
Roughly 2 GB of free disk space for the data and database, depending on the build.

You don't need an administrator account to run the package itself, however installing homebrew or the linux MariaDB packages may require a super user account.

See the included readme.txt for installation and useage details

Questions, comments, or requests: john.mund@noaa.gov