This collection contains experimental data which was generated between 10th May 2010 and 30th November 2019. The experiments were stored in the temporary files folder - there is another one for permanent storage of scientifically relevant data - and were supposedly conducted with DF600 as solid phase and aqueous 1 mM NaCl solution as liquid phase (see file names and metadata).

You will need to refer to the .html files, if you don't want to install a Python environment. The two files are static versions of the iPython notebooks described below and contain all scripts to achieve a clean dataset collection.

The original data is stored in the National Instruments .tdm file format in the "TDM" folder. This file format has been superceded by .tdms, which can be read into Python with the nptdms library.

Files in the .tdm format are converted with the Diadem script "TDM_Conversion.VBS" into the newer .tdms format. The resulting files are stored in the "TDMS" folder.

Two additional Jupyter notebooks are included which are concerned with the transformation of the raw metadata into sensible information, which can be used for analysis. It is recommended to use Anaconda with a separate environment created from the "environment.yml" file.

"Data_Wrangling.ipynb": This first reads the necessary properties from each TDMS file and stores it in a CSV and a pickled Pandas DataFrame. The actual wrangling step is looking for missing values, dropping all experiments that don't have a time step width of 1s and don't appear in groups of three.

"Data_Cleaning.ipynb": This part checks for consistency and validity of the properties.