Datastreams

A datastream is a structured way to import your data into Marple DB.

In the example setup below, there are three datastreams:

1. Simulation data: for importing MATLAB files

2. Heat measurements: for zipped CSV files

3. Car data: for MDF files

Each of these datastreams contains different files, and has a different configuration.

Importing data

Upload one or multiple files by

• Clicking "Upload Files"

• or by drag and dropping them on the "Upload Files" button

The import status is shown next to each file.

• Importing means the file is being handled by the plugin. If supported, the plugin will first import priority signals. They will first become available in cold storage and are automatically saved in hot storage as well.

• Failed means something went wrong. Click the "Failed" to see more details.

• Waiting means the file is in the queue. By default, two files can be imported in parallel, but this depends on your server configuration.

• Imported means that all data and metadata is processed

Metadata

File metadata can be added both manually and automatically.

Manually

1. Manually for an individual file

1. By uploading a .csv file, with a column dataset and a column for each field you want to set. Example:

dataset,Location,Scientist
file1.csv,Italy,James
file2.csv,Spain,Hilde
file3.csv,Germany,Michel

Automatically

1. From the file upon importing (if the plugin supports it, like MDF)

2. Using our API & SDK