Datastreams

A datastream is a structured way to import your data into Marple DB.

In the example setup below, there are three datastreams:

1. Simulation data: for importing MATLAB files

2. Heat measurements: for zipped CSV files

3. Car data: for MDF files

Each of these datastreams contains different files, and has a different configuration.

Importing data

Upload one or multiple files by

• Clicking "Upload Files"

• or by drag and dropping them on the "Upload Files" button

The import status is shown next to each file.

• Importing means the file being handled by the plugin. If supported, the plugin will first import priority signals. They will first become available in cold storage.

• Failed means something went wrong. Click the "Failed" to see more details.

• Waiting means the file is in the queue. By default, two files can be imported in parallel, but this depends on your server configuration.

• Imported means that all data and metadata is processed

Metadata

File metadata can be added both manually and automatically.

Manually

1. Manually for an individual file

1. By uploading a .csv file, with a column dataset and a column for each field you want to set. Example:

dataset,Location,Scientist
file1.csv,Italy,James
file2.csv,Spain,Hilde
file3.csv,Germany,Michel

Automatically

1. From the file upon importing (if the plugin supports it, like MDF)

2. Using our API & SDK