Key concepts

Storage types

Marple DB is a highly optimised data storage solution. It mainly targets high-frequency time series data obtained with measurement files. To achieve this performance, it combines two types of storages:

1. Hot storage (PostgreSQL)

2. Cold storage (Parquet files on blob storage)

Marple DB automatically handles loading individual signals from cold storage to hot when needed.

Datastream

Marple DB can consume data from different sources. A datastream allows you to configure

• The file plugin (see below)

• Preprocessing rules rules

• A unified name space (UNS)

• Automations

Read more in Datastreams

Plugin

Data files exist in a lot of different file types (CSV, MDF, MAT, HDF5, ...). A plugin is a software module that reads out the data & metadata for a specific file type.

Read more in Supported file types

Datapool

A datastream writes its data into a datapool, which defines the Postgres tables where data will be written to.

By default, all datastreams write into the same default datapool. Changing this is for advanced use cases.