Configuration
Datastream configuration is mainly handled by choosing a correct plugin and plugin arguments. These two fields are used for this:
Valid plugin names and arguments can found in Supported file types
To do data cleaning and setting up a Unified Name Space (UNS), you can use Preprocessing rules
Data reduction
A datastream can automatically decrease the data size of a signal-by-signal basis. Click the checkbox to enable it:
This will evaluate for each signal if it can be highly compressed. A typical example would be a status signal (shown below). The algorithm will only keep data points that are different from one of their neighbouring data points. Additionally, a minimum data rate is also guaranteed (default 1Hz).
Two advanced options (see below) can be configured for this feature
Data reduction frequency: minimum rate to keep (default: 1Hz)
Data reduction threshold: minimum compressibility that is needed before applying the reduction (default: 90%)
Advanced options
Advanced options are designed to be used by expert users. For help, reach out to [email protected]
Datapool
default
Determines the postgres tables where data will be written to
Time partition size
20 hours (2^46 nanoseconds)
Size of postgres partitions. Change if you are handling files that are very long (weeks) or very short (seconds)
Downsampled data layers
2*10^-10 (<< 32)
Factor for downsampling layer (in bit shifts)
Data reduction frequency (Hz)
1
See explanation above
Data reduction threshold
90
See explanation above
Last updated