> For the complete documentation index, see [llms.txt](https://docs.marpledata.com/docs/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.marpledata.com/docs/marple-db/datastreams/ingestion-pipeline.md).

# Ingestion pipeline

From file to processed data

To ingest data from your file format into structured cold/hot storage in the database, configure your pipeline in the following steps:

1. **Define dataset metadata.** Specify required and optional metadata for the dataset.
2. [**Configure plugin settings**](/docs/marple-db/datastreams/supported-file-types.md)**.** Select the dataset type and set its specific parameters.
3. [**Calibrate signals**](/docs/marple-db/datastreams/signal-calibration.md)**.** Set signal priority, apply scaling, and add units and descriptions.
4. [**Configure signal aliasing**](/docs/marple-db/datastreams/signal-aliasing.md)**.** Define aliasing rules to create a unified namespace across all your datastreams.
5. **Add scripts.** Enhance your datasets with custom Python scripts to add metadata, signals, KPIs, and more.

You can configure your datastream pipeline under **Datastream → Configure → Pipeline**.

<figure><img src="https://3590686807-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FwEBNWlmdcxXBXd7oyqyR%2Fuploads%2FQ6jlMI2oufBePjAbyYbi%2Fimage.png?alt=media&amp;token=d11a9fb9-8613-48bc-a235-55c1eca4b96f" alt=""><figcaption></figcaption></figure>