Back to the Index

ML Pipeline

What is an ML pipeline?

A ML pipeline is a program that takes input and produces one or more ML artifacts as output. Typically, a ML pipeline is one of the following: a feature pipeline, a training pipeline, or an inference pipeline

Why are ML pipelines important?

ML pipelines help ensure the reproducibility and scalability of machine learning workflows. By encapsulating the entire process in multiple pipelines, it is easier to manage, version control, and share the different stages of the process. 

How are ML pipelines related to the feature store?

If you have a feature store, you can decompose a monolithic ML pipeline into feature, training and inference pipelines. The feature store becomes the data layer for your ML pipelines, storing the outputs of the feature pipeline, and providing inputs to the training and inference pipelines.

Does this content look outdated? If you are interested in helping us maintain this, feel free to contact us.

© Hopsworks 2023. All rights reserved. Various trademarks held by their respective owners.

Privacy Policy
Cookie Policy
Terms and Conditions