starryendymion/tfx-data-pipeline

A complete machine learning data-preprocessing pipeline using TFx ( Tensorflow Extended)

Data Preparation using Tensorflow Extended

In this notebook, we will explore how we can preprocess data professionally in a production environment. We will be using Tensorflow Extended, also known as TFx.

⦿ TFx has many components. In this notebook, we will only be using the data-handling components such as ExampleGen, StatisticsGen, SchemaGen, and Transform.

⦿ The ML metadata and the generated files are stored inside the pipeline folder.

⦿ The dataset we are using is the diabetes prediction dataset, which is a structured tabular dataset.

---

About Tensorflow Extended:

TensorFlow Extended (TFX) is a flexible framework allowing Machine Learning (ML) practitioners to iterate on production-grade ML workflows faster with reliability and resiliency. TFX's power lies in its flexibility to run ML pipelines across TensorFlow.