A Deep Dive into Custom Spark Transformers for Machine Learning Pipelines

Modern Spark Pipelines are a powerful way to create machine learning pipelines Spark Pipelines use off-the-shelf data transformers to reduce boilerplate code and improve readability for specific use cases This blog outlines how to construct custom Spark Transformers to integrate with Spark Pipelines Learn how to identify the components of each Transformer class member function […]

deep dive dive engineering & tech featured machine machine learning spark transformers