Transformer Guide

This section contains documentation on creating a JSON spec for a Transformer so that it can be registered with SDL Data Pipelines.

There are a few options for creating new Transformers.

Using Dynamic Transformers

Some Transformers that are shipped out-of-the-box with SDL allow users to configure them when creating a Pipeline. You can use the Pipeline UI to edit the transformation code directly, instead of building and pushing a new Transformer yourself. For many use cases, this is the easiest option and gets users started quickly. See Dynamic Transformers for more information.

Creating a New Transformer

Generally, writing a new Transformer will consist of the following steps:

  1. Write the Transformer code, containerize it, and push the image.

  2. Set environment variables to match those given below.

  3. Write the Transformer JSON configuration, and add it to the pipeline engine.

The following pages will explain guidelines behind how to create Transformers, as well as how to create a Transformer JSON to register it.