Instantiation
The instantiation block describes how a Transformer is created by the Pipeline Engine. Two options are available: job_image (instantiate as a Kubernetes Job) and rdp_workflow (instantiate via the SDL workflow runtime).
job_image
job_image tells the Pipeline Engine to instantiate the Transformer as a Kubernetes Job. Available fields are as follows:
"job_image": {
"image": "asdf",
"pull_policy": "IfNotPresent", // Alternatives: Always, Never
"image_pull_secret": "pat-name",
"default_replicas": 2,
"ports": [
{
"name": "http-port",
"containerPort": 8080
}
],
"volumes": [ // A list of Kubernetes Volumes, just in JSON format instead of YAML
{
"name": "volume-1",
"configMap": {
"name": "volume-configmap",
"items": {
"key": "config",
"path": "my-config.conf"
}
}
}
],
"volume_mounts": [ // A list of Kubernetes Volume Mounts, just in JSON format instead of YAML
{
"name": "volume-1",
"mountPath": "/etc/config"
}
],
"args": [ // Alternative arguments passed to the main container at startup
"tail", "-f", "/dev/null"
]
}
rdp_workflow
rdp_workflow tells the Pipeline Engine to instantiate the Transformer via the SDL workflow runtime in a one-shot configuration. This is used for transformers with the rdp_workflow type.
"rdp_workflow": {
"definition_id": "my-custom-definition-id"
}
definition_id-
Optional. If present, overrides the Transformer template’s UID when searching for the appropriate node definition in the workflow runtime. If omitted, the template’s own UID is used.