Data Transformation

In order to process data into the format needed by the destination data repository, a number of jobs are run at this step. For regular workstreams like business reporting, these jobs integrate automation and governance to make sure that data is consistently cleaned and transformed. As an illustration, a data stream might be in nested JSON format; the goal of the data transformation stage is to unroll that JSON and extract the important fields for analysis.