-
Notifications
You must be signed in to change notification settings - Fork 4
2. ETLComponents
TaskETL is based in five components: extractor, transformer, loader, processor and job.
An extractor will retrieve data from a source and nothing else. Transformation and data cleanse should be delegated to a transformer.
A transformer converts from one data type to another. This is used when source data type is distinct from destination data type.
Another use of a transformer is data cleanse.
A loader takes data and do something usefull with it (save to a file, database, print on console, log).
A job will take one extractor, one transformer and one or more loaders. It will take data from the extractor, pass it to the transformer and provide final generated data to each loader.
A processor will coordinate jobs and dispose each component that is no longer required.