| Package | Description |
|---|---|
| com.hof.mi.etl | |
| com.hof.mi.etl.runner | |
| com.hof.mi.etl.runner.status | |
| com.hof.mi.etl.step |
| Modifier and Type | Class and Description |
|---|---|
class |
ETLStepErrorThresholdExceededException
Exception thrown when an ETL step exceeds its error threshold.
|
class |
ETLStepRowThresholdExceededException
Exception thrown when an ETL step exceeds max rows to be output from the step
|
| Modifier and Type | Method and Description |
|---|---|
static ETLException |
ETLException.getETLException(ETLElement elementType,
java.lang.String elementUid,
java.lang.Object data,
java.lang.String messageKey,
java.lang.Throwable e) |
| Modifier and Type | Method and Description |
|---|---|
static void |
ETLException.throwETLException(ETLElement elementType,
java.lang.String elementUid,
java.lang.Object data,
java.lang.String messageKey,
java.lang.Throwable e) |
| Modifier and Type | Method and Description |
|---|---|
void |
ETLRunnerImpl.buildProcess()
Build the process by building steps, linking them together and identifying heads of execution.
|
void |
ETLRunner.buildProcess()
Build the ETL Process
|
void |
ETLRunner.run()
Begin running the ETL process
|
| Modifier and Type | Method and Description |
|---|---|
java.util.Collection<ETLException> |
ETLStepStatusImpl.getErrors() |
java.util.Collection<ETLException> |
ETLStepStatus.getErrors()
Get all unhandled errors.
|
| Modifier and Type | Method and Description |
|---|---|
void |
ETLStepStatusImpl.addError(ETLException e) |
void |
ETLStepStatus.addError(ETLException e)
Add an unhandled error to the set of errors.
|
| Constructor and Description |
|---|
ETLStepStatusImpl(java.lang.String stepUuid,
java.util.Collection<ETLException> errors) |
| Modifier and Type | Method and Description |
|---|---|
ETLException |
AbstractETLStep.getETLException(java.lang.String messageKey)
Get an ETLException for the step with the message key that is passed in.
|
ETLException |
AbstractETLStep.getInvalidConfigETLException()
Get a generic ETLException when there is a problem in the step's config.
|
ETLException |
AbstractETLStep.getUnhandledETLException(java.lang.Throwable e)
Get an ETLException when the error cannot be handled.
|
| Modifier and Type | Method and Description |
|---|---|
java.util.Collection<ETLException> |
AbstractETLInlineRowStep.validate()
This function validates that the step has everything it requires to run successfully.
|
java.util.Collection<ETLException> |
ETLStep.validate()
Perform validations on the ETLStep and return errors as a collection of
ETLException |
| Modifier and Type | Method and Description |
|---|---|
protected void |
AbstractETLStep.addError(ETLException e)
Use this method to record errors during execution of the step.
|
| Modifier and Type | Method and Description |
|---|---|
protected void |
AbstractETLStep.emitData(ETLStepResult dataPacket)
Send a data packet to its output step
|
protected void |
AbstractETLStep.emitData(ETLStepResults data)
Send data packets to all output steps.
|
void |
AbstractETLRowStep.endRows(java.lang.String inFlowUuid)
Set the step's status and signal endRows() in subsequent steps.
|
void |
ETLStep.endRows(java.lang.String inFlowUuid)
This method is used to signal end-of-input.
|
void |
AbstractETLCachedStep.endRows(java.lang.String inFlowUuid)
Signal end of data from an input step
|
protected void |
AbstractETLRowStep.postRow(ETLStepResults processedData)
Perform any post-processing here..
|
protected void |
AbstractETLRowStep.preEndRows(java.lang.String inFlowUuid)
Any pre-processing before finishing this step.
|
protected java.lang.Object[] |
AbstractETLRowStep.preRow(java.lang.Object[] data,
java.util.List<ETLStepMetadataFieldBean> metadata)
Perform any pre-processing here.
|
protected abstract void |
AbstractETLCachedStep.processEndRows()
This executes the core processing logic of the step implementation.
|
protected ETLStepResults |
AbstractETLRowStep.processRow(java.lang.Object[] data,
java.util.List<ETLStepMetadataFieldBean> metadata)
This method initiates the core processing of this step and maps data from the input structure to the output structure.
|
protected abstract boolean |
AbstractETLRowStep.processWireData(java.util.List<ETLStepMetadataFieldBean> fields)
Process data on
Wires. |
protected boolean |
AbstractGroupedDataInlineStep.processWireData(java.util.List<ETLStepMetadataFieldBean> fields) |
void |
AbstractETLRowStep.row(java.lang.Object[] data,
java.lang.String inFlowUuid) |
void |
ETLStep.row(java.lang.Object[] data,
java.lang.String inFlowUuid)
Process a row of data received from the specified input flow.
|
void |
AbstractETLCachedStep.row(java.lang.Object[] data,
java.lang.String inFlowUuid)
Cache a row of data from an input step.
|
void |
AbstractETLStep.setupDefaultFields()
Set up the default metadata fields for this step.
|
void |
ETLStep.setupDefaultFields()
Setup Default Metadata Fields for this step.
|
void |
AbstractETLInlineRowStep.setupGeneratedFields()
This implementation makes sure that the operating field is of the type that is acceptable by the inline if it
has restrictions on the data types it accepts.
|
abstract void |
AbstractETLStep.setupGeneratedFields()
Set up the default metadata fields for fields generated by this step.
|
void |
AbstractGroupedDataInlineStep.setupGeneratedFields() |
void |
AbstractETLStep.throwInvalidConfigETLException()
Throw an ETLException when there is a problem in the step's config.
|
void |
AbstractETLStep.throwUnhandledETLException(java.lang.Throwable e)
Throw an ETLException when the error cannot be handled.
|
void |
AbstractETLStep.waitForDependencies(long checkAfterMillis)
Block the step's execution till all dependent input steps finish execution
|