Overview

Joiner Processor is a processor component aimed at efficiently joining input records with different topics into a new output record.

FQCN

com.datumize.ddc.component.mixer.JoinerProcessor


This processor effectively joins a record from topic A and another record from topic B into a new record, combining both of them. 

Properties


Common properties that apply to all source and processor components of a pipeline.

PROPERTYIDDESCRIPTION

REQUIRED

TYPE

DEFAULT

EXAMPLES

Common
IdentifierIDComponent unique Identifier within the pipeline, read only, only useful for advanced mode.YesStringAuto

MyComponent_23423

This Identifier is automatically generated by the system and you can't change it. Might be helpful for advanced pipeline configuration.

DescriptiondescriptionA short description for the component, to be visualized inside the component representation, aimed at providing additional information to understand the pipeline at a glance.NoString

Extract customer id and loyalty number.

Short and sweet description.

TopictopicAll Source and Processor components support a topic to tag the output records. If the record does not have a tag applied, this topic will be automatically applied. The topic may be used by future components to route, group or classify records.NoString

foo

All output records will be tagged using "foo", unless they have not been tagged during the execution of the step.

NameIDDescriptionTypeRequiredDefault
Default
First topictopic-ATopic of the records that contain items of type 'one for many'Stringyes
First topic extractorid-extractor-AExtracts object id from topic ASee Extractors sectionyes
Second topictopic-BTopic of the records that contain items of type 'one for many'Stringyes
Second topic extractorid-extractor-BExtracts object id from topic BSee Extractors sectionyes
CombinercombinerCombines all objectsSee Combiners section
FlatToMapCombiner
Advanced
TimeouttimeoutTime to keep mixable objects before discarding themDuration
1 day
CachecacheMultivalueCache to store partial objects before mix themMultivalueCache
Memory Cache

Multivalue Cache

The following compatible MultivalueCache implementations are provided with the DDC:

Memory Cache

In-memory implementation of MultivalueCache. A thread in background purges the expired values.

IDDescriptionTypeRequiredDefault
purge-intervalTime interval to execute the background task to purge valuesDuration
5min
key-separatorString used to separate the keyString
: