Overview

S3 Sink is a sink component aimed at persisting records to AWS S3 storage.

FQCN

com.datumize.ddc.component.file.sink.S3Sink

Properties


Common properties that apply to all sink components of a pipeline.

PROPERTYIDDESCRIPTION

REQUIRED

TYPE

DEFAULT

EXAMPLES

Common
IdentifierIDComponent unique Identifier within the pipeline, read only, only useful for advanced mode.YesStringAuto

MyComponent_23423

This Identifier is automatically generated by the system and you can't change it. Might be helpful for advanced pipeline configuration.

DescriptiondescriptionA short description for the component, to be visualized inside the component representation, aimed at providing additional information to understand the pipeline at a glance.NoString

Extract customer id and loyalty number.

Short and sweet description.

PROPERTYIDDESCRIPTIONREQUIREDTYPEDEFAULT
Default
Access keyaws-access-keyAWS access key.YesString
Secret keyaws-secret-keyAWS secret key.YesString
Buckettarget-bucketS3 bucket name.YesString
Regiontarget-regionAWS regionYesString
Advanced
Target pathtarget-pathS3 target path name (inside the bucket), Directory separation in S3 = '/'.NoString
File patternfile-patternFile name pattern for files to be uploaded. Content created in S3 will use this pattern to create files.NoString
TimeouttimeoutConnection timeout.NoDuration1m
Maximum retries

retries

Maximum number of retries to connect and on errors before failing.

No

Integer5
SerializerserializerSerializer to serialize the content.NoSee Serializers section.NoSerializer