Skip to main content
Version: 2.3.10

DataHub

DataHub sink connector

Description

A sink plugin which use send message to DataHub

Key features

Options

nametyperequireddefault value
endpointstringyes-
accessIdstringyes-
accessKeystringyes-
projectstringyes-
topicstringyes-
timeoutintyes-
retryTimesintyes-
common-optionsno-

endpoint [string]

your DataHub endpoint start with http (string)

accessId [string]

your DataHub accessId which cloud be access from Alibaba Cloud (string)

accessKey[string]

your DataHub accessKey which cloud be access from Alibaba Cloud (string)

project [string]

your DataHub project which is created in Alibaba Cloud (string)

topic [string]

your DataHub topic (string)

timeout [int]

the max connection timeout (int)

retryTimes [int]

the max retry times when your client put record failed (int)

common options

Sink plugin common parameters, please refer to Sink Common Options for details

Example

sink {
DataHub {
endpoint="yourendpoint"
accessId="xxx"
accessKey="xxx"
project="projectname"
topic="topicname"
timeout=3000
retryTimes=3
}
}

Changelog

Change Log
ChangeCommitVersion
[improve] datahub sink options (#8744)https://github.com/apache/seatunnel/commit/88f35bd702.3.10
[Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786)https://github.com/apache/seatunnel/commit/6b7c53d032.3.9
[Improve] Remove use SeaTunnelSink::getConsumedType method and mark it as deprecated (#5755)https://github.com/apache/seatunnel/commit/8de7408102.3.4
[Improve][build] Give the maven module a human readable name (#4114)https://github.com/apache/seatunnel/commit/d7cd601052.3.1
[Improve][Project] Code format with spotless plugin. (#4101)https://github.com/apache/seatunnel/commit/a2ab166562.3.1
[Hotfix][OptionRule] Fix option rule about all connectors (#3592)https://github.com/apache/seatunnel/commit/226dc6a112.3.0
[Improve][Connector-V2][DataHub] Unified exception for DataHub sink connector & change package name of DataHub (#3446)https://github.com/apache/seatunnel/commit/395635fa12.3.0
[improve][connector] The Factory#factoryIdentifier must be consistent with PluginIdentifierInterface#getPluginName (#3328)https://github.com/apache/seatunnel/commit/d9519d6962.3.0
[Improve][Connector-V2][DataHub] Add DataHub Sink Factory (#3323)https://github.com/apache/seatunnel/commit/685978d062.3.0
[#2606]Dependency management split (#2630)https://github.com/apache/seatunnel/commit/fc047be692.2.0-beta
[Feature][Connector-V2]Support datahub sink (#2558)https://github.com/apache/seatunnel/commit/43600a7042.2.0-beta