Version: Next

Databend

Databend source connector

Supported Engines

Spark
Flink
SeaTunnel Zeta

Key Features

Description

A source connector for reading data from Databend.

Dependencies

For Spark/Flink

You need to download the Databend JDBC driver jar package and add it to the directory ${SEATUNNEL_HOME}/plugins/.

For SeaTunnel Zeta

You need to download the Databend JDBC driver jar package and add it to the directory ${SEATUNNEL_HOME}/lib/.

Supported Data Source Information

Data Source	Supported Version	Driver	URL	Maven
Databend	1.2.x and above	-	-	-

Data Type Mapping

Databend Data Type	SeaTunnel Data Type
BOOLEAN	BOOLEAN
TINYINT	TINYINT
SMALLINT	SMALLINT
INT	INT
BIGINT	BIGINT
FLOAT	FLOAT
DOUBLE	DOUBLE
DECIMAL	DECIMAL
STRING	STRING
VARCHAR	STRING
CHAR	STRING
TIMESTAMP	TIMESTAMP
DATE	DATE
TIME	TIME
BINARY	BYTES

Source Options

Basic Configuration:

Name	Type	Required	Default Value	Description
url	String	Yes	-	Databend JDBC connection URL. It must start with `jdbc:databend://`
username	String	Yes	-	Databend database username
password	String	Yes	-	Databend database password
database	String	No	-	Databend database name, defaults to the database name specified in the connection URL
table	String	No	-	Databend table name
query	String	No	-	Databend query statement. If set, it overrides database and table settings
sql	String	No	-	Alias-style custom SQL statement. If both `sql` and `query` are set, `sql` takes precedence
fetch_size	Integer	No	1	Number of records to fetch from Databend at once. Set it higher for large reads
ssl	Boolean	No	false	Whether to use SSL for the Databend connection
jdbc_config	Map	No	-	Additional JDBC connection configuration, such as load balancing strategies

You must configure either sql, query, or both database and table. When more than one of them is configured, the read SQL is chosen in this order: sql, then query, then SELECT * FROM database.table. The connector does not currently support table_list, so configure one Databend source block for each table.

Task Examples

Single Table Reading

env {
  parallelism = 2
  job.mode = "BATCH"
}

source {
  Databend {
    url = "jdbc:databend://localhost:8000"
    username = "root"
    password = ""
    database = "default"
    table = "users"
  }
}

sink {
  Console {}
}

Using Custom Query

source {
  Databend {
    url = "jdbc:databend://localhost:8000"
    username = "root"
    password = ""
    query = "SELECT id, name, age FROM default.users WHERE age > 18"
  }
}

Using SSL

source {
  Databend {
    url = "jdbc:databend://databend.example.com:8000/default"
    username = "root"
    password = ""
    sql = "SELECT * FROM default.users"
    ssl = true
    fetch_size = 1000
  }
}

Changelog

Change Log

Change	Commit	Version
[Feature][Connector-V2] Support databend source/sink connector (#9331)	https://github.com/apache/seatunnel/commit/2f96f2e46c	2.3.12

Databend

Supported Engines​

Key Features​

Description​

Dependencies​

For Spark/Flink​

For SeaTunnel Zeta​

Supported Data Source Information​

Data Type Mapping​

Source Options​

Task Examples​

Single Table Reading​

Using Custom Query​

Using SSL​

Related Links​

Changelog​