Hbase
Hbase Source Connector
Descriptionâ
Reads data from Apache Hbase.
Key Featuresâ
Optionsâ
Name | Type | Required | Default |
---|---|---|---|
zookeeper_quorum | string | Yes | - |
table | string | Yes | - |
schema | config | Yes | - |
hbase_extra_config | string | No | - |
caching | int | No | -1 |
batch | int | No | -1 |
cache_blocks | boolean | No | false |
common-options | No | - |
zookeeper_quorum [string]â
The zookeeper quorum for Hbase cluster hosts, e.g., "hadoop001:2181,hadoop002:2181,hadoop003:2181".
table [string]â
The name of the table to write to, e.g., "seatunnel".
schema [config]â
Hbase stores data in byte arrays. Therefore, you need to configure the data types for each column in the table. For more information, see: guide.
hbase_extra_config [config]â
Additional configurations for Hbase.
cachingâ
The caching parameter sets the number of rows fetched per server trip during scans. This reduces round-trips between client and server, improving scan efficiency. Default: -1.
batchâ
The batch parameter sets the maximum number of columns returned per scan. This is useful for rows with many columns to avoid fetching excessive data at once, thus saving memory and improving performance.
cache_blocksâ
The cache_blocks parameter determines whether to cache data blocks during scans. By default, HBase caches data blocks during scans. Setting this to false reduces memory usage during scans. Default in SeaTunnel: false.
common-optionsâ
Common parameters for Source plugins, refer to Common Source Options.
Exampleâ
source {
Hbase {
zookeeper_quorum = "hadoop001:2181,hadoop002:2181,hadoop003:2181"
table = "seatunnel_test"
caching = 1000
batch = 100
cache_blocks = false
schema = {
columns = [
{
name = "rowkey"
type = string
},
{
name = "columnFamily1:column1"
type = boolean
},
{
name = "columnFamily1:column2"
type = double
},
{
name = "columnFamily2:column1"
type = bigint
}
]
}
}
}