⭐️
Tablestore
Tablestore source connector
Description
Read data from Alicloud Tablestore，support full and CDC.
Key features
Options
| name | type | required | default value |
|---|---|---|---|
| end_point | string | yes | - |
| instance_name | string | yes | - |
| access_key_id | string | yes | - |
| access_key_secret | string | yes | - |
| table | string | yes | - |
| primary_keys | array | yes | - |
| schema | config | yes | - |
end_point [string]
The endpoint of Tablestore.
instance_name [string]
The intance name of Tablestore.
access_key_id [string]
The access id of Tablestore.
access_key_secret [string]
The access secret of Tablestore.
table [string]
The table name of Tablestore.
primary_keys [array]
The primarky key of table,just add a unique primary key.
schema [Config]
Example
env {
parallelism = 1
job.mode = "STREAMING"
}
source {
# This is a example source plugin **only for test and demonstrate the feature source plugin**
Tablestore {
end_point = "https://****.cn-zhangjiakou.tablestore.aliyuncs.com"
instance_name = "****"
access_key_id="***************2Ag5"
access_key_secret="***********2Dok"
table="test"
primary_keys=["id"]
schema={
fields {
id = string
name = string
}
}
}
}
sink {
MongoDB{
uri = "mongodb://localhost:27017"
database = "test"
collection = "test"
primary-key = ["id"]
schema = {
fields {
id = string
name = string
}
}
}
}
Changelog
Change Log
| Change | Commit | Version |
|---|---|---|
| [Improve] restruct connector common options (#8634) | https://github.com/apache/seatunnel/commit/f3499a6eeb | dev |
| [Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786) | https://github.com/apache/seatunnel/commit/6b7c53d03c | 2.3.9 |
| [Feature][Connector-V2][Tablestore] Support Source connector for Tablestore #7448 (#7467) | https://github.com/apache/seatunnel/commit/a7ca51b585 | 2.3.8 |
| [Improve][Common] Introduce new error define rule (#5793) | https://github.com/apache/seatunnel/commit/9d1b2582b2 | 2.3.4 |
[Improve] Remove use SeaTunnelSink::getConsumedType method and mark it as deprecated (#5755) | https://github.com/apache/seatunnel/commit/8de7408100 | 2.3.4 |
| Support config column/primaryKey/constraintKey in schema (#5564) | https://github.com/apache/seatunnel/commit/eac76b4e50 | 2.3.4 |
| [Improve][Connector-V2] Remove scheduler in Tablestore sink (#5272) | https://github.com/apache/seatunnel/commit/8d6b07e466 | 2.3.3 |
| Merge branch 'dev' into merge/cdc | https://github.com/apache/seatunnel/commit/4324ee1912 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. | https://github.com/apache/seatunnel/commit/423b583038 | 2.3.1 |
| [improve][api] Refactoring schema parse (#4157) | https://github.com/apache/seatunnel/commit/b2f573a13e | 2.3.1 |
| [Improve][build] Give the maven module a human readable name (#4114) | https://github.com/apache/seatunnel/commit/d7cd601051 | 2.3.1 |
| [Improve][Project] Code format with spotless plugin. (#4101) | https://github.com/apache/seatunnel/commit/a2ab166561 | 2.3.1 |
| [Hotfix][OptionRule] Fix option rule about all connectors (#3592) | https://github.com/apache/seatunnel/commit/226dc6a119 | 2.3.0 |
| [Improve][Connector-V2][TableStore] Unified excetion for TableStore sink connector (#3527) | https://github.com/apache/seatunnel/commit/7b264d7004 | 2.3.0 |
| [Feature][connector-v2] add tablestore source and sink (#3309) | https://github.com/apache/seatunnel/commit/ebebf0b633 | 2.3.0 |