Common Options
Common parameters of sink connectors
name | type | required | default value |
---|---|---|---|
source_table_name | string | no | - |
parallelism | int | no | - |
source_table_name [string]â
When source_table_name
is not specified, the current plug-in processes the data set dataset
output by the previous plugin in the configuration file;
When source_table_name
is specified, the current plug-in is processing the data set corresponding to this parameter.
parallelism [int]â
When parallelism
is not specified, the parallelism
in env is used by default.
When parallelism is specified, it will override the parallelism in env.
Examplesâ
source {
FakeSourceStream {
parallelism = 2
result_table_name = "fake"
field_name = "name,age"
}
}
transform {
sql {
source_table_name = "fake"
sql = "select name from fake"
result_table_name = "fake_name"
}
sql {
source_table_name = "fake"
sql = "select age from fake"
result_table_name = "fake_age"
}
}
sink {
console {
parallelism = 3
source_table_name = "fake_name"
}
}
If
source_table_name
is not specified, the console outputs the data of the last transform, and if it is set tofake_name
, it will output the data offake_name