Iceberg
Description
Read data from Iceberg.
提示
Engine Supported and plugin name
- Spark: Iceberg
- Flink
Options
| name | type | required | default value |
|---|---|---|---|
| common-options | yes | - | |
| path | string | yes | - |
| pre_sql | string | yes | - |
| snapshot-id | long | no | - |
| as-of-timestamp | long | no | - |
Refer to iceberg read options for more configurations.
common-options
Source plugin common parameters, please refer to Source Plugin for details
path
Iceberg table location.
pre_sql
SQL statements queried from iceberg table. Note that the table name is result_table_name configuration
snapshot-id
Snapshot ID of the table snapshot to read
as-of-timestamp
A timestamp in milliseconds; the snapshot used will be the snapshot current at this time.
Example
iceberg {
path = "hdfs://localhost:9000/iceberg/warehouse/db/table"
result_table_name = "my_source"
pre_sql="select * from my_source where dt = '2019-01-01'"
}