Skip to main content
Version: 2.3.8

Maxcompute

Maxcompute source connector

Description​

Used to read data from Maxcompute.

Key features​

Options​

nametyperequireddefault value
accessIdstringyes-
accesskeystringyes-
endpointstringyes-
projectstringyes-
table_namestringyes-
partition_specstringno-
split_rowintno10000
common-optionsstringno
schemaconfigno

accessId [string]​

accessId Your Maxcompute accessId which cloud be access from Alibaba Cloud.

accesskey [string]​

accesskey Your Maxcompute accessKey which cloud be access from Alibaba Cloud.

endpoint [string]​

endpoint Your Maxcompute endpoint start with http.

project [string]​

project Your Maxcompute project which is created in Alibaba Cloud.

table_name [string]​

table_name Target Maxcompute table name eg: fake.

partition_spec [string]​

partition_spec This spec of Maxcompute partition table eg:ds='20220101'.

split_row [int]​

split_row Number of rows per split, default: 10000.

common options​

Source plugin common parameters, please refer to Source Common Options for details.

schema [config]​

fields [Config]​

The schema information of upstream data.

Examples​

source {
Maxcompute {
accessId="<your access id>"
accesskey="<your access Key>"
endpoint="<http://service.odps.aliyun.com/api>"
project="<your project>"
table_name="<your table name>"
#partition_spec="<your partition spec>"
#split_row = 10000
schema {
fields {
name = string
age = int
gender = string
}
}
}
}

Changelog​

next version​

  • [Feature] Add Maxcompute Source Connector(3640)
  • [Feature] Support Schema in MaxCompute Source(3640)