Version: Next

Http

Http source connector

Support Those Engines

Spark
Flink
SeaTunnel Zeta

Key Features

Description

Used to read data from Http.

Key features

Supported DataSource Info

In order to use the Http connector, the following dependencies are required. They can be downloaded via install-plugin.sh or from the Maven central repository.

Datasource	Supported Versions	Dependency
Http	universal	Download

Source Options

Name	Type	Required	Default	Description
url	String	Yes	-	Http request url.
schema	Config	No	-	Http and seatunnel data structure mapping. For more details, please refer to Schema Feature.
schema.fields	Config	No	-	The schema fields of upstream data
json_field	Config	No	-	This parameter helps you configure the schema,so this parameter must be used with schema.
pageing	Config	No	-	This parameter is used for paging queries
pageing.page_field	String	No	-	This parameter is used to specify the page field name in the request. It can be used in headers, params, or body with placeholders like ${page_field}.
pageing.use_placeholder_replacement	Boolean	No	false	If true, use placeholder replacement (${field}) for headers, parameters and body values, otherwise use key-based replacement.
pageing.total_page_size	Int	No	-	This parameter is used to control the total number of pages
pageing.batch_size	Int	No	-	The batch size returned per request is used to determine whether to continue when the total number of pages is unknown
pageing.start_page_number	Int	No	1	Specify the page number from which synchronization starts
pageing.page_type	String	No	PageNumber	this parameter is used to specify the page type ,or PageNumber if not set, only support `PageNumber` and `Cursor`.
pageing.cursor_field	String	No	-	this parameter is used to specify the Cursor field name in the request parameter.
pageing.cursor_response_field	String	No	-	This parameter specifies the field in the response from which the cursor is retrieved.
content_field	String	No	-	This parameter can get some json data.If you only need the data in the 'book' section, configure `content_field = "$.store.book.*"`.
format	String	No	text	The format of upstream data, supports `json` `text` `binary`, default `text`. When set to `binary`, the response body is treated as raw bytes for downloading files (PDF, images, ZIP, etc.).
binary_chunk_size	Long	No	10485760	Chunk size in bytes when `format = binary`. Large files are split into multiple rows. Default 10MB. Only effective in BATCH mode.
method	String	No	get	Http request method, only supports GET, POST method.
headers	Map	No	-	Http headers.
params	Map	No	-	Http params.
body	String	No	-	Http body,the program will automatically add http header application/json,body is jsonbody.
poll_interval_millis	Int	No	-	Request http api interval(millis) in stream mode.
retry	Int	No	-	The max retry times if request http return to `IOException`.
retry_backoff_multiplier_ms	Int	No	100	The retry-backoff times(millis) multiplier if request http failed.
retry_backoff_max_ms	Int	No	10000	The maximum retry-backoff times(millis) if request http failed
enable_multi_lines	Boolean	No	false
connect_timeout_ms	Int	No	12000	Connection timeout setting, default 12s.
socket_timeout_ms	Int	No	60000	Socket timeout setting, default 60s.
common-options		No	-	Source plugin common parameters, please refer to Source Common Options for details
keep_params_as_form	Boolean	No	false	Whether the params are submitted according to the form, used for compatibility with legacy behaviors. When true, the value of the params parameter is submitted through the form.
keep_page_param_as_http_param	Boolean	No	false	Whether to set the paging parameters to params. For compatibility with legacy behaviors.
json_filed_missed_return_null	Boolean	No	false	When the json field is missing, set true return null else error.

How to Create a Http Data Synchronization Jobs

env {
  parallelism = 1
  job.mode = "BATCH"
}

source {
  Http {
    plugin_output = "http"
    url = "http://mockserver:1080/example/http"
    method = "GET"
    format = "json"
    schema = {
      fields {
        c_map = "map<string, string>"
        c_array = "array<int>"
        c_string = string
        c_boolean = boolean
        c_tinyint = tinyint
        c_smallint = smallint
        c_int = int
        c_bigint = bigint
        c_float = float
        c_double = double
        c_bytes = bytes
        c_date = date
        c_decimal = "decimal(38, 18)"
        c_timestamp = timestamp
        c_row = {
          C_MAP = "map<string, string>"
          C_ARRAY = "array<int>"
          C_STRING = string
          C_BOOLEAN = boolean
          C_TINYINT = tinyint
          C_SMALLINT = smallint
          C_INT = int
          C_BIGINT = bigint
          C_FLOAT = float
          C_DOUBLE = double
          C_BYTES = bytes
          C_DATE = date
          C_DECIMAL = "decimal(38, 18)"
          C_TIMESTAMP = timestamp
        }
      }
    }
  }
}

# Console printing of the read Http data
sink {
  Console {
    parallelism = 1
  }
}

Parameter Interpretation

format

when you assign format is json, you should also assign schema option, for example:

upstream data is the following:

{
  "code": 200,
  "data": "get success",
  "success": true
}

you should assign schema as the following:

schema {
  fields {
    code = int
    data = string
    success = boolean
  }
}

connector will generate data as the following:

code	data	success
200	get success	true

when you assign format is text, connector will do nothing for upstream data, for example:

upstream data is the following:

{
  "code": 200,
  "data": "get success",
  "success": true
}

connector will generate data as the following:

content
{"code": 200, "data": "get success", "success": true}

when you assign format is binary, the HTTP response body is treated as raw bytes for downloading files (PDF, images, ZIP, etc.). The output schema is fixed as (data: bytes, relativePath: string, partIndex: long). Large files are automatically split into multiple rows based on binary_chunk_size. Only supports BATCH mode and does not support pagination (pageing).

Example: Download a file via HTTP and write to LocalFileSink:

env {
  parallelism = 1
  job.mode = "BATCH"
}

source {
  Http {
    url = "http://example.com/files/report.pdf"
    method = "GET"
    format = "binary"
    binary_chunk_size = 10485760  # 10MB per chunk
    schema = {
      fields {
        data = bytes
        relativePath = string
        partIndex = long
      }
    }
  }
}

sink {
  LocalFile {
    path = "/tmp/download"
    file_format = "binary"
  }
}

keep_params_as_form

For compatibility with old versions of http. When set to true,<params> and <pageing> will be submitted in the form. When set to false，<params> will be added to the url path,and <pageing> will not be added to the body or form. It will replace placeholders in params and body.

keep_page_param_as_http_param

Whether to set the paging parameters to params. When set to true,<pageing> is set to <params>. When set to false,When the page field exists in <body> or <params>, replace value.

When set to false,config example:

body="""{"id":1,"page":"${page}"}"""

params={
 page: "${page}"
}

params

By default, the parameters will be added to the url path. If you need to keep the old version behavior, please check keep_params_as_form.

body

The HTTP body is used to carry the actual data in requests or responses, including JSON, form submissions.

The reference format is as follows：

body="{"id":1,"name":"seatunnel"}"

For form submissions,please set the content-type as follows.

headers {
    Content-Type = "application/x-www-form-urlencoded"
}

Pagination and final request shape

The easiest way to troubleshoot the Http source is to reason from the final outbound request:

For GET, params are always appended to the URL query string.
For POST with keep_params_as_form = false:
- params still go to the URL query string
- on the default non-form path, body is serialized as the JSON request body
- if body is not configured and the request stays on that default non-form path, the runtime sends an empty JSON object {} as the request body
- if you explicitly force Content-Type: application/x-www-form-urlencoded, the runtime follows the form-body branch instead of the default JSON branch
For POST with keep_params_as_form = true:
- params are merged into the form body
- if Content-Type is not set explicitly, SeaTunnel adds application/x-www-form-urlencoded
- if body and params contain the same key, the value from params overrides the value in body
keep_page_param_as_http_param = true writes the paging field directly into params
keep_page_param_as_http_param = false only updates existing keys or placeholders in headers, params, and body; it does not invent new paging fields automatically
pageing.use_placeholder_replacement = true supports ${page} and ${cursor} placeholders, and also prefixed/suffixed replacements such as "10${page}" -> "105"; when false, only key-based replacement is applied

Example 1: GET pagination with the page number in query parameters

source {
  Http {
    url = "https://api.example.com/orders"
    method = "GET"
    params = {
      page = "${page}"
      size = "100"
    }
    pageing = {
      page_field = "page"
      page_type = "PageNumber"
      start_page_number = 3
      use_placeholder_replacement = true
    }
  }
}

When the page advances to 3, the final request is:

GET https://api.example.com/orders?page=3&size=100

Example 2: POST JSON on the default non-form path, with URL query parameters and the paging field inside the body

source {
  Http {
    url = "https://api.example.com/orders/search"
    method = "POST"
    keep_params_as_form = false
    params = {
      tenant = "acme"
    }
    body = """{"page":"${page}","pageSize":100}"""
    pageing = {
      page_field = "page"
      page_type = "PageNumber"
      start_page_number = 3
      use_placeholder_replacement = true
    }
  }
}

When the page advances to 3, the final request is:

POST https://api.example.com/orders/search?tenant=acme
Content-Type: application/json
Body: {"page":"3","pageSize":100}

Example 3: POST form submission with paging fields merged into the form body

source {
  Http {
    url = "https://api.example.com/orders/search"
    method = "POST"
    keep_params_as_form = true
    keep_page_param_as_http_param = true
    params = {
      size = "100"
    }
    pageing = {
      page_field = "page"
      page_type = "PageNumber"
      start_page_number = 3
    }
  }
}

When the page advances to 3, the final request is:

POST https://api.example.com/orders/search
Content-Type: application/x-www-form-urlencoded
Body: size=100&page=3

content_field

This parameter can get some json data.If you only need the data in the 'book' section, configure content_field = "$.store.book.*".

If your return data looks something like this.

{
  "store": {
    "book": [
      {
        "category": "reference",
        "author": "Nigel Rees",
        "title": "Sayings of the Century",
        "price": 8.95
      },
      {
        "category": "fiction",
        "author": "Evelyn Waugh",
        "title": "Sword of Honour",
        "price": 12.99
      }
    ],
    "bicycle": {
      "color": "red",
      "price": 19.95
    }
  },
  "expensive": 10
}

You can configure content_field = "$.store.book.*" and the result returned looks like this:

[
  {
    "category": "reference",
    "author": "Nigel Rees",
    "title": "Sayings of the Century",
    "price": 8.95
  },
  {
    "category": "fiction",
    "author": "Evelyn Waugh",
    "title": "Sword of Honour",
    "price": 12.99
  }
]

Then you can get the desired result with a simpler schema,like

Http {
  url = "http://mockserver:1080/contentjson/mock"
  method = "GET"
  format = "json"
  content_field = "$.store.book.*"
  schema = {
    fields {
      category = string
      author = string
      title = string
      price = string
    }
  }
}

Here is an example:

Test data can be found at this link mockserver-config.json
See this link for task configuration http_contentjson_to_assert.conf.

json_field

This parameter helps you configure the schema,so this parameter must be used with schema.

If your data looks something like this:

{
  "store": {
    "book": [
      {
        "category": "reference",
        "author": "Nigel Rees",
        "title": "Sayings of the Century",
        "price": 8.95
      },
      {
        "category": "fiction",
        "author": "Evelyn Waugh",
        "title": "Sword of Honour",
        "price": 12.99
      }
    ],
    "bicycle": {
      "color": "red",
      "price": 19.95
    }
  },
  "expensive": 10
}

You can get the contents of 'book' by configuring the task as follows:

source {
  Http {
    url = "http://mockserver:1080/jsonpath/mock"
    method = "GET"
    format = "json"
    json_field = {
      category = "$.store.book[*].category"
      author = "$.store.book[*].author"
      title = "$.store.book[*].title"
      price = "$.store.book[*].price"
    }
    schema = {
      fields {
        category = string
        author = string
        title = string
        price = string
      }
    }
  }
}

Test data can be found at this link mockserver-config.json
See this link for task configuration http_jsonpath_to_assert.conf.

pageing

The current supported pagination type are PageNumber and Cursor. if you need to use pagination, you need to configure pageing. the default pagination type is PageNumber.

1. PageNumber

When using PageNumber pagination, you can include page parameters in different parts of your HTTP request:

In URL parameters: Add the page parameter to the params section
In request body: Include the page parameter in the body JSON
In headers: Add the page parameter to the headers section

You can use placeholders like ${page} with use_placeholder_replacement = true to dynamically update these values. The placeholders can be used in various formats:

As a standalone value: "${page}"
With prefix/suffix: "10${page}" or "page-${page}"
As a number without quotes: ${page} (in JSON body)
In nested JSON structures: {"pagination":{"page":${page}}}

Example 1: Using page parameters in body and params

source {
    Http {
      url = "http://localhost:8080/mock/queryData"
      method = "POST"
      format = "json"
      body="""{"id":1,"page":"${page}"}"""
      content_field = "$.data.*"
      params={
       page: "${page}"
      }
      pageing={
       #you can not set this parameter ,the default value is PageNumber
       page_type="PageNumber"
       total_page_size=20
       page_field=page
       use_placeholder_replacement=true
       #when don't know the total_page_size use batch_size if read size<batch_size finish ,otherwise continue
       #batch_size=10
      }
      schema = {
        fields {
          name = string
          age = string
        }
      }
    }
}

Example 2: Using page parameters in headers

source {
    Http {
      url = "http://localhost:8080/mock/queryData"
      method = "GET"
      format = "json"
      headers={
        Page-Number = "${pageNo}"
        Authorization = "Bearer token-123"
      }
      pageing={
        page_field = pageNo
        start_page_number = 1
        batch_size = 10
        use_placeholder_replacement = true
      }
      schema = {
        fields {
          name = string
          age = string
        }
      }
    }
}

Example 3: Using key-based replacement (without placeholders)

source {
    Http {
      url = "http://localhost:8080/mock/queryData"
      method = "GET"
      format = "json"
      params={
        page = "1"
      }
      pageing={
        page_field = page
        start_page_number = 1
        batch_size = 10
        use_placeholder_replacement = false
      }
      schema = {
        fields {
          name = string
          age = string
        }
      }
    }
}

Example 4: Using prefixed page number in headers

source {
    Http {
      url = "http://localhost:8080/mock/queryData"
      method = "GET"
      format = "json"
      headers = {
        Page-Number = "10${page}"  # Will become "105" when page=5
        Authorization = "Bearer token-123"
      }
      pageing = {
        page_field = page
        start_page_number = 5
        batch_size = 10
        use_placeholder_replacement = true
      }
      schema = {
        fields {
          name = string
          age = string
        }
      }
    }
}

Example 5: Using unquoted page number in body

source {
    Http {
      url = "http://localhost:8080/mock/queryData"
      method = "POST"
      format = "json"
      body = """{"a":${page},"limit":10}"""  # Unquoted number
      pageing = {
        page_field = page
        start_page_number = 1
        batch_size = 10
        use_placeholder_replacement = true
      }
      schema = {
        fields {
          name = string
          age = string
        }
      }
    }
}

Example 6: Using nested JSON structure with page parameter

source {
    Http {
      url = "http://localhost:8080/mock/queryData"
      method = "POST"
      format = "json"
      body = """{"pagination":{"page":${page},"size":10},"filters":{"active":true}}"""  # Nested structure
      pageing = {
        page_field = page
        start_page_number = 1
        total_page_size = 20
        use_placeholder_replacement = true
      }
      schema = {
        fields {
          name = string
          age = string
        }
      }
    }
}

2. Cursor

the pageing.page_type parameter must be set to Cursor. cursor_field is the field name of the cursor in the request parameters. cursor_response_field is the field name denotes the name of the pagination token field in the response data, we should add this to add pageing fields into request.

source {
    Http {
      plugin_output = "http"
      url = "http://localhost:8080/mock/cursor_data"
      method = "GET"
      format = "json"
      content_field = "$.data.*"
      keep_page_param_as_http_param = true
      pageing ={
        page_type="Cursor"
        cursor_field ="cursor"
        cursor_response_field="$.paging.cursors.next"
      }
    schema = {
      fields {
        content=string
        id=int
        name=string
      }
    }
   json_field = {
    content = "$.data[*].content"
    id = "$.data[*].id"
    name = "$.data[*].name"
   }
  }
}

Changelog

Change Log

Change	Commit	Version
[Fix][Connectors-v2] Fix UT for connector-http (#9821)	https://github.com/apache/seatunnel/commit/2653f6798e	dev
[Fix][connector-http] fix parsing httpjson, the number of two fields is inconsistent with the import failure (#9103)	https://github.com/apache/seatunnel/commit/c8ade098ee	2.3.12
[Fix][Connector-HTTP] Add default content-type when user not set (#9497)	https://github.com/apache/seatunnel/commit/8da0a78c1d	2.3.12
[Bug][connector-http] Fix paging request running infinitely (#9504)	https://github.com/apache/seatunnel/commit/1844e04c97	2.3.12
[Bug][seatunnel-connector-http-base] An NPE (NullPointerException) will occur when the pageField is null (#9498)	https://github.com/apache/seatunnel/commit/b898a3225c	2.3.12
[Fix][Connector-Http] fix Invalid mime type (#9363)	https://github.com/apache/seatunnel/commit/4d7d765a26	2.3.12
[Feature][http-Sink] Implementing http batch writes (#9292)	https://github.com/apache/seatunnel/commit/04ee8aca04	2.3.11
[Feature][connector-http] Parameters support placeholder replacement (#9184)	https://github.com/apache/seatunnel/commit/8617014edc	2.3.11
[Improve][Connector-V2][Http] Supports Cursor-based Pagination (#9109) (#9138)	https://github.com/apache/seatunnel/commit/879b1e2d5b	2.3.11
[improve] http connector options (#8969)	https://github.com/apache/seatunnel/commit/63ff9f910a	2.3.10
[Fix][connector-http] fix when post have param (#8434)	https://github.com/apache/seatunnel/commit/c1b2675ab0	2.3.10
[Improve] restruct connector common options (#8634)	https://github.com/apache/seatunnel/commit/f3499a6eeb	2.3.10
[Improve][dist]add shade check rule (#8136)	https://github.com/apache/seatunnel/commit/51ef800016	2.3.9
[Feature][Connector-V2] Add prometheus source and sink (#7265)	https://github.com/apache/seatunnel/commit/dde6f9fcbd	2.3.9
[Feature][Restapi] Allow metrics information to be associated to logical plan nodes (#7786)	https://github.com/apache/seatunnel/commit/6b7c53d03c	2.3.9
[Fix][Connector-V2] Fix http source can not read streaming (#7703)	https://github.com/apache/seatunnel/commit/a0ffa7ba02	2.3.8
[Feature][Connector-V2] Suport choose the start page in http paging (#7180)	https://github.com/apache/seatunnel/commit/ed15f0dcf9	2.3.8
[Improve][Connector] Add multi-table sink option check (#7360)	https://github.com/apache/seatunnel/commit/2489f6446b	2.3.7
[Improve][API] Make sure the table name in TablePath not be null (#7252)	https://github.com/apache/seatunnel/commit/764d8b0bc8	2.3.7
[Feature][Core] Support using upstream table placeholders in sink options and auto replacement (#7131)	https://github.com/apache/seatunnel/commit/c4ca74122c	2.3.6
[Feature][Kafka] Support multi-table source read (#5992)	https://github.com/apache/seatunnel/commit/60104602d1	2.3.6
[Improve][CDC] Close idle subtasks gorup(reader/writer) in increment phase (#6526)	https://github.com/apache/seatunnel/commit/454c339b9c	2.3.6
Fix HttpSource bug (#6824)	https://github.com/apache/seatunnel/commit/c3ab84caa4	2.3.6
[Hotfix] fix http source can not read yyyy-MM-dd HH:mm:ss format bug & Improve DateTime Utils (#6601)	https://github.com/apache/seatunnel/commit/19888e7969	2.3.5
[Improve][Connector-V2]Support multi-table sink feature for httpsink (#6316)	https://github.com/apache/seatunnel/commit/e6c51a95c7	2.3.5
[Improve][HttpConnector]Increase custom configuration timeout. (#6223)	https://github.com/apache/seatunnel/commit/fa5b7d3d83	2.3.4
[Feature][Core] Upgrade flink source translation (#5100)	https://github.com/apache/seatunnel/commit/5aabb14a94	2.3.4
[BUG][Connector-V2][Http] fix bug http config no schema option and improve e2e test add case (#5939)	https://github.com/apache/seatunnel/commit/8a71b9e072	2.3.4
[Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on redis (#5901)	https://github.com/apache/seatunnel/commit/e84dcb8c10	2.3.4
[Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on http (#5816)	https://github.com/apache/seatunnel/commit/6f49ec6ead	2.3.4
[Improve][Common] Introduce new error define rule (#5793)	https://github.com/apache/seatunnel/commit/9d1b2582b2	2.3.4
[Feature][Transform] add JsonPath transform (#5632)	https://github.com/apache/seatunnel/commit/d908f0af40	2.3.4
[Improve] Remove use `SeaTunnelSink::getConsumedType` method and mark it as deprecated (#5755)	https://github.com/apache/seatunnel/commit/8de7408100	2.3.4
[Feature][Connector-V2] HTTP supports page increase #5477 (#5561)	https://github.com/apache/seatunnel/commit/bb180b2988	2.3.4
[improve][Connector-V2][http] improve http e2e test (#5655)	https://github.com/apache/seatunnel/commit/f5867adcaa	2.3.4
Support config column/primaryKey/constraintKey in schema (#5564)	https://github.com/apache/seatunnel/commit/eac76b4e50	2.3.4
[BUG][Connector-V2][http] fix httpheader cover (#5446)	https://github.com/apache/seatunnel/commit/cdd8e0a65e	2.3.4
[Feature][Connector][Http] Support multi-line text splits (#4698)	https://github.com/apache/seatunnel/commit/6a524981cb	2.3.2
Merge branch 'dev' into merge/cdc	https://github.com/apache/seatunnel/commit/4324ee1912	2.3.1
[Improve][Project] Code format with spotless plugin.	https://github.com/apache/seatunnel/commit/423b583038	2.3.1
[Feature][Connector-V2][Github] Adding Github Source Connector (#4155)	https://github.com/apache/seatunnel/commit/49d9172b10	2.3.1
[improve][api] Refactoring schema parse (#4157)	https://github.com/apache/seatunnel/commit/b2f573a13e	2.3.1
[Improve][build] Give the maven module a human readable name (#4114)	https://github.com/apache/seatunnel/commit/d7cd601051	2.3.1
[Improve][Project] Code format with spotless plugin. (#4101)	https://github.com/apache/seatunnel/commit/a2ab166561	2.3.1
[Feature][Connector-V2][Persistiq]Add Persistiq source connector (#3460)	https://github.com/apache/seatunnel/commit/aec3912edf	2.3.1
[Feature][Connector] add get source method to all source connector (#3846)	https://github.com/apache/seatunnel/commit/417178fb84	2.3.1
[Feature][Connector-V2][Notion] Add Notion source connector (#3470)	https://github.com/apache/seatunnel/commit/46abc6d943	2.3.0
[Hotfix][seatunnel-connectors-v2] [connector-http] fix http json request error (#3629)	https://github.com/apache/seatunnel/commit/54f594d6ca	2.3.0
[Improve][Connector-V2][Http]Improve json parse option rule for all http connector (#3627)	https://github.com/apache/seatunnel/commit/589e4161ec	2.3.0
[Improve][Connector-V2][OneSignal]Unified exception for OneSignal connector (#3609)	https://github.com/apache/seatunnel/commit/97cce8c255	2.3.0
[Feature][Connector-V2][HTTP] Use json-path parsing (#3510)	https://github.com/apache/seatunnel/commit/1807eb6c95	2.3.0
[Improve][Connector-V2][Http]Unified exception for http source & sink… (#3594)	https://github.com/apache/seatunnel/commit/d798cd8670	2.3.0
[Hotfix][OptionRule] Fix option rule about all connectors (#3592)	https://github.com/apache/seatunnel/commit/226dc6a119	2.3.0
[Improve][Connector-V2][MyHours]Unified exception for MyHours connector (#3538)	https://github.com/apache/seatunnel/commit/48ab7c97d5	2.3.0
[Improve][Connector-V2][Gitlab] Unified excetion for Gitlab connector and improve optione rule (#3533)	https://github.com/apache/seatunnel/commit/77f68f1eef	2.3.0
[Improve][Connector-V2][Klaviyo]Unified exception for Klaviyo connector (#3555)	https://github.com/apache/seatunnel/commit/08f8615078	2.3.0
[Feature][Connector-V2][Jira]Add Jira source connector (#3473)	https://github.com/apache/seatunnel/commit/fb40162c07	2.3.0
[Improve][Connector-V2][Lemlist] Unified exception for lemlist connector (#3534)	https://github.com/apache/seatunnel/commit/705728ebbb	2.3.0
[Feature][Connector V2] add gitlab source connector (#3408)	https://github.com/apache/seatunnel/commit/545595c6d2	2.3.0
[Feature][Connector-V2][OneSignal]Add OneSignal source conector (#3454)	https://github.com/apache/seatunnel/commit/b318b3166f	2.3.0
[Feature][Connector-V2][Klaviyo]Add Klaviyo source connector (#3443)	https://github.com/apache/seatunnel/commit/fc00a2866b	2.3.0
[Feature][Connector-V2][Lemlist]Add Lemlist source connector (#3346)	https://github.com/apache/seatunnel/commit/12d66b4247	2.3.0
[HotFix][Core][API] Fix OptionValidation error code (#3439)	https://github.com/apache/seatunnel/commit/ace219f376	2.3.0
[Improve][Connector-V2][My Hours]Add http method enum && Improve My Hours connector option rule (#3390)	https://github.com/apache/seatunnel/commit/a86c9d90f7	2.3.0
[Feature][Connector-V2][Http] Add option rules && Improve Myhours sink connector (#3351)	https://github.com/apache/seatunnel/commit/cc8bb60c83	2.3.0
[Feature][Connector-V2][My Hours] Add My Hours Source Connector (#3228)	https://github.com/apache/seatunnel/commit/4104a3e30e	2.3.0
[Improve][all] change Log to @Slf4j (#3001)	https://github.com/apache/seatunnel/commit/6016100f12	2.3.0-beta
[Bug][format][json] Fix jackson package conflict with spark (#2934)	https://github.com/apache/seatunnel/commit/1a92b8369b	2.3.0-beta
[Bug][Connector-V2] Fix wechat sink data serialization (#2856)	https://github.com/apache/seatunnel/commit/3aee11fc16	2.3.0-beta
[Improve][Connector-V2] Improve http connector (#2833)	https://github.com/apache/seatunnel/commit/5b3957bc52	2.2.0-beta
[DEV][Api] Replace SeaTunnelContext with JobContext and remove singleton pattern (#2706)	https://github.com/apache/seatunnel/commit/cbf82f755c	2.2.0-beta
[Improve][build] Improved scope of maven-shade-plugin (#2665)	https://github.com/apache/seatunnel/commit/93bc8bd116	2.2.0-beta
[#2606]Dependency management split (#2630)	https://github.com/apache/seatunnel/commit/fc047be69b	2.2.0-beta
[chore][connector-common] Rename SeatunnelSchema to SeaTunnelSchema (#2538)	https://github.com/apache/seatunnel/commit/7dc2a27388	2.2.0-beta
[Bug][Connector-V2] Fix the bug that set params by mistake (#2511) (#2513)	https://github.com/apache/seatunnel/commit/ead3d68b0e	2.2.0-beta
[Improve][Connector-V2] Http source support user-defined schema (#2439)	https://github.com/apache/seatunnel/commit/793933b6b8	2.2.0-beta
[Feature][Connector-V2] Add Enterprise Wechat sink connector (#2412)	https://github.com/apache/seatunnel/commit/3e200e0a38	2.2.0-beta
[Improve][Connector-V2] Format SeaTunnelRow use seatunnel-format-json (#2435)	https://github.com/apache/seatunnel/commit/e4e8f7fbff	2.2.0-beta
[Improve][Connector-V2] Make the attribute of http-connector from private to protected (#2418)	https://github.com/apache/seatunnel/commit/f3b00ef696	2.2.0-beta
[Feature][Connector-V2] Add feishu sink (#2381)	https://github.com/apache/seatunnel/commit/0fec8ca438	2.2.0-beta
[Feature][Connector-V2] Add http sink(Webhook) (#2348)	https://github.com/apache/seatunnel/commit/4b7207490a	2.2.0-beta
[Improve][Http Connector-V2-Source] Refactor the code and make code more clearly (#2322)	https://github.com/apache/seatunnel/commit/a9a797ad85	2.2.0-beta
[Improve][Connector-V2] Fix the log information (#2317)	https://github.com/apache/seatunnel/commit/736983a708	2.2.0-beta
[Improve][Connector-V2] Http client provider improve (#2312)	https://github.com/apache/seatunnel/commit/cc950007c8	2.2.0-beta
[Improve][Connector-V2] Fix 'Singleton' word error (#2309)	https://github.com/apache/seatunnel/commit/12ebcb4a0d	2.2.0-beta
[api-draft][Optimize] Optimize module name (#2062)	https://github.com/apache/seatunnel/commit/f79e3112b1	2.2.0-beta

Http

Support Those Engines​

Key Features​

Description​

Key features​

Supported DataSource Info​

Source Options​

How to Create a Http Data Synchronization Jobs​

Parameter Interpretation​

format​

keep_params_as_form​

keep_page_param_as_http_param​

params​

body​

Pagination and final request shape​

content_field​

json_field​

pageing​

1. PageNumber​

Example 1: Using page parameters in body and params​

Example 2: Using page parameters in headers​

Example 3: Using key-based replacement (without placeholders)​

Example 4: Using prefixed page number in headers​

Example 5: Using unquoted page number in body​

Example 6: Using nested JSON structure with page parameter​

2. Cursor​

Changelog​

Support Those Engines

Key Features

Description

Key features

Supported DataSource Info

Source Options

How to Create a Http Data Synchronization Jobs

Parameter Interpretation

format

keep_params_as_form

keep_page_param_as_http_param

params

body

Pagination and final request shape

content_field

json_field

pageing

1. PageNumber

Example 1: Using page parameters in body and params

Example 2: Using page parameters in headers

Example 3: Using key-based replacement (without placeholders)

Example 4: Using prefixed page number in headers

Example 5: Using unquoted page number in body

Example 6: Using nested JSON structure with page parameter

2. Cursor

Changelog