Rabbitmq
Rabbitmq source connector
Descriptionโ
Used to read data from Rabbitmq.
Key featuresโ
The source must be non-parallel (parallelism set to 1) in order to achieve exactly-once. This limitation is mainly due to RabbitMQโs approach to dispatching messages from a single queue to multiple consumers.
Optionsโ
name | type | required | default value |
---|---|---|---|
host | string | yes | - |
port | int | yes | - |
virtual_host | string | yes | - |
username | string | yes | - |
password | string | yes | - |
queue_name | string | yes | - |
schema | config | yes | - |
url | string | no | - |
routing_key | string | no | - |
exchange | string | no | - |
network_recovery_interval | int | no | - |
topology_recovery_enabled | boolean | no | - |
automatic_recovery_enabled | boolean | no | - |
connection_timeout | int | no | - |
requested_channel_max | int | no | - |
requested_frame_max | int | no | - |
requested_heartbeat | int | no | - |
prefetch_count | int | no | - |
delivery_timeout | long | no | - |
common-options | no | - |
host [string]โ
the default host to use for connections
port [int]โ
the default port to use for connections
virtual_host [string]โ
virtual host โ the virtual host to use when connecting to the broker
username [string]โ
the AMQP user name to use when connecting to the broker
password [string]โ
the password to use when connecting to the broker
url [string]โ
convenience method for setting the fields in an AMQP URI: host, port, username, password and virtual host
queue_name [string]โ
the queue to publish the message to
routing_key [string]โ
the routing key to publish the message to
exchange [string]โ
the exchange to publish the message to
schema [Config]โ
fields [Config]โ
the schema fields of upstream data.
network_recovery_interval [int]โ
how long will automatic recovery wait before attempting to reconnect, in ms
topology_recovery [string]โ
if true, enables topology recovery
automatic_recovery [string]โ
if true, enables connection recovery
connection_timeout [int]โ
connection tcp establishment timeout in milliseconds; zero for infinite
requested_channel_max [int]โ
initially requested maximum channel number; zero for unlimited **Note: Note the value must be between 0 and 65535 (unsigned short in AMQP 0-9-1).
requested_frame_max [int]โ
the requested maximum frame size
requested_heartbeat [int]โ
Set the requested heartbeat timeout **Note: Note the value must be between 0 and 65535 (unsigned short in AMQP 0-9-1).
prefetch_count [int]โ
prefetchCount the max number of messages to receive without acknowledgement
delivery_timeout [long]โ
deliveryTimeout maximum wait time, in milliseconds, for the next message delivery
common optionsโ
Source plugin common parameters, please refer to Source Common Options for details
Exampleโ
simple:
source {
RabbitMQ {
host = "rabbitmq-e2e"
port = 5672
virtual_host = "/"
username = "guest"
password = "guest"
queue_name = "test"
schema = {
fields {
id = bigint
c_map = "map<string, smallint>"
c_array = "array<tinyint>"
}
}
}
}
Changelogโ
2.3.0 2022-12-30โ
- Add Rabbitmq source Connector