Skip to main content
Version: 3.0.0

About Edge Agent

Edge Agent is the operational surface for SeaTunnel Edge Agent — a lightweight collector on edge hosts where source data is only reachable locally (log files, host-local paths, and similar). The agent buffers outbound records in WAL and forwards batches to a running SeaTunnel job through the EdgeSocket line protocol.

Edge Agent is not a replacement for SeaTunnel Engine. Typical topology:

  Edge host                         SeaTunnel Engine cluster
+------------------+ +---------------------------+
| Edge Agent | EdgeSocket | Job with EdgeSocket Source|
| (this module) | -----------> | (ingest + pipeline) |
+------------------+ +---------------------------+

When to use Edge Agent​

  • Sources exist only on edge machines (for example /var/log, application log directories).
  • You want a small, long-lived daemon with local durability before network send.
  • The downstream pipeline uses EdgeSocket Source on the engine side.

When not to use Edge Agent​

  • Sources are reachable directly from the engine cluster (use connector sources on the engine instead).
  • You need full SeaTunnel transform/sink orchestration on the edge host (deploy engine workers or another runtime there).

Glossary​

TermDefinition
WALThe local outbound queue durability mechanism in Edge Agent, used to persist and retry records until the engine returns RECEIVED for a batch.
BEST_EFFORTDelivery behavior in this release: persist to local WAL and retry until RECEIVED; duplicate delivery can occur.
WAL row statesPENDING (ready), SENDING (in-flight), ACKED (engine returned RECEIVED for the batch), DEAD (retry limit exceeded).
Engine response codesACK confirms authentication only. RECEIVED confirms batch ingest and moves a SENDING WAL row to ACKED. Other responses are AUTH_FAILED, REJECTED, RETRY, QUEUE_FULL, and DECRYPT_FAILED.
PhaseDocumentDescription
Try it outQuick StartLocal test → connect to Engine
InstallDownload / Deployment GuidePackage download and production setup
ConfigureInput Configuration / Output ConfigurationScenario-based YAML examples
ReferenceConfiguration ReferenceFull agent.yaml parameter tables
Deep diveArchitecture OverviewDesign, reliability and Engine boundary
Engine sideEdgeSocket SourceEngine-side receive protocol
OperateOperationsStart/stop, logs, troubleshooting