Skip to content

Support stopping connectors and reading their offsets - #2881

Open
delthas wants to merge 1 commit into
improvement/BB-906/exclusive-connector-updatesfrom
improvement/BB-906/kafka-connect-pause-offsets
Open

delthas wants to merge 1 commit into
improvement/BB-906/exclusive-connector-updatesfrom
improvement/BB-906/kafka-connect-pause-offsets

Conversation

@delthas

@delthas delthas commented Oct 14, 2026 •

Copy link
Copy Markdown
Contributor

Stop and offsets (Kafka Connect >= 3.5; stopped tasks commit their final offsets), a single listing with config and status, and HTTP status on errors.

Part of the hashed oplog ingestion stack, overview in #2869.

Issue: BB-906

@delthas
delthas added this pull request to stack #2885 October 14, 2026 08:48
Comment thread lib/wrappers/KafkaConnectWrapper.js Outdated
Comment thread lib/wrappers/KafkaConnectWrapper.js Outdated
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch from 202b053 to 95de025 Compare October 14, 2026 09:02
@delthas
delthas removed this pull request from stack #2885 October 14, 2026 10:06
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch from 95de025 to 0cac1af Compare October 14, 2026 10:07
@delthas
delthas added this pull request to stack #2886 October 14, 2026 10:07
Comment thread lib/wrappers/KafkaConnectWrapper.js Outdated
Comment thread lib/wrappers/KafkaConnectWrapper.js Outdated
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch 2 times, most recently from bc56193 to de06110 Compare October 14, 2026 12:49
Comment thread lib/wrappers/KafkaConnectWrapper.js Outdated
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch from de06110 to e94817c Compare October 14, 2026 12:58
Comment thread lib/wrappers/KafkaConnectWrapper.js Outdated
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch from e94817c to 2d6eea4 Compare October 14, 2026 13:04
Comment thread lib/wrappers/KafkaConnectWrapper.js

@SylvainSenechal SylvainSenechal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not blocking: Updating the file to ts, and typing only the new apis could help ?

Comment thread lib/wrappers/KafkaConnectWrapper.js Outdated
Comment thread lib/wrappers/KafkaConnectWrapper.js
Comment thread lib/wrappers/KafkaConnectWrapper.js
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch 2 times, most recently from 4650933 to e28af41 Compare October 16, 2026 10:47
@delthas delthas changed the title Support pausing connectors and reading their offsets Support stopping connectors and reading their offsets Oct 16, 2026
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch from e28af41 to 7588a0e Compare October 20, 2026 14:14
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch from 7588a0e to 6f2b397 Compare October 20, 2026 14:44
@delthas
delthas removed this pull request from stack #2886 October 20, 2026 14:45
@delthas
delthas added this pull request to stack #2895 October 20, 2026 14:45
- stopConnector and getConnectorOffsets (Kafka Connect >= 3.5,
  KIP-875): stopped tasks commit their final offsets.
- getConnectorsWithStatus lists every connector with its configuration
  and status in a single request. Kafka Connect leaves out the
  connectors whose status lookup fails.
- Request errors carry the HTTP status, so callers can tell a missing
  connector (404) or an existing one (409) from other failures.
- Empty response bodies resolve to an empty object instead of failing
  to parse: stop answers with no body.

Issue: BB-906
@delthas
delthas force-pushed the improvement/BB-906/kafka-connect-pause-offsets branch from 6f2b397 to 29705e0 Compare October 20, 2026 16:49

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants