-
Notifications
You must be signed in to change notification settings - Fork 260
Open
Labels
connectorsConnectors runtimeConnectors runtimegood first issueGood for newcomersGood for newcomerstestNew testcase, or improvement of existingNew testcase, or improvement of existing
Description
The Elasticsearch source connector needs integration tests. See the Postgres source tests (#2579) for the testing pattern.
What needs testing
- Basic flow: documents in ES → messages in Iggy
- JSON document handling
- Pagination modes (scroll-based, cursor-based)
- Timestamp filtering behavior
- State persistence (last_document_id, last_poll_timestamp)
Implementation notes
- Reuse the testcontainers ES setup from sink tests
- Use
poll_messagespattern from postgres source tests - Test state recovery scenarios
Files to reference
core/integration/tests/connectors/postgres/postgres_source.rscore/connectors/sources/elasticsearch_source/src/lib.rscore/connectors/sources/elasticsearch_source/src/state_manager.rs
Acceptance criteria
- Tests for at least 2 pagination modes
- State persistence test (stop/restart scenario)
- Clear failure messages
Metadata
Metadata
Assignees
Labels
connectorsConnectors runtimeConnectors runtimegood first issueGood for newcomersGood for newcomerstestNew testcase, or improvement of existingNew testcase, or improvement of existing