Skip to content

Conversation

@colinmarc
Copy link
Contributor

DataFusion ExecutionPlan implementations are generally public, so that they can be inspected and munged by optimization rules.

Our specific use case is to use IcebergTableProvider to plan files, and then pass those files (assuming no deletes) to DataFusions ListingTable`.

Copy link
Contributor

@liurenjie1024 liurenjie1024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @colinmarc for this pr, generally LGTM! Just some minor suggestions.

@colinmarc colinmarc force-pushed the expose-iceberg-table-scan branch from 8310d33 to 763d6aa Compare August 1, 2025 10:06
DataFusion `ExecutionPlan` implementations are usually public, so that
they can be inspected and munged by optimization rules.
@colinmarc colinmarc force-pushed the expose-iceberg-table-scan branch from 763d6aa to 81d1d4d Compare August 1, 2025 10:21
Copy link
Contributor

@liurenjie1024 liurenjie1024 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @colinmarc for this pr!

@liurenjie1024 liurenjie1024 merged commit 6e21b7f into apache:main Aug 1, 2025
17 checks passed
Yiyang-C pushed a commit to Yiyang-C/iceberg-rust that referenced this pull request Aug 26, 2025
DataFusion `ExecutionPlan` implementations are generally public, so that
they can be inspected and munged by optimization rules.

Our specific use case is to use `IcebergTableProvider` to plan files,
and then pass those files (assuming no deletes) to DataFusion`s
`ListingTable`.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants