Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additional decorrelation work #233

Open
scsmithr opened this issue Sep 14, 2024 · 0 comments
Open

Additional decorrelation work #233

scsmithr opened this issue Sep 14, 2024 · 0 comments

Comments

@scsmithr
Copy link
Member

Detect additional correlations: https://github.com/glaredb/rayexec/blob/1466b38894916554546b8b7c4c1044e5ac9f7e4e/crates/rayexec_execution/src/logical/planner/plan_subquery.rs#L383

Currently detects correlations in nodes that likely make up the majority of correlated queries. Not detecting correlations means we end up with errors like:

Column expr not referencing a valid table ref, column: #0.1, valid tables: [#3]

More operators to push dependent joins down through: https://github.com/glaredb/rayexec/blob/1466b38894916554546b8b7c4c1044e5ac9f7e4e/crates/rayexec_execution/src/logical/planner/plan_subquery.rs#L455-L459

Missing some of the ones that we do detect correlations in. We just get a "Not yet implemented: dependent join pushdown for node: ..." error for operators that are missing.

https://btw-2015.informatik.uni-hamburg.de/res/proceedings/Hauptband/Wiss/Neumann-Unnesting_Arbitrary_Querie.pdf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant