Add list manipulation expressions #6030
Replies: 5 comments 2 replies
-
|
I'm curious what conventions this list's type inference follows. I'm not sure if there will be a type inference problem 🤔 |
Beta Was this translation helpful? Give feedback.
-
|
For the motivating case (map_list(get_item("a", _), list<struct{a,b}>)), I wonder if we can avoid higher‑order funcs entirely by defining get_item("a", list<struct{a: T, ...}>) -> list (and same for FixedSizeList). |
Beta Was this translation helpful? Give feedback.
-
|
I really think what we want to follow all other query engines here and have The question becomes do we have monomorphised functions map_list or a generic one map. (I prefer map) |
Beta Was this translation helpful? Give feedback.
-
|
We can add a temporary UNSTABLE get_item_list expression This should have the semantics |
Beta Was this translation helpful? Give feedback.
-
|
I replaced vortex.map with a temporary vortex.get_item_list(col, array) (as sugar for a future map) and updated list pushdown accordingly; the existing write->scan regression for items.a and the unit tests pass, with no new deps. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
What expressions do we need to operator for
DType::List.I am currently thinking that we want
map_list(func, array). The question becomes how to be handle function in expressions.If we had a
map_list(get_item("a", _), array)where the array has dtypelist({a: i32, b: u8})expression this would extract the column "a" for each list element returning an array of dtypelist(i32)Beta Was this translation helpful? Give feedback.
All reactions