[bug] `bind` visitor causes `RecursionError: maximum recursion depth exceeded`

[kevinjqliu]

Apache Iceberg version

main (development)

Please describe the bug 🐞

As seen in #1571 and #1759

The bind function uses the visitors pattern. The recursion depth is determined by both the schema and the expression passed to the function. When either the schema or expression is deeply nested, the visitor runs into the RecursionError

A temporary workaround can be to override the system recursion limit

import sys
sys.setrecursionlimit(5000)

from #1759 (comment)

Willingness to contribute

• I can contribute a fix for this bug independently
• I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• I cannot contribute a fix for this bug at this time

[kevinjqliu]

Perhaps we'd want to convert the visitor to an iterative approach, for example #1783

[kevinjqliu]

more details in #1759 (comment)