Skip to content

Commit 9362838

Browse files
committed
exclude ML results from jobless query path
1 parent 2a29309 commit 9362838

File tree

1 file changed

+11
-1
lines changed

1 file changed

+11
-1
lines changed

bigframes/ml/core.py

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -95,7 +95,17 @@ def _apply_ml_tvf(
9595
)
9696

9797
result_sql = apply_sql_tvf(input_sql)
98-
df = self._session.read_gbq(result_sql, index_col=index_col_ids)
98+
df = self._session.read_gbq_query(
99+
result_sql,
100+
index_col=index_col_ids,
101+
# Many ML methods use nested JSON, which isn't yet compatible with
102+
# joining local results. Also, there is a chance that the results
103+
# are greater than 10 GB.
104+
# TODO(b/395912450): Once the limitations with local data are
105+
# resolved, consider setting allow_large_results only when expected
106+
# data size is large.
107+
allow_large_results=True,
108+
)
99109
if df._has_index:
100110
df.index.names = index_labels
101111
# Restore column labels

0 commit comments

Comments
 (0)