Merge remote-tracking branch 'github/main' into agg_factoring

Author: TrevorBergeron

.github/workflows/js-tests.yml

@@ -0,0 +1,20 @@
+name: js-tests
+on:
+  pull_request:
+    branches:
+      - main
+  push:
+    branches:
+      - main
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+    - name: Checkout
+      uses: actions/checkout@v4
+    - name: Install modules
+      working-directory: ./tests/js
+      run: npm install
+    - name: Run tests
+      working-directory: ./tests/js
+      run: npm test

.gitignore

@@ -58,6 +58,7 @@ coverage.xml
 
 # System test environment variables.
 system_tests/local_test_setup
+tests/js/node_modules/
 
 # Make sure a generated file isn't accidentally committed.
 pylintrc

.librarian/state.yaml

@@ -1,7 +1,8 @@
 image: us-central1-docker.pkg.dev/cloud-sdk-librarian-prod/images-prod/python-librarian-generator@sha256:c8612d3fffb3f6a32353b2d1abd16b61e87811866f7ec9d65b59b02eb452a620
 libraries:
   - id: bigframes
-    version: 2.28.0
+    version: 2.31.0
+    last_generated_commit: ""
     apis: []
     source_roots:
       - .

CHANGELOG.md

@@ -4,6 +4,54 @@
 
 [1]: https://pypi.org/project/bigframes/#history
 
+## [2.31.0](https://github.com/googleapis/google-cloud-python/compare/bigframes-v2.30.0...bigframes-v2.31.0) (2025-12-10)
+
+
+### Features
+
+* add `bigframes.bigquery.ml` methods (#2300) ([719b278c844ca80c1bec741873b30a9ee4fd6c56](https://github.com/googleapis/google-cloud-python/commit/719b278c844ca80c1bec741873b30a9ee4fd6c56))
+* add 'weekday' property to DatatimeMethod (#2304) ([fafd7c732d434eca3f8b5d849a87149f106e3d5d](https://github.com/googleapis/google-cloud-python/commit/fafd7c732d434eca3f8b5d849a87149f106e3d5d))
+
+
+### Bug Fixes
+
+* cache DataFrames to temp tables in bigframes.bigquery.ml methods to avoid time travel (#2318) ([d99383195ac3f1683842cfe472cca5a914b04d8e](https://github.com/googleapis/google-cloud-python/commit/d99383195ac3f1683842cfe472cca5a914b04d8e))
+
+## [2.30.0](https://github.com/googleapis/google-cloud-python/compare/bigframes-v2.29.0...bigframes-v2.30.0) (2025-12-03)
+
+
+### Documentation
+
+* Add Google Analytics configuration to conf.py (#2301) ([0b266da10f4d3d0ef9b4dd71ddadebfc7d5064ca](https://github.com/googleapis/google-cloud-python/commit/0b266da10f4d3d0ef9b4dd71ddadebfc7d5064ca))
+* fix LogisticRegression docs rendering (#2295) ([32e531343c764156b45c6fb9de49793d26c19f02](https://github.com/googleapis/google-cloud-python/commit/32e531343c764156b45c6fb9de49793d26c19f02))
+* update API reference to new `dataframes.bigquery.dev` location (#2293) ([da064397acd2358c16fdd9659edf23afde5c882a](https://github.com/googleapis/google-cloud-python/commit/da064397acd2358c16fdd9659edf23afde5c882a))
+* use autosummary to split documentation pages (#2251) ([f7fd2d20896fe3e0e210c3833b6a4c3913270ebc](https://github.com/googleapis/google-cloud-python/commit/f7fd2d20896fe3e0e210c3833b6a4c3913270ebc))
+* update docs and tests for Gemini 2.5 models (#2279) ([08c0c0c8fe8f806f6224dc403a3f1d4db708573a](https://github.com/googleapis/google-cloud-python/commit/08c0c0c8fe8f806f6224dc403a3f1d4db708573a))
+
+
+### Features
+
+* Allow drop_duplicates over unordered dataframe (#2303) ([52665fa57ef13c58254bfc8736afcc521f7f0f11](https://github.com/googleapis/google-cloud-python/commit/52665fa57ef13c58254bfc8736afcc521f7f0f11))
+* Add agg/aggregate methods to windows (#2288) ([c4cb39dcbd388356f5f1c48ff28b19b79b996485](https://github.com/googleapis/google-cloud-python/commit/c4cb39dcbd388356f5f1c48ff28b19b79b996485))
+* Implement single-column sorting for interactive table widget (#2255) ([d1ecc61bf448651a0cca0fc760673da54f5c2183](https://github.com/googleapis/google-cloud-python/commit/d1ecc61bf448651a0cca0fc760673da54f5c2183))
+* add bigquery.json_keys (#2286) ([b487cf1f6ecacb1ee3b35ffdd934221516bbd558](https://github.com/googleapis/google-cloud-python/commit/b487cf1f6ecacb1ee3b35ffdd934221516bbd558))
+* use end user credentials for `bigframes.bigquery.ai` functions when `connection_id` is not present  (#2272) ([7c062a68c6a3c9737865985b4f1fd80117490c73](https://github.com/googleapis/google-cloud-python/commit/7c062a68c6a3c9737865985b4f1fd80117490c73))
+* pivot_table supports fill_value arg (#2257) ([8f490e68a9a2584236486060ad3b55923781d975](https://github.com/googleapis/google-cloud-python/commit/8f490e68a9a2584236486060ad3b55923781d975))
+* Support mixed scalar-analytic expressions (#2239) ([20ab469d29767a2f04fe02aa66797893ecd1c539](https://github.com/googleapis/google-cloud-python/commit/20ab469d29767a2f04fe02aa66797893ecd1c539))
+* Support builtins funcs for df.agg (#2256) ([956a5b00dff55b73e3cbebb4e6e81672680f1f63](https://github.com/googleapis/google-cloud-python/commit/956a5b00dff55b73e3cbebb4e6e81672680f1f63))
+* Preserve source names better for more readable sql (#2243) ([64995d659837a8576b2ee9335921904e577c7014](https://github.com/googleapis/google-cloud-python/commit/64995d659837a8576b2ee9335921904e577c7014))
+* Add bigframes.pandas.crosstab (#2231) ([c62e5535ed4c19b6d65f9a46cb1531e8099621b2](https://github.com/googleapis/google-cloud-python/commit/c62e5535ed4c19b6d65f9a46cb1531e8099621b2))
+
+
+### Bug Fixes
+
+* Update max_instances default to reflect actual value (#2302) ([4489687eafc9a1ea1b985600010296a4245cef94](https://github.com/googleapis/google-cloud-python/commit/4489687eafc9a1ea1b985600010296a4245cef94))
+* Fix issue with stream upload batch size upload limit (#2290) ([6cdf64b0674d0e673f86362032d549316850837b](https://github.com/googleapis/google-cloud-python/commit/6cdf64b0674d0e673f86362032d549316850837b))
+* Pass credentials properly for read api instantiation (#2280) ([3e3fe259567d249d91f90786a577b05577e2b9fd](https://github.com/googleapis/google-cloud-python/commit/3e3fe259567d249d91f90786a577b05577e2b9fd))
+* Improve Anywidget pagination and display for unknown row counts (#2258) ([508deae5869e06cdad7bb94537c9c58d8f083d86](https://github.com/googleapis/google-cloud-python/commit/508deae5869e06cdad7bb94537c9c58d8f083d86))
+* calling info() on empty dataframes no longer leads to errors (#2267) ([95a83f7774766cd19cb583dfaa3417882b5c9b1e](https://github.com/googleapis/google-cloud-python/commit/95a83f7774766cd19cb583dfaa3417882b5c9b1e))
+* do not warn with DefaultIndexWarning in partial ordering mode (#2230) ([cc2dbae684103a21fe8838468f7eb8267188780d](https://github.com/googleapis/google-cloud-python/commit/cc2dbae684103a21fe8838468f7eb8267188780d))
+
 ## [2.29.0](https://github.com/googleapis/python-bigquery-dataframes/compare/v2.28.0...v2.29.0) (2025-11-10)
 
 

README.rst

@@ -6,15 +6,25 @@ BigQuery DataFrames (BigFrames)
 |GA| |pypi| |versions|
 
 BigQuery DataFrames (also known as BigFrames) provides a Pythonic DataFrame
-and machine learning (ML) API powered by the BigQuery engine.
+and machine learning (ML) API powered by the BigQuery engine. It provides modules
+for many use cases, including:
 
-* `bigframes.pandas` provides a pandas API for analytics. Many workloads can be
+* `bigframes.pandas <https://dataframes.bigquery.dev/reference/api/bigframes.pandas.html>`_
+  is a pandas API for analytics. Many workloads can be
   migrated from pandas to bigframes by just changing a few imports.
-* ``bigframes.ml`` provides a scikit-learn-like API for ML.
+* `bigframes.ml <https://dataframes.bigquery.dev/reference/index.html#ml-apis>`_
+  is a scikit-learn-like API for ML.
+* `bigframes.bigquery.ai <https://dataframes.bigquery.dev/reference/api/bigframes.bigquery.ai.html>`_
+  are a collection of powerful AI methods, powered by Gemini.
 
-BigQuery DataFrames is an open-source package.
+BigQuery DataFrames is an `open-source package <https://github.com/googleapis/python-bigquery-dataframes>`_.
 
-**Version 2.0 introduces breaking changes for improved security and performance. See below for details.**
+.. |GA| image:: https://img.shields.io/badge/support-GA-gold.svg
+   :target: https://github.com/googleapis/google-cloud-python/blob/main/README.rst#general-availability
+.. |pypi| image:: https://img.shields.io/pypi/v/bigframes.svg
+   :target: https://pypi.org/project/bigframes/
+.. |versions| image:: https://img.shields.io/pypi/pyversions/bigframes.svg
+   :target: https://pypi.org/project/bigframes/
 
 Getting started with BigQuery DataFrames
 ----------------------------------------
@@ -38,7 +48,8 @@ To use BigFrames in your local development environment,
 
     import bigframes.pandas as bpd
 
-    bpd.options.bigquery.project = your_gcp_project_id
+    bpd.options.bigquery.project = your_gcp_project_id  # Optional in BQ Studio.
+    bpd.options.bigquery.ordering_mode = "partial"  # Recommended for performance.
     df = bpd.read_gbq("bigquery-public-data.usa_names.usa_1910_2013")
     print(
         df.groupby("name")
@@ -48,49 +59,16 @@ To use BigFrames in your local development environment,
         .to_pandas()
     )
 
-
 Documentation
 -------------
 
 To learn more about BigQuery DataFrames, visit these pages
 
 * `Introduction to BigQuery DataFrames (BigFrames) <https://cloud.google.com/bigquery/docs/bigquery-dataframes-introduction>`_
 * `Sample notebooks <https://github.com/googleapis/python-bigquery-dataframes/tree/main/notebooks>`_
-* `API reference <https://cloud.google.com/python/docs/reference/bigframes/latest/summary_overview>`_
+* `API reference <https://dataframes.bigquery.dev/>`_
 * `Source code (GitHub) <https://github.com/googleapis/python-bigquery-dataframes>`_
 
-⚠️ Warning: Breaking Changes in BigQuery DataFrames v2.0
---------------------------------------------------------
-
-Version 2.0 introduces breaking changes for improved security and performance. Key default behaviors have changed, including
-
-* **Large Results (>10GB):** The default value for ``allow_large_results`` has changed to ``False``.
-  Methods like ``to_pandas()`` will now fail if the query result's compressed data size exceeds 10GB,
-  unless large results are explicitly permitted.
-* **Remote Function Security:** The library no longer automatically lets the Compute Engine default service
-  account become the identity of the Cloud Run functions. If that is desired, it has to be indicated by passing
-  ``cloud_function_service_account="default"``. And network ingress now defaults to ``"internal-only"``.
-* **@remote_function Argument Passing:** Arguments other than ``input_types``, ``output_type``, and ``dataset``
-  to ``remote_function`` must now be passed using keyword syntax, as positional arguments are no longer supported.
-* **@udf Argument Passing:** Arguments ``dataset`` and ``name`` to ``udf`` are now mandatory.
-* **Endpoint Connections:** Automatic fallback to locational endpoints in certain regions is removed.
-* **LLM Updates (Gemini Integration):** Integrations now default to the ``gemini-2.0-flash-001`` model.
-  PaLM2 support has been removed; please migrate any existing PaLM2 usage to Gemini. **Note:** The current default
-  model will be removed in Version 3.0.
-
-**Important:** If you are not ready to adapt to these changes, please pin your dependency to a version less than 2.0
-(e.g., ``bigframes==1.42.0``) to avoid disruption.
-
-To learn about these changes and how to migrate to version 2.0, see the
-`updated introduction guide <https://cloud.google.com/bigquery/docs/bigquery-dataframes-introduction>`_.
-
-.. |GA| image:: https://img.shields.io/badge/support-GA-gold.svg
-   :target: https://github.com/googleapis/google-cloud-python/blob/main/README.rst#general-availability
-.. |pypi| image:: https://img.shields.io/pypi/v/bigframes.svg
-   :target: https://pypi.org/project/bigframes/
-.. |versions| image:: https://img.shields.io/pypi/pyversions/bigframes.svg
-   :target: https://pypi.org/project/bigframes/
-
 License
 -------
 

bigframes/bigquery/__init__.py

@@ -18,7 +18,7 @@
 
 import sys
 
-from bigframes.bigquery import ai
+from bigframes.bigquery import ai, ml
 from bigframes.bigquery._operations.approx_agg import approx_top_count
 from bigframes.bigquery._operations.array import (
     array_agg,
@@ -157,4 +157,5 @@
     "struct",
     # Modules / SQL namespaces
     "ai",
+    "ml",
 ]