bigquery-bigframes — Claude Code skill: what it does, install
Generates Python code for BigQuery data processing, analysis, and machine learning with BigFrames. Use it when a DataFrame API fits the task.
npx skills add google/skills --skill bigquery-bigframes -a claude-codeWhat bigquery-bigframes does
bigquery-bigframes guides an agent to write Python with BigQuery DataFrames, also called BigFrames. It covers data processing, analysis, plotting, and machine learning through BigQuery, keeping large datasets in the cloud instead of moving them into client memory.
The skill includes guidance for peek(), partial ordering mode, schema checks with .dtypes, and accessors instead of unnecessary UDFs. For machine learning, it points to bigframes.bigquery.ml; the legacy bigframes.ml package is reserved for cases where the user explicitly asks for it.
Install it when an agent writes Python for BigQuery and should follow the BigFrames API. Skip it for SQL-first workflows or the google-cloud-bigquery client library, where bigquery-basics fits better. BigFrames is required.
What it helps with
- process BigQuery data through the Python DataFrame API
- inspect the schema of an intermediate result
- plot data from a BigFrames DataFrame
- train an ML model inside BigQuery
- keep large datasets out of local client memory
Example prompts for the agent
- Process this BigQuery table with BigFrames and show a random row sample.
- Check `.dtypes`, prepare the data, and train a model with `bigframes.bigquery.ml`.
- Create a plot from the BigFrames DataFrame, aggregating the data before local plotting if needed.
How to install bigquery-bigframes
1Skills CLI (Vercel)
npx skills add google/skills --skill bigquery-bigframes -a claude-code2Manually: put the files in place
~/.claude/skills/bigquery-bigframes/SKILL.mdCopy the whole skill folder; for one project use .claude/skills/bigquery-bigframes/
1Skills CLI (Vercel)
npx skills add google/skills --skill bigquery-bigframes -a codex2Manually: put the files in place
.agents/skills/bigquery-bigframes/SKILL.mdFor all projects use ~/.agents/skills/
Manually: put the files in place
.cursor/skills/bigquery-bigframes/SKILL.mdCursor also reads .agents/skills/ and .claude/skills/
1GitHub CLI
gh skill install google/skills bigquery-bigframes2Manually: put the files in place
.github/skills/bigquery-bigframes/SKILL.md1Skills CLI (Vercel)
npx skills add google/skills --skill bigquery-bigframes -a gemini-cli2Platform CLI
gemini skills install https://github.com/google/skills --path skills/cloud/bigquery-bigframesManually: put the files in place
.devin/skills/bigquery-bigframes/SKILL.mdThe legacy .windsurf/skills/ path still works
Claude.ai
Zip the folder and upload it in Settings → Capabilities → Skills
From the same set172
The whole set →Similar
Questions about bigquery-bigframes
How do I install bigquery-bigframes in Claude Code?
Run npx skills add google/skills --skill bigquery-bigframes -a claude-code. The skill file will be at ~/.claude/skills/bigquery-bigframes/SKILL.md.
What does bigquery-bigframes do?
It generates Python code with BigFrames for processing, analyzing, and modeling data in BigQuery. Its guidance favors cloud-side DataFrame operations over downloading the full dataset locally.
When should I use bigquery-basics instead?
Use bigquery-basics for SQL-first workflows or when the code uses the google-cloud-bigquery client library. bigquery-bigframes is for Python tasks built around the BigFrames DataFrame API.
Source text
SKILL.md · Apache-2.0
---
name: bigquery-bigframes
metadata:
version: "2.0.1"
category: BigDataAndAnalytics
description: >-
Generates Python code using BigQuery DataFrames (BigFrames). Use by default for any Python data task involving BigQuery, including data processing, analysis, and machine learning. Don't use for SQL-first workflows or the google-cloud-bigquery client library — use bigquery-basics.
---
# BigFrames (BigQuery DataFrame) basics
BigFrames is a Python library that lets you take advantage of BigQuery
data processing by using familiar Python APIs.
## Attribution
**MUST READ**: Before executing any `gcloud`, REST API, or MCP command, you
MUST read [Usage Attribution](references/attribution.md). For commands executed
directly in the terminal (never in generated scripts, Terraform, or user code),
prefix `gcloud` with
`CLOUDSDK_METRICS_REQUEST_ATTRIBUTION="agent-skills/1.0 (skill:bigquery-bigframes)"`
and append `agent-skills/1.0 (skill:bigquery-bigframes)` to `User-Agent` headers.
## Dataframe API best practices
* **Stay in the Cloud**: Perform data cleaning, transformation, and analysis
via BigFrames methods to leverage BigQuery's scale rather than downloading
data.
* **Prefer partial ordering mode**: Enable partial ordering mode right after
importing BigFrames. This speeds up data processing significantly by relaxing
row-sequence constraints.
```python
import bigframes.pandas as bpd
bpd.options.bigquery.ordering_mode = 'partial'
```
* **Use `peek()` for data preview**: Use `peek(n)` to preview data instead of
`head(n)`. `peek(n)` randomly samples `n` rows and is significantly faster.
`head(n)` returns rows in strict order and fails in `partial` ordering mode
unless the DataFrame has been explicitly sorted.
* **Avoid materializing data locally**: Methods like `to_pandas()` download all
data to client memory, bypassing BigQuery’s distributed computation and
risking Out of Memory (OOM) errors. Do not materialize data locally unless:
* The dataset is small enough to fit safely in memory.
* An error message explicitly requires local materialization.
* **Prefer Dataframe API over SQL queries**: Do not write raw SQL queries via
`read_gbq()` if a DataFrame/Series method achieves the same result, as it
breaks the Pandas abstraction and prevents lazy query execution.
* **Accessors over UDFs/Lambdas**:
* Use built-in accessors (e.g., `df.col.str.*`, `df.col.dt.*`) instead of
remote User Defined Functions (UDFs). UDFs require extra resources and
time to deploy.
* Do not use lambdas with `Series.map()` or `DataFrame.apply()`. These
methods do not accept functions without `udf` or `remote_function`
decorators.
```python
# Avoid:
df["upper"] = df["name"].map(lambda x: x.upper())
# Prefer:
df["upper"] = df["name"].str.upper()
```
* **Schema Verification**: Do not assume the schema of intermediate outputs.
Proactively verify schemas using `.dtypes` and inspect sample records using
`display()` with `.peek()`.
* **Visualization**: Plot directly from the BigFrames DataFrame/Series when
possible. BigFrames is compatible with Matplotlib and Seaborn. If direct
plotting fails, use the `.plot` accessor. If the dataset is too large to plot,
aggregate or sample the data before calling
`.to_pandas()` to plot locally.
## Machine Learning
* **Use `bigframes.bigquery.ml` package**: Do not use Scikit-learn or other ML
libraries with BigQuery DataFrames. Standard Scikit-learn models require
bringing data into local client memory, whereas `bigframes.bigquery.ml`
delegates training directly to BigQuery's scalable ML engine. Import functions
from `bigframes.bigquery.ml`.
### Reference Directory
* [Linear Regression](references/linear_regression.md): Train a linear
regression model to predict numerical values.
* [Logistic Regression](references/logistic_regression.md): Train a logistic
regression model to predict boolean values.
## BigFrames ML (Legacy)
The BigFrames ML package (`bigframes.ml`) is a legacy package that mimics the
scikit-learn API but is no longer recommended for new projects. Only use this
package if the user explicitly requests BigFrames ML.
* **Legacy Imports**: When legacy BigFrames ML is requested, import tools and
classes from `bigframes.ml` instead of `bigframes.bigquery.ml`.
* **DataFrame Return on Prediction**: Unlike Scikit-learn, BigFrames'
`predict()` method always returns a **DataFrame** containing both predictions
and features, rather than a single series of predictions.
* **No `random_state`**: Do not pass a `random_state` argument when
instantiating BigFrames ML models, as this parameter is not supported in the
BigFrames ML package.
* **Automatic Scaling**: Do not use `OneHotEncoder` or `StandardScaler` unless
explicitly requested, as scaling is handled automatically.
* **Hyperparameter Tuning**: Write custom loops for hyperparameter tuning, as
BigFrames lacks `GridSearchCV` or `RandomizedSearchCV`.
* **ARIMA Plus** (Forecasting):
* Import from `bigframes.ml.forecasting`.
* Sort data chronologically and split around a timepoint before training.
* Ensure the prediction horizon is less than or equal to the training
horizon.
* **PCA**: BigFrames' PCA class lacks a `transform()` method. Use `predict()`
instead.
* **Model Persistence**: To persist a model, use `model.to_gbq()`. To load a
persisted model, use `bpd.read_gbq_model()`.
© google · Apache-2.0 · google/skills