From 617519988ba1d6b55b1343ed2ca585c3107b7ac0 Mon Sep 17 00:00:00 2001 From: javier Date: Wed, 18 Feb 2026 19:48:27 +0100 Subject: [PATCH] Add TSBS Benchmark skill section to AI Coding Agents page --- .../getting-started/ai-coding-agents.mdx | 52 ++++++++++++++++++- 1 file changed, 51 insertions(+), 1 deletion(-) diff --git a/documentation/getting-started/ai-coding-agents.mdx b/documentation/getting-started/ai-coding-agents.mdx index 916ce5ee1..283b878fe 100644 --- a/documentation/getting-started/ai-coding-agents.mdx +++ b/documentation/getting-started/ai-coding-agents.mdx @@ -7,7 +7,7 @@ description: AI coding agents like Claude Code and OpenAI Codex can help you build applications that use QuestDB. -These agents work with QuestDB out of the box by reading the online documentation. For deeper integration, the [QuestDB agent skill](#questdb-agent-skill) embeds rich context directly into the agent, making it faster and more accurate for common tasks like writing SQL, setting up ingestion, and deploying Grafana dashboards. +These agents work with QuestDB out of the box by reading the online documentation. For deeper integration, agent skills embed rich context directly into the agent so it can work faster and more accurately. The [QuestDB agent skill](#questdb-agent-skill) covers SQL, ingestion, and Grafana dashboards, while the [TSBS Benchmark skill](#tsbs-benchmark-skill) automates end-to-end performance benchmarking. ## Getting started @@ -95,6 +95,56 @@ The following indicators are embedded in the skill and can be generated without Aggressor imbalance, ATR, Bid-ask spread, Bollinger Bands, Bollinger BandWidth, Compound interest, Cumulative product, Donchian Channels, Keltner Channels, Liquidity comparison, MACD, Maximum drawdown, OBV, OHLC bars, Rate of Change, Realized volatility, Rolling std dev, RSI, Stochastic Oscillator, TICK & TRIN, Volume profile, Volume spikes, VWAP. +## TSBS Benchmark skill + +The TSBS Benchmark skill is a skill for Claude Code and Codex that runs end-to-end Time Series Benchmark Suite (TSBS) benchmarks against QuestDB. It installs prerequisites, spins up QuestDB in Docker, builds TSBS, generates data, loads it, runs all query benchmarks, and cleans up - all from a single prompt. + +### Installation + +Copy `claude/SKILL.md` from the repository into your skills directory: + +**Claude Code:** +- `~/.claude/skills/tsbs-benchmark/SKILL.md` - available in all projects +- `/.claude/skills/tsbs-benchmark/SKILL.md` - available in a specific project + +**Codex:** +- `~/.codex/skills/tsbs-benchmark/SKILL.md` - available in all projects +- `/.codex/skills/tsbs-benchmark/SKILL.md` - available in a specific project + +### What it handles + +The skill orchestrates eight sequential steps: + +1. **Prerequisites** - validates and installs Docker, Go 1.22.5, and build tools (make, gcc, gzip) +2. **QuestDB deployment** - launches the latest QuestDB container with ports 9000, 9009, 8812, and 9003 +3. **TSBS compilation** - clones and builds four QuestDB-specific binaries from the TSBS repository +4. **Data generation** - creates ~12 GB of uncompressed benchmark data (34.5M rows, 345.6M metrics) +5. **Data loading** - ingests via ILP with worker threads matching CPU cores (capped at 32) +6. **Query generation** - produces 1,000 queries for each of the 16 query types +7. **Benchmark execution** - runs all queries in single-worker mode so QuestDB's internal parallelization is measured accurately +8. **Cleanup** - removes the Docker container and temporary files + +### Benchmark parameters + +| Parameter | Value | +|-----------|-------| +| Use case | `cpu-only` | +| Scale | 4,000 hosts | +| Time window | 1 day (2016-01-01 to 2016-01-02) | +| Log interval | 10 seconds | +| Rows generated | 34.5M | +| Metrics generated | 345.6M | +| Query types | 16 (cpu-max variants, single/double-groupby, high-cpu, lastpoint, groupby-orderby-limit) | +| Queries per type | 1,000 | + +### Example prompt + +```text +Run the full TSBS benchmark against QuestDB with the default cpu-only dataset. +``` + +The agent will handle everything from installing prerequisites through reporting the final query-by-query results. + ## Tips - **Provide context** - Tell the agent about your use case, data volume, and