-
Notifications
You must be signed in to change notification settings - Fork 126
Try and benchmark on metal instances #6169
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: develop
Are you sure you want to change the base?
Conversation
3147706 to
07600dc
Compare
Merging this PR will degrade performance by 29.88%
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| 🆕 | WallTime | 1M_90pct[1000000] |
N/A | 29 µs | N/A |
| 🆕 | WallTime | 10M_90pct[10000000] |
N/A | 194.2 µs | N/A |
| 🆕 | WallTime | 1M_90pct[1000000] |
N/A | 56.5 µs | N/A |
| 🆕 | WallTime | 1M_50pct[500000] |
N/A | 21.5 µs | N/A |
| 🆕 | WallTime | 10M_50pct[5000000] |
N/A | 279.8 µs | N/A |
| 🆕 | WallTime | 10M_90pct[10000000] |
N/A | 365.4 µs | N/A |
| 🆕 | WallTime | 1M_10pct[100000] |
N/A | 42.8 µs | N/A |
| 🆕 | WallTime | 1M_90pct[1000000] |
N/A | 54.6 µs | N/A |
| 🆕 | WallTime | 10M_50pct[5000000] |
N/A | 279.2 µs | N/A |
| 🆕 | WallTime | 1M_10pct[100000] |
N/A | 44.6 µs | N/A |
| 🆕 | WallTime | 10M_10pct[1000000] |
N/A | 217.6 µs | N/A |
| 🆕 | WallTime | 1M_50pct[500000] |
N/A | 49.3 µs | N/A |
| 🆕 | WallTime | 10M_90pct[10000000] |
N/A | 362.2 µs | N/A |
| 🆕 | WallTime | 1M_50pct[500000] |
N/A | 51.3 µs | N/A |
| 🆕 | WallTime | 10M_50pct[5000000] |
N/A | 158.1 µs | N/A |
| 🆕 | WallTime | 10M_10pct[1000000] |
N/A | 219 µs | N/A |
| 🆕 | WallTime | 10M_10pct[1000000] |
N/A | 135.2 µs | N/A |
| 🆕 | WallTime | 1M_10pct[100000] |
N/A | 45.7 µs | N/A |
| ❌ | Simulation | canonical_into_non_nullable[(10000, 1, 0.0)] |
25.7 µs | 36.1 µs | -28.84% |
| ❌ | Simulation | canonical_into_non_nullable[(10000, 1, 0.01)] |
32.2 µs | 40.9 µs | -21.22% |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Comparing adamg/benchmark-on-metal2 (f96f8f2) with develop (68130ce)2
Footnotes
-
1323 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
-
No successful run was found on
develop(db2e2af) during the generation of this report, so 68130ce was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩
Benchmarks: FineWeb NVMeSummary
Detailed Results Table
|
Benchmarks: TPC-H SF=1 on NVMESummary
Detailed Results Table
|
Benchmarks: TPC-H SF=1 on S3Summary
Detailed Results Table
|
Benchmarks: Clickbench on NVMESummary
Detailed Results Table
|
Benchmarks: Statistical and Population GeneticsSummary
Detailed Results Table
|
Benchmarks: FineWeb S3Summary
Detailed Results Table
|
Benchmarks: TPC-H SF=10 on S3Summary
Detailed Results Table
|
Benchmarks: TPC-DS SF=1 on NVMESummary
Detailed Results Table
|
Benchmarks: TPC-H SF=10 on NVMESummary
Detailed Results Table
|
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
07600dc to
f96f8f2
Compare
No description provided.