Skip to content

Exclude teardown metrics from executors in the gungraun benchmark functions#4336

Merged
Keavon merged 1 commit into
masterfrom
benches-exclude-teardown
Jul 15, 2026
Merged

Exclude teardown metrics from executors in the gungraun benchmark functions#4336
Keavon merged 1 commit into
masterfrom
benches-exclude-teardown

Conversation

@Keavon

@Keavon Keavon commented Jul 15, 2026

Copy link
Copy Markdown
Member

No description provided.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the benchmark functions run_cached, run_once, and update_executor to return the DynamicExecutor instance. This ensures that the executor's teardown occurs outside of the measured benchmark section, preventing teardown overhead from skewing the benchmark results. There are no review comments, so I have no feedback to provide.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 3 files

Confidence score: 5/5

  • Automated review surfaced no issues in the provided summaries.
  • No files require special attention.

Re-trigger cubic

@github-actions

github-actions Bot commented Jul 15, 2026

Copy link
Copy Markdown
Performance Benchmark Results

🔧 Graph Compilation

compile_demo_art_gungraun::compile_group::compile_to_proto with_setup_0:(load_from_name(isometric-fountain))
Instructions: 34,826,187 (master) → 34,825,266 (HEAD) : $$\color{lime}-0.00\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          -0.02%
D1mr                     489,242|    489,201          -0.01%
D1mw                     146,283|    146,228          -0.04%
DLmr                      43,318|     43,317          -0.00%
DLmw                      63,717|     63,708          -0.01%
Dr                     8,521,092|  8,521,178          +0.00%
Dw                     5,960,432|  5,960,569          +0.00%
EstimatedCycles       55,279,085| 55,277,703          -0.00%
I1MissRate                     0|          0          +0.00%
I1mr                      48,136|     48,136          +0.00%
ILmr                         856|        856          +0.00%
Ir                    34,826,187| 34,825,266          -0.00%
L1HitRate                     99|         99          +0.00%
L1hits                48,624,050| 48,623,448          -0.00%
LLHitRate                      1|          1          -0.01%
LLMissRate                     0|          0          -0.01%
LLdMissRate                    1|          1          -0.01%
LLhits                   575,770|    575,684          -0.01%
LLiMissRate                    0|          0          +0.00%
RamHitRate                     0|          0          -0.01%
RamHits                  107,891|    107,881          -0.01%
TotalRW               49,307,711| 49,307,013          -0.00%

compile_demo_art_gungraun::compile_group::compile_to_proto with_setup_1:(load_from_name(painted-dreams))
Instructions: 17,417,510 (master) → 17,414,962 (HEAD) : $$\color{lime}-0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.03%
D1mr                     243,903|    243,943          +0.02%
D1mw                      71,718|     71,779          +0.09%
DLmr                       1,068|      1,068          +0.00%
DLmw                      22,224|     22,225          +0.00%
Dr                     4,258,159|  4,257,948          -0.00%
Dw                     2,971,704|  2,971,709          +0.00%
EstimatedCycles       26,711,127| 26,708,807          -0.01%
I1MissRate                     0|          0          +0.01%
I1mr                      20,490|     20,490          +0.00%
ILmr                         685|        685          +0.00%
Ir                    17,417,510| 17,414,962          -0.01%
L1HitRate                     99|         99          -0.00%
L1hits                24,311,262| 24,308,407          -0.01%
LLHitRate                      1|          1          +0.04%
LLMissRate                     0|          0          +0.02%
LLdMissRate                    0|          0          +0.01%
LLhits                   312,134|    312,234          +0.03%
LLiMissRate                    0|          0          +0.01%
RamHitRate                     0|          0          +0.02%
RamHits                   23,977|     23,978          +0.00%
TotalRW               24,647,373| 24,644,619          -0.01%

compile_demo_art_gungraun::compile_group::compile_to_proto with_setup_2:(load_from_name(procedural-string-lights))
Instructions: 3,622,813 (master) → 3,622,603 (HEAD) : $$\color{lime}-0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          -0.04%
D1mr                      45,822|     45,804          -0.04%
D1mw                      15,704|     15,693          -0.07%
DLmr                          17|         17          +0.00%
DLmw                       3,846|      3,843          -0.08%
Dr                       882,394|    882,325          -0.01%
Dw                       616,415|    616,367          -0.01%
EstimatedCycles        5,523,406|  5,522,873          -0.01%
I1MissRate                     0|          0          +0.01%
I1mr                       4,870|      4,870          +0.00%
ILmr                         677|        677          +0.00%
Ir                     3,622,813|  3,622,603          -0.01%
L1HitRate                     99|         99          +0.00%
L1hits                 5,055,226|  5,054,928          -0.01%
LLHitRate                      1|          1          -0.04%
LLMissRate                     0|          0          -0.06%
LLdMissRate                    0|          0          -0.07%
LLhits                    61,856|     61,830          -0.04%
LLiMissRate                    0|          0          +0.01%
RamHitRate                     0|          0          -0.06%
RamHits                    4,540|      4,537          -0.07%
TotalRW                5,121,622|  5,121,295          -0.01%

compile_demo_art_gungraun::compile_group::compile_to_proto with_setup_3:(load_from_name(parametric-dunescape))
Instructions: 12,751,504 (master) → 12,753,347 (HEAD) : $$\color{red}+0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          -0.11%
D1mr                     173,720|    173,501          -0.13%
D1mw                      60,466|     60,438          -0.05%
DLmr                          39|         39          +0.00%
DLmw                      15,723|     15,719          -0.03%
Dr                     3,110,702|  3,110,857          +0.00%
Dw                     2,194,046|  2,193,961          -0.00%
EstimatedCycles       19,538,694| 19,539,533          +0.00%
I1MissRate                     0|          0          -0.01%
I1mr                      12,142|     12,143          +0.01%
ILmr                         809|        810          +0.12%
Ir                    12,751,504| 12,753,347          +0.01%
L1HitRate                     99|         99          +0.00%
L1hits                17,809,924| 17,812,083          +0.01%
LLHitRate                      1|          1          -0.12%
LLMissRate                     0|          0          -0.03%
LLdMissRate                    0|          0          -0.03%
LLhits                   229,757|    229,514          -0.11%
LLiMissRate                    0|          0          +0.11%
RamHitRate                     0|          0          -0.03%
RamHits                   16,571|     16,568          -0.02%
TotalRW               18,056,252| 18,058,165          +0.01%

compile_demo_art_gungraun::compile_group::compile_to_proto with_setup_4:(load_from_name(red-dress))
Instructions: 37,357,998 (master) → 37,357,064 (HEAD) : $$\color{lime}-0.00\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.00%
D1mr                     538,130|    538,151          +0.00%
D1mw                     155,411|    155,404          -0.00%
DLmr                      49,217|     49,213          -0.01%
DLmw                      81,036|     81,051          +0.02%
Dr                     9,148,442|  9,148,428          -0.00%
Dw                     6,403,832|  6,403,911          +0.00%
EstimatedCycles       59,806,494| 59,806,011          -0.00%
I1MissRate                     0|          0          +0.00%
I1mr                      47,167|     47,167          +0.00%
ILmr                         860|        860          +0.00%
Ir                    37,357,998| 37,357,064          -0.00%
L1HitRate                     99|         99          -0.00%
L1hits                52,169,564| 52,168,681          -0.00%
LLHitRate                      1|          1          +0.00%
LLMissRate                     0|          0          +0.01%
LLdMissRate                    1|          1          +0.01%
LLhits                   609,595|    609,598          +0.00%
LLiMissRate                    0|          0          +0.00%
RamHitRate                     0|          0          +0.01%
RamHits                  131,113|    131,124          +0.01%
TotalRW               52,910,272| 52,909,403          -0.00%

compile_demo_art_gungraun::compile_group::compile_to_proto with_setup_5:(load_from_name(valley-of-spires))
Instructions: 27,826,737 (master) → 27,825,047 (HEAD) : $$\color{lime}-0.01\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          4          +0.02%
D1mr                     397,706|    397,781          +0.02%
D1mw                     117,283|    117,320          +0.03%
DLmr                      21,401|     21,401          +0.00%
DLmw                      56,602|     56,610          +0.01%
Dr                     6,821,283|  6,821,103          -0.00%
Dw                     4,758,024|  4,758,012          -0.00%
EstimatedCycles       43,976,904| 43,975,710          -0.00%
I1MissRate                     0|          0          +0.01%
I1mr                      36,426|     36,426          +0.00%
ILmr                         837|        837          +0.00%
Ir                    27,826,737| 27,825,047          -0.01%
L1HitRate                     99|         99          -0.00%
L1hits                38,854,629| 38,852,635          -0.01%
LLHitRate                      1|          1          +0.03%
LLMissRate                     0|          0          +0.01%
LLdMissRate                    1|          1          +0.01%
LLhits                   472,575|    472,679          +0.02%
LLiMissRate                    0|          0          +0.01%
RamHitRate                     0|          0          +0.01%
RamHits                   78,840|     78,848          +0.01%
TotalRW               39,406,044| 39,404,162          -0.00%

🔄 Executor Update

update_executor_gungraun::update_group::update_executor with_setup_0:(setup_update_executor(isometric-fountain))
Instructions: 66,940,194 (master) → 59,388,759 (HEAD) : $$\color{lime}-11.28\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3         -13.73%
D1mr                     731,566|    519,862         -28.94%
D1mw                     159,979|    158,878          -0.69%
DLmr                      24,002|     19,218         -19.93%
DLmw                      35,742|     34,099          -4.60%
Dr                    16,924,711| 14,796,992         -12.57%
Dw                    11,355,127| 10,158,072         -10.54%
EstimatedCycles      100,661,864| 88,714,497         -11.87%
I1MissRate                     0|          0         -29.28%
I1mr                      16,393|     10,286         -37.25%
ILmr                         592|        502         -15.20%
Ir                    66,940,194| 59,388,759         -11.28%
L1HitRate                     99|         99          +0.14%
L1hits                94,312,094| 83,654,797         -11.30%
LLHitRate                      1|          1         -15.39%
LLMissRate                     0|          0          +0.70%
LLdMissRate                    0|          0          +1.13%
LLhits                   847,602|    635,207         -25.06%
LLiMissRate                    0|          0          -4.42%
RamHitRate                     0|          0          +0.70%
RamHits                   60,336|     53,819         -10.80%
TotalRW               95,220,032| 84,343,823         -11.42%

update_executor_gungraun::update_group::update_executor with_setup_1:(setup_update_executor(painted-dreams))
Instructions: 35,052,649 (master) → 31,165,398 (HEAD) : $$\color{lime}-11.09\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3         -12.73%
D1mr                     372,370|    269,263         -27.69%
D1mw                      86,646|     85,876          -0.89%
DLmr                         694|        282         -59.37%
DLmw                      11,914|      9,426         -20.88%
Dr                     9,010,347|  7,913,210         -12.18%
Dw                     6,154,370|  5,531,727         -10.12%
EstimatedCycles       52,477,174| 46,356,511         -11.66%
I1MissRate                     0|          0         -17.16%
I1mr                      10,101|      7,440         -26.34%
ILmr                         170|        154          -9.41%
Ir                    35,052,649| 31,165,398         -11.09%
L1HitRate                     99|         99          +0.12%
L1hits                49,748,249| 44,247,756         -11.06%
LLHitRate                      1|          1         -12.99%
LLMissRate                     0|          0         -13.12%
LLdMissRate                    0|          0         -13.15%
LLhits                   456,339|    352,717         -22.71%
LLiMissRate                    0|          0          +1.89%
RamHitRate                     0|          0         -13.12%
RamHits                   12,778|      9,862         -22.82%
TotalRW               50,217,366| 44,610,335         -11.17%

update_executor_gungraun::update_group::update_executor with_setup_2:(setup_update_executor(procedural-string-lights)...
Instructions: 8,635,508 (master) → 7,692,180 (HEAD) : $$\color{lime}-10.92\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3         -10.34%
D1mr                      88,614|     66,085         -25.42%
D1mw                      21,576|     21,606          +0.14%
DLmr                           3|        NaN        -100.00%
DLmw                         803|        864          +7.60%
Dr                     2,205,738|  1,939,493         -12.07%
Dw                     1,504,744|  1,353,952         -10.02%
EstimatedCycles       12,831,386| 11,379,547         -11.31%
I1MissRate                     0|          0          -8.79%
I1mr                       3,929|      3,192         -18.76%
ILmr                         158|        149          -5.70%
Ir                     8,635,508|  7,692,180         -10.92%
L1HitRate                     99|         99          +0.10%
L1hits                12,231,871| 10,894,742         -10.93%
LLHitRate                      1|          1         -10.74%
LLMissRate                     0|          0         +18.10%
LLdMissRate                    0|          0         +20.77%
LLhits                   113,155|     89,870         -20.58%
LLiMissRate                    0|          0          +5.87%
RamHitRate                     0|          0         +18.10%
RamHits                      964|      1,013          +5.08%
TotalRW               12,345,990| 10,985,625         -11.02%

update_executor_gungraun::update_group::update_executor with_setup_3:(setup_update_executor(parametric-dunescape))
Instructions: 31,334,315 (master) → 28,249,667 (HEAD) : $$\color{lime}-9.84\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          2         -11.91%
D1mr                     314,547|    233,860         -25.65%
D1mw                      73,827|     74,046          +0.30%
DLmr                         121|        118          -2.48%
DLmw                       7,841|      7,939          +1.25%
Dr                     8,079,963|  7,210,313         -10.76%
Dw                     5,607,583|  5,108,359          -8.90%
EstimatedCycles       46,849,063| 42,072,413         -10.20%
I1MissRate                     0|          0          -3.26%
I1mr                       7,504|      6,545         -12.78%
ILmr                         161|        152          -5.59%
Ir                    31,334,315| 28,249,667          -9.84%
L1HitRate                     99|         99          +0.11%
L1hits                44,625,983| 40,253,888          -9.80%
LLHitRate                      1|          1         -12.35%
LLMissRate                     0|          0         +12.15%
LLdMissRate                    0|          0         +12.44%
LLhits                   387,755|    306,242         -21.02%
LLiMissRate                    0|          0          +4.72%
RamHitRate                     0|          0         +12.15%
RamHits                    8,123|      8,209          +1.06%
TotalRW               45,021,861| 40,568,339          -9.89%

update_executor_gungraun::update_group::update_executor with_setup_4:(setup_update_executor(red-dress))
Instructions: 80,412,645 (master) → 71,672,360 (HEAD) : $$\color{lime}-10.87\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3         -13.92%
D1mr                     863,221|    614,667         -28.79%
D1mw                     194,648|    194,712          +0.03%
DLmr                      56,514|     37,921         -32.90%
DLmw                      64,896|     62,411          -3.83%
Dr                    20,496,257| 18,045,894         -11.96%
Dw                    13,892,905| 12,518,945          -9.89%
EstimatedCycles      122,773,025|108,553,401         -11.58%
I1MissRate                     0|          0         -28.74%
I1mr                      17,003|     10,799         -36.49%
ILmr                         981|        851         -13.25%
Ir                    80,412,645| 71,672,360         -10.87%
L1HitRate                     99|         99          +0.14%
L1hits               113,726,935|101,417,021         -10.82%
LLHitRate                      1|          1         -15.24%
LLMissRate                     0|          0          -7.17%
LLdMissRate                    0|          0          -7.02%
LLhits                   952,481|    718,995         -24.51%
LLiMissRate                    0|          0          -2.67%
RamHitRate                     0|          0          -7.17%
RamHits                  122,391|    101,183         -17.33%
TotalRW              114,801,807|102,237,199         -10.94%

update_executor_gungraun::update_group::update_executor with_setup_5:(setup_update_executor(valley-of-spires))
Instructions: 53,904,263 (master) → 47,788,922 (HEAD) : $$\color{lime}-11.34\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          3         -13.54%
D1mr                     585,485|    416,522         -28.86%
D1mw                     137,168|    136,669          -0.36%
DLmr                       5,302|      4,280         -19.28%
DLmw                      25,720|     27,029          +5.09%
Dr                    13,953,228| 12,229,677         -12.35%
Dw                     9,562,868|  8,591,671         -10.16%
EstimatedCycles       81,303,299| 71,804,998         -11.68%
I1MissRate                     0|          0         -25.70%
I1mr                      13,437|      8,851         -34.13%
ILmr                         264|        243          -7.95%
Ir                    53,904,263| 47,788,922         -11.34%
L1HitRate                     99|         99          +0.13%
L1hits                76,684,269| 68,048,228         -11.26%
LLHitRate                      1|          1         -15.07%
LLMissRate                     0|          0         +13.80%
LLdMissRate                    0|          0         +13.99%
LLhits                   704,804|    530,490         -24.73%
LLiMissRate                    0|          0          +3.82%
RamHitRate                     0|          0         +13.80%
RamHits                   31,286|     31,552          +0.85%
TotalRW               77,420,359| 68,610,270         -11.38%

🚀 Render: Cold Execution

run_once_gungraun::run_once_group::run_once with_setup_0:(setup_run_once(isometric-fountain))
Instructions: 37,305,745 (master) → 25,861,649 (HEAD) : $$\color{lime}-30.68\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          2         -34.55%
D1mr                     448,061|    163,308         -63.55%
D1mw                      80,656|     79,450          -1.50%
DLmr                      35,155|      8,499         -75.82%
DLmw                      15,086|     15,482          +2.62%
Dr                     9,748,898|  6,577,746         -32.53%
Dw                     6,531,600|  4,843,729         -25.84%
EstimatedCycles       58,423,177| 40,186,706         -31.21%
I1MissRate                     1|          1         +44.87%
I1mr                     243,814|    244,855          +0.43%
ILmr                       7,986|      7,790          -2.45%
Ir                    37,305,745| 25,861,649         -30.68%
L1HitRate                     99|         99          +0.14%
L1hits                52,813,712| 36,795,511         -30.33%
LLHitRate                      1|          1          -8.28%
LLMissRate                     0|          0         -21.58%
LLdMissRate                    0|          0         -31.96%
LLhits                   714,304|    455,842         -36.18%
LLiMissRate                    0|          0         +40.71%
RamHitRate                     0|          0         -21.58%
RamHits                   58,227|     31,771         -45.44%
TotalRW               53,586,243| 37,283,124         -30.42%

run_once_gungraun::run_once_group::run_once with_setup_1:(setup_run_once(painted-dreams))
Instructions: 214,373,255 (master) → 203,036,726 (HEAD) : $$\color{lime}-5.29\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     2|          2          -8.80%
D1mr                   1,019,301|    800,371         -21.48%
D1mw                     482,408|    481,729          -0.14%
DLmr                      32,338|      4,346         -86.56%
DLmw                      55,276|     55,053          -0.40%
Dr                    46,234,103| 43,007,846          -6.98%
Dw                    31,378,909| 29,645,662          -5.52%
EstimatedCycles      306,819,915|288,876,724          -5.85%
I1MissRate                     1|          1          +7.08%
I1mr                   1,475,423|  1,496,355          +1.42%
ILmr                       9,890|      9,690          -2.02%
Ir                   214,373,255|203,036,726          -5.29%
L1HitRate                     99|         99          +0.01%
L1hits               289,009,135|272,911,779          -5.57%
LLHitRate                      1|          1          -0.35%
LLMissRate                     0|          0         -24.95%
LLdMissRate                    0|          0         -27.58%
LLhits                 2,879,628|  2,709,366          -5.91%
LLiMissRate                    0|          0          +3.45%
RamHitRate                     0|          0         -24.95%
RamHits                   97,504|     69,089         -29.14%
TotalRW              291,986,267|275,690,234          -5.58%

run_once_gungraun::run_once_group::run_once with_setup_2:(setup_run_once(procedural-string-lights))
Instructions: 19,090,728 (master) → 16,589,041 (HEAD) : $$\color{lime}-13.10\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     2|          2         -18.41%
D1mr                     114,325|     70,208         -38.59%
D1mw                      38,181|     38,233          +0.14%
DLmr                       1,001|        971          -3.00%
DLmw                       1,724|      1,637          -5.05%
Dr                     4,825,976|  4,133,241         -14.35%
Dw                     3,401,218|  3,036,838         -10.71%
EstimatedCycles       28,544,724| 24,845,008         -12.96%
I1MissRate                     0|          1         +30.43%
I1mr                      83,537|     94,676         +13.33%
ILmr                       6,696|      6,506          -2.84%
Ir                    19,090,728| 16,589,041         -13.10%
L1HitRate                     99|         99          +0.01%
L1hits                27,081,879| 23,556,003         -13.02%
LLHitRate                      1|          1          -1.57%
LLMissRate                     0|          0         +11.23%
LLdMissRate                    0|          0          +9.82%
LLhits                   226,622|    194,003         -14.39%
LLiMissRate                    0|          0         +11.81%
RamHitRate                     0|          0         +11.23%
RamHits                    9,421|      9,114          -3.26%
TotalRW               27,317,922| 23,759,120         -13.03%

run_once_gungraun::run_once_group::run_once with_setup_3:(setup_run_once(parametric-dunescape))
Instructions: 24,663,658 (master) → 20,697,159 (HEAD) : $$\color{lime}-16.08\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          2         -27.43%
D1mr                     192,868|     89,252         -53.72%
D1mw                      72,708|     72,088          -0.85%
DLmr                       4,270|      4,214          -1.31%
DLmw                       7,804|      8,547          +9.52%
Dr                     6,159,773|  5,042,040         -18.15%
Dw                     4,438,241|  3,829,743         -13.71%
EstimatedCycles       37,186,176| 31,089,268         -16.40%
I1MissRate                     0|          0         +18.67%
I1mr                      85,800|     85,444          -0.41%
ILmr                       5,226|      5,012          -4.09%
Ir                    24,663,658| 20,697,159         -16.08%
L1HitRate                     99|         99          +0.16%
L1hits                34,910,296| 29,322,158         -16.01%
LLHitRate                      1|          1         -18.25%
LLMissRate                     0|          0         +22.51%
LLdMissRate                    0|          0         +26.25%
LLhits                   334,076|    229,011         -31.45%
LLiMissRate                    0|          0         +14.28%
RamHitRate                     0|          0         +22.51%
RamHits                   17,300|     17,773          +2.73%
TotalRW               35,261,672| 29,568,942         -16.14%

run_once_gungraun::run_once_group::run_once with_setup_4:(setup_run_once(red-dress))
Instructions: 1,920,388,088 (master) → 1,868,992,622 (HEAD) : $$\color{lime}-2.68\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     1|          0         -17.04%
D1mr                   2,952,902|  2,145,152         -27.35%
D1mw                   1,251,182|  1,236,698          -1.16%
DLmr                     630,635|    280,141         -55.58%
DLmw                     698,632|    693,137          -0.79%
Dr                   459,891,219|444,919,896          -3.26%
Dw                   301,605,179|293,507,707          -2.68%
EstimatedCycles      2,745,762,268|2,658,040,639          -3.19%
I1MissRate                     0|          0         +13.44%
I1mr                   1,735,814|  1,916,406         +10.40%
ILmr                       8,006|      7,635          -4.63%
Ir                   1,920,388,088|1,868,992,622          -2.68%
L1HitRate                    100|        100          +0.02%
L1hits               2,675,944,588|2,602,121,969          -2.76%
LLHitRate                      0|          0          -3.52%
LLMissRate                     0|          0         -24.55%
LLdMissRate                    0|          0         -24.49%
LLhits                 4,602,625|  4,317,343          -6.20%
LLiMissRate                    0|          0          -2.01%
RamHitRate                     0|          0         -24.55%
RamHits                1,337,273|    980,913         -26.65%
TotalRW              2,681,884,486|2,607,420,225          -2.78%

run_once_gungraun::run_once_group::run_once with_setup_5:(setup_run_once(valley-of-spires))
Instructions: 34,029,403 (master) → 24,597,839 (HEAD) : $$\color{lime}-27.72\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     3|          2         -33.90%
D1mr                     367,638|    137,647         -62.56%
D1mw                      72,651|     70,132          -3.47%
DLmr                      15,127|      6,391         -57.75%
DLmw                      15,518|     14,265          -8.07%
Dr                     8,748,647|  6,052,046         -30.82%
Dw                     5,883,562|  4,393,820         -25.32%
EstimatedCycles       52,329,010| 37,497,199         -28.34%
I1MissRate                     1|          1         +41.89%
I1mr                     202,878|    208,082          +2.57%
ILmr                       5,846|      5,679          -2.86%
Ir                    34,029,403| 24,597,839         -27.72%
L1HitRate                     99|         99          +0.14%
L1hits                48,018,445| 34,627,844         -27.89%
LLHitRate                      1|          1         -10.84%
LLMissRate                     0|          0          +0.21%
LLdMissRate                    0|          0          -5.58%
LLhits                   606,676|    389,526         -35.79%
LLiMissRate                    0|          0         +34.39%
RamHitRate                     0|          0          +0.21%
RamHits                   36,491|     26,335         -27.83%
TotalRW               48,661,612| 35,043,705         -27.98%

⚡ Render: Cached Execution

run_cached_gungraun::run_cached_group::run_cached with_setup_0:(setup_run_cached(isometric-fountain))
Instructions: 11,682,662 (master) → 172,520 (HEAD) : $$\color{lime}-98.52\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     6|          3         -44.29%
D1mr                     291,107|      4,206         -98.56%
D1mw                       4,246|      2,114         -50.21%
DLmr                      27,114|          3         -99.99%
DLmw                         394|          7         -98.22%
Dr                     3,337,568|    102,721         -96.92%
Dw                     1,847,804|     96,437         -94.78%
EstimatedCycles       18,884,146|    399,666         -97.88%
I1MissRate                     0|          0       +3585.62%
I1mr                         610|        332         -45.57%
ILmr                         234|         36         -84.62%
Ir                    11,682,662|    172,520         -98.52%
L1HitRate                     98|         98          -0.04%
L1hits                16,572,071|    365,026         -97.80%
LLHitRate                      2|          2         +11.77%
LLMissRate                     0|          0         -92.47%
LLdMissRate                    1|          0         -99.05%
LLhits                   268,221|      6,606         -97.54%
LLiMissRate                    0|          0        +941.81%
RamHitRate                     0|          0         -92.47%
RamHits                   27,742|         46         -99.83%
TotalRW               16,868,034|    371,678         -97.80%

run_cached_gungraun::run_cached_group::run_cached with_setup_1:(setup_run_cached(painted-dreams))
Instructions: 11,563,130 (master) → 223,938 (HEAD) : $$\color{lime}-98.06\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|          3         -42.81%
D1mr                     228,645|      4,810         -97.90%
D1mw                       4,430|      2,620         -40.86%
DLmr                      27,341|         33         -99.88%
DLmw                         204|         17         -91.67%
Dr                     3,370,303|    150,163         -95.54%
Dw                     1,863,600|    141,568         -92.40%
EstimatedCycles       18,567,741|    551,913         -97.03%
I1MissRate                     0|          0       +2673.17%
I1mr                         607|        326         -46.29%
ILmr                         321|        124         -61.37%
Ir                    11,563,130|    223,938         -98.06%
L1HitRate                     99|         98          -0.11%
L1hits                16,563,351|    507,913         -96.93%
LLHitRate                      1|          1         +20.00%
LLMissRate                     0|          0         -79.66%
LLdMissRate                    1|          0         -96.74%
LLhits                   205,816|      7,582         -96.32%
LLiMissRate                    0|          0       +1894.64%
RamHitRate                     0|          0         -79.66%
RamHits                   27,866|        174         -99.38%
TotalRW               16,797,033|    515,669         -96.93%

run_cached_gungraun::run_cached_group::run_cached with_setup_2:(setup_run_cached(parametric-dunescape))
Instructions: 4,109,828 (master) → 130,983 (HEAD) : $$\color{lime}-96.81\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     6|          2         -64.55%
D1mr                     106,176|      2,272         -97.86%
D1mw                       2,828|      1,973         -30.23%
DLmr                          67|          3         -95.52%
DLmw                           1|          5        +400.00%
Dr                     1,230,463|    108,027         -91.22%
Dw                       717,251|    105,919         -85.23%
EstimatedCycles        6,504,158|    364,337         -94.40%
I1MissRate                     0|          0       +1771.50%
I1mr                         565|        337         -40.35%
ILmr                         210|         28         -86.67%
Ir                     4,109,828|    130,983         -96.81%
L1HitRate                     98|         99          +0.49%
L1hits                 5,947,973|    340,347         -94.28%
LLHitRate                      2|          1         -26.95%
LLMissRate                     0|          0        +127.42%
LLdMissRate                    0|          0          +7.10%
LLhits                   109,291|      4,546         -95.84%
LLiMissRate                    0|          0        +318.36%
RamHitRate                     0|          0        +127.42%
RamHits                      278|         36         -87.05%
TotalRW                6,057,542|    344,929         -94.31%

run_cached_gungraun::run_cached_group::run_cached with_setup_3:(setup_run_cached(red-dress))
Instructions: 51,564,781 (master) → 493,926 (HEAD) : $$\color{lime}-99.04\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     4|         34        +760.12%
D1mr                     866,687|     55,408         -93.61%
D1mw                      34,579|     27,183         -21.39%
DLmr                     339,739|        182         -99.95%
DLmw                       3,302|      1,552         -53.00%
Dr                    14,869,389|    131,855         -99.11%
Dw                     7,980,374|    111,592         -98.60%
EstimatedCycles       88,327,222|  1,127,905         -98.72%
I1MissRate                     0|          0       +5878.65%
I1mr                         571|        327         -42.73%
ILmr                         470|        228         -51.49%
Ir                    51,564,781|    493,926         -99.04%
L1HitRate                     99|         89         -10.16%
L1hits                73,512,707|    654,455         -99.11%
LLHitRate                      1|         11       +1363.29%
LLMissRate                     0|          0         -42.36%
LLdMissRate                    2|          1         -52.56%
LLhits                   558,326|     80,956         -85.50%
LLiMissRate                    0|          0       +4964.40%
RamHitRate                     0|          0         -42.36%
RamHits                  343,511|      1,962         -99.43%
TotalRW               74,414,544|    737,373         -99.01%

run_cached_gungraun::run_cached_group::run_cached with_setup_4:(setup_run_cached(valley-of-spires))
Instructions: 9,551,566 (master) → 168,283 (HEAD) : $$\color{lime}-98.24\%$$

Detailed metrics
Baselines:                master|       HEAD
D1MissRate                     6|          3         -41.42%
D1mr                     232,075|      4,183         -98.20%
D1mw                       3,831|      2,064         -46.12%
DLmr                       8,059|          3         -99.96%
DLmw                         139|        464        +233.81%
Dr                     2,739,767|     99,519         -96.37%
Dw                     1,524,167|     93,233         -93.88%
EstimatedCycles       15,013,820|    402,449         -97.32%
I1MissRate                     0|          0       +3146.15%
I1mr                         584|        334         -42.81%
ILmr                         214|         36         -83.18%
Ir                     9,551,566|    168,283         -98.24%
L1HitRate                     98|         98          -0.11%
L1hits                13,579,010|    354,454         -97.39%
LLHitRate                      2|          2          +1.98%
LLMissRate                     0|          0        +128.82%
LLdMissRate                    0|          0         +26.01%
LLhits                   228,078|      6,078         -97.34%
LLiMissRate                    0|          0        +854.82%
RamHitRate                     0|          0        +128.82%
RamHits                    8,412|        503         -94.02%
TotalRW               13,815,500|    361,035         -97.39%

@Keavon Keavon force-pushed the benches-exclude-teardown branch from a94fec3 to 289e16b Compare July 15, 2026 12:29
@Keavon Keavon merged commit e40fe78 into master Jul 15, 2026
3 checks passed
@Keavon Keavon deleted the benches-exclude-teardown branch July 15, 2026 12:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant