benchmark · startup performance · subscribe to the feed
ovm benchmark
Startup latency plotted by release date, so every product sits on one timeline — point density shows shipping cadence, height shows speed. Series are measured per platform on a consistent runner. Lower is faster.
startup time · release timeline
Claude Code · avg startup claude-opus-5
800 ms
261 versions · spawn 93 ms · response 2821 ms · MCP +23 ms · 46.2 MB
Codex · avg startup
542 ms
115 versions · spawn 8 ms · response 5461 ms · MCP -151 ms · fast -488 ms
coverage floors
- codex coverage starts at v0.37.0 — the floor is physical, not a sampling choice: macOS loses older builds to Apple certificate revocations, and arm64 Linux binaries simply do not exist below the Linux floor. See the per-platform tabs for each lane's own floor.
- claude response probes currently reach down to 2.0.24 — earlier versions carry launch metrics only while the response backfill works toward the launch floor.
detail · Claude Code
| version | spawn (--version) | interactive startup | response | response (no mcp) | mcp overhead | result |
|---|---|---|---|---|---|---|
| 2.1.251 claude-opus-5 |
6 ms | 756 ms | 2,969 ms | 2,937 ms | +32 ms | ready |
| 2.1.250† claude-opus-5 |
6 ms | 772 ms | 2,924 ms | 3,174 ms | -250 ms | ready |
| 2.1.248† claude-sonnet-5 |
11 ms | 758 ms | 2,751 ms | 2,598 ms | +153 ms | ready |
| 2.1.247† claude-opus-5 |
6 ms | 766 ms | 3,022 ms | 3,085 ms | -63 ms | ready |
| 2.1.246† claude-sonnet-5 |
6 ms | 768 ms | 3,010 ms | 2,944 ms | +66 ms | ready |
| 2.1.245† claude-sonnet-5 |
9 ms | 807 ms | 3,143 ms | 3,072 ms | +71 ms | ready |
| 2.1.243† claude-sonnet-5 |
14 ms | 823 ms | 2,885 ms | 3,008 ms | -123 ms | ready |
| 2.1.241 claude-sonnet-5 |
50 ms | 848 ms | 3,070 ms | 3,731 ms | -661 ms | ready |
| 2.1.240 claude-sonnet-5 |
56 ms | 874 ms | 3,612 ms | 2,889 ms | +723 ms | ready |
| 2.1.239 claude-sonnet-5 |
66 ms | 879 ms | 3,125 ms | 3,173 ms | -48 ms | ready |
| 2.1.238† claude-opus-5 |
55 ms | 838 ms | 3,388 ms | 3,490 ms | -102 ms | ready |
| 2.1.237 claude-sonnet-5 |
52 ms | 818 ms | 3,060 ms | 2,912 ms | +148 ms | ready |
| 2.1.236† claude-sonnet-5 |
52 ms | 821 ms | 3,061 ms | 2,937 ms | +124 ms | ready |
| 2.1.235 claude-opus-5 |
48 ms | 777 ms | 4,326 ms | 4,259 ms | +67 ms | ready |
| 2.1.234 claude-opus-5 |
49 ms | 788 ms | 3,096 ms | 3,636 ms | -540 ms | ready |
| 2.1.233† claude-sonnet-5 |
46 ms | 758 ms | 2,762 ms | 2,929 ms | -167 ms | ready |
| 2.1.232 claude-sonnet-5 |
48 ms | 783 ms | 3,012 ms | 2,773 ms | +239 ms | ready |
| 2.1.231 claude-sonnet-5 |
46 ms | 761 ms | 3,707 ms | 3,272 ms | +435 ms | ready |
| 2.1.229† claude-sonnet-5 |
46 ms | 763 ms | 2,998 ms | 2,905 ms | +93 ms | ready |
| 2.1.228 claude-sonnet-5 |
42 ms | 757 ms | 2,967 ms | 3,755 ms | -788 ms | ready |
| 2.1.227 claude-sonnet-5 |
45 ms | 777 ms | 3,510 ms | 2,823 ms | +687 ms | ready |
| 2.1.226 claude-sonnet-5 |
45 ms | 798 ms | 4,010 ms | 2,798 ms | +1,212 ms | ready |
| 2.1.225† claude-sonnet-5 |
44 ms | 784 ms | 2,993 ms | 2,756 ms | +237 ms | ready |
| 2.1.224† claude-sonnet-5 |
41 ms | 784 ms | 2,934 ms | 2,890 ms | +44 ms | ready |
| 2.1.222† claude-sonnet-5 |
41 ms | 776 ms | 3,216 ms | 2,877 ms | +339 ms | ready |
| 2.1.221 claude-sonnet-5 |
40 ms | 786 ms | 3,379 ms | 3,794 ms | -415 ms | ready |
| 2.1.220 claude-sonnet-5 |
37 ms | 767 ms | 3,577 ms | 2,831 ms | +746 ms | ready |
| 2.1.219 claude-sonnet-5 |
39 ms | 769 ms | 2,990 ms | 2,776 ms | +214 ms | ready |
| 2.1.218 claude-sonnet-5 |
37 ms | 767 ms | 3,150 ms | 3,083 ms | +67 ms | ready |
| 2.1.217 claude-sonnet-5 |
37 ms | 770 ms | 3,243 ms | 2,754 ms | +489 ms | ready |
| 2.1.216 claude-sonnet-5 |
40 ms | 802 ms | 2,894 ms | 3,122 ms | -228 ms | ready |
| 2.1.215 claude-opus-4-8 |
35 ms | 748 ms | 3,201 ms | 2,796 ms | +405 ms | ready |
| 2.1.214 claude-opus-4-8 |
34 ms | 768 ms | 2,801 ms | 2,697 ms | +104 ms | ready |
| 2.1.213 claude-opus-4-8 |
34 ms | 769 ms | 2,805 ms | 3,252 ms | -447 ms | ready |
| 2.1.212 claude-opus-4-8 |
38 ms | 752 ms | 3,481 ms | 3,767 ms | -286 ms | ready |
| 2.1.211 claude-opus-4-8 |
35 ms | 758 ms | 3,138 ms | 2,739 ms | +399 ms | ready |
| 2.1.210 claude-opus-4-8 |
35 ms | 767 ms | 3,723 ms | 5,123 ms | -1,400 ms | ready |
| 2.1.209 claude-opus-4-8 |
34 ms | 742 ms | 2,972 ms | 2,881 ms | +91 ms | ready |
| 2.1.208 claude-opus-4-8 |
34 ms | 745 ms | 3,856 ms | 2,659 ms | +1,197 ms | ready |
| 2.1.207 claude-opus-4-8 |
34 ms | 736 ms | 2,674 ms | 4,408 ms | -1,734 ms | ready |
| 2.1.206 claude-opus-4-8 |
34 ms | 734 ms | 3,325 ms | 3,206 ms | +119 ms | ready |
| 2.1.205 claude-opus-4-8 |
34 ms | 737 ms | 3,341 ms | 3,105 ms | +236 ms | ready |
| 2.1.204 claude-opus-4-8 |
34 ms | 742 ms | 2,866 ms | 4,996 ms | -2,130 ms | ready |
| 2.1.203 claude-opus-4-8 |
33 ms | 737 ms | 3,563 ms | 2,957 ms | +606 ms | ready |
| 2.1.202 claude-opus-4-8 |
35 ms | 735 ms | 2,683 ms | 3,179 ms | -496 ms | ready |
| 2.1.201 claude-opus-4-8 |
33 ms | 732 ms | 2,812 ms | 3,088 ms | -276 ms | ready |
| 2.1.200 claude-opus-4-8 |
33 ms | 731 ms | 4,402 ms | 2,580 ms | +1,822 ms | ready |
| 2.1.199 claude-opus-4-8 |
37 ms | 736 ms | 3,250 ms | 3,175 ms | +75 ms | ready |
| 2.1.198 claude-opus-4-8 |
35 ms | 724 ms | 2,718 ms | 6,084 ms | -3,366 ms | ready |
| 2.1.197 claude-opus-4-8 |
33 ms | 715 ms | 2,694 ms | 3,008 ms | -314 ms | ready |
| 2.1.196 claude-opus-4-8 |
33 ms | 720 ms | 2,609 ms | 2,708 ms | -99 ms | ready |
| 2.1.195 claude-opus-4-8 |
32 ms | 713 ms | 3,077 ms | 2,889 ms | +188 ms | ready |
| 2.1.193 claude-opus-4-8 |
31 ms | 706 ms | 2,615 ms | 2,862 ms | -247 ms | ready |
| 2.1.191 claude-opus-4-8 |
31 ms | 709 ms | 4,017 ms | 2,564 ms | +1,453 ms | ready |
| 2.1.190 claude-opus-4-8 |
31 ms | 705 ms | 2,498 ms | 4,025 ms | -1,527 ms | ready |
| 2.1.187 claude-opus-4-8 |
31 ms | 698 ms | 2,525 ms | 2,730 ms | -205 ms | ready |
| 2.1.186 claude-opus-4-8 |
31 ms | 696 ms | 2,970 ms | 3,309 ms | -339 ms | ready |
| 2.1.185 claude-opus-4-8 |
32 ms | 702 ms | 2,916 ms | 2,618 ms | +298 ms | ready |
| 2.1.183 claude-opus-4-8 |
33 ms | 702 ms | 2,682 ms | 3,259 ms | -577 ms | ready |
| 2.1.182 claude-opus-4-8 |
32 ms | 702 ms | 2,756 ms | 2,753 ms | +3 ms | ready |
| 2.1.181 claude-opus-4-8 |
31 ms | 699 ms | 2,494 ms | 2,925 ms | -431 ms | ready |
| 2.1.179 claude-opus-4-8 |
37 ms | 710 ms | 5,507 ms | 2,504 ms | +3,003 ms | ready |
| 2.1.178 claude-opus-4-8 |
37 ms | 721 ms | 2,890 ms | 2,547 ms | +343 ms | ready |
| 2.1.177 claude-opus-4-8 |
37 ms | 708 ms | 3,141 ms | 2,432 ms | +709 ms | ready |
| 2.1.176 claude-opus-4-8 |
37 ms | 709 ms | 2,571 ms | 2,572 ms | -1 ms | ready |
| 2.1.175 claude-opus-4-8 |
37 ms | 707 ms | 4,016 ms | 2,673 ms | +1,343 ms | ready |
| 2.1.174 claude-opus-4-8 |
38 ms | 711 ms | 2,838 ms | 3,502 ms | -664 ms | ready |
| 2.1.173 claude-opus-4-8 |
36 ms | 718 ms | 3,020 ms | 2,659 ms | +361 ms | ready |
| 2.1.172 claude-opus-4-8 |
36 ms | 712 ms | 2,795 ms | 3,001 ms | -206 ms | ready |
| 2.1.170 claude-opus-4-8 |
36 ms | 709 ms | 2,979 ms | 2,718 ms | +261 ms | ready |
| 2.1.169 claude-opus-4-8 |
36 ms | 703 ms | 2,802 ms | 4,054 ms | -1,252 ms | ready |
| 2.1.168 claude-opus-4-8 |
36 ms | 707 ms | 2,804 ms | 2,803 ms | +1 ms | ready |
| 2.1.167 claude-opus-4-8 |
37 ms | 704 ms | 3,416 ms | 2,281 ms | +1,135 ms | ready |
| 2.1.166 claude-opus-4-8 |
37 ms | 707 ms | 2,763 ms | 2,623 ms | +140 ms | ready |
| 2.1.165 claude-opus-4-8 |
36 ms | 705 ms | 2,497 ms | 2,941 ms | -444 ms | ready |
| 2.1.163 claude-opus-4-8 |
35 ms | 710 ms | 2,324 ms | 3,418 ms | -1,094 ms | ready |
| 2.1.162 claude-opus-4-8 |
36 ms | 705 ms | 2,331 ms | 3,710 ms | -1,379 ms | ready |
| 2.1.161 claude-opus-4-8 |
35 ms | 705 ms | 3,600 ms | 2,667 ms | +933 ms | ready |
| 2.1.160 claude-opus-4-8 |
35 ms | 711 ms | 2,567 ms | 2,579 ms | -12 ms | ready |
| 2.1.159 claude-opus-4-8 |
35 ms | 710 ms | 2,836 ms | 3,132 ms | -296 ms | ready |
| 2.1.158 claude-opus-4-8 |
35 ms | 700 ms | 2,399 ms | 2,807 ms | -408 ms | ready |
| 2.1.157 claude-opus-4-8 |
35 ms | 706 ms | 2,451 ms | 2,403 ms | +48 ms | ready |
| 2.1.156 claude-opus-4-8 |
35 ms | 704 ms | 3,142 ms | 2,543 ms | +599 ms | ready |
| 2.1.154 claude-opus-4-8 |
35 ms | 709 ms | 2,452 ms | 2,797 ms | -345 ms | ready |
| 2.1.153 claude-opus-4-7 |
34 ms | 700 ms | 2,616 ms | 2,872 ms | -256 ms | ready |
| 2.1.152 claude-opus-4-7 |
34 ms | 702 ms | 4,715 ms | 2,100 ms | +2,615 ms | ready |
| 2.1.150 claude-opus-4-7 |
34 ms | 704 ms | 2,785 ms | 4,191 ms | -1,406 ms | ready |
| 2.1.149 claude-opus-4-7 |
34 ms | 704 ms | 3,431 ms | 4,689 ms | -1,258 ms | ready |
| 2.1.148 claude-opus-4-7 |
34 ms | 707 ms | 2,655 ms | 2,633 ms | +22 ms | ready |
| 2.1.147 claude-opus-4-7 |
34 ms | 707 ms | 2,352 ms | 3,371 ms | -1,019 ms | ready |
| 2.1.146 claude-opus-4-7 |
34 ms | 704 ms | 2,695 ms | 2,886 ms | -191 ms | ready |
| 2.1.145 claude-opus-4-7 |
33 ms | 701 ms | 2,220 ms | 2,436 ms | -216 ms | ready |
| 2.1.144 claude-opus-4-7 |
33 ms | 700 ms | 2,237 ms | 2,438 ms | -201 ms | ready |
| 2.1.143 claude-opus-4-7 |
33 ms | 700 ms | 2,726 ms | 2,314 ms | +412 ms | ready |
| 2.1.142 claude-opus-4-7 |
35 ms | 698 ms | 3,706 ms | 3,299 ms | +407 ms | ready |
| 2.1.141 claude-opus-4-7 |
32 ms | 703 ms | 2,303 ms | 2,899 ms | -596 ms | ready |
| 2.1.140 claude-opus-4-7 |
32 ms | 703 ms | 2,617 ms | 2,437 ms | +180 ms | ready |
| 2.1.139 claude-opus-4-7 |
32 ms | 696 ms | 3,096 ms | 2,600 ms | +496 ms | ready |
| 2.1.138 claude-opus-4-7 |
32 ms | 703 ms | 3,143 ms | 2,581 ms | +562 ms | ready |
| 2.1.137 claude-opus-4-7 |
32 ms | 697 ms | 2,688 ms | 2,155 ms | +533 ms | ready |
| 2.1.136 claude-opus-4-7 |
31 ms | 697 ms | 2,800 ms | 2,473 ms | +327 ms | ready |
| 2.1.133 claude-opus-4-7 |
31 ms | 695 ms | 2,347 ms | 5,695 ms | -3,348 ms | ready |
| 2.1.132 claude-opus-4-7 |
35 ms | 708 ms | 4,192 ms | 6,075 ms | -1,883 ms | ready |
| 2.1.131 claude-opus-4-7 |
34 ms | 699 ms | 3,375 ms | 2,008 ms | +1,367 ms | ready |
| 2.1.129 claude-opus-4-7 |
34 ms | 694 ms | 2,563 ms | 3,203 ms | -640 ms | ready |
| 2.1.128 claude-opus-4-7 |
35 ms | 712 ms | 4,461 ms | 3,583 ms | +878 ms | ready |
| 2.1.126 claude-opus-4-7 |
36 ms | 713 ms | 3,101 ms | 4,183 ms | -1,082 ms | ready |
| 2.1.124 claude-opus-4-7 |
35 ms | 692 ms | 2,243 ms | 3,214 ms | -971 ms | ready |
| 2.1.123 claude-opus-4-7 |
35 ms | 709 ms | 2,385 ms | 2,596 ms | -211 ms | ready |
| 2.1.122 claude-opus-4-7 |
34 ms | 709 ms | 2,162 ms | 2,640 ms | -478 ms | ready |
| 2.1.121 claude-opus-4-7 |
35 ms | 707 ms | 2,813 ms | 2,275 ms | +538 ms | ready |
| 2.1.120 claude-opus-4-7 |
35 ms | 710 ms | 2,924 ms | 2,120 ms | +804 ms | ready |
| 2.1.119 claude-opus-4-7 |
34 ms | 708 ms | 2,359 ms | 2,641 ms | -282 ms | ready |
| 2.1.118 claude-opus-4-7 |
33 ms | 700 ms | 2,309 ms | 2,444 ms | -135 ms | ready |
| 2.1.117 claude-opus-4-7 |
33 ms | 694 ms | 2,168 ms | 3,079 ms | -911 ms | ready |
| 2.1.116 claude-opus-4-7 |
32 ms | 701 ms | 2,439 ms | 2,735 ms | -296 ms | ready |
| 2.1.114 claude-opus-4-7 |
32 ms | 699 ms | 2,720 ms | 3,153 ms | -433 ms | ready |
| 2.1.113 claude-opus-4-7 |
32 ms | 688 ms | 3,515 ms | 2,687 ms | +828 ms | ready |
| 2.1.112 claude-opus-4-7 |
33 ms | 701 ms | 2,267 ms | 4,209 ms | -1,942 ms | ready |
| 2.1.111 claude-opus-4-7 |
35 ms | 686 ms | 2,849 ms | 2,462 ms | +387 ms | ready |
| 2.1.110 claude-opus-4-6 |
32 ms | 684 ms | 3,106 ms | 3,460 ms | -354 ms | ready |
| 2.1.109 claude-opus-4-6 |
32 ms | 680 ms | 3,372 ms | 3,978 ms | -606 ms | ready |
| 2.1.108 claude-opus-4-6 |
33 ms | 685 ms | 3,142 ms | 3,533 ms | -391 ms | ready |
| 2.1.107 claude-opus-4-6 |
33 ms | 684 ms | 7,160 ms | 3,918 ms | +3,242 ms | ready |
| 2.1.105 claude-opus-4-6 |
32 ms | 677 ms | 3,413 ms | 3,446 ms | -33 ms | ready |
| 2.1.104 claude-opus-4-6 |
32 ms | 686 ms | 3,992 ms | 3,544 ms | +448 ms | ready |
| 2.1.101 claude-opus-4-6 |
32 ms | 693 ms | 3,869 ms | 4,557 ms | -688 ms | ready |
| 2.1.100 claude-opus-4-6 |
33 ms | 683 ms | 3,710 ms | 3,729 ms | -19 ms | ready |
| 2.1.98 claude-opus-4-6 |
32 ms | 680 ms | 3,487 ms | 3,521 ms | -34 ms | ready |
| 2.1.97 claude-opus-4-6 |
32 ms | 691 ms | 3,767 ms | 3,677 ms | +90 ms | ready |
| 2.1.96 claude-opus-4-6 |
33 ms | 684 ms | 3,707 ms | 3,811 ms | -104 ms | ready |
| 2.1.94 claude-opus-4-6 |
33 ms | 691 ms | 3,448 ms | 3,387 ms | +61 ms | ready |
| 2.1.92 claude-opus-4-6 |
31 ms | 682 ms | 3,634 ms | 3,432 ms | +202 ms | ready |
| 2.1.91† claude-opus-4-6 |
31 ms | 764 ms | 3,147 ms | 3,166 ms | -19 ms | ready |
| 2.1.90† claude-opus-4-6 |
30 ms | 690 ms | 3,202 ms | 3,247 ms | -45 ms | ready |
| 2.1.89 claude-opus-4-6 |
30 ms | 693 ms | 5,795 ms | 3,499 ms | +2,296 ms | ready |
| 2.1.87 claude-opus-4-6 |
30 ms | 678 ms | 3,677 ms | 3,263 ms | +414 ms | ready |
| 2.1.86 claude-opus-4-6 |
30 ms | 674 ms | 4,101 ms | 3,506 ms | +595 ms | ready |
| 2.1.85 claude-opus-4-6 |
30 ms | 673 ms | 3,537 ms | 3,147 ms | +390 ms | ready |
| 2.1.84† claude-opus-4-6 |
30 ms | 677 ms | 3,232 ms | 3,501 ms | -269 ms | ready |
| 2.1.83 claude-opus-4-6 |
29 ms | 699 ms | 3,107 ms | 3,077 ms | +30 ms | ready |
| 2.1.81† claude-opus-4-6 |
29 ms | 680 ms | 2,913 ms | 3,310 ms | -397 ms | ready |
| 2.1.80 claude-opus-4-6 |
30 ms | 678 ms | 2,925 ms | 3,004 ms | -79 ms | ready |
| 2.1.79 claude-opus-4-6 |
31 ms | 674 ms | 3,272 ms | 3,662 ms | -390 ms | ready |
| 2.1.78† claude-opus-4-6 |
29 ms | 679 ms | 3,019 ms | 4,432 ms | -1,413 ms | ready |
| 2.1.77† claude-opus-4-6 |
29 ms | 657 ms | 2,890 ms | 3,812 ms | -922 ms | ready |
| 2.1.76† claude-opus-4-6 |
30 ms | 663 ms | 2,794 ms | 2,647 ms | +147 ms | ready |
| 2.1.75 claude-opus-4-6 |
28 ms | 672 ms | 3,149 ms | 3,843 ms | -694 ms | ready |
| 2.1.74 claude-opus-4-6 |
29 ms | 667 ms | 3,208 ms | 4,204 ms | -996 ms | ready |
| 2.1.73 claude-opus-4-6 |
29 ms | 662 ms | 2,924 ms | 2,991 ms | -67 ms | ready |
| 2.1.72 claude-opus-4-6 |
31 ms | 665 ms | 4,154 ms | 3,237 ms | +917 ms | ready |
| 2.1.71† claude-opus-4-6 |
28 ms | 669 ms | 3,468 ms | 2,924 ms | +544 ms | ready |
| 2.1.70 claude-opus-4-6 |
31 ms | 833 ms | 3,257 ms | 3,675 ms | -418 ms | ready |
| 2.1.69† claude-opus-4-6 |
29 ms | 679 ms | 2,958 ms | 4,512 ms | -1,554 ms | ready |
| 2.1.68 claude-opus-4-6 |
28 ms | 686 ms | 4,715 ms | 3,667 ms | +1,048 ms | ready |
| 2.1.66 claude-opus-4-6 |
29 ms | 681 ms | 4,203 ms | 3,955 ms | +248 ms | ready |
| 2.1.64† claude-opus-4-6 |
28 ms | 676 ms | 3,871 ms | 3,913 ms | -42 ms | ready |
| 2.1.63† claude-opus-4-6 |
27 ms | 696 ms | 6,432 ms | 3,744 ms | +2,688 ms | ready |
| 2.1.62 claude-opus-4-6 |
28 ms | 683 ms | 5,332 ms | 4,436 ms | +896 ms | ready |
| 2.1.61† claude-opus-4-6 |
28 ms | 698 ms | 6,187 ms | 5,015 ms | +1,172 ms | ready |
| 2.1.59† claude-opus-4-6 |
26 ms | 681 ms | 4,202 ms | 4,059 ms | +143 ms | ready |
| 2.1.58 claude-opus-4-6 |
27 ms | 679 ms | 4,524 ms | 4,762 ms | -238 ms | ready |
| 2.1.56† claude-opus-4-6 |
30 ms | 680 ms | 4,233 ms | 4,141 ms | +92 ms | ready |
| 2.1.55 claude-opus-4-6 |
27 ms | 678 ms | 4,124 ms | 4,977 ms | -853 ms | ready |
| 2.1.54† claude-opus-4-6 |
27 ms | 696 ms | 3,918 ms | 4,019 ms | -101 ms | ready |
| 2.1.53 claude-opus-4-6 |
29 ms | 685 ms | 4,390 ms | 5,170 ms | -780 ms | ready |
| 2.1.52 claude-opus-4-6 |
37 ms | 692 ms | 7,804 ms | 4,580 ms | +3,224 ms | ready |
| 2.1.51† | 40 ms | 717 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.50 claude-opus-4-6 |
37 ms | 688 ms | 5,534 ms | 5,232 ms | +302 ms | ready |
| 2.1.49 claude-opus-4-6 |
37 ms | 722 ms | 7,309 ms | 5,753 ms | +1,556 ms | ready |
| 2.1.48† claude-opus-4-6 |
37 ms | 698 ms | 4,370 ms | 5,128 ms | -758 ms | ready |
| 2.1.47 claude-opus-4-6 |
37 ms | 711 ms | 5,243 ms | 5,027 ms | +216 ms | ready |
| 2.1.45 claude-opus-4-6 |
36 ms | 705 ms | 7,359 ms | 4,170 ms | +3,189 ms | ready |
| 2.1.44† claude-opus-4-6 |
36 ms | 714 ms | 3,894 ms | 4,983 ms | -1,089 ms | ready |
| 2.1.42 claude-opus-4-6 |
36 ms | 706 ms | 3,965 ms | 5,591 ms | -1,626 ms | ready |
| 2.1.41† claude-opus-4-6 |
37 ms | 721 ms | 5,110 ms | 4,335 ms | +775 ms | ready |
| 2.1.40 claude-opus-4-6 |
36 ms | 708 ms | 4,112 ms | 4,733 ms | -621 ms | ready |
| 2.1.39 claude-opus-4-6 |
36 ms | 671 ms | 4,144 ms | 5,285 ms | -1,141 ms | ready |
| 2.1.38† claude-opus-4-6 |
36 ms | 671 ms | 5,808 ms | 4,105 ms | +1,703 ms | ready |
| 2.1.37 claude-opus-4-6 |
35 ms | 682 ms | 1,093 ms | 1,086 ms | +7 ms | ready |
| 2.1.36† claude-opus-4-6 |
36 ms | 692 ms | 1,119 ms | 1,089 ms | +30 ms | ready |
| 2.1.34 claude-opus-4-6 |
36 ms | 692 ms | 1,099 ms | 1,281 ms | -182 ms | ready |
| 2.1.33 claude-opus-4-6 |
37 ms | 692 ms | 1,101 ms | 1,101 ms | +0 ms | ready |
| 2.1.32† claude-opus-4-6 |
153 ms | 710 ms | 1,107 ms | 1,099 ms | +8 ms | ready |
| 2.1.31† claude-opus-4-5-20251101 |
154 ms | 718 ms | 1,116 ms | 1,113 ms | +3 ms | ready |
| 2.1.30† claude-opus-4-5-20251101 |
151 ms | 707 ms | 1,108 ms | 1,099 ms | +9 ms | ready |
| 2.1.29† claude-opus-4-5-20251101 |
151 ms | 705 ms | 1,128 ms | 1,148 ms | -20 ms | ready |
| 2.1.27 claude-opus-4-5-20251101 |
149 ms | 705 ms | 1,153 ms | 1,140 ms | +13 ms | ready |
| 2.1.25† | 1,183 ms | 698 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.23† | 1,185 ms | 707 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.22 claude-opus-4-5-20251101 |
1,183 ms | 704 ms | 3,739 ms | 1,142 ms | +2,597 ms | ready |
| 2.1.21† claude-opus-4-5-20251101 |
1,192 ms | 704 ms | 1,154 ms | 1,155 ms | -1 ms | ready |
| 2.1.20† | 1,185 ms | 708 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.19† claude-opus-4-5-20251101 |
141 ms | 702 ms | 1,138 ms | 1,154 ms | -16 ms | ready |
| 2.1.18† claude-opus-4-5-20251101 |
141 ms | 705 ms | 1,141 ms | 1,148 ms | -7 ms | ready |
| 2.1.17† claude-opus-4-5-20251101 |
139 ms | 703 ms | 1,155 ms | 1,123 ms | +32 ms | ready |
| 2.1.16† claude-opus-4-5-20251101 |
143 ms | 710 ms | 1,141 ms | 1,153 ms | -12 ms | ready |
| 2.1.15 claude-opus-4-5-20251101 |
142 ms | 816 ms | 3,484 ms | 1,214 ms | +2,270 ms | ready |
| 2.1.14 claude-opus-4-5-20251101 |
139 ms | 993 ms | 1,502 ms | 1,402 ms | +100 ms | ready |
| 2.1.12† claude-opus-4-5-20251101 |
140 ms | 1,351 ms | 1,798 ms | 1,799 ms | -1 ms | ready |
| 2.1.11† claude-opus-4-5-20251101 |
140 ms | 1,358 ms | 1,797 ms | 1,767 ms | +30 ms | ready |
| 2.1.10 claude-opus-4-5-20251101 |
139 ms | 1,390 ms | 1,809 ms | 1,823 ms | -14 ms | ready |
| 2.1.9† claude-opus-4-5-20251101 |
139 ms | 1,203 ms | 1,658 ms | 1,913 ms | -255 ms | ready |
| 2.1.8† | 140 ms | 1,075 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.7† claude-opus-4-5-20251101 |
139 ms | 1,252 ms | 1,577 ms | 1,815 ms | -238 ms | ready |
| 2.1.6 claude-opus-4-5-20251101 |
143 ms | 1,110 ms | 1,797 ms | 1,734 ms | +63 ms | ready |
| 2.1.5† claude-opus-4-5-20251101 |
140 ms | 1,081 ms | 1,665 ms | 1,941 ms | -276 ms | ready |
| 2.1.4 claude-opus-4-5-20251101 |
141 ms | 1,099 ms | 1,644 ms | 1,712 ms | -68 ms | ready |
| 2.1.3† claude-opus-4-5-20251101 |
141 ms | 1,151 ms | 1,814 ms | 1,857 ms | -43 ms | ready |
| 2.1.2 claude-opus-4-5-20251101 |
142 ms | 1,417 ms | 1,966 ms | 1,867 ms | +99 ms | ready |
| 2.1.1† claude-opus-4-5-20251101 |
140 ms | 1,331 ms | 1,838 ms | 2,042 ms | -204 ms | ready |
| 2.1.0 claude-opus-4-5-20251101 |
140 ms | 1,279 ms | 1,832 ms | 1,763 ms | +69 ms | ready |
| 2.0.77 claude-opus-4-5-20251101 |
140 ms | 1,149 ms | 1,682 ms | 1,803 ms | -121 ms | ready |
| 2.0.76† claude-opus-4-5-20251101 |
147 ms | 1,229 ms | 1,632 ms | 1,637 ms | -5 ms | ready |
| 2.0.75† claude-opus-4-5-20251101 |
340 ms | 1,224 ms | 1,963 ms | 1,616 ms | +347 ms | ready |
| 2.0.74† claude-opus-4-5-20251101 |
401 ms | 1,516 ms | 1,567 ms | 1,570 ms | -3 ms | ready |
| 2.0.73 claude-opus-4-5-20251101 |
147 ms | 1,417 ms | 1,538 ms | 1,599 ms | -61 ms | ready |
| 2.0.72 claude-opus-4-5-20251101 |
147 ms | 1,311 ms | 1,538 ms | 1,679 ms | -141 ms | ready |
| 2.0.71 claude-opus-4-5-20251101 |
146 ms | 1,154 ms | 1,490 ms | 1,447 ms | +43 ms | ready |
| 2.0.70 claude-opus-4-5-20251101 |
128 ms | 1,119 ms | 1,711 ms | 1,766 ms | -55 ms | ready |
| 2.0.69† claude-opus-4-5-20251101 |
128 ms | 970 ms | 1,275 ms | 1,286 ms | -11 ms | ready |
| 2.0.68† claude-opus-4-5-20251101 |
127 ms | 973 ms | 1,755 ms | 1,295 ms | +460 ms | ready |
| 2.0.67† claude-opus-4-5-20251101 |
128 ms | 985 ms | 1,544 ms | 1,294 ms | +250 ms | ready |
| 2.0.66 claude-opus-4-5-20251101 |
128 ms | 957 ms | 1,285 ms | 1,728 ms | -443 ms | ready |
| 2.0.65 claude-opus-4-5-20251101 |
127 ms | 955 ms | 1,275 ms | 1,295 ms | -20 ms | ready |
| 2.0.64 claude-opus-4-5-20251101 |
127 ms | 953 ms | 1,275 ms | 1,263 ms | +12 ms | ready |
| 2.0.62 claude-opus-4-5-20251101 |
132 ms | 951 ms | 1,281 ms | 1,274 ms | +7 ms | ready |
| 2.0.61 claude-opus-4-5-20251101 |
131 ms | 955 ms | 1,287 ms | 1,288 ms | -1 ms | ready |
| 2.0.60 claude-opus-4-5-20251101 |
133 ms | 952 ms | 1,277 ms | 1,275 ms | +2 ms | ready |
| 2.0.59† claude-opus-4-5-20251101 |
131 ms | 964 ms | 1,301 ms | 1,596 ms | -295 ms | ready |
| 2.0.58† claude-opus-4-5-20251101 |
131 ms | 958 ms | 1,366 ms | 1,337 ms | +29 ms | ready |
| 2.0.57 claude-opus-4-5-20251101 |
147 ms | 975 ms | 1,417 ms | 1,571 ms | -154 ms | ready |
| 2.0.56 claude-opus-4-5-20251101 |
129 ms | 953 ms | 1,292 ms | 1,337 ms | -45 ms | ready |
| 2.0.55 claude-opus-4-5-20251101 |
140 ms | 1,010 ms | 1,630 ms | 1,522 ms | +108 ms | ready |
| 2.0.54† claude-opus-4-5-20251101 |
136 ms | 938 ms | 1,305 ms | 1,427 ms | -122 ms | ready |
| 2.0.53 claude-opus-4-5-20251101 |
127 ms | 942 ms | 1,356 ms | 1,308 ms | +48 ms | ready |
| 2.0.52 claude-opus-4-5-20251101 |
127 ms | 947 ms | 1,553 ms | 1,453 ms | +100 ms | ready |
| 2.0.51 claude-opus-4-5-20251101 |
128 ms | 950 ms | 1,344 ms | 1,393 ms | -49 ms | ready |
| 2.0.50 claude-opus-4-5-20251101 |
128 ms | 939 ms | 1,656 ms | 1,487 ms | +169 ms | ready |
| 2.0.49 claude-opus-4-5-20251101 |
128 ms | 938 ms | 1,783 ms | 1,736 ms | +47 ms | ready |
| 2.0.47 claude-opus-4-5-20251101 |
164 ms | 932 ms | 1,732 ms | 1,472 ms | +260 ms | ready |
| 2.0.46 claude-opus-4-5-20251101 |
164 ms | 931 ms | 1,555 ms | 1,566 ms | -11 ms | ready |
| 2.0.45 claude-opus-4-5-20251101 |
164 ms | 938 ms | 1,371 ms | 1,588 ms | -217 ms | ready |
| 2.0.44 claude-opus-4-5-20251101 |
157 ms | 918 ms | 1,590 ms | 1,661 ms | -71 ms | ready |
| 2.0.43 claude-opus-4-5-20251101 |
154 ms | 929 ms | 1,483 ms | 1,532 ms | -49 ms | ready |
| 2.0.42† claude-opus-4-5-20251101 |
161 ms | 921 ms | 1,551 ms | 1,479 ms | +72 ms | ready |
| 2.0.41 claude-opus-4-5-20251101 |
161 ms | 915 ms | 1,559 ms | 1,562 ms | -3 ms | ready |
| 2.0.37 claude-opus-4-5-20251101 |
162 ms | 921 ms | 1,810 ms | 1,739 ms | +71 ms | ready |
| 2.0.36 claude-opus-4-5-20251101 |
160 ms | 916 ms | 1,582 ms | 1,513 ms | +69 ms | ready |
| 2.0.35† claude-opus-4-5-20251101 |
182 ms | 925 ms | 1,261 ms | 1,497 ms | -236 ms | ready |
| 2.0.34 claude-opus-4-5-20251101 |
159 ms | 981 ms | 1,550 ms | 1,466 ms | +84 ms | ready |
| 2.0.33† claude-opus-4-5-20251101 |
159 ms | 891 ms | 1,469 ms | 1,496 ms | -27 ms | ready |
| 2.0.32 claude-opus-4-5-20251101 |
273 ms | 1,047 ms | 1,675 ms | 1,561 ms | +114 ms | ready |
| 2.0.31 claude-opus-4-1-20250805 |
275 ms | 1,026 ms | 1,700 ms | 1,581 ms | +119 ms | ready |
| 2.0.30 claude-opus-4-1-20250805 |
276 ms | 1,017 ms | 1,700 ms | 1,543 ms | +157 ms | ready |
| 2.0.29 claude-opus-4-1-20250805 |
272 ms | 1,025 ms | 1,541 ms | 1,614 ms | -73 ms | ready |
| 2.0.28† claude-opus-4-1-20250805 |
275 ms | 1,015 ms | 1,807 ms | 1,592 ms | +215 ms | ready |
| 2.0.27 claude-opus-4-1-20250805 |
274 ms | 1,010 ms | 1,543 ms | 1,610 ms | -67 ms | ready |
| 2.0.26 claude-opus-4-1-20250805 |
286 ms | 1,026 ms | 1,711 ms | 1,507 ms | +204 ms | ready |
| 2.0.25 claude-opus-4-1-20250805 |
297 ms | 1,041 ms | 1,659 ms | 1,672 ms | -13 ms | ready |
| 2.0.24 claude-opus-4-1-20250805 |
298 ms | 1,056 ms | 1,705 ms | 1,553 ms | +152 ms | ready |
detail · Codex
| version | spawn (--version) | interactive startup | response | response (no mcp) | mcp overhead | response fast | fast savings | fast (no mcp) | migrations | result |
|---|---|---|---|---|---|---|---|---|---|---|
| rust-v0.150.1† gpt-5.6-sol |
9 ms | 515 ms | 5,258 ms | 5,061 ms | +197 ms | 5,001 ms | -257 ms | 4,938 ms | — | ready |
| rust-v0.150.0† gpt-5.6-sol |
8 ms | 516 ms | 5,109 ms | 6,052 ms | -943 ms | 4,775 ms | -334 ms | 4,542 ms | — | ready |
| rust-v0.149.1 gpt-5.6-sol |
8 ms | 517 ms | 8,789 ms | 6,968 ms | +1,821 ms | 4,859 ms | -3,930 ms | 4,665 ms | — | ready |
| rust-v0.149.0† gpt-5.6-sol |
8 ms | 521 ms | 8,269 ms | 5,427 ms | +2,842 ms | 4,895 ms | -3,374 ms | 5,040 ms | — | ready |
| rust-v0.148.0† gpt-5.6-sol |
9 ms | 520 ms | 6,151 ms | 5,247 ms | +904 ms | 4,808 ms | -1,343 ms | 4,906 ms | — | ready |
| rust-v0.147.0† gpt-5.5 |
9 ms | 528 ms | 5,185 ms | 5,594 ms | -409 ms | 4,969 ms | -216 ms | 4,680 ms | — | ready |
| rust-v0.146.0 gpt-5.5 |
28 ms | 556 ms | 6,078 ms | 6,395 ms | -317 ms | 4,780 ms | -1,298 ms | 7,024 ms | — | ready |
| rust-v0.145.0 gpt-5.5 |
28 ms | 571 ms | 5,353 ms | 5,657 ms | -304 ms | 4,823 ms | -530 ms | 5,504 ms | — | ready |
| rust-v0.144.6 gpt-5.6 |
27 ms | 551 ms | 4,155 ms | 3,736 ms | +419 ms | 3,259 ms | -896 ms | 3,242 ms | — | ready |
| rust-v0.144.5 gpt-5.6 |
27 ms | 554 ms | 3,941 ms | 3,239 ms | +702 ms | 3,233 ms | -708 ms | 3,360 ms | — | ready |
| rust-v0.144.4 gpt-5.6 |
27 ms | 553 ms | 3,242 ms | 4,555 ms | -1,313 ms | 3,159 ms | -83 ms | 3,174 ms | — | ready |
| rust-v0.144.3 gpt-5.6 |
26 ms | 549 ms | 3,174 ms | 3,359 ms | -185 ms | 3,224 ms | +50 ms | 3,341 ms | — | ready |
| rust-v0.144.2 gpt-5.6 |
26 ms | 563 ms | 3,245 ms | 3,302 ms | -57 ms | 3,347 ms | +102 ms | 3,298 ms | — | ready |
| rust-v0.144.1 gpt-5.6 |
24 ms | 550 ms | 3,376 ms | 3,355 ms | +21 ms | 3,194 ms | -182 ms | 3,370 ms | — | ready |
| rust-v0.144.0 gpt-5.6 |
27 ms | 553 ms | 3,140 ms | 3,173 ms | -33 ms | 3,541 ms | +401 ms | 3,144 ms | — | ready |
| rust-v0.143.0 gpt-5.5 |
26 ms | 551 ms | 5,805 ms | 4,997 ms | +808 ms | 4,665 ms | -1,140 ms | 6,018 ms | — | ready |
| rust-v0.142.5 gpt-5.5 |
27 ms | 550 ms | 4,829 ms | 4,993 ms | -164 ms | 5,531 ms | +702 ms | 5,220 ms | — | ready |
| rust-v0.142.4 gpt-5.5 |
27 ms | 550 ms | 4,240 ms | 5,454 ms | -1,214 ms | 6,130 ms | +1,890 ms | 4,622 ms | — | ready |
| rust-v0.142.3 gpt-5.5 |
27 ms | 549 ms | 4,776 ms | 4,957 ms | -181 ms | 4,455 ms | -321 ms | 4,495 ms | — | ready |
| rust-v0.142.2 gpt-5.5 |
27 ms | 549 ms | 6,974 ms | 4,704 ms | +2,270 ms | 4,917 ms | -2,057 ms | 4,716 ms | — | ready |
| rust-v0.142.1 gpt-5.5 |
27 ms | 554 ms | 4,869 ms | 5,142 ms | -273 ms | 4,130 ms | -739 ms | 4,646 ms | — | ready |
| rust-v0.142.0 gpt-5.5 |
25 ms | 551 ms | 4,874 ms | 6,021 ms | -1,147 ms | 4,794 ms | -80 ms | 5,569 ms | — | ready |
| rust-v0.141.0 gpt-5.5 |
26 ms | 555 ms | 4,797 ms | 4,971 ms | -174 ms | 4,719 ms | -78 ms | 4,868 ms | — | ready |
| rust-v0.140.0 gpt-5.5 |
26 ms | 555 ms | 4,981 ms | 5,739 ms | -758 ms | 4,313 ms | -668 ms | 5,503 ms | — | ready |
| rust-v0.139.0 gpt-5.5 |
28 ms | 555 ms | 7,787 ms | 7,404 ms | +383 ms | 7,815 ms | +28 ms | 6,698 ms | — | ready |
| rust-v0.138.0 gpt-5.5 |
28 ms | 564 ms | 7,703 ms | 8,154 ms | -451 ms | 6,973 ms | -730 ms | 8,000 ms | — | ready |
| rust-v0.137.0 gpt-5.5 |
27 ms | 560 ms | 6,885 ms | 7,506 ms | -621 ms | 7,980 ms | +1,095 ms | 7,341 ms | — | ready |
| rust-v0.136.0 gpt-5.5 |
28 ms | 581 ms | 7,469 ms | 9,591 ms | -2,122 ms | 7,862 ms | +393 ms | 7,160 ms | — | ready |
| rust-v0.135.0 gpt-5.5 |
30 ms | 560 ms | 6,675 ms | 6,513 ms | +162 ms | 7,028 ms | +353 ms | 5,760 ms | — | ready |
| rust-v0.134.0 gpt-5.5 |
27 ms | 547 ms | 5,504 ms | 6,522 ms | -1,018 ms | 4,931 ms | -573 ms | 5,546 ms | — | ready |
| rust-v0.133.0 gpt-5.5 |
13 ms | 532 ms | 5,634 ms | 8,494 ms | -2,860 ms | 5,016 ms | -618 ms | 4,599 ms | — | ready |
| rust-v0.132.0† gpt-5.5 |
14 ms | 531 ms | 6,480 ms | 7,286 ms | -806 ms | 6,017 ms | -463 ms | 6,273 ms | — | ready |
| rust-v0.131.0 gpt-5.5 |
1 ms | 528 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.130.0† gpt-5.5 |
1 ms | 526 ms | — | — | — | — | — | — | — | ready |
| rust-v0.129.0 gpt-5.5 |
1 ms | 526 ms | — | — | — | — | — | — | — | ready |
| rust-v0.128.0 | 3 ms | 793 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.125.0 | 3 ms | 880 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.124.0 | 3 ms | 811 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.123.0 | 3 ms | 808 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.122.0 | 3 ms | 813 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.121.0 | 1 ms | 526 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.120.0 | 1 ms | 528 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.119.0 | 1 ms | 529 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.118.0 gpt-5.5 |
1 ms | 523 ms | — | — | — | — | — | — | 46 ▼5 | incompatible The requested model requires a newer product version |
| rust-v0.117.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | 46 ▼5 | incompatible The requested model requires a newer product version |
| rust-v0.116.0 gpt-5.5 |
1 ms | 526 ms | — | — | — | — | — | — | 46 ▼5 | incompatible The requested model requires a newer product version |
| rust-v0.115.0† gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.114.0† gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.113.0† gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.112.0 gpt-5.5 |
1 ms | 528 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.111.0 gpt-5.5 |
1 ms | 525 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.110.0 gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.107.0 gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.106.0 gpt-5.5 |
1 ms | 529 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.105.0 gpt-5.5 |
3 ms | 525 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.104.0 gpt-5.5 |
1 ms | 528 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.103.0 gpt-5.5 |
1 ms | 523 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.102.0 gpt-5.5 |
2 ms | 529 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.101.0 gpt-5.5 |
1 ms | 532 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.100.0 gpt-5.5 |
2 ms | 530 ms | — | — | — | — | — | — | — | incompatible The requested model is not supported by this product version |
| rust-v0.99.0 gpt-5.5 |
3 ms | 494 ms | — | — | — | — | — | — | — | incompatible The requested model is not supported by this product version |
| rust-v0.98.0 gpt-5.5 |
2 ms | 527 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.97.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.96.0 gpt-5.5 |
2 ms | 529 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.95.0 gpt-5.5 |
2 ms | 528 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.94.0 gpt-5.5 |
3 ms | 491 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.93.0 gpt-5.5 |
1 ms | 524 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.92.0 gpt-5.5 |
2 ms | 520 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.91.0 gpt-5.5 |
3 ms | 527 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.90.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.89.0 gpt-5.5 |
2 ms | 523 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.88.0 gpt-5.5 |
2 ms | 521 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.87.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.86.0 gpt-5.5 |
2 ms | 522 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.85.0 gpt-5.5 |
1 ms | 521 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.84.0 gpt-5.5 |
2 ms | 522 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.81.0 gpt-5.5 |
2 ms | 522 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.80.0 gpt-5.5 |
2 ms | 517 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.79.0 gpt-5.5 |
2 ms | 516 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.78.0 gpt-5.5 |
2 ms | 519 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.77.0 gpt-5.5 |
3 ms | 513 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.76.0 gpt-5.5 |
3 ms | 515 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.75.0 gpt-5.5 |
1 ms | 516 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.74.0 gpt-5.5 |
2 ms | 516 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.73.0 gpt-5.5 |
2 ms | 516 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.72.0 gpt-5.5 |
1 ms | 515 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.71.0 gpt-5.5 |
1 ms | 515 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.69.0 gpt-5.5 |
1 ms | 516 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.66.0 gpt-5.5 |
2 ms | 515 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.65.0 gpt-5.5 |
3 ms | 518 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.64.0 | 1 ms | 515 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.63.0 | 1 ms | 518 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.61.0 | 2 ms | 515 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.60.1 | 2 ms | 515 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.59.0 | 2 ms | 518 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.58.0 | 3 ms | 513 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.57.0 | 2 ms | 516 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.56.0 gpt-5.5 |
2 ms | 514 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.55.0 | 1 ms | 519 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.54.0 | 2 ms | 515 ms | — | — | — | — | — | — | 51 ▼5 | ready |
| rust-v0.53.0 | 2 ms | 518 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.52.0 | 2 ms | 514 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.50.0 | 2 ms | 514 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.49.0 gpt-5.5 |
2 ms | 518 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.48.0 | 2 ms | 518 ms | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.47.0 gpt-5.5 |
3 ms | 510 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.46.0 gpt-5.5 |
1 ms | 508 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.45.0 gpt-5.5 |
2 ms | 469 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.44.0 gpt-5.5 |
2 ms | 470 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.42.0 gpt-5.5 |
2 ms | 508 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.41.0 gpt-5.5 |
2 ms | 507 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.40.0 gpt-5.5 |
2 ms | 508 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.39.0 gpt-5.5 |
3 ms | 511 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.38.0 gpt-5.5 |
2 ms | 506 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.37.0 gpt-5.5 |
1 ms | 467 ms | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
caveats
- † Claude Code 2.0.28 — response (no mcp) spike of 1,912 ms vs 1,613.5 ms median; dropped and re-run clean. slow sample exceeded 1773 ms cutoff
- † Claude Code 2.0.33 — response spike of 1,686 ms vs 1,466 ms median; dropped and re-run clean. slow sample exceeded 1618 ms cutoff
- † Claude Code 2.0.33 — response (no mcp) spike of 1,707 ms vs 1,464 ms median; dropped and re-run clean. slow sample exceeded 1630 ms cutoff
- † Claude Code 2.0.33 — response (no mcp) spike of 1,696 ms vs 1,464 ms median; dropped and re-run clean. slow sample exceeded 1630 ms cutoff
- † Claude Code 2.0.35 — response spike of 1,609 ms vs 1,270 ms median; dropped and re-run clean. slow sample exceeded 1428 ms cutoff
- † Claude Code 2.0.35 — response spike of 1,624 ms vs 1,270 ms median; dropped and re-run clean. slow sample exceeded 1428 ms cutoff
- † Claude Code 2.0.35 — response spike of 1,574 ms vs 1,270 ms median; dropped and re-run clean. slow sample exceeded 1428 ms cutoff
- † Claude Code 2.0.42 — response spike of 1,745 ms vs 1,513 ms median; dropped and re-run clean. slow sample exceeded 1664 ms cutoff
- † Claude Code 2.0.42 — response spike of 1,741 ms vs 1,513 ms median; dropped and re-run clean. slow sample exceeded 1664 ms cutoff
- † Claude Code 2.0.54 — response spike of 1,548 ms vs 1,315 ms median; dropped and re-run clean. slow sample exceeded 1523 ms cutoff
- † Claude Code 2.0.58 — response (no mcp) spike of 1,605 ms vs 1,302.5 ms median; dropped and re-run clean. slow sample exceeded 1486 ms cutoff
- † Claude Code 2.0.59 — response spike of 1,520 ms vs 1,288 ms median; dropped and re-run clean. slow sample exceeded 1456 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 1,655 ms vs 1,300.5 ms median; dropped and re-run clean. slow sample exceeded 1503 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 1,623 ms vs 1,300.5 ms median; dropped and re-run clean. slow sample exceeded 1503 ms cutoff
- † Claude Code 2.0.68 — response (no mcp) spike of 1,685 ms vs 1,296 ms median; dropped and re-run clean. slow sample exceeded 1504 ms cutoff
- † Claude Code 2.0.68 — response (no mcp) spike of 1,728 ms vs 1,296 ms median; dropped and re-run clean. slow sample exceeded 1504 ms cutoff
- † Claude Code 2.0.69 — response spike of 1,545 ms vs 1,277 ms median; dropped and re-run clean. slow sample exceeded 1430 ms cutoff
- † Claude Code 2.0.69 — response (no mcp) spike of 1,606 ms vs 1,288.5 ms median; dropped and re-run clean. slow sample exceeded 1440 ms cutoff
- † Claude Code 2.0.74 — response spike of 2,444 ms vs 1,569 ms median; dropped and re-run clean. slow sample exceeded 1729 ms cutoff
- † Claude Code 2.0.75 — interactive startup spike of 1,531 ms vs 1,184 ms median; dropped and re-run clean. slow sample exceeded 1530 ms cutoff
- † Claude Code 2.0.75 — interactive startup spike of 1,637 ms vs 1,184 ms median; dropped and re-run clean. slow sample exceeded 1530 ms cutoff
- † Claude Code 2.0.76 — response spike of 2,071 ms vs 1,566.5 ms median; dropped and re-run clean. slow sample exceeded 1858 ms cutoff
- † Claude Code 2.0.76 — response (no mcp) spike of 1,943 ms vs 1,683.5 ms median; dropped and re-run clean. slow sample exceeded 1837 ms cutoff
- † Claude Code 2.1.1 — response spike of 3,018 ms vs 1,863.5 ms median; dropped and re-run clean. slow sample exceeded 2025 ms cutoff
- † Claude Code 2.1.1 — response spike of 2,907 ms vs 1,863.5 ms median; dropped and re-run clean. slow sample exceeded 2025 ms cutoff
- † Claude Code 2.1.1 — response (no mcp) spike of 2,512 ms vs 1,878.5 ms median; dropped and re-run clean. slow sample exceeded 2408 ms cutoff
- † Claude Code 2.1.3 — response spike of 2,486 ms vs 1,895 ms median; dropped and re-run clean. slow sample exceeded 2083 ms cutoff
- † Claude Code 2.1.3 — response spike of 2,400 ms vs 1,895 ms median; dropped and re-run clean. slow sample exceeded 2083 ms cutoff
- † Claude Code 2.1.5 — interactive startup spike of 1,386 ms vs 1,085 ms median; dropped and re-run clean. slow sample exceeded 1242 ms cutoff
- † Claude Code 2.1.5 — response spike of 1,926 ms vs 1,669 ms median; dropped and re-run clean. slow sample exceeded 1833 ms cutoff
- † Claude Code 2.1.7 — interactive startup spike of 1,392 ms vs 1,219 ms median; dropped and re-run clean. slow sample exceeded 1370 ms cutoff
- † Claude Code 2.1.8 — interactive startup spike of 1,265 ms vs 1,076 ms median; dropped and re-run clean. slow sample exceeded 1238 ms cutoff
- † Claude Code 2.1.8 — interactive startup spike of 1,790 ms vs 1,076 ms median; dropped and re-run clean. slow sample exceeded 1238 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,207 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,285 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,375 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,283 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff; rerun budget exhausted
- † Claude Code 2.1.9 — interactive startup spike of 1,903 ms vs 1,235 ms median; dropped and re-run clean. slow sample exceeded 1700 ms cutoff
- † Claude Code 2.1.11 — response spike of 1,939 ms vs 1,775.5 ms median; dropped and re-run clean. slow sample exceeded 1926 ms cutoff
- † Claude Code 2.1.12 — interactive startup spike of 1,971 ms vs 1,330 ms median; dropped and re-run clean. slow sample exceeded 1508 ms cutoff
- † Claude Code 2.1.12 — interactive startup spike of 1,652 ms vs 1,330 ms median; dropped and re-run clean. slow sample exceeded 1508 ms cutoff
- † Claude Code 2.1.12 — response (no mcp) spike of 2,128 ms vs 1,815 ms median; dropped and re-run clean. slow sample exceeded 2033 ms cutoff
- † Claude Code 2.1.16 — response (no mcp) spike of 5,152 ms vs 1,156.5 ms median; dropped and re-run clean. slow sample exceeded 1313 ms cutoff
- † Claude Code 2.1.17 — response (no mcp) spike of 1,406 ms vs 1,114 ms median; dropped and re-run clean. slow sample exceeded 1272 ms cutoff
- † Claude Code 2.1.17 — response (no mcp) spike of 1,393 ms vs 1,114 ms median; dropped and re-run clean. slow sample exceeded 1272 ms cutoff
- † Claude Code 2.1.18 — response spike of 2,170 ms vs 1,134.5 ms median; dropped and re-run clean. slow sample exceeded 1298 ms cutoff
- † Claude Code 2.1.18 — response spike of 4,891 ms vs 1,134.5 ms median; dropped and re-run clean. slow sample exceeded 1298 ms cutoff
- † Claude Code 2.1.19 — response (no mcp) spike of 4,869 ms vs 1,157.5 ms median; dropped and re-run clean. slow sample exceeded 1313 ms cutoff
- † Claude Code 2.1.20 — response spike of 4,674 ms vs 1,148 ms median; dropped and re-run clean. slow sample exceeded 1306 ms cutoff
- † Claude Code 2.1.21 — response spike of 1,317 ms vs 1,150.5 ms median; dropped and re-run clean. slow sample exceeded 1303 ms cutoff
- † Claude Code 2.1.21 — response (no mcp) spike of 1,417 ms vs 1,152 ms median; dropped and re-run clean. slow sample exceeded 1308 ms cutoff
- † Claude Code 2.1.23 — response spike of 1,357 ms vs 1,149 ms median; dropped and re-run clean. slow sample exceeded 1299 ms cutoff
- † Claude Code 2.1.25 — response spike of 1,503 ms vs 1,130 ms median; dropped and re-run clean. slow sample exceeded 1293 ms cutoff
- † Claude Code 2.1.29 — response spike of 3,480 ms vs 1,126 ms median; dropped and re-run clean. slow sample exceeded 1282 ms cutoff
- † Claude Code 2.1.30 — response (no mcp) spike of 2,336 ms vs 1,105.5 ms median; dropped and re-run clean. slow sample exceeded 1266 ms cutoff
- † Claude Code 2.1.31 — response spike of 1,517 ms vs 1,114.5 ms median; dropped and re-run clean. slow sample exceeded 1265 ms cutoff
- † Claude Code 2.1.31 — response spike of 3,629 ms vs 1,114.5 ms median; dropped and re-run clean. slow sample exceeded 1265 ms cutoff
- † Claude Code 2.1.32 — response spike of 5,123 ms vs 1,110.5 ms median; dropped and re-run clean. slow sample exceeded 1264 ms cutoff
- † Claude Code 2.1.32 — response (no mcp) spike of 4,899 ms vs 1,098.5 ms median; dropped and re-run clean. slow sample exceeded 1256 ms cutoff
- † Claude Code 2.1.36 — response spike of 5,623 ms vs 1,145.5 ms median; dropped and re-run clean. slow sample exceeded 1744 ms cutoff
- † Claude Code 2.1.36 — response (no mcp) spike of 6,631 ms vs 1,092 ms median; dropped and re-run clean. slow sample exceeded 1244 ms cutoff
- † Claude Code 2.1.36 — response (no mcp) spike of 1,456 ms vs 1,092 ms median; dropped and re-run clean. slow sample exceeded 1244 ms cutoff
- † Claude Code 2.1.38 — response (no mcp) spike of 4,725 ms vs 4,238 ms median; dropped and re-run clean. slow sample exceeded 4703 ms cutoff
- † Claude Code 2.1.41 — response spike of 9,780 ms vs 5,135 ms median; dropped and re-run clean. slow sample exceeded 7540 ms cutoff
- † Claude Code 2.1.44 — response spike of 6,096 ms vs 4,040.5 ms median; dropped and re-run clean. slow sample exceeded 5480 ms cutoff
- † Claude Code 2.1.48 — response (no mcp) spike of 8,560 ms vs 5,045 ms median; dropped and re-run clean. slow sample exceeded 5787 ms cutoff
- † Claude Code 2.1.51 — response spike of 11,035 ms vs 4,560.5 ms median; dropped and re-run clean. slow sample exceeded 6099 ms cutoff
- † Claude Code 2.1.51 — response spike of 7,814 ms vs 4,560.5 ms median; dropped and re-run clean. slow sample exceeded 6099 ms cutoff
- † Claude Code 2.1.51 — response spike of 7,693 ms vs 4,560.5 ms median; dropped and re-run clean. slow sample exceeded 6099 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 4,510 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 14,514 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 5,948 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 4,893 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff; rerun budget exhausted
- † Claude Code 2.1.54 — response spike of 4,492 ms vs 4,010.5 ms median; dropped and re-run clean. slow sample exceeded 4342 ms cutoff
- † Claude Code 2.1.54 — response (no mcp) spike of 7,834 ms vs 4,387.5 ms median; dropped and re-run clean. slow sample exceeded 6104 ms cutoff
- † Claude Code 2.1.54 — response (no mcp) spike of 4,561 ms vs 4,232.5 ms median; dropped and re-run clean. slow sample exceeded 4416 ms cutoff
- † Claude Code 2.1.56 — response spike of 9,557 ms vs 4,236.5 ms median; dropped and re-run clean. slow sample exceeded 6478 ms cutoff
- † Claude Code 2.1.56 — response (no mcp) spike of 5,096 ms vs 4,122 ms median; dropped and re-run clean. slow sample exceeded 4439 ms cutoff
- † Claude Code 2.1.56 — response (no mcp) spike of 10,222 ms vs 4,122 ms median; dropped and re-run clean. slow sample exceeded 4439 ms cutoff
- † Claude Code 2.1.56 — response (no mcp) spike of 5,169 ms vs 4,122 ms median; dropped and re-run clean. slow sample exceeded 4439 ms cutoff
- † Claude Code 2.1.59 — response (no mcp) spike of 9,302 ms vs 4,079.5 ms median; dropped and re-run clean. slow sample exceeded 8171 ms cutoff
- † Claude Code 2.1.61 — response (no mcp) spike of 7,983 ms vs 4,661 ms median; dropped and re-run clean. slow sample exceeded 6808 ms cutoff
- † Claude Code 2.1.63 — response (no mcp) spike of 7,693 ms vs 3,546 ms median; dropped and re-run clean. slow sample exceeded 4545 ms cutoff
- † Claude Code 2.1.64 — response (no mcp) spike of 6,335 ms vs 4,168 ms median; dropped and re-run clean. slow sample exceeded 4900 ms cutoff
- † Claude Code 2.1.69 — response spike of 9,867 ms vs 3,081.5 ms median; dropped and re-run clean. slow sample exceeded 3364 ms cutoff
- † Claude Code 2.1.71 — response (no mcp) spike of 3,517 ms vs 2,842 ms median; dropped and re-run clean. slow sample exceeded 3218 ms cutoff
- † Claude Code 2.1.76 — response (no mcp) spike of 4,321 ms vs 2,652.5 ms median; dropped and re-run clean. slow sample exceeded 2855 ms cutoff
- † Claude Code 2.1.76 — response (no mcp) spike of 3,210 ms vs 2,652.5 ms median; dropped and re-run clean. slow sample exceeded 2855 ms cutoff
- † Claude Code 2.1.77 — response spike of 3,385 ms vs 2,934 ms median; dropped and re-run clean. slow sample exceeded 3379 ms cutoff
- † Claude Code 2.1.78 — response spike of 3,577 ms vs 3,196.5 ms median; dropped and re-run clean. slow sample exceeded 3429 ms cutoff
- † Claude Code 2.1.81 — response spike of 5,120 ms vs 2,900 ms median; dropped and re-run clean. slow sample exceeded 4582 ms cutoff
- † Claude Code 2.1.84 — response spike of 4,890 ms vs 3,294 ms median; dropped and re-run clean. slow sample exceeded 3522 ms cutoff
- † Claude Code 2.1.90 — response spike of 5,203 ms vs 3,127 ms median; dropped and re-run clean. slow sample exceeded 3434 ms cutoff
- † Claude Code 2.1.91 — response (no mcp) spike of 7,805 ms vs 3,371.5 ms median; dropped and re-run clean. slow sample exceeded 7434 ms cutoff
- † Claude Code 2.1.91 — response (no mcp) spike of 3,782 ms vs 3,021 ms median; dropped and re-run clean. slow sample exceeded 3615 ms cutoff
- † Claude Code 2.1.222 — response (no mcp) spike of 3,364 ms vs 3,063 ms median; dropped and re-run clean. slow sample exceeded 3216 ms cutoff
- † Claude Code 2.1.224 — response (no mcp) spike of 4,524 ms vs 2,893 ms median; dropped and re-run clean. slow sample exceeded 3516 ms cutoff
- † Claude Code 2.1.225 — response spike of 3,983 ms vs 2,980.5 ms median; dropped and re-run clean. slow sample exceeded 3142 ms cutoff
- † Claude Code 2.1.229 — response spike of 5,225 ms vs 2,999 ms median; dropped and re-run clean. slow sample exceeded 3622 ms cutoff
- † Claude Code 2.1.233 — response spike of 3,180 ms vs 2,759 ms median; dropped and re-run clean. slow sample exceeded 2919 ms cutoff
- † Claude Code 2.1.233 — response spike of 3,589 ms vs 2,759 ms median; dropped and re-run clean. slow sample exceeded 2919 ms cutoff
- † Claude Code 2.1.233 — response spike of 3,055 ms vs 2,759 ms median; dropped and re-run clean. slow sample exceeded 2919 ms cutoff
- † Claude Code 2.1.236 — response (no mcp) spike of 3,674 ms vs 2,935.5 ms median; dropped and re-run clean. slow sample exceeded 3336 ms cutoff
- † Claude Code 2.1.238 — response spike of 6,960 ms vs 3,280.5 ms median; dropped and re-run clean. slow sample exceeded 3869 ms cutoff
- † Claude Code 2.1.238 — response (no mcp) spike of 5,317 ms vs 3,544.5 ms median; dropped and re-run clean. slow sample exceeded 3708 ms cutoff
- † Claude Code 2.1.243 — response spike of 3,612 ms vs 2,917.5 ms median; dropped and re-run clean. slow sample exceeded 3200 ms cutoff
- † Claude Code 2.1.245 — response spike of 3,368 ms vs 3,128.5 ms median; dropped and re-run clean. slow sample exceeded 3284 ms cutoff
- † Claude Code 2.1.246 — response (no mcp) spike of 3,991 ms vs 2,985.5 ms median; dropped and re-run clean. slow sample exceeded 3752 ms cutoff
- † Claude Code 2.1.247 — response spike of 3,271 ms vs 3,011.5 ms median; dropped and re-run clean. slow sample exceeded 3214 ms cutoff
- † Claude Code 2.1.247 — response spike of 3,250 ms vs 3,011.5 ms median; dropped and re-run clean. slow sample exceeded 3214 ms cutoff
- † Claude Code 2.1.248 — response spike of 3,484 ms vs 2,721 ms median; dropped and re-run clean. slow sample exceeded 2885 ms cutoff
- † Claude Code 2.1.250 — response spike of 4,243 ms vs 2,998.5 ms median; dropped and re-run clean. slow sample exceeded 3696 ms cutoff
- † Codex rust-v0.113.0 — response spike of 8,741 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff
- † Codex rust-v0.113.0 — response spike of 7,221 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff
- † Codex rust-v0.113.0 — response spike of 6,780 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff
- † Codex rust-v0.113.0 — response spike of 7,595 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff; rerun budget exhausted
- † Codex rust-v0.114.0 — response (fast) spike of 9,881 ms vs 6,492.5 ms median; dropped and re-run clean. slow sample exceeded 7645 ms cutoff
- † Codex rust-v0.114.0 — response (fast) spike of 6,609 ms vs 6,371 ms median; dropped and re-run clean. slow sample exceeded 6526 ms cutoff
- † Codex rust-v0.114.0 — response (fast) spike of 7,187 ms vs 6,371 ms median; dropped and re-run clean. slow sample exceeded 6526 ms cutoff
- † Codex rust-v0.114.0 — response (fast) spike of 8,389 ms vs 6,371 ms median; dropped and re-run clean. slow sample exceeded 6526 ms cutoff; rerun budget exhausted
- † Codex rust-v0.115.0 — response (no mcp) spike of 8,391 ms vs 6,829.5 ms median; dropped and re-run clean. slow sample exceeded 6995 ms cutoff
- † Codex rust-v0.115.0 — response (no mcp) spike of 8,387 ms vs 6,829.5 ms median; dropped and re-run clean. slow sample exceeded 6995 ms cutoff
- † Codex rust-v0.115.0 — response (no mcp) spike of 7,960 ms vs 6,829.5 ms median; dropped and re-run clean. slow sample exceeded 6995 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 7,112 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 6,661 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 6,839 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 6,797 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff; rerun budget exhausted
- † Codex rust-v0.130.0 — response (fast) spike of 19,371 ms vs 17,639 ms median; dropped and re-run clean. slow sample exceeded 19094 ms cutoff
- † Codex rust-v0.132.0 — response (fast) spike of 17,861 ms vs 6,039.5 ms median; dropped and re-run clean. slow sample exceeded 8924 ms cutoff
- † Codex rust-v0.147.0 — response spike of 9,425 ms vs 5,348 ms median; dropped and re-run clean. slow sample exceeded 5556 ms cutoff
- † Codex rust-v0.147.0 — response (fast) spike of 5,954 ms vs 4,929.5 ms median; dropped and re-run clean. slow sample exceeded 5815 ms cutoff
- † Codex rust-v0.147.0 — response (fast, no mcp) spike of 5,225 ms vs 4,712 ms median; dropped and re-run clean. slow sample exceeded 4959 ms cutoff
- † Codex rust-v0.148.0 — response (no mcp) spike of 5,613 ms vs 5,242 ms median; dropped and re-run clean. slow sample exceeded 5499 ms cutoff
- † Codex rust-v0.149.0 — response (fast, no mcp) spike of 9,592 ms vs 5,411.5 ms median; dropped and re-run clean. slow sample exceeded 8682 ms cutoff
- † Codex rust-v0.149.0 — response (fast, no mcp) spike of 5,742 ms vs 5,068 ms median; dropped and re-run clean. slow sample exceeded 5231 ms cutoff
- † Codex rust-v0.150.0 — response spike of 7,431 ms vs 4,817 ms median; dropped and re-run clean. slow sample exceeded 6440 ms cutoff
- † Codex rust-v0.150.0 — response spike of 6,600 ms vs 4,817 ms median; dropped and re-run clean. slow sample exceeded 6440 ms cutoff
- † Codex rust-v0.150.1 — response (no mcp) spike of 6,225 ms vs 4,888.5 ms median; dropped and re-run clean. slow sample exceeded 5636 ms cutoff
- † Codex rust-v0.150.1 — response (fast, no mcp) spike of 5,515 ms vs 4,907 ms median; dropped and re-run clean. slow sample exceeded 5273 ms cutoff
- † Codex rust-v0.150.1 — response (fast, no mcp) spike of 6,280 ms vs 4,907 ms median; dropped and re-run clean. slow sample exceeded 5273 ms cutoff
- † Codex rust-v0.150.1 — response (fast, no mcp) spike of 6,063 ms vs 4,907 ms median; dropped and re-run clean. slow sample exceeded 5273 ms cutoff
Claude Code · avg startup claude-opus-5
800 ms
261 versions · spawn 93 ms · response 2821 ms · MCP +23 ms · 46.2 MB
Codex · avg startup gpt-5.6-sol
547 ms
32 versions · spawn 23 ms · response 5461 ms · MCP -151 ms · fast -488 ms · 499.3 MB
coverage floors
- codex coverage starts at v0.132.0 — Apple has revoked the signing certificates on older builds, and this floor moves as revocations land (tracked by the weekly Gatekeeper watch).
- claude response probes currently reach down to 2.0.24 — earlier versions carry launch metrics only while the response backfill works toward the launch floor.
detail · Claude Code
| version | spawn (--version) | interactive startup | response | response (no mcp) | mcp overhead | result |
|---|---|---|---|---|---|---|
| 2.1.251 claude-opus-5 |
6 ms | 756 ms | 2,969 ms | 2,937 ms | +32 ms | ready |
| 2.1.250† claude-opus-5 |
6 ms | 772 ms | 2,924 ms | 3,174 ms | -250 ms | ready |
| 2.1.248† claude-sonnet-5 |
11 ms | 758 ms | 2,751 ms | 2,598 ms | +153 ms | ready |
| 2.1.247† claude-opus-5 |
6 ms | 766 ms | 3,022 ms | 3,085 ms | -63 ms | ready |
| 2.1.246† claude-sonnet-5 |
6 ms | 768 ms | 3,010 ms | 2,944 ms | +66 ms | ready |
| 2.1.245† claude-sonnet-5 |
9 ms | 807 ms | 3,143 ms | 3,072 ms | +71 ms | ready |
| 2.1.243† claude-sonnet-5 |
14 ms | 823 ms | 2,885 ms | 3,008 ms | -123 ms | ready |
| 2.1.241 claude-sonnet-5 |
50 ms | 848 ms | 3,070 ms | 3,731 ms | -661 ms | ready |
| 2.1.240 claude-sonnet-5 |
56 ms | 874 ms | 3,612 ms | 2,889 ms | +723 ms | ready |
| 2.1.239 claude-sonnet-5 |
66 ms | 879 ms | 3,125 ms | 3,173 ms | -48 ms | ready |
| 2.1.238† claude-opus-5 |
55 ms | 838 ms | 3,388 ms | 3,490 ms | -102 ms | ready |
| 2.1.237 claude-sonnet-5 |
52 ms | 818 ms | 3,060 ms | 2,912 ms | +148 ms | ready |
| 2.1.236† claude-sonnet-5 |
52 ms | 821 ms | 3,061 ms | 2,937 ms | +124 ms | ready |
| 2.1.235 claude-opus-5 |
48 ms | 777 ms | 4,326 ms | 4,259 ms | +67 ms | ready |
| 2.1.234 claude-opus-5 |
49 ms | 788 ms | 3,096 ms | 3,636 ms | -540 ms | ready |
| 2.1.233† claude-sonnet-5 |
46 ms | 758 ms | 2,762 ms | 2,929 ms | -167 ms | ready |
| 2.1.232 claude-sonnet-5 |
48 ms | 783 ms | 3,012 ms | 2,773 ms | +239 ms | ready |
| 2.1.231 claude-sonnet-5 |
46 ms | 761 ms | 3,707 ms | 3,272 ms | +435 ms | ready |
| 2.1.229† claude-sonnet-5 |
46 ms | 763 ms | 2,998 ms | 2,905 ms | +93 ms | ready |
| 2.1.228 claude-sonnet-5 |
42 ms | 757 ms | 2,967 ms | 3,755 ms | -788 ms | ready |
| 2.1.227 claude-sonnet-5 |
45 ms | 777 ms | 3,510 ms | 2,823 ms | +687 ms | ready |
| 2.1.226 claude-sonnet-5 |
45 ms | 798 ms | 4,010 ms | 2,798 ms | +1,212 ms | ready |
| 2.1.225† claude-sonnet-5 |
44 ms | 784 ms | 2,993 ms | 2,756 ms | +237 ms | ready |
| 2.1.224† claude-sonnet-5 |
41 ms | 784 ms | 2,934 ms | 2,890 ms | +44 ms | ready |
| 2.1.222† claude-sonnet-5 |
41 ms | 776 ms | 3,216 ms | 2,877 ms | +339 ms | ready |
| 2.1.221 claude-sonnet-5 |
40 ms | 786 ms | 3,379 ms | 3,794 ms | -415 ms | ready |
| 2.1.220 claude-sonnet-5 |
37 ms | 767 ms | 3,577 ms | 2,831 ms | +746 ms | ready |
| 2.1.219 claude-sonnet-5 |
39 ms | 769 ms | 2,990 ms | 2,776 ms | +214 ms | ready |
| 2.1.218 claude-sonnet-5 |
37 ms | 767 ms | 3,150 ms | 3,083 ms | +67 ms | ready |
| 2.1.217 claude-sonnet-5 |
37 ms | 770 ms | 3,243 ms | 2,754 ms | +489 ms | ready |
| 2.1.216 claude-sonnet-5 |
40 ms | 802 ms | 2,894 ms | 3,122 ms | -228 ms | ready |
| 2.1.215 claude-opus-4-8 |
35 ms | 748 ms | 3,201 ms | 2,796 ms | +405 ms | ready |
| 2.1.214 claude-opus-4-8 |
34 ms | 768 ms | 2,801 ms | 2,697 ms | +104 ms | ready |
| 2.1.213 claude-opus-4-8 |
34 ms | 769 ms | 2,805 ms | 3,252 ms | -447 ms | ready |
| 2.1.212 claude-opus-4-8 |
38 ms | 752 ms | 3,481 ms | 3,767 ms | -286 ms | ready |
| 2.1.211 claude-opus-4-8 |
35 ms | 758 ms | 3,138 ms | 2,739 ms | +399 ms | ready |
| 2.1.210 claude-opus-4-8 |
35 ms | 767 ms | 3,723 ms | 5,123 ms | -1,400 ms | ready |
| 2.1.209 claude-opus-4-8 |
34 ms | 742 ms | 2,972 ms | 2,881 ms | +91 ms | ready |
| 2.1.208 claude-opus-4-8 |
34 ms | 745 ms | 3,856 ms | 2,659 ms | +1,197 ms | ready |
| 2.1.207 claude-opus-4-8 |
34 ms | 736 ms | 2,674 ms | 4,408 ms | -1,734 ms | ready |
| 2.1.206 claude-opus-4-8 |
34 ms | 734 ms | 3,325 ms | 3,206 ms | +119 ms | ready |
| 2.1.205 claude-opus-4-8 |
34 ms | 737 ms | 3,341 ms | 3,105 ms | +236 ms | ready |
| 2.1.204 claude-opus-4-8 |
34 ms | 742 ms | 2,866 ms | 4,996 ms | -2,130 ms | ready |
| 2.1.203 claude-opus-4-8 |
33 ms | 737 ms | 3,563 ms | 2,957 ms | +606 ms | ready |
| 2.1.202 claude-opus-4-8 |
35 ms | 735 ms | 2,683 ms | 3,179 ms | -496 ms | ready |
| 2.1.201 claude-opus-4-8 |
33 ms | 732 ms | 2,812 ms | 3,088 ms | -276 ms | ready |
| 2.1.200 claude-opus-4-8 |
33 ms | 731 ms | 4,402 ms | 2,580 ms | +1,822 ms | ready |
| 2.1.199 claude-opus-4-8 |
37 ms | 736 ms | 3,250 ms | 3,175 ms | +75 ms | ready |
| 2.1.198 claude-opus-4-8 |
35 ms | 724 ms | 2,718 ms | 6,084 ms | -3,366 ms | ready |
| 2.1.197 claude-opus-4-8 |
33 ms | 715 ms | 2,694 ms | 3,008 ms | -314 ms | ready |
| 2.1.196 claude-opus-4-8 |
33 ms | 720 ms | 2,609 ms | 2,708 ms | -99 ms | ready |
| 2.1.195 claude-opus-4-8 |
32 ms | 713 ms | 3,077 ms | 2,889 ms | +188 ms | ready |
| 2.1.193 claude-opus-4-8 |
31 ms | 706 ms | 2,615 ms | 2,862 ms | -247 ms | ready |
| 2.1.191 claude-opus-4-8 |
31 ms | 709 ms | 4,017 ms | 2,564 ms | +1,453 ms | ready |
| 2.1.190 claude-opus-4-8 |
31 ms | 705 ms | 2,498 ms | 4,025 ms | -1,527 ms | ready |
| 2.1.187 claude-opus-4-8 |
31 ms | 698 ms | 2,525 ms | 2,730 ms | -205 ms | ready |
| 2.1.186 claude-opus-4-8 |
31 ms | 696 ms | 2,970 ms | 3,309 ms | -339 ms | ready |
| 2.1.185 claude-opus-4-8 |
32 ms | 702 ms | 2,916 ms | 2,618 ms | +298 ms | ready |
| 2.1.183 claude-opus-4-8 |
33 ms | 702 ms | 2,682 ms | 3,259 ms | -577 ms | ready |
| 2.1.182 claude-opus-4-8 |
32 ms | 702 ms | 2,756 ms | 2,753 ms | +3 ms | ready |
| 2.1.181 claude-opus-4-8 |
31 ms | 699 ms | 2,494 ms | 2,925 ms | -431 ms | ready |
| 2.1.179 claude-opus-4-8 |
37 ms | 710 ms | 5,507 ms | 2,504 ms | +3,003 ms | ready |
| 2.1.178 claude-opus-4-8 |
37 ms | 721 ms | 2,890 ms | 2,547 ms | +343 ms | ready |
| 2.1.177 claude-opus-4-8 |
37 ms | 708 ms | 3,141 ms | 2,432 ms | +709 ms | ready |
| 2.1.176 claude-opus-4-8 |
37 ms | 709 ms | 2,571 ms | 2,572 ms | -1 ms | ready |
| 2.1.175 claude-opus-4-8 |
37 ms | 707 ms | 4,016 ms | 2,673 ms | +1,343 ms | ready |
| 2.1.174 claude-opus-4-8 |
38 ms | 711 ms | 2,838 ms | 3,502 ms | -664 ms | ready |
| 2.1.173 claude-opus-4-8 |
36 ms | 718 ms | 3,020 ms | 2,659 ms | +361 ms | ready |
| 2.1.172 claude-opus-4-8 |
36 ms | 712 ms | 2,795 ms | 3,001 ms | -206 ms | ready |
| 2.1.170 claude-opus-4-8 |
36 ms | 709 ms | 2,979 ms | 2,718 ms | +261 ms | ready |
| 2.1.169 claude-opus-4-8 |
36 ms | 703 ms | 2,802 ms | 4,054 ms | -1,252 ms | ready |
| 2.1.168 claude-opus-4-8 |
36 ms | 707 ms | 2,804 ms | 2,803 ms | +1 ms | ready |
| 2.1.167 claude-opus-4-8 |
37 ms | 704 ms | 3,416 ms | 2,281 ms | +1,135 ms | ready |
| 2.1.166 claude-opus-4-8 |
37 ms | 707 ms | 2,763 ms | 2,623 ms | +140 ms | ready |
| 2.1.165 claude-opus-4-8 |
36 ms | 705 ms | 2,497 ms | 2,941 ms | -444 ms | ready |
| 2.1.163 claude-opus-4-8 |
35 ms | 710 ms | 2,324 ms | 3,418 ms | -1,094 ms | ready |
| 2.1.162 claude-opus-4-8 |
36 ms | 705 ms | 2,331 ms | 3,710 ms | -1,379 ms | ready |
| 2.1.161 claude-opus-4-8 |
35 ms | 705 ms | 3,600 ms | 2,667 ms | +933 ms | ready |
| 2.1.160 claude-opus-4-8 |
35 ms | 711 ms | 2,567 ms | 2,579 ms | -12 ms | ready |
| 2.1.159 claude-opus-4-8 |
35 ms | 710 ms | 2,836 ms | 3,132 ms | -296 ms | ready |
| 2.1.158 claude-opus-4-8 |
35 ms | 700 ms | 2,399 ms | 2,807 ms | -408 ms | ready |
| 2.1.157 claude-opus-4-8 |
35 ms | 706 ms | 2,451 ms | 2,403 ms | +48 ms | ready |
| 2.1.156 claude-opus-4-8 |
35 ms | 704 ms | 3,142 ms | 2,543 ms | +599 ms | ready |
| 2.1.154 claude-opus-4-8 |
35 ms | 709 ms | 2,452 ms | 2,797 ms | -345 ms | ready |
| 2.1.153 claude-opus-4-7 |
34 ms | 700 ms | 2,616 ms | 2,872 ms | -256 ms | ready |
| 2.1.152 claude-opus-4-7 |
34 ms | 702 ms | 4,715 ms | 2,100 ms | +2,615 ms | ready |
| 2.1.150 claude-opus-4-7 |
34 ms | 704 ms | 2,785 ms | 4,191 ms | -1,406 ms | ready |
| 2.1.149 claude-opus-4-7 |
34 ms | 704 ms | 3,431 ms | 4,689 ms | -1,258 ms | ready |
| 2.1.148 claude-opus-4-7 |
34 ms | 707 ms | 2,655 ms | 2,633 ms | +22 ms | ready |
| 2.1.147 claude-opus-4-7 |
34 ms | 707 ms | 2,352 ms | 3,371 ms | -1,019 ms | ready |
| 2.1.146 claude-opus-4-7 |
34 ms | 704 ms | 2,695 ms | 2,886 ms | -191 ms | ready |
| 2.1.145 claude-opus-4-7 |
33 ms | 701 ms | 2,220 ms | 2,436 ms | -216 ms | ready |
| 2.1.144 claude-opus-4-7 |
33 ms | 700 ms | 2,237 ms | 2,438 ms | -201 ms | ready |
| 2.1.143 claude-opus-4-7 |
33 ms | 700 ms | 2,726 ms | 2,314 ms | +412 ms | ready |
| 2.1.142 claude-opus-4-7 |
35 ms | 698 ms | 3,706 ms | 3,299 ms | +407 ms | ready |
| 2.1.141 claude-opus-4-7 |
32 ms | 703 ms | 2,303 ms | 2,899 ms | -596 ms | ready |
| 2.1.140 claude-opus-4-7 |
32 ms | 703 ms | 2,617 ms | 2,437 ms | +180 ms | ready |
| 2.1.139 claude-opus-4-7 |
32 ms | 696 ms | 3,096 ms | 2,600 ms | +496 ms | ready |
| 2.1.138 claude-opus-4-7 |
32 ms | 703 ms | 3,143 ms | 2,581 ms | +562 ms | ready |
| 2.1.137 claude-opus-4-7 |
32 ms | 697 ms | 2,688 ms | 2,155 ms | +533 ms | ready |
| 2.1.136 claude-opus-4-7 |
31 ms | 697 ms | 2,800 ms | 2,473 ms | +327 ms | ready |
| 2.1.133 claude-opus-4-7 |
31 ms | 695 ms | 2,347 ms | 5,695 ms | -3,348 ms | ready |
| 2.1.132 claude-opus-4-7 |
35 ms | 708 ms | 4,192 ms | 6,075 ms | -1,883 ms | ready |
| 2.1.131 claude-opus-4-7 |
34 ms | 699 ms | 3,375 ms | 2,008 ms | +1,367 ms | ready |
| 2.1.129 claude-opus-4-7 |
34 ms | 694 ms | 2,563 ms | 3,203 ms | -640 ms | ready |
| 2.1.128 claude-opus-4-7 |
35 ms | 712 ms | 4,461 ms | 3,583 ms | +878 ms | ready |
| 2.1.126 claude-opus-4-7 |
36 ms | 713 ms | 3,101 ms | 4,183 ms | -1,082 ms | ready |
| 2.1.124 claude-opus-4-7 |
35 ms | 692 ms | 2,243 ms | 3,214 ms | -971 ms | ready |
| 2.1.123 claude-opus-4-7 |
35 ms | 709 ms | 2,385 ms | 2,596 ms | -211 ms | ready |
| 2.1.122 claude-opus-4-7 |
34 ms | 709 ms | 2,162 ms | 2,640 ms | -478 ms | ready |
| 2.1.121 claude-opus-4-7 |
35 ms | 707 ms | 2,813 ms | 2,275 ms | +538 ms | ready |
| 2.1.120 claude-opus-4-7 |
35 ms | 710 ms | 2,924 ms | 2,120 ms | +804 ms | ready |
| 2.1.119 claude-opus-4-7 |
34 ms | 708 ms | 2,359 ms | 2,641 ms | -282 ms | ready |
| 2.1.118 claude-opus-4-7 |
33 ms | 700 ms | 2,309 ms | 2,444 ms | -135 ms | ready |
| 2.1.117 claude-opus-4-7 |
33 ms | 694 ms | 2,168 ms | 3,079 ms | -911 ms | ready |
| 2.1.116 claude-opus-4-7 |
32 ms | 701 ms | 2,439 ms | 2,735 ms | -296 ms | ready |
| 2.1.114 claude-opus-4-7 |
32 ms | 699 ms | 2,720 ms | 3,153 ms | -433 ms | ready |
| 2.1.113 claude-opus-4-7 |
32 ms | 688 ms | 3,515 ms | 2,687 ms | +828 ms | ready |
| 2.1.112 claude-opus-4-7 |
33 ms | 701 ms | 2,267 ms | 4,209 ms | -1,942 ms | ready |
| 2.1.111 claude-opus-4-7 |
35 ms | 686 ms | 2,849 ms | 2,462 ms | +387 ms | ready |
| 2.1.110 claude-opus-4-6 |
32 ms | 684 ms | 3,106 ms | 3,460 ms | -354 ms | ready |
| 2.1.109 claude-opus-4-6 |
32 ms | 680 ms | 3,372 ms | 3,978 ms | -606 ms | ready |
| 2.1.108 claude-opus-4-6 |
33 ms | 685 ms | 3,142 ms | 3,533 ms | -391 ms | ready |
| 2.1.107 claude-opus-4-6 |
33 ms | 684 ms | 7,160 ms | 3,918 ms | +3,242 ms | ready |
| 2.1.105 claude-opus-4-6 |
32 ms | 677 ms | 3,413 ms | 3,446 ms | -33 ms | ready |
| 2.1.104 claude-opus-4-6 |
32 ms | 686 ms | 3,992 ms | 3,544 ms | +448 ms | ready |
| 2.1.101 claude-opus-4-6 |
32 ms | 693 ms | 3,869 ms | 4,557 ms | -688 ms | ready |
| 2.1.100 claude-opus-4-6 |
33 ms | 683 ms | 3,710 ms | 3,729 ms | -19 ms | ready |
| 2.1.98 claude-opus-4-6 |
32 ms | 680 ms | 3,487 ms | 3,521 ms | -34 ms | ready |
| 2.1.97 claude-opus-4-6 |
32 ms | 691 ms | 3,767 ms | 3,677 ms | +90 ms | ready |
| 2.1.96 claude-opus-4-6 |
33 ms | 684 ms | 3,707 ms | 3,811 ms | -104 ms | ready |
| 2.1.94 claude-opus-4-6 |
33 ms | 691 ms | 3,448 ms | 3,387 ms | +61 ms | ready |
| 2.1.92 claude-opus-4-6 |
31 ms | 682 ms | 3,634 ms | 3,432 ms | +202 ms | ready |
| 2.1.91† claude-opus-4-6 |
31 ms | 764 ms | 3,147 ms | 3,166 ms | -19 ms | ready |
| 2.1.90† claude-opus-4-6 |
30 ms | 690 ms | 3,202 ms | 3,247 ms | -45 ms | ready |
| 2.1.89 claude-opus-4-6 |
30 ms | 693 ms | 5,795 ms | 3,499 ms | +2,296 ms | ready |
| 2.1.87 claude-opus-4-6 |
30 ms | 678 ms | 3,677 ms | 3,263 ms | +414 ms | ready |
| 2.1.86 claude-opus-4-6 |
30 ms | 674 ms | 4,101 ms | 3,506 ms | +595 ms | ready |
| 2.1.85 claude-opus-4-6 |
30 ms | 673 ms | 3,537 ms | 3,147 ms | +390 ms | ready |
| 2.1.84† claude-opus-4-6 |
30 ms | 677 ms | 3,232 ms | 3,501 ms | -269 ms | ready |
| 2.1.83 claude-opus-4-6 |
29 ms | 699 ms | 3,107 ms | 3,077 ms | +30 ms | ready |
| 2.1.81† claude-opus-4-6 |
29 ms | 680 ms | 2,913 ms | 3,310 ms | -397 ms | ready |
| 2.1.80 claude-opus-4-6 |
30 ms | 678 ms | 2,925 ms | 3,004 ms | -79 ms | ready |
| 2.1.79 claude-opus-4-6 |
31 ms | 674 ms | 3,272 ms | 3,662 ms | -390 ms | ready |
| 2.1.78† claude-opus-4-6 |
29 ms | 679 ms | 3,019 ms | 4,432 ms | -1,413 ms | ready |
| 2.1.77† claude-opus-4-6 |
29 ms | 657 ms | 2,890 ms | 3,812 ms | -922 ms | ready |
| 2.1.76† claude-opus-4-6 |
30 ms | 663 ms | 2,794 ms | 2,647 ms | +147 ms | ready |
| 2.1.75 claude-opus-4-6 |
28 ms | 672 ms | 3,149 ms | 3,843 ms | -694 ms | ready |
| 2.1.74 claude-opus-4-6 |
29 ms | 667 ms | 3,208 ms | 4,204 ms | -996 ms | ready |
| 2.1.73 claude-opus-4-6 |
29 ms | 662 ms | 2,924 ms | 2,991 ms | -67 ms | ready |
| 2.1.72 claude-opus-4-6 |
31 ms | 665 ms | 4,154 ms | 3,237 ms | +917 ms | ready |
| 2.1.71† claude-opus-4-6 |
28 ms | 669 ms | 3,468 ms | 2,924 ms | +544 ms | ready |
| 2.1.70 claude-opus-4-6 |
31 ms | 833 ms | 3,257 ms | 3,675 ms | -418 ms | ready |
| 2.1.69† claude-opus-4-6 |
29 ms | 679 ms | 2,958 ms | 4,512 ms | -1,554 ms | ready |
| 2.1.68 claude-opus-4-6 |
28 ms | 686 ms | 4,715 ms | 3,667 ms | +1,048 ms | ready |
| 2.1.66 claude-opus-4-6 |
29 ms | 681 ms | 4,203 ms | 3,955 ms | +248 ms | ready |
| 2.1.64† claude-opus-4-6 |
28 ms | 676 ms | 3,871 ms | 3,913 ms | -42 ms | ready |
| 2.1.63† claude-opus-4-6 |
27 ms | 696 ms | 6,432 ms | 3,744 ms | +2,688 ms | ready |
| 2.1.62 claude-opus-4-6 |
28 ms | 683 ms | 5,332 ms | 4,436 ms | +896 ms | ready |
| 2.1.61† claude-opus-4-6 |
28 ms | 698 ms | 6,187 ms | 5,015 ms | +1,172 ms | ready |
| 2.1.59† claude-opus-4-6 |
26 ms | 681 ms | 4,202 ms | 4,059 ms | +143 ms | ready |
| 2.1.58 claude-opus-4-6 |
27 ms | 679 ms | 4,524 ms | 4,762 ms | -238 ms | ready |
| 2.1.56† claude-opus-4-6 |
30 ms | 680 ms | 4,233 ms | 4,141 ms | +92 ms | ready |
| 2.1.55 claude-opus-4-6 |
27 ms | 678 ms | 4,124 ms | 4,977 ms | -853 ms | ready |
| 2.1.54† claude-opus-4-6 |
27 ms | 696 ms | 3,918 ms | 4,019 ms | -101 ms | ready |
| 2.1.53 claude-opus-4-6 |
29 ms | 685 ms | 4,390 ms | 5,170 ms | -780 ms | ready |
| 2.1.52 claude-opus-4-6 |
37 ms | 692 ms | 7,804 ms | 4,580 ms | +3,224 ms | ready |
| 2.1.51† | 40 ms | 717 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.50 claude-opus-4-6 |
37 ms | 688 ms | 5,534 ms | 5,232 ms | +302 ms | ready |
| 2.1.49 claude-opus-4-6 |
37 ms | 722 ms | 7,309 ms | 5,753 ms | +1,556 ms | ready |
| 2.1.48† claude-opus-4-6 |
37 ms | 698 ms | 4,370 ms | 5,128 ms | -758 ms | ready |
| 2.1.47 claude-opus-4-6 |
37 ms | 711 ms | 5,243 ms | 5,027 ms | +216 ms | ready |
| 2.1.45 claude-opus-4-6 |
36 ms | 705 ms | 7,359 ms | 4,170 ms | +3,189 ms | ready |
| 2.1.44† claude-opus-4-6 |
36 ms | 714 ms | 3,894 ms | 4,983 ms | -1,089 ms | ready |
| 2.1.42 claude-opus-4-6 |
36 ms | 706 ms | 3,965 ms | 5,591 ms | -1,626 ms | ready |
| 2.1.41† claude-opus-4-6 |
37 ms | 721 ms | 5,110 ms | 4,335 ms | +775 ms | ready |
| 2.1.40 claude-opus-4-6 |
36 ms | 708 ms | 4,112 ms | 4,733 ms | -621 ms | ready |
| 2.1.39 claude-opus-4-6 |
36 ms | 671 ms | 4,144 ms | 5,285 ms | -1,141 ms | ready |
| 2.1.38† claude-opus-4-6 |
36 ms | 671 ms | 5,808 ms | 4,105 ms | +1,703 ms | ready |
| 2.1.37 claude-opus-4-6 |
35 ms | 682 ms | 1,093 ms | 1,086 ms | +7 ms | ready |
| 2.1.36† claude-opus-4-6 |
36 ms | 692 ms | 1,119 ms | 1,089 ms | +30 ms | ready |
| 2.1.34 claude-opus-4-6 |
36 ms | 692 ms | 1,099 ms | 1,281 ms | -182 ms | ready |
| 2.1.33 claude-opus-4-6 |
37 ms | 692 ms | 1,101 ms | 1,101 ms | +0 ms | ready |
| 2.1.32† claude-opus-4-6 |
153 ms | 710 ms | 1,107 ms | 1,099 ms | +8 ms | ready |
| 2.1.31† claude-opus-4-5-20251101 |
154 ms | 718 ms | 1,116 ms | 1,113 ms | +3 ms | ready |
| 2.1.30† claude-opus-4-5-20251101 |
151 ms | 707 ms | 1,108 ms | 1,099 ms | +9 ms | ready |
| 2.1.29† claude-opus-4-5-20251101 |
151 ms | 705 ms | 1,128 ms | 1,148 ms | -20 ms | ready |
| 2.1.27 claude-opus-4-5-20251101 |
149 ms | 705 ms | 1,153 ms | 1,140 ms | +13 ms | ready |
| 2.1.25† | 1,183 ms | 698 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.23† | 1,185 ms | 707 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.22 claude-opus-4-5-20251101 |
1,183 ms | 704 ms | 3,739 ms | 1,142 ms | +2,597 ms | ready |
| 2.1.21† claude-opus-4-5-20251101 |
1,192 ms | 704 ms | 1,154 ms | 1,155 ms | -1 ms | ready |
| 2.1.20† | 1,185 ms | 708 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.19† claude-opus-4-5-20251101 |
141 ms | 702 ms | 1,138 ms | 1,154 ms | -16 ms | ready |
| 2.1.18† claude-opus-4-5-20251101 |
141 ms | 705 ms | 1,141 ms | 1,148 ms | -7 ms | ready |
| 2.1.17† claude-opus-4-5-20251101 |
139 ms | 703 ms | 1,155 ms | 1,123 ms | +32 ms | ready |
| 2.1.16† claude-opus-4-5-20251101 |
143 ms | 710 ms | 1,141 ms | 1,153 ms | -12 ms | ready |
| 2.1.15 claude-opus-4-5-20251101 |
142 ms | 816 ms | 3,484 ms | 1,214 ms | +2,270 ms | ready |
| 2.1.14 claude-opus-4-5-20251101 |
139 ms | 993 ms | 1,502 ms | 1,402 ms | +100 ms | ready |
| 2.1.12† claude-opus-4-5-20251101 |
140 ms | 1,351 ms | 1,798 ms | 1,799 ms | -1 ms | ready |
| 2.1.11† claude-opus-4-5-20251101 |
140 ms | 1,358 ms | 1,797 ms | 1,767 ms | +30 ms | ready |
| 2.1.10 claude-opus-4-5-20251101 |
139 ms | 1,390 ms | 1,809 ms | 1,823 ms | -14 ms | ready |
| 2.1.9† claude-opus-4-5-20251101 |
139 ms | 1,203 ms | 1,658 ms | 1,913 ms | -255 ms | ready |
| 2.1.8† | 140 ms | 1,075 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.7† claude-opus-4-5-20251101 |
139 ms | 1,252 ms | 1,577 ms | 1,815 ms | -238 ms | ready |
| 2.1.6 claude-opus-4-5-20251101 |
143 ms | 1,110 ms | 1,797 ms | 1,734 ms | +63 ms | ready |
| 2.1.5† claude-opus-4-5-20251101 |
140 ms | 1,081 ms | 1,665 ms | 1,941 ms | -276 ms | ready |
| 2.1.4 claude-opus-4-5-20251101 |
141 ms | 1,099 ms | 1,644 ms | 1,712 ms | -68 ms | ready |
| 2.1.3† claude-opus-4-5-20251101 |
141 ms | 1,151 ms | 1,814 ms | 1,857 ms | -43 ms | ready |
| 2.1.2 claude-opus-4-5-20251101 |
142 ms | 1,417 ms | 1,966 ms | 1,867 ms | +99 ms | ready |
| 2.1.1† claude-opus-4-5-20251101 |
140 ms | 1,331 ms | 1,838 ms | 2,042 ms | -204 ms | ready |
| 2.1.0 claude-opus-4-5-20251101 |
140 ms | 1,279 ms | 1,832 ms | 1,763 ms | +69 ms | ready |
| 2.0.77 claude-opus-4-5-20251101 |
140 ms | 1,149 ms | 1,682 ms | 1,803 ms | -121 ms | ready |
| 2.0.76† claude-opus-4-5-20251101 |
147 ms | 1,229 ms | 1,632 ms | 1,637 ms | -5 ms | ready |
| 2.0.75† claude-opus-4-5-20251101 |
340 ms | 1,224 ms | 1,963 ms | 1,616 ms | +347 ms | ready |
| 2.0.74† claude-opus-4-5-20251101 |
401 ms | 1,516 ms | 1,567 ms | 1,570 ms | -3 ms | ready |
| 2.0.73 claude-opus-4-5-20251101 |
147 ms | 1,417 ms | 1,538 ms | 1,599 ms | -61 ms | ready |
| 2.0.72 claude-opus-4-5-20251101 |
147 ms | 1,311 ms | 1,538 ms | 1,679 ms | -141 ms | ready |
| 2.0.71 claude-opus-4-5-20251101 |
146 ms | 1,154 ms | 1,490 ms | 1,447 ms | +43 ms | ready |
| 2.0.70 claude-opus-4-5-20251101 |
128 ms | 1,119 ms | 1,711 ms | 1,766 ms | -55 ms | ready |
| 2.0.69† claude-opus-4-5-20251101 |
128 ms | 970 ms | 1,275 ms | 1,286 ms | -11 ms | ready |
| 2.0.68† claude-opus-4-5-20251101 |
127 ms | 973 ms | 1,755 ms | 1,295 ms | +460 ms | ready |
| 2.0.67† claude-opus-4-5-20251101 |
128 ms | 985 ms | 1,544 ms | 1,294 ms | +250 ms | ready |
| 2.0.66 claude-opus-4-5-20251101 |
128 ms | 957 ms | 1,285 ms | 1,728 ms | -443 ms | ready |
| 2.0.65 claude-opus-4-5-20251101 |
127 ms | 955 ms | 1,275 ms | 1,295 ms | -20 ms | ready |
| 2.0.64 claude-opus-4-5-20251101 |
127 ms | 953 ms | 1,275 ms | 1,263 ms | +12 ms | ready |
| 2.0.62 claude-opus-4-5-20251101 |
132 ms | 951 ms | 1,281 ms | 1,274 ms | +7 ms | ready |
| 2.0.61 claude-opus-4-5-20251101 |
131 ms | 955 ms | 1,287 ms | 1,288 ms | -1 ms | ready |
| 2.0.60 claude-opus-4-5-20251101 |
133 ms | 952 ms | 1,277 ms | 1,275 ms | +2 ms | ready |
| 2.0.59† claude-opus-4-5-20251101 |
131 ms | 964 ms | 1,301 ms | 1,596 ms | -295 ms | ready |
| 2.0.58† claude-opus-4-5-20251101 |
131 ms | 958 ms | 1,366 ms | 1,337 ms | +29 ms | ready |
| 2.0.57 claude-opus-4-5-20251101 |
147 ms | 975 ms | 1,417 ms | 1,571 ms | -154 ms | ready |
| 2.0.56 claude-opus-4-5-20251101 |
129 ms | 953 ms | 1,292 ms | 1,337 ms | -45 ms | ready |
| 2.0.55 claude-opus-4-5-20251101 |
140 ms | 1,010 ms | 1,630 ms | 1,522 ms | +108 ms | ready |
| 2.0.54† claude-opus-4-5-20251101 |
136 ms | 938 ms | 1,305 ms | 1,427 ms | -122 ms | ready |
| 2.0.53 claude-opus-4-5-20251101 |
127 ms | 942 ms | 1,356 ms | 1,308 ms | +48 ms | ready |
| 2.0.52 claude-opus-4-5-20251101 |
127 ms | 947 ms | 1,553 ms | 1,453 ms | +100 ms | ready |
| 2.0.51 claude-opus-4-5-20251101 |
128 ms | 950 ms | 1,344 ms | 1,393 ms | -49 ms | ready |
| 2.0.50 claude-opus-4-5-20251101 |
128 ms | 939 ms | 1,656 ms | 1,487 ms | +169 ms | ready |
| 2.0.49 claude-opus-4-5-20251101 |
128 ms | 938 ms | 1,783 ms | 1,736 ms | +47 ms | ready |
| 2.0.47 claude-opus-4-5-20251101 |
164 ms | 932 ms | 1,732 ms | 1,472 ms | +260 ms | ready |
| 2.0.46 claude-opus-4-5-20251101 |
164 ms | 931 ms | 1,555 ms | 1,566 ms | -11 ms | ready |
| 2.0.45 claude-opus-4-5-20251101 |
164 ms | 938 ms | 1,371 ms | 1,588 ms | -217 ms | ready |
| 2.0.44 claude-opus-4-5-20251101 |
157 ms | 918 ms | 1,590 ms | 1,661 ms | -71 ms | ready |
| 2.0.43 claude-opus-4-5-20251101 |
154 ms | 929 ms | 1,483 ms | 1,532 ms | -49 ms | ready |
| 2.0.42† claude-opus-4-5-20251101 |
161 ms | 921 ms | 1,551 ms | 1,479 ms | +72 ms | ready |
| 2.0.41 claude-opus-4-5-20251101 |
161 ms | 915 ms | 1,559 ms | 1,562 ms | -3 ms | ready |
| 2.0.37 claude-opus-4-5-20251101 |
162 ms | 921 ms | 1,810 ms | 1,739 ms | +71 ms | ready |
| 2.0.36 claude-opus-4-5-20251101 |
160 ms | 916 ms | 1,582 ms | 1,513 ms | +69 ms | ready |
| 2.0.35† claude-opus-4-5-20251101 |
182 ms | 925 ms | 1,261 ms | 1,497 ms | -236 ms | ready |
| 2.0.34 claude-opus-4-5-20251101 |
159 ms | 981 ms | 1,550 ms | 1,466 ms | +84 ms | ready |
| 2.0.33† claude-opus-4-5-20251101 |
159 ms | 891 ms | 1,469 ms | 1,496 ms | -27 ms | ready |
| 2.0.32 claude-opus-4-5-20251101 |
273 ms | 1,047 ms | 1,675 ms | 1,561 ms | +114 ms | ready |
| 2.0.31 claude-opus-4-1-20250805 |
275 ms | 1,026 ms | 1,700 ms | 1,581 ms | +119 ms | ready |
| 2.0.30 claude-opus-4-1-20250805 |
276 ms | 1,017 ms | 1,700 ms | 1,543 ms | +157 ms | ready |
| 2.0.29 claude-opus-4-1-20250805 |
272 ms | 1,025 ms | 1,541 ms | 1,614 ms | -73 ms | ready |
| 2.0.28† claude-opus-4-1-20250805 |
275 ms | 1,015 ms | 1,807 ms | 1,592 ms | +215 ms | ready |
| 2.0.27 claude-opus-4-1-20250805 |
274 ms | 1,010 ms | 1,543 ms | 1,610 ms | -67 ms | ready |
| 2.0.26 claude-opus-4-1-20250805 |
286 ms | 1,026 ms | 1,711 ms | 1,507 ms | +204 ms | ready |
| 2.0.25 claude-opus-4-1-20250805 |
297 ms | 1,041 ms | 1,659 ms | 1,672 ms | -13 ms | ready |
| 2.0.24 claude-opus-4-1-20250805 |
298 ms | 1,056 ms | 1,705 ms | 1,553 ms | +152 ms | ready |
detail · Codex
| version | spawn (--version) | interactive startup | response | response (no mcp) | mcp overhead | response fast | fast savings | fast (no mcp) | result |
|---|---|---|---|---|---|---|---|---|---|
| rust-v0.150.1† gpt-5.6-sol |
9 ms | 515 ms | 5,258 ms | 5,061 ms | +197 ms | 5,001 ms | -257 ms | 4,938 ms | ready |
| rust-v0.150.0† gpt-5.6-sol |
8 ms | 516 ms | 5,109 ms | 6,052 ms | -943 ms | 4,775 ms | -334 ms | 4,542 ms | ready |
| rust-v0.149.1 gpt-5.6-sol |
8 ms | 517 ms | 8,789 ms | 6,968 ms | +1,821 ms | 4,859 ms | -3,930 ms | 4,665 ms | ready |
| rust-v0.149.0† gpt-5.6-sol |
8 ms | 521 ms | 8,269 ms | 5,427 ms | +2,842 ms | 4,895 ms | -3,374 ms | 5,040 ms | ready |
| rust-v0.148.0† gpt-5.6-sol |
9 ms | 520 ms | 6,151 ms | 5,247 ms | +904 ms | 4,808 ms | -1,343 ms | 4,906 ms | ready |
| rust-v0.147.0† gpt-5.5 |
9 ms | 528 ms | 5,185 ms | 5,594 ms | -409 ms | 4,969 ms | -216 ms | 4,680 ms | ready |
| rust-v0.146.0 gpt-5.5 |
28 ms | 556 ms | 6,078 ms | 6,395 ms | -317 ms | 4,780 ms | -1,298 ms | 7,024 ms | ready |
| rust-v0.145.0 gpt-5.5 |
28 ms | 571 ms | 5,353 ms | 5,657 ms | -304 ms | 4,823 ms | -530 ms | 5,504 ms | ready |
| rust-v0.144.6 gpt-5.6 |
27 ms | 551 ms | 4,155 ms | 3,736 ms | +419 ms | 3,259 ms | -896 ms | 3,242 ms | ready |
| rust-v0.144.5 gpt-5.6 |
27 ms | 554 ms | 3,941 ms | 3,239 ms | +702 ms | 3,233 ms | -708 ms | 3,360 ms | ready |
| rust-v0.144.4 gpt-5.6 |
27 ms | 553 ms | 3,242 ms | 4,555 ms | -1,313 ms | 3,159 ms | -83 ms | 3,174 ms | ready |
| rust-v0.144.3 gpt-5.6 |
26 ms | 549 ms | 3,174 ms | 3,359 ms | -185 ms | 3,224 ms | +50 ms | 3,341 ms | ready |
| rust-v0.144.2 gpt-5.6 |
26 ms | 563 ms | 3,245 ms | 3,302 ms | -57 ms | 3,347 ms | +102 ms | 3,298 ms | ready |
| rust-v0.144.1 gpt-5.6 |
24 ms | 550 ms | 3,376 ms | 3,355 ms | +21 ms | 3,194 ms | -182 ms | 3,370 ms | ready |
| rust-v0.144.0 gpt-5.6 |
27 ms | 553 ms | 3,140 ms | 3,173 ms | -33 ms | 3,541 ms | +401 ms | 3,144 ms | ready |
| rust-v0.143.0 gpt-5.5 |
26 ms | 551 ms | 5,805 ms | 4,997 ms | +808 ms | 4,665 ms | -1,140 ms | 6,018 ms | ready |
| rust-v0.142.5 gpt-5.5 |
27 ms | 550 ms | 4,829 ms | 4,993 ms | -164 ms | 5,531 ms | +702 ms | 5,220 ms | ready |
| rust-v0.142.4 gpt-5.5 |
27 ms | 550 ms | 4,240 ms | 5,454 ms | -1,214 ms | 6,130 ms | +1,890 ms | 4,622 ms | ready |
| rust-v0.142.3 gpt-5.5 |
27 ms | 549 ms | 4,776 ms | 4,957 ms | -181 ms | 4,455 ms | -321 ms | 4,495 ms | ready |
| rust-v0.142.2 gpt-5.5 |
27 ms | 549 ms | 6,974 ms | 4,704 ms | +2,270 ms | 4,917 ms | -2,057 ms | 4,716 ms | ready |
| rust-v0.142.1 gpt-5.5 |
27 ms | 554 ms | 4,869 ms | 5,142 ms | -273 ms | 4,130 ms | -739 ms | 4,646 ms | ready |
| rust-v0.142.0 gpt-5.5 |
25 ms | 551 ms | 4,874 ms | 6,021 ms | -1,147 ms | 4,794 ms | -80 ms | 5,569 ms | ready |
| rust-v0.141.0 gpt-5.5 |
26 ms | 555 ms | 4,797 ms | 4,971 ms | -174 ms | 4,719 ms | -78 ms | 4,868 ms | ready |
| rust-v0.140.0 gpt-5.5 |
26 ms | 555 ms | 4,981 ms | 5,739 ms | -758 ms | 4,313 ms | -668 ms | 5,503 ms | ready |
| rust-v0.139.0 gpt-5.5 |
28 ms | 555 ms | 7,787 ms | 7,404 ms | +383 ms | 7,815 ms | +28 ms | 6,698 ms | ready |
| rust-v0.138.0 gpt-5.5 |
28 ms | 564 ms | 7,703 ms | 8,154 ms | -451 ms | 6,973 ms | -730 ms | 8,000 ms | ready |
| rust-v0.137.0 gpt-5.5 |
27 ms | 560 ms | 6,885 ms | 7,506 ms | -621 ms | 7,980 ms | +1,095 ms | 7,341 ms | ready |
| rust-v0.136.0 gpt-5.5 |
28 ms | 581 ms | 7,469 ms | 9,591 ms | -2,122 ms | 7,862 ms | +393 ms | 7,160 ms | ready |
| rust-v0.135.0 gpt-5.5 |
30 ms | 560 ms | 6,675 ms | 6,513 ms | +162 ms | 7,028 ms | +353 ms | 5,760 ms | ready |
| rust-v0.134.0 gpt-5.5 |
27 ms | 547 ms | 5,504 ms | 6,522 ms | -1,018 ms | 4,931 ms | -573 ms | 5,546 ms | ready |
| rust-v0.133.0 gpt-5.5 |
13 ms | 532 ms | 5,634 ms | 8,494 ms | -2,860 ms | 5,016 ms | -618 ms | 4,599 ms | ready |
| rust-v0.132.0† gpt-5.5 |
14 ms | 531 ms | 6,480 ms | 7,286 ms | -806 ms | 6,017 ms | -463 ms | 6,273 ms | ready |
caveats
- † Claude Code 2.0.28 — response (no mcp) spike of 1,912 ms vs 1,613.5 ms median; dropped and re-run clean. slow sample exceeded 1773 ms cutoff
- † Claude Code 2.0.33 — response spike of 1,686 ms vs 1,466 ms median; dropped and re-run clean. slow sample exceeded 1618 ms cutoff
- † Claude Code 2.0.33 — response (no mcp) spike of 1,707 ms vs 1,464 ms median; dropped and re-run clean. slow sample exceeded 1630 ms cutoff
- † Claude Code 2.0.33 — response (no mcp) spike of 1,696 ms vs 1,464 ms median; dropped and re-run clean. slow sample exceeded 1630 ms cutoff
- † Claude Code 2.0.35 — response spike of 1,609 ms vs 1,270 ms median; dropped and re-run clean. slow sample exceeded 1428 ms cutoff
- † Claude Code 2.0.35 — response spike of 1,624 ms vs 1,270 ms median; dropped and re-run clean. slow sample exceeded 1428 ms cutoff
- † Claude Code 2.0.35 — response spike of 1,574 ms vs 1,270 ms median; dropped and re-run clean. slow sample exceeded 1428 ms cutoff
- † Claude Code 2.0.42 — response spike of 1,745 ms vs 1,513 ms median; dropped and re-run clean. slow sample exceeded 1664 ms cutoff
- † Claude Code 2.0.42 — response spike of 1,741 ms vs 1,513 ms median; dropped and re-run clean. slow sample exceeded 1664 ms cutoff
- † Claude Code 2.0.54 — response spike of 1,548 ms vs 1,315 ms median; dropped and re-run clean. slow sample exceeded 1523 ms cutoff
- † Claude Code 2.0.58 — response (no mcp) spike of 1,605 ms vs 1,302.5 ms median; dropped and re-run clean. slow sample exceeded 1486 ms cutoff
- † Claude Code 2.0.59 — response spike of 1,520 ms vs 1,288 ms median; dropped and re-run clean. slow sample exceeded 1456 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 1,655 ms vs 1,300.5 ms median; dropped and re-run clean. slow sample exceeded 1503 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 1,623 ms vs 1,300.5 ms median; dropped and re-run clean. slow sample exceeded 1503 ms cutoff
- † Claude Code 2.0.68 — response (no mcp) spike of 1,685 ms vs 1,296 ms median; dropped and re-run clean. slow sample exceeded 1504 ms cutoff
- † Claude Code 2.0.68 — response (no mcp) spike of 1,728 ms vs 1,296 ms median; dropped and re-run clean. slow sample exceeded 1504 ms cutoff
- † Claude Code 2.0.69 — response spike of 1,545 ms vs 1,277 ms median; dropped and re-run clean. slow sample exceeded 1430 ms cutoff
- † Claude Code 2.0.69 — response (no mcp) spike of 1,606 ms vs 1,288.5 ms median; dropped and re-run clean. slow sample exceeded 1440 ms cutoff
- † Claude Code 2.0.74 — response spike of 2,444 ms vs 1,569 ms median; dropped and re-run clean. slow sample exceeded 1729 ms cutoff
- † Claude Code 2.0.75 — interactive startup spike of 1,531 ms vs 1,184 ms median; dropped and re-run clean. slow sample exceeded 1530 ms cutoff
- † Claude Code 2.0.75 — interactive startup spike of 1,637 ms vs 1,184 ms median; dropped and re-run clean. slow sample exceeded 1530 ms cutoff
- † Claude Code 2.0.76 — response spike of 2,071 ms vs 1,566.5 ms median; dropped and re-run clean. slow sample exceeded 1858 ms cutoff
- † Claude Code 2.0.76 — response (no mcp) spike of 1,943 ms vs 1,683.5 ms median; dropped and re-run clean. slow sample exceeded 1837 ms cutoff
- † Claude Code 2.1.1 — response spike of 3,018 ms vs 1,863.5 ms median; dropped and re-run clean. slow sample exceeded 2025 ms cutoff
- † Claude Code 2.1.1 — response spike of 2,907 ms vs 1,863.5 ms median; dropped and re-run clean. slow sample exceeded 2025 ms cutoff
- † Claude Code 2.1.1 — response (no mcp) spike of 2,512 ms vs 1,878.5 ms median; dropped and re-run clean. slow sample exceeded 2408 ms cutoff
- † Claude Code 2.1.3 — response spike of 2,486 ms vs 1,895 ms median; dropped and re-run clean. slow sample exceeded 2083 ms cutoff
- † Claude Code 2.1.3 — response spike of 2,400 ms vs 1,895 ms median; dropped and re-run clean. slow sample exceeded 2083 ms cutoff
- † Claude Code 2.1.5 — interactive startup spike of 1,386 ms vs 1,085 ms median; dropped and re-run clean. slow sample exceeded 1242 ms cutoff
- † Claude Code 2.1.5 — response spike of 1,926 ms vs 1,669 ms median; dropped and re-run clean. slow sample exceeded 1833 ms cutoff
- † Claude Code 2.1.7 — interactive startup spike of 1,392 ms vs 1,219 ms median; dropped and re-run clean. slow sample exceeded 1370 ms cutoff
- † Claude Code 2.1.8 — interactive startup spike of 1,265 ms vs 1,076 ms median; dropped and re-run clean. slow sample exceeded 1238 ms cutoff
- † Claude Code 2.1.8 — interactive startup spike of 1,790 ms vs 1,076 ms median; dropped and re-run clean. slow sample exceeded 1238 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,207 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,285 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,375 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff
- † Claude Code 2.1.8 — response (no mcp) spike of 2,283 ms vs 1,844.5 ms median; dropped and re-run clean. slow sample exceeded 2176 ms cutoff; rerun budget exhausted
- † Claude Code 2.1.9 — interactive startup spike of 1,903 ms vs 1,235 ms median; dropped and re-run clean. slow sample exceeded 1700 ms cutoff
- † Claude Code 2.1.11 — response spike of 1,939 ms vs 1,775.5 ms median; dropped and re-run clean. slow sample exceeded 1926 ms cutoff
- † Claude Code 2.1.12 — interactive startup spike of 1,971 ms vs 1,330 ms median; dropped and re-run clean. slow sample exceeded 1508 ms cutoff
- † Claude Code 2.1.12 — interactive startup spike of 1,652 ms vs 1,330 ms median; dropped and re-run clean. slow sample exceeded 1508 ms cutoff
- † Claude Code 2.1.12 — response (no mcp) spike of 2,128 ms vs 1,815 ms median; dropped and re-run clean. slow sample exceeded 2033 ms cutoff
- † Claude Code 2.1.16 — response (no mcp) spike of 5,152 ms vs 1,156.5 ms median; dropped and re-run clean. slow sample exceeded 1313 ms cutoff
- † Claude Code 2.1.17 — response (no mcp) spike of 1,406 ms vs 1,114 ms median; dropped and re-run clean. slow sample exceeded 1272 ms cutoff
- † Claude Code 2.1.17 — response (no mcp) spike of 1,393 ms vs 1,114 ms median; dropped and re-run clean. slow sample exceeded 1272 ms cutoff
- † Claude Code 2.1.18 — response spike of 2,170 ms vs 1,134.5 ms median; dropped and re-run clean. slow sample exceeded 1298 ms cutoff
- † Claude Code 2.1.18 — response spike of 4,891 ms vs 1,134.5 ms median; dropped and re-run clean. slow sample exceeded 1298 ms cutoff
- † Claude Code 2.1.19 — response (no mcp) spike of 4,869 ms vs 1,157.5 ms median; dropped and re-run clean. slow sample exceeded 1313 ms cutoff
- † Claude Code 2.1.20 — response spike of 4,674 ms vs 1,148 ms median; dropped and re-run clean. slow sample exceeded 1306 ms cutoff
- † Claude Code 2.1.21 — response spike of 1,317 ms vs 1,150.5 ms median; dropped and re-run clean. slow sample exceeded 1303 ms cutoff
- † Claude Code 2.1.21 — response (no mcp) spike of 1,417 ms vs 1,152 ms median; dropped and re-run clean. slow sample exceeded 1308 ms cutoff
- † Claude Code 2.1.23 — response spike of 1,357 ms vs 1,149 ms median; dropped and re-run clean. slow sample exceeded 1299 ms cutoff
- † Claude Code 2.1.25 — response spike of 1,503 ms vs 1,130 ms median; dropped and re-run clean. slow sample exceeded 1293 ms cutoff
- † Claude Code 2.1.29 — response spike of 3,480 ms vs 1,126 ms median; dropped and re-run clean. slow sample exceeded 1282 ms cutoff
- † Claude Code 2.1.30 — response (no mcp) spike of 2,336 ms vs 1,105.5 ms median; dropped and re-run clean. slow sample exceeded 1266 ms cutoff
- † Claude Code 2.1.31 — response spike of 1,517 ms vs 1,114.5 ms median; dropped and re-run clean. slow sample exceeded 1265 ms cutoff
- † Claude Code 2.1.31 — response spike of 3,629 ms vs 1,114.5 ms median; dropped and re-run clean. slow sample exceeded 1265 ms cutoff
- † Claude Code 2.1.32 — response spike of 5,123 ms vs 1,110.5 ms median; dropped and re-run clean. slow sample exceeded 1264 ms cutoff
- † Claude Code 2.1.32 — response (no mcp) spike of 4,899 ms vs 1,098.5 ms median; dropped and re-run clean. slow sample exceeded 1256 ms cutoff
- † Claude Code 2.1.36 — response spike of 5,623 ms vs 1,145.5 ms median; dropped and re-run clean. slow sample exceeded 1744 ms cutoff
- † Claude Code 2.1.36 — response (no mcp) spike of 6,631 ms vs 1,092 ms median; dropped and re-run clean. slow sample exceeded 1244 ms cutoff
- † Claude Code 2.1.36 — response (no mcp) spike of 1,456 ms vs 1,092 ms median; dropped and re-run clean. slow sample exceeded 1244 ms cutoff
- † Claude Code 2.1.38 — response (no mcp) spike of 4,725 ms vs 4,238 ms median; dropped and re-run clean. slow sample exceeded 4703 ms cutoff
- † Claude Code 2.1.41 — response spike of 9,780 ms vs 5,135 ms median; dropped and re-run clean. slow sample exceeded 7540 ms cutoff
- † Claude Code 2.1.44 — response spike of 6,096 ms vs 4,040.5 ms median; dropped and re-run clean. slow sample exceeded 5480 ms cutoff
- † Claude Code 2.1.48 — response (no mcp) spike of 8,560 ms vs 5,045 ms median; dropped and re-run clean. slow sample exceeded 5787 ms cutoff
- † Claude Code 2.1.51 — response spike of 11,035 ms vs 4,560.5 ms median; dropped and re-run clean. slow sample exceeded 6099 ms cutoff
- † Claude Code 2.1.51 — response spike of 7,814 ms vs 4,560.5 ms median; dropped and re-run clean. slow sample exceeded 6099 ms cutoff
- † Claude Code 2.1.51 — response spike of 7,693 ms vs 4,560.5 ms median; dropped and re-run clean. slow sample exceeded 6099 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 4,510 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 14,514 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 5,948 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff
- † Claude Code 2.1.51 — response (no mcp) spike of 4,893 ms vs 4,166.5 ms median; dropped and re-run clean. slow sample exceeded 4399 ms cutoff; rerun budget exhausted
- † Claude Code 2.1.54 — response spike of 4,492 ms vs 4,010.5 ms median; dropped and re-run clean. slow sample exceeded 4342 ms cutoff
- † Claude Code 2.1.54 — response (no mcp) spike of 7,834 ms vs 4,387.5 ms median; dropped and re-run clean. slow sample exceeded 6104 ms cutoff
- † Claude Code 2.1.54 — response (no mcp) spike of 4,561 ms vs 4,232.5 ms median; dropped and re-run clean. slow sample exceeded 4416 ms cutoff
- † Claude Code 2.1.56 — response spike of 9,557 ms vs 4,236.5 ms median; dropped and re-run clean. slow sample exceeded 6478 ms cutoff
- † Claude Code 2.1.56 — response (no mcp) spike of 5,096 ms vs 4,122 ms median; dropped and re-run clean. slow sample exceeded 4439 ms cutoff
- † Claude Code 2.1.56 — response (no mcp) spike of 10,222 ms vs 4,122 ms median; dropped and re-run clean. slow sample exceeded 4439 ms cutoff
- † Claude Code 2.1.56 — response (no mcp) spike of 5,169 ms vs 4,122 ms median; dropped and re-run clean. slow sample exceeded 4439 ms cutoff
- † Claude Code 2.1.59 — response (no mcp) spike of 9,302 ms vs 4,079.5 ms median; dropped and re-run clean. slow sample exceeded 8171 ms cutoff
- † Claude Code 2.1.61 — response (no mcp) spike of 7,983 ms vs 4,661 ms median; dropped and re-run clean. slow sample exceeded 6808 ms cutoff
- † Claude Code 2.1.63 — response (no mcp) spike of 7,693 ms vs 3,546 ms median; dropped and re-run clean. slow sample exceeded 4545 ms cutoff
- † Claude Code 2.1.64 — response (no mcp) spike of 6,335 ms vs 4,168 ms median; dropped and re-run clean. slow sample exceeded 4900 ms cutoff
- † Claude Code 2.1.69 — response spike of 9,867 ms vs 3,081.5 ms median; dropped and re-run clean. slow sample exceeded 3364 ms cutoff
- † Claude Code 2.1.71 — response (no mcp) spike of 3,517 ms vs 2,842 ms median; dropped and re-run clean. slow sample exceeded 3218 ms cutoff
- † Claude Code 2.1.76 — response (no mcp) spike of 4,321 ms vs 2,652.5 ms median; dropped and re-run clean. slow sample exceeded 2855 ms cutoff
- † Claude Code 2.1.76 — response (no mcp) spike of 3,210 ms vs 2,652.5 ms median; dropped and re-run clean. slow sample exceeded 2855 ms cutoff
- † Claude Code 2.1.77 — response spike of 3,385 ms vs 2,934 ms median; dropped and re-run clean. slow sample exceeded 3379 ms cutoff
- † Claude Code 2.1.78 — response spike of 3,577 ms vs 3,196.5 ms median; dropped and re-run clean. slow sample exceeded 3429 ms cutoff
- † Claude Code 2.1.81 — response spike of 5,120 ms vs 2,900 ms median; dropped and re-run clean. slow sample exceeded 4582 ms cutoff
- † Claude Code 2.1.84 — response spike of 4,890 ms vs 3,294 ms median; dropped and re-run clean. slow sample exceeded 3522 ms cutoff
- † Claude Code 2.1.90 — response spike of 5,203 ms vs 3,127 ms median; dropped and re-run clean. slow sample exceeded 3434 ms cutoff
- † Claude Code 2.1.91 — response (no mcp) spike of 7,805 ms vs 3,371.5 ms median; dropped and re-run clean. slow sample exceeded 7434 ms cutoff
- † Claude Code 2.1.91 — response (no mcp) spike of 3,782 ms vs 3,021 ms median; dropped and re-run clean. slow sample exceeded 3615 ms cutoff
- † Claude Code 2.1.222 — response (no mcp) spike of 3,364 ms vs 3,063 ms median; dropped and re-run clean. slow sample exceeded 3216 ms cutoff
- † Claude Code 2.1.224 — response (no mcp) spike of 4,524 ms vs 2,893 ms median; dropped and re-run clean. slow sample exceeded 3516 ms cutoff
- † Claude Code 2.1.225 — response spike of 3,983 ms vs 2,980.5 ms median; dropped and re-run clean. slow sample exceeded 3142 ms cutoff
- † Claude Code 2.1.229 — response spike of 5,225 ms vs 2,999 ms median; dropped and re-run clean. slow sample exceeded 3622 ms cutoff
- † Claude Code 2.1.233 — response spike of 3,180 ms vs 2,759 ms median; dropped and re-run clean. slow sample exceeded 2919 ms cutoff
- † Claude Code 2.1.233 — response spike of 3,589 ms vs 2,759 ms median; dropped and re-run clean. slow sample exceeded 2919 ms cutoff
- † Claude Code 2.1.233 — response spike of 3,055 ms vs 2,759 ms median; dropped and re-run clean. slow sample exceeded 2919 ms cutoff
- † Claude Code 2.1.236 — response (no mcp) spike of 3,674 ms vs 2,935.5 ms median; dropped and re-run clean. slow sample exceeded 3336 ms cutoff
- † Claude Code 2.1.238 — response spike of 6,960 ms vs 3,280.5 ms median; dropped and re-run clean. slow sample exceeded 3869 ms cutoff
- † Claude Code 2.1.238 — response (no mcp) spike of 5,317 ms vs 3,544.5 ms median; dropped and re-run clean. slow sample exceeded 3708 ms cutoff
- † Claude Code 2.1.243 — response spike of 3,612 ms vs 2,917.5 ms median; dropped and re-run clean. slow sample exceeded 3200 ms cutoff
- † Claude Code 2.1.245 — response spike of 3,368 ms vs 3,128.5 ms median; dropped and re-run clean. slow sample exceeded 3284 ms cutoff
- † Claude Code 2.1.246 — response (no mcp) spike of 3,991 ms vs 2,985.5 ms median; dropped and re-run clean. slow sample exceeded 3752 ms cutoff
- † Claude Code 2.1.247 — response spike of 3,271 ms vs 3,011.5 ms median; dropped and re-run clean. slow sample exceeded 3214 ms cutoff
- † Claude Code 2.1.247 — response spike of 3,250 ms vs 3,011.5 ms median; dropped and re-run clean. slow sample exceeded 3214 ms cutoff
- † Claude Code 2.1.248 — response spike of 3,484 ms vs 2,721 ms median; dropped and re-run clean. slow sample exceeded 2885 ms cutoff
- † Claude Code 2.1.250 — response spike of 4,243 ms vs 2,998.5 ms median; dropped and re-run clean. slow sample exceeded 3696 ms cutoff
- † Codex rust-v0.132.0 — response (fast) spike of 17,861 ms vs 6,039.5 ms median; dropped and re-run clean. slow sample exceeded 8924 ms cutoff
- † Codex rust-v0.147.0 — response spike of 9,425 ms vs 5,348 ms median; dropped and re-run clean. slow sample exceeded 5556 ms cutoff
- † Codex rust-v0.147.0 — response (fast) spike of 5,954 ms vs 4,929.5 ms median; dropped and re-run clean. slow sample exceeded 5815 ms cutoff
- † Codex rust-v0.147.0 — response (fast, no mcp) spike of 5,225 ms vs 4,712 ms median; dropped and re-run clean. slow sample exceeded 4959 ms cutoff
- † Codex rust-v0.148.0 — response (no mcp) spike of 5,613 ms vs 5,242 ms median; dropped and re-run clean. slow sample exceeded 5499 ms cutoff
- † Codex rust-v0.149.0 — response (fast, no mcp) spike of 9,592 ms vs 5,411.5 ms median; dropped and re-run clean. slow sample exceeded 8682 ms cutoff
- † Codex rust-v0.149.0 — response (fast, no mcp) spike of 5,742 ms vs 5,068 ms median; dropped and re-run clean. slow sample exceeded 5231 ms cutoff
- † Codex rust-v0.150.0 — response spike of 7,431 ms vs 4,817 ms median; dropped and re-run clean. slow sample exceeded 6440 ms cutoff
- † Codex rust-v0.150.0 — response spike of 6,600 ms vs 4,817 ms median; dropped and re-run clean. slow sample exceeded 6440 ms cutoff
- † Codex rust-v0.150.1 — response (no mcp) spike of 6,225 ms vs 4,888.5 ms median; dropped and re-run clean. slow sample exceeded 5636 ms cutoff
- † Codex rust-v0.150.1 — response (fast, no mcp) spike of 5,515 ms vs 4,907 ms median; dropped and re-run clean. slow sample exceeded 5273 ms cutoff
- † Codex rust-v0.150.1 — response (fast, no mcp) spike of 6,280 ms vs 4,907 ms median; dropped and re-run clean. slow sample exceeded 5273 ms cutoff
- † Codex rust-v0.150.1 — response (fast, no mcp) spike of 6,063 ms vs 4,907 ms median; dropped and re-run clean. slow sample exceeded 5273 ms cutoff
Claude Code · avg startup claude-sonnet-5
778 ms
260 versions · spawn 107 ms · response 3644 ms · MCP +79 ms · 22.2 MB
Codex · avg startup
547 ms
115 versions · spawn 2 ms · response 4485 ms · MCP +170 ms · fast -338 ms
coverage floors
- codex coverage starts at v0.37.0 — upstream shipped no arm64 Linux binary before it; the floor cannot be extended by re-running.
- claude response probes currently reach down to 2.0.24 — earlier versions carry launch metrics only while the response backfill works toward the launch floor.
detail · Claude Code
| version | spawn (--version) | interactive startup | response | response (no mcp) | mcp overhead | result |
|---|---|---|---|---|---|---|
| 2.1.251† claude-sonnet-5 |
2 ms | 774 ms | 2,861 ms | 2,982 ms | -121 ms | ready |
| 2.1.250† claude-sonnet-5 |
2 ms | 776 ms | 2,658 ms | 2,797 ms | -139 ms | ready |
| 2.1.248† claude-sonnet-5 |
2 ms | 786 ms | 2,841 ms | 2,778 ms | +63 ms | ready |
| 2.1.247† claude-sonnet-5 |
3 ms | 787 ms | 2,908 ms | 3,400 ms | -492 ms | ready |
| 2.1.246† claude-sonnet-5 |
2 ms | 779 ms | 2,944 ms | 2,727 ms | +217 ms | ready |
| 2.1.245 claude-sonnet-5 |
6 ms | 908 ms | 3,683 ms | 3,076 ms | +607 ms | ready |
| 2.1.243† claude-sonnet-5 |
5 ms | 843 ms | 3,007 ms | 2,995 ms | +12 ms | ready |
| 2.1.241† claude-sonnet-5 |
53 ms | 892 ms | 3,399 ms | 3,231 ms | +168 ms | ready |
| 2.1.240 claude-sonnet-5 |
54 ms | 891 ms | 3,343 ms | 3,107 ms | +236 ms | ready |
| 2.1.239† claude-sonnet-5 |
55 ms | 902 ms | 3,278 ms | 2,878 ms | +400 ms | ready |
| 2.1.238† claude-sonnet-5 |
50 ms | 820 ms | 2,898 ms | 2,979 ms | -81 ms | ready |
| 2.1.237† claude-sonnet-5 |
49 ms | 826 ms | 2,942 ms | 3,103 ms | -161 ms | ready |
| 2.1.236 claude-sonnet-5 |
50 ms | 827 ms | 3,092 ms | 3,161 ms | -69 ms | ready |
| 2.1.235 claude-sonnet-5 |
53 ms | 798 ms | 2,997 ms | 3,066 ms | -69 ms | ready |
| 2.1.234 claude-sonnet-5 |
53 ms | 828 ms | 3,137 ms | 3,040 ms | +97 ms | ready |
| 2.1.233† claude-sonnet-5 |
54 ms | 816 ms | 2,848 ms | 3,054 ms | -206 ms | ready |
| 2.1.232 claude-sonnet-5 |
48 ms | 778 ms | 3,270 ms | 3,478 ms | -208 ms | ready |
| 2.1.231 claude-sonnet-5 |
51 ms | 781 ms | 3,209 ms | 2,933 ms | +276 ms | ready |
| 2.1.229 claude-sonnet-5 |
51 ms | 800 ms | 3,315 ms | 2,894 ms | +421 ms | ready |
| 2.1.228 claude-sonnet-5 |
45 ms | 787 ms | 3,703 ms | 5,575 ms | -1,872 ms | ready |
| 2.1.226† claude-sonnet-5 |
46 ms | 761 ms | 2,553 ms | 2,658 ms | -105 ms | ready |
| 2.1.225† claude-sonnet-5 |
49 ms | 775 ms | 2,586 ms | 2,568 ms | +18 ms | ready |
| 2.1.224† claude-sonnet-5 |
44 ms | 769 ms | 2,848 ms | 3,078 ms | -230 ms | ready |
| 2.1.222 claude-sonnet-5 |
45 ms | 783 ms | 3,771 ms | 3,168 ms | +603 ms | ready |
| 2.1.221† claude-sonnet-5 |
43 ms | 763 ms | 3,550 ms | 2,868 ms | +682 ms | ready |
| 2.1.220 claude-sonnet-5 |
41 ms | 745 ms | 2,889 ms | 4,945 ms | -2,056 ms | ready |
| 2.1.219 claude-sonnet-5 |
43 ms | 778 ms | 3,150 ms | 3,435 ms | -285 ms | ready |
| 2.1.218 claude-sonnet-5 |
45 ms | 769 ms | 3,278 ms | 2,649 ms | +629 ms | ready |
| 2.1.217 claude-sonnet-5 |
41 ms | 784 ms | 2,792 ms | 3,498 ms | -706 ms | ready |
| 2.1.216 claude-sonnet-5 |
46 ms | 769 ms | 3,091 ms | 2,921 ms | +170 ms | ready |
| 2.1.215 claude-opus-4-8 |
37 ms | 742 ms | 2,505 ms | 2,869 ms | -364 ms | ready |
| 2.1.214 claude-opus-4-8 |
37 ms | 742 ms | 2,679 ms | 2,799 ms | -120 ms | ready |
| 2.1.213 claude-opus-4-8 |
38 ms | 752 ms | 2,622 ms | 2,852 ms | -230 ms | ready |
| 2.1.212 claude-opus-4-8 |
44 ms | 782 ms | 2,963 ms | 2,998 ms | -35 ms | ready |
| 2.1.211 claude-opus-4-8 |
38 ms | 750 ms | 2,430 ms | 2,505 ms | -75 ms | ready |
| 2.1.210 claude-opus-4-8 |
35 ms | 743 ms | 2,453 ms | 2,592 ms | -139 ms | ready |
| 2.1.209 claude-opus-4-8 |
36 ms | 743 ms | 2,794 ms | 2,858 ms | -64 ms | ready |
| 2.1.208 claude-opus-4-8 |
36 ms | 752 ms | 3,534 ms | 2,322 ms | +1,212 ms | ready |
| 2.1.207 claude-opus-4-8 |
35 ms | 745 ms | 2,610 ms | 2,554 ms | +56 ms | ready |
| 2.1.206 claude-opus-4-8 |
39 ms | 741 ms | 2,987 ms | 2,736 ms | +251 ms | ready |
| 2.1.205 claude-opus-4-8 |
37 ms | 741 ms | 2,859 ms | 2,794 ms | +65 ms | ready |
| 2.1.204 claude-opus-4-8 |
40 ms | 744 ms | 2,884 ms | 2,546 ms | +338 ms | ready |
| 2.1.203 claude-opus-4-8 |
36 ms | 746 ms | 2,354 ms | 2,599 ms | -245 ms | ready |
| 2.1.202 claude-opus-4-8 |
36 ms | 743 ms | 2,494 ms | 2,369 ms | +125 ms | ready |
| 2.1.201 claude-opus-4-8 |
34 ms | 732 ms | 2,427 ms | 3,608 ms | -1,181 ms | ready |
| 2.1.200 claude-opus-4-8 |
35 ms | 738 ms | 2,792 ms | 2,999 ms | -207 ms | ready |
| 2.1.199 claude-opus-4-8 |
35 ms | 730 ms | 2,645 ms | 2,366 ms | +279 ms | ready |
| 2.1.198 claude-opus-4-8 |
36 ms | 716 ms | 2,568 ms | 2,662 ms | -94 ms | ready |
| 2.1.197 claude-opus-4-8 |
36 ms | 711 ms | 2,802 ms | 2,425 ms | +377 ms | ready |
| 2.1.196 claude-opus-4-8 |
39 ms | 709 ms | 2,572 ms | 2,612 ms | -40 ms | ready |
| 2.1.195 claude-opus-4-8 |
34 ms | 703 ms | 2,484 ms | 2,535 ms | -51 ms | ready |
| 2.1.193 claude-opus-4-8 |
34 ms | 701 ms | 2,468 ms | 2,454 ms | +14 ms | ready |
| 2.1.191 claude-opus-4-8 |
34 ms | 703 ms | 2,514 ms | 2,707 ms | -193 ms | ready |
| 2.1.190 claude-opus-4-8 |
33 ms | 689 ms | 2,492 ms | 3,088 ms | -596 ms | ready |
| 2.1.187 claude-opus-4-8 |
32 ms | 694 ms | 2,583 ms | 2,465 ms | +118 ms | ready |
| 2.1.186 claude-opus-4-8 |
33 ms | 689 ms | 3,785 ms | 2,320 ms | +1,465 ms | ready |
| 2.1.185 claude-opus-4-8 |
34 ms | 692 ms | 3,076 ms | 2,537 ms | +539 ms | ready |
| 2.1.183 claude-opus-4-8 |
37 ms | 828 ms | 2,447 ms | 2,468 ms | -21 ms | ready |
| 2.1.182 claude-opus-4-8 |
33 ms | 687 ms | 3,490 ms | 2,368 ms | +1,122 ms | ready |
| 2.1.181 claude-opus-4-8 |
32 ms | 681 ms | 2,433 ms | 2,447 ms | -14 ms | ready |
| 2.1.179 claude-opus-4-8 |
39 ms | 699 ms | 2,825 ms | 2,532 ms | +293 ms | ready |
| 2.1.178 claude-opus-4-8 |
40 ms | 695 ms | 2,488 ms | 2,703 ms | -215 ms | ready |
| 2.1.177 claude-opus-4-8 |
41 ms | 703 ms | 2,278 ms | 2,361 ms | -83 ms | ready |
| 2.1.176 claude-opus-4-8 |
39 ms | 695 ms | 2,339 ms | 2,277 ms | +62 ms | ready |
| 2.1.175 claude-opus-4-8 |
42 ms | 700 ms | 2,389 ms | 2,428 ms | -39 ms | ready |
| 2.1.174 claude-opus-4-8 |
41 ms | 828 ms | 2,323 ms | 2,708 ms | -385 ms | ready |
| 2.1.173 claude-opus-4-8 |
41 ms | 694 ms | 2,222 ms | 2,629 ms | -407 ms | ready |
| 2.1.172 claude-opus-4-8 |
38 ms | 700 ms | 3,695 ms | 2,331 ms | +1,364 ms | ready |
| 2.1.170 claude-opus-4-8 |
37 ms | 696 ms | 2,446 ms | 3,395 ms | -949 ms | ready |
| 2.1.169 claude-opus-4-8 |
39 ms | 691 ms | 3,658 ms | 4,969 ms | -1,311 ms | ready |
| 2.1.168 claude-opus-4-8 |
41 ms | 693 ms | 2,533 ms | 2,659 ms | -126 ms | ready |
| 2.1.167 claude-opus-4-8 |
41 ms | 690 ms | 2,259 ms | 2,701 ms | -442 ms | ready |
| 2.1.166 claude-opus-4-8 |
41 ms | 694 ms | 25,051 ms | 2,232 ms | +22,819 ms | ready |
| 2.1.165 claude-opus-4-8 |
43 ms | 810 ms | 2,436 ms | 2,503 ms | -67 ms | ready |
| 2.1.163 claude-opus-4-8 |
40 ms | 694 ms | 2,688 ms | 2,419 ms | +269 ms | ready |
| 2.1.162 claude-opus-4-8 |
42 ms | 701 ms | 2,380 ms | 2,369 ms | +11 ms | ready |
| 2.1.161 claude-opus-4-8 |
39 ms | 691 ms | 2,452 ms | 2,349 ms | +103 ms | ready |
| 2.1.160 claude-opus-4-8 |
38 ms | 694 ms | 2,394 ms | 2,436 ms | -42 ms | ready |
| 2.1.159 claude-opus-4-8 |
40 ms | 684 ms | 2,587 ms | 2,652 ms | -65 ms | ready |
| 2.1.158 claude-opus-4-8 |
39 ms | 697 ms | 3,979 ms | 3,951 ms | +28 ms | ready |
| 2.1.157 claude-opus-4-8 |
42 ms | 689 ms | 2,546 ms | 2,409 ms | +137 ms | ready |
| 2.1.156 claude-opus-4-8 |
46 ms | 687 ms | 2,321 ms | 2,388 ms | -67 ms | ready |
| 2.1.154 claude-opus-4-8 |
35 ms | 683 ms | 2,466 ms | 2,358 ms | +108 ms | ready |
| 2.1.153 claude-opus-4-7 |
39 ms | 687 ms | 3,509 ms | 2,302 ms | +1,207 ms | ready |
| 2.1.152 claude-opus-4-7 |
38 ms | 688 ms | 3,208 ms | 3,329 ms | -121 ms | ready |
| 2.1.150 claude-opus-4-7 |
38 ms | 685 ms | 2,159 ms | 2,278 ms | -119 ms | ready |
| 2.1.149 claude-opus-4-7 |
36 ms | 683 ms | 2,108 ms | 2,203 ms | -95 ms | ready |
| 2.1.148 claude-opus-4-7 |
37 ms | 685 ms | 2,681 ms | 2,001 ms | +680 ms | ready |
| 2.1.147 claude-opus-4-7 |
44 ms | 703 ms | 14,497 ms | 2,161 ms | +12,336 ms | ready |
| 2.1.146 claude-opus-4-7 |
46 ms | 702 ms | 2,600 ms | 5,896 ms | -3,296 ms | ready |
| 2.1.145 claude-opus-4-7 |
38 ms | 681 ms | 2,675 ms | 2,621 ms | +54 ms | ready |
| 2.1.144 claude-opus-4-7 |
37 ms | 684 ms | 2,443 ms | 2,488 ms | -45 ms | ready |
| 2.1.143 claude-opus-4-7 |
36 ms | 685 ms | 2,533 ms | 2,447 ms | +86 ms | ready |
| 2.1.142 claude-opus-4-7 |
36 ms | 678 ms | 2,204 ms | 2,657 ms | -453 ms | ready |
| 2.1.141 claude-opus-4-7 |
33 ms | 681 ms | 2,177 ms | 2,371 ms | -194 ms | ready |
| 2.1.140 claude-opus-4-7 |
38 ms | 680 ms | 2,693 ms | 3,176 ms | -483 ms | ready |
| 2.1.139 claude-opus-4-7 |
34 ms | 687 ms | 3,259 ms | 2,444 ms | +815 ms | ready |
| 2.1.138 claude-opus-4-7 |
40 ms | 689 ms | 3,113 ms | 3,732 ms | -619 ms | ready |
| 2.1.137 claude-opus-4-7 |
38 ms | 685 ms | 2,103 ms | 2,716 ms | -613 ms | ready |
| 2.1.136 claude-opus-4-7 |
35 ms | 690 ms | 2,951 ms | 2,022 ms | +929 ms | ready |
| 2.1.133 claude-opus-4-7 |
35 ms | 686 ms | 2,485 ms | 2,407 ms | +78 ms | ready |
| 2.1.132 claude-opus-4-7 |
44 ms | 737 ms | 3,475 ms | 3,402 ms | +73 ms | ready |
| 2.1.131 claude-opus-4-7 |
45 ms | 865 ms | 2,580 ms | 2,114 ms | +466 ms | ready |
| 2.1.129 claude-opus-4-7 |
40 ms | 730 ms | 3,003 ms | 2,969 ms | +34 ms | ready |
| 2.1.128 claude-opus-4-7 |
39 ms | 721 ms | 2,409 ms | 2,449 ms | -40 ms | ready |
| 2.1.126 claude-opus-4-7 |
44 ms | 717 ms | 3,961 ms | 2,633 ms | +1,328 ms | ready |
| 2.1.124 claude-opus-4-7 |
40 ms | 716 ms | 2,698 ms | 3,224 ms | -526 ms | ready |
| 2.1.123 claude-opus-4-7 |
36 ms | 716 ms | 2,379 ms | 4,349 ms | -1,970 ms | ready |
| 2.1.122 claude-opus-4-7 |
40 ms | 717 ms | 2,273 ms | 3,673 ms | -1,400 ms | ready |
| 2.1.121 claude-opus-4-7 |
37 ms | 719 ms | 3,835 ms | 2,416 ms | +1,419 ms | ready |
| 2.1.120 claude-opus-4-7 |
36 ms | 710 ms | 2,366 ms | 2,612 ms | -246 ms | ready |
| 2.1.119 claude-opus-4-7 |
37 ms | 710 ms | 4,181 ms | 2,769 ms | +1,412 ms | ready |
| 2.1.118 claude-opus-4-7 |
36 ms | 706 ms | 2,662 ms | 2,238 ms | +424 ms | ready |
| 2.1.117 claude-opus-4-7 |
39 ms | 705 ms | 4,354 ms | 3,636 ms | +718 ms | ready |
| 2.1.116 claude-opus-4-7 |
38 ms | 704 ms | 2,428 ms | 7,599 ms | -5,171 ms | ready |
| 2.1.114 claude-opus-4-7 |
37 ms | 697 ms | 3,031 ms | 2,524 ms | +507 ms | ready |
| 2.1.113 claude-opus-4-7 |
35 ms | 705 ms | 2,173 ms | 3,272 ms | -1,099 ms | ready |
| 2.1.112 claude-opus-4-7 |
39 ms | 710 ms | 2,074 ms | 2,151 ms | -77 ms | ready |
| 2.1.111 claude-opus-4-7 |
58 ms | 711 ms | 2,447 ms | 2,570 ms | -123 ms | ready |
| 2.1.110 claude-opus-4-6 |
37 ms | 697 ms | 3,931 ms | 3,411 ms | +520 ms | ready |
| 2.1.109 claude-opus-4-6 |
38 ms | 701 ms | 3,757 ms | 4,368 ms | -611 ms | ready |
| 2.1.108 claude-opus-4-6 |
40 ms | 701 ms | 3,481 ms | 3,944 ms | -463 ms | ready |
| 2.1.107 claude-opus-4-6 |
41 ms | 699 ms | 3,798 ms | 4,618 ms | -820 ms | ready |
| 2.1.105 claude-opus-4-6 |
38 ms | 700 ms | 3,130 ms | 4,531 ms | -1,401 ms | ready |
| 2.1.104 claude-opus-4-6 |
39 ms | 708 ms | 3,628 ms | 3,845 ms | -217 ms | ready |
| 2.1.101 claude-opus-4-6 |
34 ms | 697 ms | 3,333 ms | 3,932 ms | -599 ms | ready |
| 2.1.100 claude-opus-4-6 |
35 ms | 703 ms | 3,227 ms | 3,912 ms | -685 ms | ready |
| 2.1.98 claude-opus-4-6 |
37 ms | 697 ms | 3,671 ms | 3,116 ms | +555 ms | ready |
| 2.1.97 claude-opus-4-6 |
36 ms | 701 ms | 3,524 ms | 4,048 ms | -524 ms | ready |
| 2.1.96 claude-opus-4-6 |
51 ms | 696 ms | 4,569 ms | 3,864 ms | +705 ms | ready |
| 2.1.94 claude-opus-4-6 |
37 ms | 695 ms | 3,326 ms | 3,773 ms | -447 ms | ready |
| 2.1.92 claude-opus-4-6 |
39 ms | 701 ms | 3,579 ms | 4,154 ms | -575 ms | ready |
| 2.1.91 claude-opus-4-6 |
35 ms | 715 ms | 3,196 ms | 3,591 ms | -395 ms | ready |
| 2.1.90† claude-opus-4-6 |
34 ms | 702 ms | 2,907 ms | 4,079 ms | -1,172 ms | ready |
| 2.1.89† claude-opus-4-6 |
35 ms | 701 ms | 3,139 ms | 3,598 ms | -459 ms | ready |
| 2.1.87 claude-opus-4-6 |
36 ms | 699 ms | 4,161 ms | 3,891 ms | +270 ms | ready |
| 2.1.86 claude-opus-4-6 |
37 ms | 691 ms | 3,858 ms | 3,727 ms | +131 ms | ready |
| 2.1.85† claude-opus-4-6 |
36 ms | 696 ms | 3,107 ms | 3,783 ms | -676 ms | ready |
| 2.1.84† claude-opus-4-6 |
34 ms | 702 ms | 3,159 ms | 3,114 ms | +45 ms | ready |
| 2.1.83 claude-opus-4-6 |
38 ms | 720 ms | 4,614 ms | 4,134 ms | +480 ms | ready |
| 2.1.81 claude-opus-4-6 |
61 ms | 740 ms | 3,435 ms | 3,444 ms | -9 ms | ready |
| 2.1.80 claude-opus-4-6 |
61 ms | 757 ms | 2,837 ms | 2,946 ms | -109 ms | ready |
| 2.1.79† claude-opus-4-6 |
55 ms | 721 ms | 4,920 ms | 2,756 ms | +2,164 ms | ready |
| 2.1.78† claude-opus-4-6 |
54 ms | 715 ms | 4,349 ms | 3,622 ms | +727 ms | ready |
| 2.1.77 claude-opus-4-6 |
54 ms | 735 ms | 4,249 ms | 3,289 ms | +960 ms | ready |
| 2.1.76 claude-opus-4-6 |
51 ms | 729 ms | 3,309 ms | 3,551 ms | -242 ms | ready |
| 2.1.75 claude-opus-4-6 |
52 ms | 725 ms | 4,579 ms | 4,000 ms | +579 ms | ready |
| 2.1.74 claude-opus-4-6 |
55 ms | 728 ms | 4,924 ms | 3,161 ms | +1,763 ms | ready |
| 2.1.73† claude-opus-4-6 |
56 ms | 726 ms | 3,468 ms | 2,934 ms | +534 ms | ready |
| 2.1.72 claude-opus-4-6 |
55 ms | 744 ms | 3,425 ms | 4,374 ms | -949 ms | ready |
| 2.1.71† claude-opus-4-6 |
56 ms | 736 ms | 3,499 ms | 2,959 ms | +540 ms | ready |
| 2.1.70 claude-opus-4-6 |
65 ms | 766 ms | 4,116 ms | 3,283 ms | +833 ms | ready |
| 2.1.69 claude-opus-4-6 |
58 ms | 754 ms | 3,109 ms | 3,377 ms | -268 ms | ready |
| 2.1.68† claude-opus-4-6 |
52 ms | 740 ms | 3,825 ms | 5,851 ms | -2,026 ms | ready |
| 2.1.66† claude-opus-4-6 |
54 ms | 740 ms | 3,493 ms | 3,431 ms | +62 ms | ready |
| 2.1.64 claude-opus-4-6 |
54 ms | 741 ms | 5,386 ms | 3,598 ms | +1,788 ms | ready |
| 2.1.63 claude-opus-4-6 |
56 ms | 750 ms | 4,069 ms | 3,767 ms | +302 ms | ready |
| 2.1.62 claude-opus-4-6 |
46 ms | 741 ms | 4,377 ms | 3,900 ms | +477 ms | ready |
| 2.1.61 claude-opus-4-6 |
46 ms | 744 ms | 4,300 ms | 4,822 ms | -522 ms | ready |
| 2.1.59 claude-opus-4-6 |
48 ms | 746 ms | 5,610 ms | 4,308 ms | +1,302 ms | ready |
| 2.1.58 claude-opus-4-6 |
54 ms | 751 ms | 3,703 ms | 4,134 ms | -431 ms | ready |
| 2.1.56 claude-opus-4-6 |
45 ms | 739 ms | 3,702 ms | 3,885 ms | -183 ms | ready |
| 2.1.55 claude-opus-4-6 |
45 ms | 739 ms | 4,567 ms | 3,674 ms | +893 ms | ready |
| 2.1.54 claude-opus-4-6 |
46 ms | 739 ms | 3,963 ms | 3,822 ms | +141 ms | ready |
| 2.1.53† claude-opus-4-6 |
47 ms | 744 ms | 4,234 ms | 4,252 ms | -18 ms | ready |
| 2.1.52 claude-opus-4-6 |
62 ms | 756 ms | 4,106 ms | 4,119 ms | -13 ms | ready |
| 2.1.51 claude-opus-4-6 |
52 ms | 744 ms | 5,092 ms | 4,051 ms | +1,041 ms | ready |
| 2.1.50 claude-opus-4-6 |
52 ms | 743 ms | 3,576 ms | 4,321 ms | -745 ms | ready |
| 2.1.49† claude-opus-4-6 |
53 ms | 749 ms | 3,612 ms | 3,519 ms | +93 ms | ready |
| 2.1.48 claude-opus-4-6 |
53 ms | 744 ms | 3,905 ms | 3,937 ms | -32 ms | ready |
| 2.1.47† claude-opus-4-6 |
60 ms | 756 ms | 3,335 ms | 5,343 ms | -2,008 ms | ready |
| 2.1.45 claude-opus-4-6 |
56 ms | 747 ms | 3,826 ms | 4,446 ms | -620 ms | ready |
| 2.1.44† claude-opus-4-6 |
54 ms | 748 ms | 3,511 ms | 3,485 ms | +26 ms | ready |
| 2.1.42† claude-opus-4-6 |
59 ms | 746 ms | 3,323 ms | 4,181 ms | -858 ms | ready |
| 2.1.41† claude-opus-4-6 |
57 ms | 764 ms | 3,986 ms | 3,934 ms | +52 ms | ready |
| 2.1.40† | 64 ms | 749 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.39 claude-opus-4-6 |
55 ms | 663 ms | 3,534 ms | 3,186 ms | +348 ms | ready |
| 2.1.38 claude-opus-4-6 |
55 ms | 634 ms | 4,156 ms | 5,630 ms | -1,474 ms | ready |
| 2.1.37† claude-opus-4-6 |
62 ms | 706 ms | 4,657 ms | 3,555 ms | +1,102 ms | ready |
| 2.1.36 claude-opus-4-6 |
60 ms | 688 ms | 3,878 ms | 3,783 ms | +95 ms | ready |
| 2.1.34† claude-opus-4-6 |
60 ms | 715 ms | 3,773 ms | 3,428 ms | +345 ms | ready |
| 2.1.33 claude-opus-4-6 |
62 ms | 689 ms | 4,486 ms | 3,436 ms | +1,050 ms | ready |
| 2.1.32 claude-opus-4-6 |
213 ms | 746 ms | 3,783 ms | 5,084 ms | -1,301 ms | ready |
| 2.1.31 | 180 ms | 727 ms | — | — | — | ready |
| 2.1.30 | 182 ms | 724 ms | — | — | — | ready |
| 2.1.29 | 181 ms | 723 ms | — | — | — | ready |
| 2.1.27 | 182 ms | 726 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.25 | 1,238 ms | 737 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.23 | 1,237 ms | 733 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.22 claude-opus-4-5-20251101 |
1,245 ms | 736 ms | 3,289 ms | 4,674 ms | -1,385 ms | ready |
| 2.1.21 | 1,242 ms | 727 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.20† | 1,256 ms | 761 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.1.19† claude-opus-4-5-20251101 |
188 ms | 795 ms | 3,634 ms | 3,039 ms | +595 ms | ready |
| 2.1.18 claude-opus-4-5-20251101 |
182 ms | 775 ms | 3,438 ms | 2,998 ms | +440 ms | ready |
| 2.1.17 claude-opus-4-5-20251101 |
182 ms | 781 ms | 3,258 ms | 3,411 ms | -153 ms | ready |
| 2.1.16† claude-opus-4-5-20251101 |
186 ms | 761 ms | 3,660 ms | 3,128 ms | +532 ms | ready |
| 2.1.15† claude-opus-4-5-20251101 |
200 ms | 848 ms | 3,301 ms | 3,483 ms | -182 ms | ready |
| 2.1.14 claude-opus-4-5-20251101 |
180 ms | 883 ms | 3,808 ms | 3,312 ms | +496 ms | ready |
| 2.1.12† claude-opus-4-5-20251101 |
181 ms | 923 ms | 3,332 ms | 3,462 ms | -130 ms | ready |
| 2.1.11† claude-opus-4-5-20251101 |
183 ms | 952 ms | 3,413 ms | 3,099 ms | +314 ms | ready |
| 2.1.10 claude-opus-4-5-20251101 |
181 ms | 930 ms | 3,536 ms | 3,112 ms | +424 ms | ready |
| 2.1.9† claude-opus-4-5-20251101 |
178 ms | 967 ms | 4,240 ms | 3,089 ms | +1,151 ms | ready |
| 2.1.8 claude-opus-4-5-20251101 |
192 ms | 964 ms | 3,270 ms | 3,418 ms | -148 ms | ready |
| 2.1.7† claude-opus-4-5-20251101 |
189 ms | 963 ms | 3,554 ms | 3,159 ms | +395 ms | ready |
| 2.1.6† claude-opus-4-5-20251101 |
197 ms | 943 ms | 3,442 ms | 3,493 ms | -51 ms | ready |
| 2.1.5† claude-opus-4-5-20251101 |
184 ms | 912 ms | 3,369 ms | 3,155 ms | +214 ms | ready |
| 2.1.4 claude-opus-4-5-20251101 |
183 ms | 923 ms | 3,635 ms | 3,642 ms | -7 ms | ready |
| 2.1.3 claude-opus-4-5-20251101 |
181 ms | 912 ms | 3,160 ms | 3,752 ms | -592 ms | ready |
| 2.1.2† claude-opus-4-5-20251101 |
183 ms | 912 ms | 3,450 ms | 3,357 ms | +93 ms | ready |
| 2.1.1 claude-opus-4-5-20251101 |
188 ms | 973 ms | 3,385 ms | 3,210 ms | +175 ms | ready |
| 2.1.0 claude-opus-4-5-20251101 |
187 ms | 1,004 ms | 4,892 ms | 3,528 ms | +1,364 ms | ready |
| 2.0.77† claude-opus-4-5-20251101 |
184 ms | 966 ms | 3,299 ms | 3,811 ms | -512 ms | ready |
| 2.0.76 claude-opus-4-5-20251101 |
199 ms | 1,011 ms | 4,558 ms | 7,095 ms | -2,537 ms | ready |
| 2.0.75† claude-opus-4-5-20251101 |
187 ms | 968 ms | 5,327 ms | 4,839 ms | +488 ms | ready |
| 2.0.74† claude-opus-4-5-20251101 |
188 ms | 974 ms | 5,847 ms | 5,370 ms | +477 ms | ready |
| 2.0.73 claude-opus-4-5-20251101 |
189 ms | 979 ms | 5,845 ms | 6,174 ms | -329 ms | ready |
| 2.0.72† claude-opus-4-5-20251101 |
188 ms | 969 ms | 5,446 ms | 5,145 ms | +301 ms | ready |
| 2.0.71 claude-opus-4-5-20251101 |
184 ms | 954 ms | 5,458 ms | 5,945 ms | -487 ms | ready |
| 2.0.70 claude-opus-4-5-20251101 |
176 ms | 952 ms | 5,345 ms | 5,357 ms | -12 ms | ready |
| 2.0.69 claude-opus-4-5-20251101 |
165 ms | 896 ms | 4,979 ms | 5,722 ms | -743 ms | ready |
| 2.0.68† claude-opus-4-5-20251101 |
169 ms | 891 ms | 5,631 ms | 5,502 ms | +129 ms | ready |
| 2.0.67† | 162 ms | 900 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.0.66 claude-opus-4-5-20251101 |
162 ms | 930 ms | 5,320 ms | 5,912 ms | -592 ms | ready |
| 2.0.65 claude-opus-4-5-20251101 |
161 ms | 864 ms | 5,666 ms | 4,938 ms | +728 ms | ready |
| 2.0.64 claude-opus-4-5-20251101 |
169 ms | 897 ms | 6,463 ms | 5,408 ms | +1,055 ms | ready |
| 2.0.62† claude-opus-4-5-20251101 |
173 ms | 885 ms | 5,114 ms | 7,344 ms | -2,230 ms | ready |
| 2.0.61 claude-opus-4-5-20251101 |
180 ms | 923 ms | 5,184 ms | 4,485 ms | +699 ms | ready |
| 2.0.60† claude-opus-4-5-20251101 |
178 ms | 906 ms | 5,345 ms | 5,751 ms | -406 ms | ready |
| 2.0.59 claude-opus-4-5-20251101 |
173 ms | 877 ms | 5,302 ms | 5,108 ms | +194 ms | ready |
| 2.0.58 claude-opus-4-5-20251101 |
165 ms | 866 ms | 5,087 ms | 5,031 ms | +56 ms | ready |
| 2.0.57† | 163 ms | 875 ms | — | — | — | error One or more requested benchmark measurements failed |
| 2.0.56 claude-opus-4-5-20251101 |
165 ms | 872 ms | 5,419 ms | 5,935 ms | -516 ms | ready |
| 2.0.55† claude-opus-4-5-20251101 |
180 ms | 972 ms | 4,907 ms | 4,845 ms | +62 ms | ready |
| 2.0.54† claude-opus-4-5-20251101 |
167 ms | 858 ms | 5,669 ms | 5,230 ms | +439 ms | ready |
| 2.0.53 claude-opus-4-5-20251101 |
170 ms | 870 ms | 5,349 ms | 5,110 ms | +239 ms | ready |
| 2.0.52 claude-opus-4-5-20251101 |
173 ms | 884 ms | 4,890 ms | 5,264 ms | -374 ms | ready |
| 2.0.51† claude-opus-4-5-20251101 |
164 ms | 858 ms | 5,328 ms | 5,115 ms | +213 ms | ready |
| 2.0.50† claude-opus-4-5-20251101 |
165 ms | 865 ms | 5,212 ms | 6,178 ms | -966 ms | ready |
| 2.0.49† claude-opus-4-5-20251101 |
167 ms | 867 ms | 5,098 ms | 5,528 ms | -430 ms | ready |
| 2.0.47 claude-opus-4-5-20251101 |
182 ms | 868 ms | 5,432 ms | 5,688 ms | -256 ms | ready |
| 2.0.46† claude-opus-4-5-20251101 |
186 ms | 870 ms | 4,991 ms | 5,867 ms | -876 ms | ready |
| 2.0.45† claude-opus-4-5-20251101 |
183 ms | 873 ms | 5,064 ms | 5,971 ms | -907 ms | ready |
| 2.0.44† claude-opus-4-5-20251101 |
184 ms | 866 ms | 5,235 ms | 5,116 ms | +119 ms | ready |
| 2.0.43 claude-opus-4-5-20251101 |
179 ms | 868 ms | 5,247 ms | 4,928 ms | +319 ms | ready |
| 2.0.42† claude-opus-4-5-20251101 |
181 ms | 869 ms | 5,489 ms | 5,372 ms | +117 ms | ready |
| 2.0.41 claude-opus-4-5-20251101 |
175 ms | 878 ms | 5,502 ms | 4,888 ms | +614 ms | ready |
| 2.0.37† claude-opus-4-5-20251101 |
170 ms | 883 ms | 4,680 ms | 6,123 ms | -1,443 ms | ready |
| 2.0.36 claude-opus-4-5-20251101 |
147 ms | 946 ms | 5,242 ms | 5,853 ms | -611 ms | ready |
| 2.0.35† claude-opus-4-5-20251101 |
175 ms | 867 ms | 5,089 ms | 5,638 ms | -549 ms | ready |
| 2.0.34 claude-opus-4-5-20251101 |
177 ms | 875 ms | 6,060 ms | 5,621 ms | +439 ms | ready |
| 2.0.33† claude-opus-4-5-20251101 |
183 ms | 913 ms | 4,940 ms | 5,119 ms | -179 ms | ready |
| 2.0.32† claude-opus-4-5-20251101 |
308 ms | 980 ms | 4,904 ms | 5,313 ms | -409 ms | ready |
| 2.0.31 claude-opus-4-1-20250805 |
268 ms | 959 ms | 1,436 ms | 1,389 ms | +47 ms | ready |
| 2.0.30† claude-opus-4-1-20250805 |
270 ms | 956 ms | 4,393 ms | 4,074 ms | +319 ms | ready |
| 2.0.29 claude-opus-4-1-20250805 |
266 ms | 956 ms | 2,319 ms | 2,604 ms | -285 ms | ready |
| 2.0.28 claude-opus-4-1-20250805 |
267 ms | 954 ms | 2,321 ms | 2,578 ms | -257 ms | ready |
| 2.0.27 claude-opus-4-1-20250805 |
267 ms | 995 ms | 2,149 ms | 2,098 ms | +51 ms | ready |
| 2.0.26† claude-opus-4-1-20250805 |
288 ms | 978 ms | 2,223 ms | 3,038 ms | -815 ms | ready |
| 2.0.25† claude-opus-4-1-20250805 |
289 ms | 966 ms | 2,394 ms | 2,635 ms | -241 ms | ready |
| 2.0.24 claude-opus-4-1-20250805 |
291 ms | 970 ms | 2,043 ms | 1,996 ms | +47 ms | ready |
detail · Codex
| version | spawn (--version) | interactive startup | response | response (no mcp) | mcp overhead | response fast | fast savings | fast (no mcp) | migrations | downgrade behavior | result |
|---|---|---|---|---|---|---|---|---|---|---|---|
| rust-v0.150.1 anythinggpt-5.6-sol |
1 ms | 507 ms | 4,504 ms | 4,451 ms | +53 ms | 3,914 ms | -590 ms | 3,463 ms | 51 ▼5 | compatible | ready |
| rust-v0.150.0 gpt-5.6-sol |
2 ms | 508 ms | 4,838 ms | 4,826 ms | +12 ms | 4,273 ms | -565 ms | 4,311 ms | 51 ▼5 | compatible | ready |
| rust-v0.149.1 gpt-5.6-sol |
1 ms | 504 ms | 5,207 ms | 6,049 ms | -842 ms | 4,154 ms | -1,053 ms | 4,125 ms | 51 ▼5 | compatible | ready |
| rust-v0.149.0 gpt-5.6-sol |
2 ms | 504 ms | 6,633 ms | 5,206 ms | +1,427 ms | 3,736 ms | -2,897 ms | 4,632 ms | 51 ▼5 | compatible | ready |
| rust-v0.148.0† anythinggpt-5.6-sol |
1 ms | 506 ms | 4,570 ms | 4,716 ms | -146 ms | 4,845 ms | +275 ms | 5,145 ms | 51 ▼5 | compatible | error One or more requested benchmark measurements failed |
| rust-v0.147.0† | 1 ms | 773 ms | 3,630 ms | 3,560 ms | +70 ms | 3,838 ms | +208 ms | 3,591 ms | 51 ▼5 | degraded | ready |
| rust-v0.146.0† | 1 ms | 541 ms | 4,448 ms | 5,880 ms | -1,432 ms | 6,123 ms | +1,675 ms | 4,588 ms | 51 ▼5 | compatible | ready |
| rust-v0.145.0 | 2 ms | 541 ms | 3,956 ms | 4,207 ms | -251 ms | 5,643 ms | +1,687 ms | 4,290 ms | 51 ▼5 | compatible | ready |
| rust-v0.144.6 gpt-5.6 |
3 ms | 539 ms | 1,929 ms | 2,639 ms | -710 ms | 2,891 ms | +962 ms | 3,278 ms | 51 ▼5 | — | ready |
| rust-v0.144.5 gpt-5.6 |
3 ms | 540 ms | 1,943 ms | 2,283 ms | -340 ms | 2,296 ms | +353 ms | 3,618 ms | — | — | ready |
| rust-v0.144.4 gpt-5.6 |
4 ms | 544 ms | 2,162 ms | 2,611 ms | -449 ms | 3,055 ms | +893 ms | 2,382 ms | — | — | ready |
| rust-v0.144.3 gpt-5.6 |
4 ms | 538 ms | 2,178 ms | 2,132 ms | +46 ms | 2,231 ms | +53 ms | 2,414 ms | — | — | ready |
| rust-v0.144.2 gpt-5.6 |
4 ms | 545 ms | 2,838 ms | 2,053 ms | +785 ms | 2,000 ms | -838 ms | 2,454 ms | — | — | ready |
| rust-v0.144.1 gpt-5.6 |
3 ms | 538 ms | 1,965 ms | 2,102 ms | -137 ms | 2,144 ms | +179 ms | 2,331 ms | — | — | ready |
| rust-v0.144.0 gpt-5.6 |
1 ms | 540 ms | 3,532 ms | 1,932 ms | +1,600 ms | 2,140 ms | -1,392 ms | 2,448 ms | — | — | ready |
| rust-v0.143.0 gpt-5.5 |
4 ms | 537 ms | 4,793 ms | 3,704 ms | +1,089 ms | 3,626 ms | -1,167 ms | 3,862 ms | — | — | ready |
| rust-v0.142.5 gpt-5.5 |
4 ms | 538 ms | 4,040 ms | 3,985 ms | +55 ms | 4,600 ms | +560 ms | 3,507 ms | — | — | ready |
| rust-v0.142.4 gpt-5.5 |
4 ms | 539 ms | 4,946 ms | 3,464 ms | +1,482 ms | 3,613 ms | -1,333 ms | 3,783 ms | — | — | ready |
| rust-v0.142.3 gpt-5.5 |
3 ms | 541 ms | 7,198 ms | 3,400 ms | +3,798 ms | 3,765 ms | -3,433 ms | 4,012 ms | — | — | ready |
| rust-v0.142.2 gpt-5.5 |
5 ms | 539 ms | 3,771 ms | 3,833 ms | -62 ms | 4,494 ms | +723 ms | 4,136 ms | — | — | ready |
| rust-v0.142.1 gpt-5.5 |
4 ms | 539 ms | 4,112 ms | 3,623 ms | +489 ms | 3,254 ms | -858 ms | 4,560 ms | — | — | ready |
| rust-v0.142.0 gpt-5.5 |
4 ms | 540 ms | 3,999 ms | 3,982 ms | +17 ms | 4,193 ms | +194 ms | 5,502 ms | — | — | ready |
| rust-v0.141.0 gpt-5.5 |
1 ms | 542 ms | 4,227 ms | 4,620 ms | -393 ms | 3,947 ms | -280 ms | 3,729 ms | — | — | ready |
| rust-v0.140.0 | 5 ms | 750 ms | 3,585 ms | 3,518 ms | +67 ms | 3,588 ms | +3 ms | 3,526 ms | — | — | ready |
| rust-v0.139.0 gpt-5.5 |
4 ms | 536 ms | 8,256 ms | 7,113 ms | +1,143 ms | 7,337 ms | -919 ms | 6,901 ms | — | — | ready |
| rust-v0.138.0 gpt-5.5 |
4 ms | 538 ms | 6,580 ms | 7,609 ms | -1,029 ms | 6,918 ms | +338 ms | 6,351 ms | — | — | ready |
| rust-v0.137.0 | 3 ms | 758 ms | 5,630 ms | 5,512 ms | +118 ms | 5,477 ms | -153 ms | 5,494 ms | — | — | ready |
| rust-v0.136.0 gpt-5.5 |
4 ms | 537 ms | 6,729 ms | 8,912 ms | -2,183 ms | 6,528 ms | -201 ms | 7,709 ms | — | — | ready |
| rust-v0.135.0 gpt-5.5 |
4 ms | 538 ms | 5,239 ms | 4,958 ms | +281 ms | 4,397 ms | -842 ms | 4,776 ms | — | — | ready |
| rust-v0.134.0 gpt-5.5 |
4 ms | 536 ms | 6,164 ms | 6,344 ms | -180 ms | 5,052 ms | -1,112 ms | 5,468 ms | — | — | ready |
| rust-v0.133.0 gpt-5.5 |
1 ms | 547 ms | 5,433 ms | 4,538 ms | +895 ms | 4,488 ms | -945 ms | 5,116 ms | — | — | ready |
| rust-v0.132.0 | 1 ms | 793 ms | — | — | — | — | — | — | — | — | ready |
| rust-v0.131.0 gpt-5.5 |
1 ms | 528 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.130.0† gpt-5.5 |
1 ms | 526 ms | — | — | — | — | — | — | — | — | ready |
| rust-v0.129.0 gpt-5.5 |
1 ms | 526 ms | — | — | — | — | — | — | — | — | ready |
| rust-v0.128.0 | 3 ms | 793 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.125.0 | 3 ms | 880 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.124.0 | 3 ms | 811 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.123.0 | 3 ms | 808 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.122.0 | 3 ms | 813 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.121.0 | 1 ms | 526 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.120.0 | 1 ms | 528 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.119.0 | 1 ms | 529 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.118.0 gpt-5.5 |
1 ms | 523 ms | — | — | — | — | — | — | 46 ▼5 | — | incompatible The requested model requires a newer product version |
| rust-v0.117.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | 46 ▼5 | — | incompatible The requested model requires a newer product version |
| rust-v0.116.0 gpt-5.5 |
1 ms | 526 ms | — | — | — | — | — | — | 46 ▼5 | — | incompatible The requested model requires a newer product version |
| rust-v0.115.0† gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.114.0† gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.113.0† gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.112.0 gpt-5.5 |
1 ms | 528 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.111.0 gpt-5.5 |
1 ms | 525 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.110.0 gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.107.0 gpt-5.5 |
1 ms | 527 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.106.0 gpt-5.5 |
1 ms | 529 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.105.0 gpt-5.5 |
3 ms | 525 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.104.0 gpt-5.5 |
1 ms | 528 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.103.0 gpt-5.5 |
1 ms | 523 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.102.0 gpt-5.5 |
2 ms | 529 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.101.0 gpt-5.5 |
1 ms | 532 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.100.0 gpt-5.5 |
2 ms | 530 ms | — | — | — | — | — | — | — | — | incompatible The requested model is not supported by this product version |
| rust-v0.99.0 gpt-5.5 |
3 ms | 494 ms | — | — | — | — | — | — | — | — | incompatible The requested model is not supported by this product version |
| rust-v0.98.0 gpt-5.5 |
2 ms | 527 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.97.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.96.0 gpt-5.5 |
2 ms | 529 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.95.0 gpt-5.5 |
2 ms | 528 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.94.0 gpt-5.5 |
3 ms | 491 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.93.0 gpt-5.5 |
1 ms | 524 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.92.0 gpt-5.5 |
2 ms | 520 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.91.0 gpt-5.5 |
3 ms | 527 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.90.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.89.0 gpt-5.5 |
2 ms | 523 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.88.0 gpt-5.5 |
2 ms | 521 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.87.0 gpt-5.5 |
2 ms | 525 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.86.0 gpt-5.5 |
2 ms | 522 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.85.0 gpt-5.5 |
1 ms | 521 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.84.0 gpt-5.5 |
2 ms | 522 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.81.0 gpt-5.5 |
2 ms | 522 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.80.0 gpt-5.5 |
2 ms | 517 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.79.0 gpt-5.5 |
2 ms | 516 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.78.0 gpt-5.5 |
2 ms | 519 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.77.0 gpt-5.5 |
3 ms | 513 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.76.0 gpt-5.5 |
3 ms | 515 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.75.0 gpt-5.5 |
1 ms | 516 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.74.0 gpt-5.5 |
2 ms | 516 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.73.0 gpt-5.5 |
2 ms | 516 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.72.0 gpt-5.5 |
1 ms | 515 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.71.0 gpt-5.5 |
1 ms | 515 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.69.0 gpt-5.5 |
1 ms | 516 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.66.0 gpt-5.5 |
2 ms | 515 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.65.0 gpt-5.5 |
3 ms | 518 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.64.0 | 1 ms | 515 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.63.0 | 1 ms | 518 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.61.0 | 2 ms | 515 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.60.1 | 2 ms | 515 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.59.0 | 2 ms | 518 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.58.0 | 3 ms | 513 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.57.0 | 2 ms | 516 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.56.0 gpt-5.5 |
2 ms | 514 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.55.0 | 1 ms | 519 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.54.0 | 2 ms | 515 ms | — | — | — | — | — | — | 51 ▼5 | — | ready |
| rust-v0.53.0 | 2 ms | 518 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.52.0 | 2 ms | 514 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.50.0 | 2 ms | 514 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.49.0 gpt-5.5 |
2 ms | 518 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.48.0 | 2 ms | 518 ms | — | — | — | — | — | — | — | — | error One or more requested benchmark measurements failed |
| rust-v0.47.0 gpt-5.5 |
3 ms | 510 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.46.0 gpt-5.5 |
1 ms | 508 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.45.0 gpt-5.5 |
2 ms | 469 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.44.0 gpt-5.5 |
2 ms | 470 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.42.0 gpt-5.5 |
2 ms | 508 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.41.0 gpt-5.5 |
2 ms | 507 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.40.0 gpt-5.5 |
2 ms | 508 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.39.0 gpt-5.5 |
3 ms | 511 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.38.0 gpt-5.5 |
2 ms | 506 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
| rust-v0.37.0 gpt-5.5 |
1 ms | 467 ms | — | — | — | — | — | — | — | — | incompatible The requested model requires a newer product version |
caveats
- † Claude Code 2.0.25 — interactive startup spike of 1,159 ms vs 972.5 ms median; dropped and re-run clean. slow sample exceeded 1125 ms cutoff
- † Claude Code 2.0.26 — response spike of 4,564 ms vs 2,113 ms median; dropped and re-run clean. slow sample exceeded 3617 ms cutoff
- † Claude Code 2.0.30 — response (no mcp) spike of 5,531 ms vs 4,076.5 ms median; dropped and re-run clean. slow sample exceeded 4232 ms cutoff
- † Claude Code 2.0.30 — response (no mcp) spike of 4,365 ms vs 4,076.5 ms median; dropped and re-run clean. slow sample exceeded 4232 ms cutoff
- † Claude Code 2.0.32 — response spike of 5,437 ms vs 4,986 ms median; dropped and re-run clean. slow sample exceeded 5392 ms cutoff
- † Claude Code 2.0.32 — response spike of 5,679 ms vs 4,986 ms median; dropped and re-run clean. slow sample exceeded 5392 ms cutoff
- † Claude Code 2.0.33 — response spike of 5,298 ms vs 5,024 ms median; dropped and re-run clean. slow sample exceeded 5178 ms cutoff
- † Claude Code 2.0.35 — response spike of 10,471 ms vs 4,878.5 ms median; dropped and re-run clean. slow sample exceeded 6259 ms cutoff
- † Claude Code 2.0.37 — response spike of 5,086 ms vs 4,672 ms median; dropped and re-run clean. slow sample exceeded 5058 ms cutoff
- † Claude Code 2.0.42 — response spike of 7,460 ms vs 5,681.5 ms median; dropped and re-run clean. slow sample exceeded 6181 ms cutoff
- † Claude Code 2.0.44 — response spike of 8,279 ms vs 4,912 ms median; dropped and re-run clean. slow sample exceeded 6762 ms cutoff
- † Claude Code 2.0.44 — response spike of 6,830 ms vs 4,912 ms median; dropped and re-run clean. slow sample exceeded 6762 ms cutoff
- † Claude Code 2.0.44 — response (no mcp) spike of 11,667 ms vs 5,264 ms median; dropped and re-run clean. slow sample exceeded 6155 ms cutoff
- † Claude Code 2.0.45 — response spike of 11,931 ms vs 5,014 ms median; dropped and re-run clean. slow sample exceeded 5489 ms cutoff
- † Claude Code 2.0.45 — response spike of 5,781 ms vs 5,014 ms median; dropped and re-run clean. slow sample exceeded 5489 ms cutoff
- † Claude Code 2.0.46 — response spike of 6,305 ms vs 4,970 ms median; dropped and re-run clean. slow sample exceeded 5134 ms cutoff
- † Claude Code 2.0.46 — response spike of 5,180 ms vs 4,970 ms median; dropped and re-run clean. slow sample exceeded 5134 ms cutoff
- † Claude Code 2.0.46 — response spike of 5,231 ms vs 4,970 ms median; dropped and re-run clean. slow sample exceeded 5134 ms cutoff
- † Claude Code 2.0.49 — response spike of 6,816 ms vs 4,855.5 ms median; dropped and re-run clean. slow sample exceeded 5791 ms cutoff
- † Claude Code 2.0.50 — response spike of 9,688 ms vs 5,020.5 ms median; dropped and re-run clean. slow sample exceeded 6431 ms cutoff
- † Claude Code 2.0.51 — response spike of 6,463 ms vs 5,435 ms median; dropped and re-run clean. slow sample exceeded 5590 ms cutoff
- † Claude Code 2.0.51 — response (no mcp) spike of 6,174 ms vs 5,112 ms median; dropped and re-run clean. slow sample exceeded 5488 ms cutoff
- † Claude Code 2.0.54 — response (no mcp) spike of 5,866 ms vs 5,452 ms median; dropped and re-run clean. slow sample exceeded 5769 ms cutoff
- † Claude Code 2.0.55 — response spike of 6,156 ms vs 4,944.5 ms median; dropped and re-run clean. slow sample exceeded 5306 ms cutoff
- † Claude Code 2.0.55 — response (no mcp) spike of 5,104 ms vs 4,807 ms median; dropped and re-run clean. slow sample exceeded 4995 ms cutoff
- † Claude Code 2.0.57 — response (no mcp) spike of 7,493 ms vs 4,946.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff
- † Claude Code 2.0.57 — response (no mcp) spike of 5,722 ms vs 4,946.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff
- † Claude Code 2.0.57 — response (no mcp) spike of 5,576 ms vs 4,946.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff
- † Claude Code 2.0.57 — response (no mcp) spike of 8,089 ms vs 4,946.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff; rerun budget exhausted
- † Claude Code 2.0.60 — interactive startup spike of 1,238 ms vs 908 ms median; dropped and re-run clean. slow sample exceeded 1063 ms cutoff
- † Claude Code 2.0.62 — response spike of 7,675 ms vs 5,118.5 ms median; dropped and re-run clean. slow sample exceeded 6360 ms cutoff
- † Claude Code 2.0.67 — response spike of 5,398 ms vs 4,923 ms median; dropped and re-run clean. slow sample exceeded 5084 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 5,593 ms vs 5,204.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 9,126 ms vs 5,204.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 5,480 ms vs 5,204.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff
- † Claude Code 2.0.67 — response (no mcp) spike of 6,751 ms vs 5,204.5 ms median; dropped and re-run clean. slow sample exceeded 5417 ms cutoff; rerun budget exhausted
- † Claude Code 2.0.68 — response (no mcp) spike of 6,230 ms vs 5,324.5 ms median; dropped and re-run clean. slow sample exceeded 5953 ms cutoff
- † Claude Code 2.0.68 — response (no mcp) spike of 6,841 ms vs 5,324.5 ms median; dropped and re-run clean. slow sample exceeded 5953 ms cutoff
- † Claude Code 2.0.72 — response spike of 6,552 ms vs 5,555 ms median; dropped and re-run clean. slow sample exceeded 5753 ms cutoff
- † Claude Code 2.0.72 — response spike of 5,938 ms vs 5,555 ms median; dropped and re-run clean. slow sample exceeded 5753 ms cutoff
- † Claude Code 2.0.72 — response spike of 7,699 ms vs 5,555 ms median; dropped and re-run clean. slow sample exceeded 5753 ms cutoff
- † Claude Code 2.0.72 — response (no mcp) spike of 6,282 ms vs 5,207 ms median; dropped and re-run clean. slow sample exceeded 6266 ms cutoff
- † Claude Code 2.0.72 — response (no mcp) spike of 5,314 ms vs 5,092.5 ms median; dropped and re-run clean. slow sample exceeded 5250 ms cutoff
- † Claude Code 2.0.74 — response spike of 6,755 ms vs 6,312 ms median; dropped and re-run clean. slow sample exceeded 6469 ms cutoff
- † Claude Code 2.0.74 — response (no mcp) spike of 9,069 ms vs 5,215.5 ms median; dropped and re-run clean. slow sample exceeded 5923 ms cutoff
- † Claude Code 2.0.75 — response (no mcp) spike of 6,425 ms vs 4,821 ms median; dropped and re-run clean. slow sample exceeded 5563 ms cutoff
- † Claude Code 2.0.75 — response (no mcp) spike of 5,978 ms vs 4,821 ms median; dropped and re-run clean. slow sample exceeded 5563 ms cutoff
- † Claude Code 2.0.77 — response spike of 4,135 ms vs 3,361 ms median; dropped and re-run clean. slow sample exceeded 3984 ms cutoff
- † Claude Code 2.1.2 — response (no mcp) spike of 3,590 ms vs 3,335 ms median; dropped and re-run clean. slow sample exceeded 3500 ms cutoff
- † Claude Code 2.1.5 — response (no mcp) spike of 5,273 ms vs 3,440 ms median; dropped and re-run clean. slow sample exceeded 5162 ms cutoff
- † Claude Code 2.1.5 — response (no mcp) spike of 3,614 ms vs 3,239.5 ms median; dropped and re-run clean. slow sample exceeded 3502 ms cutoff
- † Claude Code 2.1.5 — response (no mcp) spike of 3,601 ms vs 3,239.5 ms median; dropped and re-run clean. slow sample exceeded 3502 ms cutoff
- † Claude Code 2.1.6 — response spike of 5,915 ms vs 3,656 ms median; dropped and re-run clean. slow sample exceeded 4705 ms cutoff
- † Claude Code 2.1.7 — response (no mcp) spike of 4,161 ms vs 3,182.5 ms median; dropped and re-run clean. slow sample exceeded 3653 ms cutoff
- † Claude Code 2.1.9 — response (no mcp) spike of 4,064 ms vs 3,083.5 ms median; dropped and re-run clean. slow sample exceeded 3811 ms cutoff
- † Claude Code 2.1.11 — response (no mcp) spike of 5,017 ms vs 3,019.5 ms median; dropped and re-run clean. slow sample exceeded 3420 ms cutoff
- † Claude Code 2.1.11 — response (no mcp) spike of 4,118 ms vs 3,019.5 ms median; dropped and re-run clean. slow sample exceeded 3420 ms cutoff
- † Claude Code 2.1.12 — response spike of 7,634 ms vs 3,210 ms median; dropped and re-run clean. slow sample exceeded 5318 ms cutoff
- † Claude Code 2.1.15 — response spike of 3,775 ms vs 3,201 ms median; dropped and re-run clean. slow sample exceeded 3577 ms cutoff
- † Claude Code 2.1.15 — response (no mcp) spike of 4,277 ms vs 3,633.5 ms median; dropped and re-run clean. slow sample exceeded 3817 ms cutoff
- † Claude Code 2.1.16 — response (no mcp) spike of 7,475 ms vs 3,249 ms median; dropped and re-run clean. slow sample exceeded 3408 ms cutoff
- † Claude Code 2.1.16 — response (no mcp) spike of 3,679 ms vs 3,249 ms median; dropped and re-run clean. slow sample exceeded 3408 ms cutoff
- † Claude Code 2.1.19 — response spike of 10,824 ms vs 3,432.5 ms median; dropped and re-run clean. slow sample exceeded 5664 ms cutoff
- † Claude Code 2.1.20 — response (no mcp) spike of 4,057 ms vs 3,122 ms median; dropped and re-run clean. slow sample exceeded 3449 ms cutoff
- † Claude Code 2.1.20 — response (no mcp) spike of 3,759 ms vs 3,122 ms median; dropped and re-run clean. slow sample exceeded 3449 ms cutoff
- † Claude Code 2.1.20 — response (no mcp) spike of 3,959 ms vs 3,122 ms median; dropped and re-run clean. slow sample exceeded 3449 ms cutoff
- † Claude Code 2.1.20 — response (no mcp) spike of 7,530 ms vs 3,122 ms median; dropped and re-run clean. slow sample exceeded 3449 ms cutoff; rerun budget exhausted
- † Claude Code 2.1.34 — response spike of 7,399 ms vs 3,953 ms median; dropped and re-run clean. slow sample exceeded 5764 ms cutoff
- † Claude Code 2.1.34 — response spike of 6,745 ms vs 3,953 ms median; dropped and re-run clean. slow sample exceeded 5764 ms cutoff
- † Claude Code 2.1.34 — response (no mcp) spike of 3,773 ms vs 3,433.5 ms median; dropped and re-run clean. slow sample exceeded 3666 ms cutoff
- † Claude Code 2.1.37 — response (no mcp) spike of 5,453 ms vs 3,603 ms median; dropped and re-run clean. slow sample exceeded 3755 ms cutoff
- † Claude Code 2.1.37 — response (no mcp) spike of 4,712 ms vs 3,603 ms median; dropped and re-run clean. slow sample exceeded 3755 ms cutoff
- † Claude Code 2.1.40 — response (no mcp) spike of 3,837 ms vs 2,920 ms median; dropped and re-run clean. slow sample exceeded 3652 ms cutoff
- † Claude Code 2.1.40 — response (no mcp) spike of 3,668 ms vs 2,920 ms median; dropped and re-run clean. slow sample exceeded 3652 ms cutoff
- † Claude Code 2.1.41 — interactive startup spike of 929 ms vs 766.5 ms median; dropped and re-run clean. slow sample exceeded 918 ms cutoff
- † Claude Code 2.1.41 — response spike of 6,189 ms vs 3,888.5 ms median; dropped and re-run clean. slow sample exceeded 4695 ms cutoff
- † Claude Code 2.1.42 — response (no mcp) spike of 6,400 ms vs 4,195 ms median; dropped and re-run clean. slow sample exceeded 5481 ms cutoff
- † Claude Code 2.1.44 — response (no mcp) spike of 7,406 ms vs 3,577 ms median; dropped and re-run clean. slow sample exceeded 5210 ms cutoff
- † Claude Code 2.1.47 — response spike of 4,140 ms vs 3,380.5 ms median; dropped and re-run clean. slow sample exceeded 3682 ms cutoff
- † Claude Code 2.1.47 — response spike of 4,769 ms vs 3,380.5 ms median; dropped and re-run clean. slow sample exceeded 3682 ms cutoff
- † Claude Code 2.1.47 — response spike of 4,171 ms vs 3,380.5 ms median; dropped and re-run clean. slow sample exceeded 3682 ms cutoff
- † Claude Code 2.1.49 — response spike of 5,357 ms vs 3,716 ms median; dropped and re-run clean. slow sample exceeded 3868 ms cutoff
- † Claude Code 2.1.49 — response spike of 4,980 ms vs 3,716 ms median; dropped and re-run clean. slow sample exceeded 3868 ms cutoff
- † Claude Code 2.1.53 — response spike of 5,827 ms vs 4,088 ms median; dropped and re-run clean. slow sample exceeded 4820 ms cutoff
- † Claude Code 2.1.53 — response (no mcp) spike of 5,329 ms vs 4,112.5 ms median; dropped and re-run clean. slow sample exceeded 4870 ms cutoff
- † Claude Code 2.1.66 — response spike of 4,811 ms vs 3,503 ms median; dropped and re-run clean. slow sample exceeded 4641 ms cutoff
- † Claude Code 2.1.66 — response spike of 5,148 ms vs 3,503 ms median; dropped and re-run clean. slow sample exceeded 4641 ms cutoff
- † Claude Code 2.1.68 — response spike of 5,497 ms vs 3,625 ms median; dropped and re-run clean. slow sample exceeded 4328 ms cutoff
- † Claude Code 2.1.68 — response spike of 4,786 ms vs 3,625 ms median; dropped and re-run clean. slow sample exceeded 4328 ms cutoff
- † Claude Code 2.1.68 — response spike of 8,870 ms vs 3,625 ms median; dropped and re-run clean. slow sample exceeded 4328 ms cutoff
- † Claude Code 2.1.71 — response (no mcp) spike of 3,799 ms vs 3,069 ms median; dropped and re-run clean. slow sample exceeded 3336 ms cutoff
- † Claude Code 2.1.71 — response (no mcp) spike of 4,599 ms vs 3,069 ms median; dropped and re-run clean. slow sample exceeded 3336 ms cutoff
- † Claude Code 2.1.73 — response (no mcp) spike of 5,611 ms vs 2,874.5 ms median; dropped and re-run clean. slow sample exceeded 3176 ms cutoff
- † Claude Code 2.1.78 — response (no mcp) spike of 4,806 ms vs 3,224 ms median; dropped and re-run clean. slow sample exceeded 4501 ms cutoff
- † Claude Code 2.1.79 — response (no mcp) spike of 2,958 ms vs 2,755 ms median; dropped and re-run clean. slow sample exceeded 2916 ms cutoff
- † Claude Code 2.1.79 — response (no mcp) spike of 2,939 ms vs 2,755 ms median; dropped and re-run clean. slow sample exceeded 2916 ms cutoff
- † Claude Code 2.1.79 — response (no mcp) spike of 4,284 ms vs 2,755 ms median; dropped and re-run clean. slow sample exceeded 2916 ms cutoff
- † Claude Code 2.1.84 — response (no mcp) spike of 4,981 ms vs 3,132 ms median; dropped and re-run clean. slow sample exceeded 3295 ms cutoff
- † Claude Code 2.1.85 — response spike of 4,160 ms vs 3,321 ms median; dropped and re-run clean. slow sample exceeded 3539 ms cutoff
- † Claude Code 2.1.89 — response spike of 5,222 ms vs 3,040.5 ms median; dropped and re-run clean. slow sample exceeded 4668 ms cutoff
- † Claude Code 2.1.90 — response spike of 3,595 ms vs 2,910.5 ms median; dropped and re-run clean. slow sample exceeded 3232 ms cutoff
- † Claude Code 2.1.90 — response spike of 4,415 ms vs 2,910.5 ms median; dropped and re-run clean. slow sample exceeded 3232 ms cutoff
- † Claude Code 2.1.90 — response spike of 4,219 ms vs 2,910.5 ms median; dropped and re-run clean. slow sample exceeded 3232 ms cutoff
- † Claude Code 2.1.221 — response (no mcp) spike of 3,150 ms vs 2,816.5 ms median; dropped and re-run clean. slow sample exceeded 3059 ms cutoff
- † Claude Code 2.1.224 — response spike of 4,543 ms vs 2,967.5 ms median; dropped and re-run clean. slow sample exceeded 3119 ms cutoff
- † Claude Code 2.1.224 — response spike of 3,254 ms vs 2,967.5 ms median; dropped and re-run clean. slow sample exceeded 3119 ms cutoff
- † Claude Code 2.1.224 — response spike of 3,671 ms vs 2,967.5 ms median; dropped and re-run clean. slow sample exceeded 3119 ms cutoff
- † Claude Code 2.1.225 — response spike of 3,301 ms vs 2,590 ms median; dropped and re-run clean. slow sample exceeded 3154 ms cutoff
- † Claude Code 2.1.225 — response (no mcp) spike of 4,383 ms vs 2,620.5 ms median; dropped and re-run clean. slow sample exceeded 3209 ms cutoff
- † Claude Code 2.1.226 — response spike of 3,126 ms vs 2,535.5 ms median; dropped and re-run clean. slow sample exceeded 2698 ms cutoff
- † Claude Code 2.1.226 — response spike of 2,868 ms vs 2,535.5 ms median; dropped and re-run clean. slow sample exceeded 2698 ms cutoff
- † Claude Code 2.1.226 — response spike of 2,933 ms vs 2,535.5 ms median; dropped and re-run clean. slow sample exceeded 2698 ms cutoff
- † Claude Code 2.1.233 — response spike of 3,187 ms vs 2,859 ms median; dropped and re-run clean. slow sample exceeded 3027 ms cutoff
- † Claude Code 2.1.237 — response spike of 3,572 ms vs 2,926 ms median; dropped and re-run clean. slow sample exceeded 3077 ms cutoff
- † Claude Code 2.1.238 — response spike of 3,486 ms vs 2,915 ms median; dropped and re-run clean. slow sample exceeded 3439 ms cutoff
- † Claude Code 2.1.238 — response (no mcp) spike of 4,311 ms vs 3,028.5 ms median; dropped and re-run clean. slow sample exceeded 3568 ms cutoff
- † Claude Code 2.1.239 — response (no mcp) spike of 3,176 ms vs 2,884.5 ms median; dropped and re-run clean. slow sample exceeded 3050 ms cutoff
- † Claude Code 2.1.239 — response (no mcp) spike of 3,171 ms vs 2,884.5 ms median; dropped and re-run clean. slow sample exceeded 3050 ms cutoff
- † Claude Code 2.1.239 — response (no mcp) spike of 3,071 ms vs 2,884.5 ms median; dropped and re-run clean. slow sample exceeded 3050 ms cutoff
- † Claude Code 2.1.241 — interactive startup spike of 1,126 ms vs 883.5 ms median; dropped and re-run clean. slow sample exceeded 1039 ms cutoff
- † Claude Code 2.1.243 — response spike of 4,305 ms vs 3,009.5 ms median; dropped and re-run clean. slow sample exceeded 3292 ms cutoff
- † Claude Code 2.1.246 — response spike of 3,698 ms vs 3,057 ms median; dropped and re-run clean. slow sample exceeded 3294 ms cutoff
- † Claude Code 2.1.246 — response spike of 3,520 ms vs 3,057 ms median; dropped and re-run clean. slow sample exceeded 3294 ms cutoff
- † Claude Code 2.1.246 — response (no mcp) spike of 4,144 ms vs 2,723 ms median; dropped and re-run clean. slow sample exceeded 2888 ms cutoff
- † Claude Code 2.1.247 — response spike of 4,692 ms vs 3,011.5 ms median; dropped and re-run clean. slow sample exceeded 3590 ms cutoff
- † Claude Code 2.1.248 — response spike of 3,288 ms vs 2,792 ms median; dropped and re-run clean. slow sample exceeded 2970 ms cutoff
- † Claude Code 2.1.250 — response (no mcp) spike of 4,493 ms vs 2,771 ms median; dropped and re-run clean. slow sample exceeded 4424 ms cutoff
- † Claude Code 2.1.251 — response spike of 3,750 ms vs 2,863.5 ms median; dropped and re-run clean. slow sample exceeded 3016 ms cutoff
- † Claude Code 2.1.251 — response spike of 3,787 ms vs 2,863.5 ms median; dropped and re-run clean. slow sample exceeded 3016 ms cutoff
- † Claude Code 2.1.251 — response spike of 3,421 ms vs 2,863.5 ms median; dropped and re-run clean. slow sample exceeded 3016 ms cutoff
- † Codex rust-v0.113.0 — response spike of 8,741 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff
- † Codex rust-v0.113.0 — response spike of 7,221 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff
- † Codex rust-v0.113.0 — response spike of 6,780 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff
- † Codex rust-v0.113.0 — response spike of 7,595 ms vs 6,587 ms median; dropped and re-run clean. slow sample exceeded 6740 ms cutoff; rerun budget exhausted
- † Codex rust-v0.114.0 — response (fast) spike of 9,881 ms vs 6,492.5 ms median; dropped and re-run clean. slow sample exceeded 7645 ms cutoff
- † Codex rust-v0.114.0 — response (fast) spike of 6,609 ms vs 6,371 ms median; dropped and re-run clean. slow sample exceeded 6526 ms cutoff
- † Codex rust-v0.114.0 — response (fast) spike of 7,187 ms vs 6,371 ms median; dropped and re-run clean. slow sample exceeded 6526 ms cutoff
- † Codex rust-v0.114.0 — response (fast) spike of 8,389 ms vs 6,371 ms median; dropped and re-run clean. slow sample exceeded 6526 ms cutoff; rerun budget exhausted
- † Codex rust-v0.115.0 — response (no mcp) spike of 8,391 ms vs 6,829.5 ms median; dropped and re-run clean. slow sample exceeded 6995 ms cutoff
- † Codex rust-v0.115.0 — response (no mcp) spike of 8,387 ms vs 6,829.5 ms median; dropped and re-run clean. slow sample exceeded 6995 ms cutoff
- † Codex rust-v0.115.0 — response (no mcp) spike of 7,960 ms vs 6,829.5 ms median; dropped and re-run clean. slow sample exceeded 6995 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 7,112 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 6,661 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 6,839 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff
- † Codex rust-v0.115.0 — response (fast) spike of 6,797 ms vs 6,349.5 ms median; dropped and re-run clean. slow sample exceeded 6632 ms cutoff; rerun budget exhausted
- † Codex rust-v0.130.0 — response (fast) spike of 19,371 ms vs 17,639 ms median; dropped and re-run clean. slow sample exceeded 19094 ms cutoff
- † Codex rust-v0.146.0 — response (fast, no mcp) spike of 8,971 ms vs 4,770.5 ms median; dropped and re-run clean. slow sample exceeded 7160 ms cutoff
- † Codex rust-v0.146.0 — response (fast, no mcp) spike of 7,177 ms vs 4,770.5 ms median; dropped and re-run clean. slow sample exceeded 7160 ms cutoff
- † Codex rust-v0.147.0 — response (no mcp) spike of 5,556 ms vs 3,680.5 ms median; dropped and re-run clean. slow sample exceeded 4042 ms cutoff
- † Codex rust-v0.147.0 — response (fast) spike of 4,881 ms vs 3,844.5 ms median; dropped and re-run clean. slow sample exceeded 4344 ms cutoff
- † Codex rust-v0.147.0 — response (fast) spike of 4,639 ms vs 3,844.5 ms median; dropped and re-run clean. slow sample exceeded 4344 ms cutoff
- † Codex rust-v0.147.0 — response (fast, no mcp) spike of 3,922 ms vs 3,700.5 ms median; dropped and re-run clean. slow sample exceeded 3865 ms cutoff
- † Codex rust-v0.148.0 — response (fast, no mcp) spike of 4,410 ms vs 4,003 ms median; dropped and re-run clean. slow sample exceeded 4231 ms cutoff