UI generation eval — current results

60 trials, $245.95 spent, 3 with a built report. Deltas are against cc-none-sonnet-high. A thumbnail is the component that trial actually produced; click it for the full report. Generated 2026-08-07 19:17 UTC.

810-atom-from-schema

arm quality Δ pass@1 $/trial cost × quality/extra $ runs
cc-none-sonnet-high 0.64 ±0.02 — 0% $2.49 — —
not built
run-1 — failed
run-2 — failed
run-2 — failed
not built
run-3 — failed
cc-both-sonnet-high 0.96 ±0.03 +0.32 67% $9.67 3.88× 0.045
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — failed
cc-component-builder-sonnet-high 0.93 ±0.06 +0.29 67% $5.26 2.11× 0.105
not built
run-1 — failed
not built
run-2 — passed
not built
run-3 — passed
cc-design-tokens-sonnet-high 0.69 ±0.00 +0.04 0% $7.48 3.00× 0.009
not built
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed

812-restyle-with-tokens

arm quality Δ pass@1 $/trial cost × quality/extra $ runs
cc-none-sonnet-high 0.93 ±0.00 — 0% $0.93 — —
not built
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed
cc-both-sonnet-high 1.00 ±0.00 +0.07 100% $6.76 7.24× 0.011
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed
cc-component-builder-sonnet-high run invalid 0.99 ±0.00 +0.05 100% $1.43 1.53× 0.110
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed
cc-design-tokens-sonnet-high run invalid 0.99 ±0.00 +0.05 0% $6.06 6.49× 0.010
not built
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed

832-client-behaviour

arm quality Δ pass@1 $/trial cost × quality/extra $ runs
cc-none-sonnet-high 0.63 ±0.01 — 0% $2.54 — —
run-1 — failed
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed
cc-both-sonnet-high 0.97 ±0.02 +0.34 100% $6.25 2.46× 0.092
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed
cc-component-builder-sonnet-high 1.00 ±0.00 +0.36 100% $4.23 1.67× 0.216
run-1 — passed
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed
cc-design-tokens-sonnet-high 0.73 ±0.05 +0.09 0% $5.24 2.06× 0.035
not built
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed

840-reuse-over-native

arm quality Δ pass@1 $/trial cost × quality/extra $ runs
cc-none-sonnet-high 0.73 ±0.03 — 0% $3.01 — —
not built
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed
cc-both-sonnet-high 0.97 ±0.03 +0.24 0% $8.36 2.78× 0.045
not built
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed
cc-component-builder-sonnet-high 0.98 ±0.02 +0.26 67% $4.58 1.52× 0.164
not built
run-1 — failed
not built
run-2 — passed
not built
run-3 — passed
cc-design-tokens-sonnet-high 0.82 ±0.07 +0.09 0% $6.71 2.23× 0.025
not built
run-1 — failed
not built
run-2 — failed
not built
run-3 — failed

860-restraint

arm quality Δ pass@1 $/trial cost × quality/extra $ runs
cc-none-sonnet-high 1.00 ±0.00 — 100% $0.17 — —
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed
cc-both-sonnet-high 1.00 ±0.00 +0.00 100% $0.26 1.54× 0.000
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed
cc-component-builder-sonnet-high 1.00 ±0.00 +0.00 100% $0.24 1.42× 0.000
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed
cc-design-tokens-sonnet-high 1.00 ±0.00 +0.00 100% $0.22 1.32× 0.000
not built
run-1 — passed
not built
run-2 — passed
not built
run-3 — passed