← Graph

How were manual tweaks benchmarked

question 1 connections

Audience asked how the team knew whether a manual tweak was for the better — customer reactions or benchmarking? Answer: the benchmark was the product and operations teams 'vibing' with the resulting boxes — looking at each suggested box given the input and asking 'would I feel good receiving this?'. A matter of taste and judgment, not a metric.

answer_summary
Benchmark was product/ops teams vibe-checking resulting boxes — taste-based, not metric-based.
question How were manual tweaks benchmarked
asked_at
Asked during the post-talk Q&A.

Provenance