Illustrative example, fictional brand. Every brand, product, participant and number on this page is made up to show what an instructions and assembly test looks like. Nothing here describes a real company.
Corvo sells the Rise, a flat-pack electric standing desk, online. Support calls and returns cluster around setup, and reviews mention the instructions. In round 1, 20 people each built the desk from a sealed box in our facility, using only the booklet and the tools inside, while we timed and observed every step. Corvo rewrote the booklet from what we saw, and in round 2, 20 different people built it again.
The nine steps in the booklet
Red outlines mark the four steps that caused most of the trouble in round 1. Booklet page numbers are shown under each step.
Who took part Measured
We schedule 22 per round to seat 20. Two standbys were thanked and released.
Screener, each round
Bought a standing desk in the past year or plans to in the next twelve months, any brand
Quota: 10 who call themselves handy (built three or more flat-pack items in two years), 10 who do not
Ages 22 to 68, a mix of women and men
Able to lift 20 kg with help, per the booklet's safety note
Out: has built any Corvo desk before
Out: works in furniture, retail or market research
Out: took part in round 1 (round 2 only)
The room
Sealed box, floor matA 4 by 4 meter build area. Only the box, the booklet and the tools inside it.
Four camerasOverhead, two side angles, and one above the booklet stand to log which page is open.
Moderator in the roomPrompts people to think aloud. Helps only when asked, or at step 8, where the booklet calls for a second person to turn the desk upright.
14-point check at the endA facility technician checks every bolt, cable and setting, so mistakes that looked fine to the builder still count.
What we measure
Task success
Built correctly without help, built correctly after asking for help, or a fault found at the final check.
Time per step
From first touching that step's parts to the last action of the step.
Error
Anything that had to be undone or left the desk wrong. Minor: caught and fixed by the builder. Major: desk would not work or had to be partly taken apart. Critical: damage or a safety risk.
Stuck
No progress for more than 60 seconds, or a request for help.
Page heat
Seconds each booklet page was open, how many builders opened it, and how often they went back.
Ratings
Ease of assembly (1 to 7) and confidence it was built right, asked before the technician's check.
Schedule
Week 1recruit
Screen and scheduleOnline screener and a short call. 640 screened, 118 qualified.
Week 2round 1
20 builders, two daysTen sessions a day in two rooms, 90 minutes each including the interview.
current bookletvideo
Week 3rewrite
Findings workshop and rewriteClips of every sticking point reviewed with Corvo's product and packaging team. New booklet drafted and printed.
Week 4round 2
20 new buildersSame screener, same room, same measures, new booklet and keypad sticker.
new bookletvideo
Week 5read out
Before and after readoutResults, clips, and the remaining open issues.
Round 1 used the current booklet. Just over half of the builders finished correctly without help, and time and errors piled up in four of the nine steps. The desk took 52 minutes on average against the booklet's promise of "about 30 minutes."
Built right, no help
55%
11 of 20 builders
Mean build time
52 min
range 31 to 86, booklet says 30
Errors observed
40
2.0 per builder, 2 critical
Asked for help
6 of 20
9 requests in all
Task success, round 1 Measured
Built right, no helpBuilt right after helpFault at final check
All three faults came from less experienced builders: two desktops marked by long screws in step 5, and one motor cable not fully seated in step 7. The booklet works for people who already know how flat-pack goes together.
Mean minutes per step, round 1 Measured
Actual meanCorvo's target (30 min in all)
Steps 4, 5, 7 and 9 account for 30 of the 52 minutes.
Errors by step and severity, round 1 Measured
Step
Minor
Major
Critical
Total
Errors at this step
Stuck
Help asked
MinorMajorCritical
Stuck counts builders who stopped for more than a minute or asked for help at that step. 31 stuck moments in all across 20 builders.
A builder counts as stuck when they make no progress for over a minute or ask for help. Four steps hold most of it. Click a step to see what happened, what people said while they worked, and the fix we tested in round 2.
Builders stuck, by step, round 1 Measured
Of 20 builders. One person can be stuck at more than one step.
Sticking points Illustrative clips
The camera above the booklet stand logged which page was open, for how long, and how often builders went back. The darker the page, the more it held people up. Switch rounds to see the rewritten booklet.
Booklet time per builder
21 min
of 52 minutes building
Hottest page
p. 8
step 4, frame width
Returns to hardware page
4.2
times per builder, page 3
Opened troubleshooting
3 of 20
where the reset step was hiding
Instruction booklet, page by page Measured
LowHigh
Means per builder, n=20 per round. Page 16 held the reset instructions in round 1. The rewrite moved them to page 15, inside step 9, and shows each step's screws on that step's own page.
What the heat says
Page 3, the hardware list, was opened again 4.2 times per builder. People flipped back to match screws to letters. The steps never showed the screws themselves.
Pages 8 and 9 (frame width) held builders for 5.5 minutes. The drawing gives a width in millimeters that nobody could measure without a metric tape.
Page 13 (cables) held 3 minutes, mostly with the builder holding the booklet next to the control box, trying to match ports.
Only 3 of 20 opened page 16. The reset instruction lived there. The other 17 never saw it.
Pages people skipped
Page 4, tools45% opened
Page 1, cover and safety60% opened
Page 14, turn upright70% opened
Page 16, troubleshooting15% opened
Skipped pages are fine when nothing important is on them. Safety and the reset are important, so in the rewrite both moved to the step where they apply.
Corvo's team rewrote the booklet with us, added a sticker to the keypad and color-coded the cable plugs. Twenty new builders assembled the desk with the new version, under the same conditions and measures.
Recommendation
Ship the new booklet and the keypad sticker
Building the desk right without help rose from 55% to 90%. Mean build time fell from 52 to 38 minutes, errors fell from 40 to 11, and no desktop was damaged. Change the booklet's time estimate to "about 40 minutes," which is honest and achievable. Step 5 is still slow, and that is a hardware question for the next model.
Before and after Measured
Measure
Round 1
Round 2
Change
Built right, no help
55% (11)
90% (18)
+35 pts
Built right after help
30% (6)
10% (2)
−20 pts
Fault at final check
15% (3)
0%
−15 pts
Mean build time
52 min
38 min
−14 min
Errors observed
40
11
−29
Critical errors
2
0
−2
Stuck moments
31
5
−26
Help requests
9
2
−7
Ease of assembly, mean of 1 to 7
4.1
5.9
+1.8
Confident it was built right (6 or 7)
45%
85%
+40 pts
Time looking at the booklet
21 min
12 min
−9 min
n=20 builders per round, different people each round, same screener and quotas. Less experienced builders: 3 of 10 built it right without help in round 1, 8 of 10 in round 2.
Task success by round Measured
No helpAfter helpFault
Mean minutes per step, before and after Measured
Round 1Round 2Target
What changed, and what it did
4
Width letters on the frame and the desktop labelS, M and L stamped on the frame, matching the desktop's label. Stuck at step 4: 9 to 1. Time: 9 to 4 min.
Worked
9
Reset moved into step 9, plus a keypad sticker"First use: hold the down button 10 seconds until it beeps." Errors at step 9: 7 to 1.
Worked
7
Color-coded plugs and ports, full-page photoErrors at step 7: 8 to 2. Time: 8 to 4 min.
Worked
5
Actual-size screw outlines, named in words"Short screws for the desktop." No long screws in the desktop. Time barely moved: 10 to 9 min.
Partly
3
Right and wrong photos for the legs"This side faces in" arrow on each leg. Errors: 5 to 1.
Worked
1
Hardware shown on each step's pageReturns to the hardware page: 4.2 to 1.1 per builder.
Worked
Still open
Step 5 takes 9 minutes. It is twelve screws driven by hand with the included driver. Fewer, larger screws or pre-set inserts in the desktop would cut it. That is a parts decision for the next model.
Two builders still asked for help, once at step 4 and once at step 7. Both were less experienced builders and both finished correctly.
Where this test could mislead
20 builders per round finds the common problems. A rare one that affects 1 in 50 buyers may not show up.
Our build room is clean, bright and roomy. A small apartment with the box on a rug, and a child helping, is harder.
People try harder when watched. Real buyers may skip more pages, which makes moving key steps out of the troubleshooting page even more important.