Ship it on forty users?
The artifact
From: Priya Ellis, Product To: you (VP Product) Subject: Sitewalk onboarding — need your call by Thursday
I've been going back and forth on this all week and I don't think I can decide it alone. Numbers below, then the three ways I see it going.
Where we are
The rebuilt first-project flow has been in beta six weeks. GA is scheduled for the 14th — six days. Marketing has the announcement queued, the partner blog post is written and scheduled, and Dan and Ije both booked leave from the 15th on the assumption this lands.
Beta numbers
- 40 accounts enrolled (opt-in from the in-app banner)
- 25 completed the new first-project flow within 7 days of signup — 62%
- Old flow, from the analytics dashboard: "around half". That figure is from a Q3 2024 report and I could not find the query behind it.
- Median time to first project: 11 minutes (old flow, no comparable figure)
- 4 support tickets, all resolved, none escalated
Qualitative
Mostly positive. Six people replied to the feedback prompt unprompted, five positive. Sample: "much less faffing about than last time," "found it fine."
The exception is Callum at Redbrick, who has been vocal in the beta channel. He runs eleven sites concurrently and the new flow assumes you are setting up one project at a time. For him it is slower than the old one — he has to run the flow eleven times. He is not wrong. I'd guess he's maybe 10–15% of our base by account, though I haven't pulled the number.
The three ways I see it
- Ship on the 14th. The flow works, nothing's on fire, and the numbers aren't bad. We keep the announcement and the partner post.
- Delay four weeks. More beta accounts, more confidence, cleaner story. Costs us the partner slot (their editorial calendar is booked to December) and Dan and Ije come back to a launch they thought had happened.
- Ship to a subset. Route some accounts to the new flow at GA, keep the rest on the old one, decide properly later.
I genuinely don't know which. Tell me what you want and I'll make it happen.
Priya
P.S. — new signups are running about 90 accounts a month at the moment, if that matters.
Your task
You are the VP Product Priya is writing to, and she needs an answer by Thursday. Make the call and defend it. Say what your choice costs and what would tell you it was wrong.
Step 1 — make the call
What's your call for Priya?
How confident are you?
The call isn't scored — there's no right option. What gets scored is what you write next.