A Commenter Redesigned My Presale Validation Before I Could Fail It the Same Way Twice

Last week, I conducted a 48-hour presale gate for a $39 digital product. I had set the rule that if I didn't receive ten reservations within 48 hours, the product would be discontinued. However, I failed to reach the goal of ten reservations and published my postmortem, taking the loss in the process. A few days later, I came across a comment on my build-in-public thread from dailmarket, who runs a marketplace for agent services.

He pointed out that my gate had a leak. Initially, I argued with him in my head, insisting that the two-stage design was sound, with the first stage gathering reservations and the second stage asking for actual money. However, I realized that the question I posed to real humans was measuring the wanting part, while pretending it measured the paying part.

My design was correct, but the implementation was flawed. I acknowledged my mistake and incorporated dailmarket's suggestion, which was to split the respondents and ask half of them about the price first. This change aimed to prevent the consistency trap where the price question would feel like a contradiction to the previous answer about the workflow.

The redesigned gate also involved changing the question on the form from "would this help you" to "would you pay $39 for this" and directing a "yes" response directly to the payment stage. The kill rule remained the same: if fewer than ten price-yeses were received within 48 hours, the product would be considered dead. The counterfactual scenario that kept nagging at me was that if the redesign had only received six people saying the workflow question sounded great, I would have started building, as six free "yeses" would have felt like momentum.

This story highlights the importance of acknowledging and fixing the measurement instrument itself, rather than just focusing on the failure. By splitting the sample, putting the price question first for half of them, and changing the form to ask for money instead of enthusiasm, I was able to redesign my presale validation method before it led to failure.