Problem Validation Workflow
Systematic approach to identifying and validating real problems worth solving, including customer interviews, market sizing, and competitor analysis
The Problem Validation workflow guides founders through the critical process of identifying and validating problems worth solving before investing time and resources into building solutions.
Overview#
| Property | Value |
|---|---|
| Phases | 4 |
| Tier | Free |
| Typical Duration | 2-4 weeks |
| Best For | Pre-idea founders, early validation, pivot exploration |
Why Validation Matters#
Most startups fail not because of bad execution, but because they build solutions to problems that:
- Don't exist or aren't painful enough
- Affect too few people
- People won't pay to solve
- Have adequate existing solutions
Validation prevents wasted months building the wrong thing.
Validation Framework#
┌─────────────────────────────────────────────────────────────────────────┐
│ PROBLEM VALIDATION FUNNEL │
├─────────────────────────────────────────────────────────────────────────┤
│ │
│ ┌─────────────────────────────────────────────────────────┐ │
│ │ PROBLEM HYPOTHESIS │ │
│ │ "I believe [customer] has [problem]" │ │
│ └───────────────────────┬─────────────────────────────────┘ │
│ │ │
│ ▼ │
│ ┌────────────────────────────────────┐ │
│ │ CUSTOMER INTERVIEWS │ │
│ │ Validate problem exists │ │
│ └────────────────┬───────────────────┘ │
│ │ │
│ ▼ │
│ ┌─────────────────────────┐ │
│ │ MARKET SIZING │ │
│ │ Validate big enough │ │
│ └───────────┬─────────────┘ │
│ │ │
│ ▼ │
│ ┌────────────────────┐ │
│ │ COMPETITOR ANALYSIS │ │
│ │ Room for you? │ │
│ └────────┬───────────┘ │
│ │ │
│ ▼ │
│ ┌───────────┐ │
│ │ VALIDATED │ │
│ │ PROBLEM │ │
│ └───────────┘ │
│ │
└─────────────────────────────────────────────────────────────────────────┘
Phases#
Phase 1: Problem Hypothesis (2-3 days)#
Agents: business-analyst
Clearly articulate the problem you believe exists.
Tasks:
- Define target customer segment
- Articulate the problem statement
- Identify current workarounds
- List assumptions to test
- Prepare interview guide
Problem Hypothesis Template:
1## Problem Hypothesis Canvas
2
3### Customer Segment
4**Who has this problem?**
5- Demographics: [age, role, industry, company size]
6- Psychographics: [motivations, frustrations, goals]
7- Behaviors: [current actions, tools used, frequency]
8
9Example:
10> Engineering managers at B2B SaaS companies (50-500 employees)
11> who are responsible for developer productivity
12
13### Problem Statement
14**What problem do they have?**
15- Describe the pain in their words
16- What triggers the problem?
17- How often does it occur?
18- What's the impact?
19
20Example:
21> Spends 5+ hours/week context-switching between tools to understand
22> why deployments are failing, leading to longer incident resolution
23> times and frustrated engineers.
24
25### Current Solutions
26**How do they solve it today?**
27- Existing tools they use
28- Manual workarounds
29- Accepted pain (do nothing)
30
31Example:
32> - Manual log searching across 4 different systems
33> - Slack war rooms with engineers
34> - Post-mortems to prevent recurrence
35
36### Assumptions to Test
37**What must be true for this to be a real problem?**
381. [Assumption 1]
392. [Assumption 2]
403. [Assumption 3]
41
42Example:
431. Engineering managers actually track deployment health
442. Current tools don't provide unified view
453. This costs significant engineering time
464. They have budget for new toolsPhase 2: Customer Interviews (1-2 weeks)#
Agents: business-analyst
Talk to potential customers to validate (or invalidate) your hypothesis.
Tasks:
- Identify 15-20 potential interviewees
- Conduct 10+ customer interviews
- Document findings systematically
- Identify patterns and insights
- Update hypothesis based on learnings
Customer Interview Guide:
1## The Mom Test Interview Framework
2
3### Rules
41. Talk about their life, not your idea
52. Ask about specifics in the past, not generics about the future
63. Talk less, listen more
74. Ask follow-up questions
85. Look for evidence, not opinions
9
10### Interview Structure (30-45 min)
11
12#### Opening (5 min)
13"Thanks for taking the time. I'm exploring [problem area] and would
14love to understand your experience. This isn't a sales call - I'm
15just trying to learn. Is it okay if I take notes?"
16
17#### Context Setting (5 min)
18- "Can you tell me about your role?"
19- "What does a typical day/week look like?"
20- "What tools do you use for [problem area]?"
21
22#### Problem Exploration (20 min)
23- "Walk me through the last time you [experienced problem area]"
24- "What happened? What did you do?"
25- "How often does this happen?"
26- "What did that cost you?" (time, money, frustration)
27- "What have you tried to solve this?"
28- "How did that work out?"
29- "What do you wish existed?"
30
31#### Digging Deeper
32- "Why is that important?"
33- "Can you give me an example?"
34- "What happened next?"
35- "How did that make you feel?"
36- "What would you do if [solution] existed?"
37
38#### Closing (5 min)
39- "Is there anything else I should know about this?"
40- "Who else should I talk to about this?"
41- "Would it be okay to follow up if I have more questions?"
42
43### Questions to Avoid
44- "Do you think it's a good idea?"
45- "Would you use this?"
46- "How much would you pay?"
47- "What features would you want?"Interview Analysis Template:
1// lib/validation/interview-tracker.ts
2
3interface Interview {
4 id: string;
5 date: Date;
6 interviewee: {
7 name: string;
8 role: string;
9 company: string;
10 segment: string;
11 };
12 problemValidation: {
13 hasProblem: boolean;
14 frequency: 'daily' | 'weekly' | 'monthly' | 'rarely';
15 severity: 1 | 2 | 3 | 4 | 5; // 1 = minor, 5 = critical
16 currentSolutions: string[];
17 willingToPay: boolean;
18 budgetRange?: string;
19 };
20 quotes: string[];
21 insights: string[];
22 nextSteps: string[];
23}
24
25// Scoring framework
26function calculateProblemScore(interviews: Interview[]): ProblemScore {
27 const n = interviews.length;
28
29 return {
30 problemExists: interviews.filter(i => i.problemValidation.hasProblem).length / n,
31 avgSeverity: interviews.reduce((sum, i) => sum + i.problemValidation.severity, 0) / n,
32 frequency: calculateFrequencyScore(interviews),
33 willingToPay: interviews.filter(i => i.problemValidation.willingToPay).length / n,
34 recommendation: determineRecommendation(interviews)
35 };
36}
37
38// Thresholds
39// - Problem exists: > 70% should confirm
40// - Avg severity: > 3.5 (it's a real pain)
41// - Willing to pay: > 50% (validates monetization)Phase 3: Market Sizing (3-5 days)#
Agents: business-analyst
Determine if the market is large enough to build a business.
Tasks:
- Calculate TAM (Total Addressable Market)
- Calculate SAM (Serviceable Addressable Market)
- Calculate SOM (Serviceable Obtainable Market)
- Validate with industry data
- Assess market trends
Market Sizing Framework:
1## TAM/SAM/SOM Analysis
2
3### TAM - Total Addressable Market
4**Everyone who could possibly use this**
5
6Calculation methods:
71. Top-down: Industry reports, total spending in category
82. Bottom-up: Number of potential customers × average price
9
10Example (Developer Tools):
11> 28 million software developers worldwide
12> × $100/month average dev tool spend
13> = $33.6 billion TAM
14
15### SAM - Serviceable Addressable Market
16**The portion of TAM you can realistically serve**
17
18Filters:
19- Geographic limitations
20- Company size focus
21- Specific use case
22
23Example:
24> Focus: B2B SaaS companies, 50-500 employees, English-speaking
25> ~200,000 companies × 10 developers × $100/month
26> = $2.4 billion SAM
27
28### SOM - Serviceable Obtainable Market
29**What you can realistically capture in 3-5 years**
30
31Factors:
32- Competitive landscape
33- Go-to-market capability
34- Resources available
35
36Example:
37> Target 1% of SAM in 5 years
38> = $24 million ARR potentialMarket Sizing Checklist:
1## Market Research Sources
2
3### Industry Data
4- [ ] Gartner/Forrester reports
5- [ ] Industry association reports
6- [ ] Government statistics (Census, BLS)
7- [ ] Publicly traded company filings (10-K, S-1)
8
9### Competitor Data
10- [ ] Competitor pricing pages
11- [ ] Competitor case studies (customer counts)
12- [ ] Crunchbase/PitchBook (funding, valuations)
13- [ ] LinkedIn (company sizes)
14
15### Primary Research
16- [ ] Survey your interviewees
17- [ ] Community polls (Reddit, Twitter)
18- [ ] Expert interviews
19
20### Validation Questions
21- [ ] Is TAM > $1B? (needed for VC-scale)
22- [ ] Is SAM > $100M? (meaningful market)
23- [ ] Is market growing > 10%/year?
24- [ ] Are there successful companies in adjacent spaces?Phase 4: Competitor Analysis (3-5 days)#
Agents: business-analyst
Understand the competitive landscape and find your differentiation.
Tasks:
- Identify direct and indirect competitors
- Analyze competitor positioning
- Identify gaps and opportunities
- Define your differentiation
- Validate differentiation with customers
Competitor Analysis Framework:
1## Competitive Analysis Matrix
2
3### Direct Competitors
4Companies solving the same problem for the same customer
5
6| Competitor | Target Customer | Pricing | Strengths | Weaknesses | Differentiation |
7|------------|-----------------|---------|-----------|------------|-----------------|
8| Competitor A | Enterprise | $500/mo | Brand, features | Expensive, complex | |
9| Competitor B | SMB | $50/mo | Easy to use | Limited features | |
10| Competitor C | Developers | Free/Pro | Community | No enterprise | |
11
12### Indirect Competitors
13Alternative solutions (including doing nothing)
14
15| Alternative | Description | When Chosen | Our Advantage |
16|-------------|-------------|-------------|---------------|
17| Spreadsheets | Manual tracking | Low budget | Automation |
18| Custom scripts | In-house solution | Developer teams | Maintained product |
19| Do nothing | Accept the pain | Low priority | Show ROI |
20
21### Competitive Positioning Map
22 High Price
│
│ ○ Enterprise A
│
○ Legacy B │
│
────────────────────┼────────────────────
Simple │ Complex
│ ○ Modern C
│
★ Our │
Position │
│
Low Price
Legend: ○ = Competitor ★ = Our target position
### Differentiation Hypothesis
**Why will customers choose us over alternatives?**
Possible differentiators:
- [ ] Price (cheaper, different model)
- [ ] Ease of use (simpler, faster time-to-value)
- [ ] Features (unique capability, better integration)
- [ ] Focus (niche segment, specific use case)
- [ ] Service (better support, implementation)
- [ ] Technology (faster, more accurate, more scalable)
Our differentiation:
> [Clear statement of why we win]
Competitor Research Checklist:
1## Competitor Research Tasks
2
3### For Each Competitor
4- [ ] Sign up for free trial
5- [ ] Read all marketing copy
6- [ ] Watch demo videos
7- [ ] Read customer reviews (G2, Capterra)
8- [ ] Check social media presence
9- [ ] Read their blog/content
10- [ ] Note pricing and packaging
11- [ ] Identify target customer
12- [ ] List key features
13- [ ] Note integrations
14
15### Analysis Questions
16- What do customers love about them?
17- What do customers complain about?
18- What features are missing?
19- What customer segments are underserved?
20- Where is their marketing weak?
21- What's their pricing strategy?Starting the Workflow#
1# Start problem validation workflow
2bootspring workflow start seed-validation
3
4# Create problem hypothesis
5bootspring seed hypothesis create
6
7# Track interview progress
8bootspring seed interviews list
9
10# Calculate market size
11bootspring seed market analyzeDeliverables#
A successful Problem Validation workflow produces:
- Problem hypothesis document
- 10+ customer interview summaries
- Interview analysis with pattern identification
- TAM/SAM/SOM market sizing
- Competitor analysis matrix
- Differentiation hypothesis
- Go/no-go recommendation
Validation Decision Framework#
1## Should You Proceed?
2
3### Strong Validation (Green Light)
4- 70%+ of interviewees confirm problem
5- Average severity 4+/5
6- 50%+ willing to pay
7- SAM > $100M
8- Clear differentiation identified
9
10### Moderate Validation (Proceed with Caution)
11- 50-70% confirm problem
12- Average severity 3-4/5
13- Some willingness to pay
14- SAM $50-100M
15- Differentiation requires testing
16
17### Weak Validation (Pivot or Stop)
18- < 50% confirm problem
19- Average severity < 3/5
20- Few willing to pay
21- SAM < $50M
22- No clear differentiation
23
24### Red Flags
25- Nobody has the problem
26- Problem exists but nobody cares
27- Solving it requires behavior change
28- Market is declining
29- Winner-take-all with clear winnerBest Practices#
- Talk to strangers - Friends and family give biased feedback
- Seek disconfirmation - Try to prove yourself wrong
- Follow the energy - Note what makes people excited/frustrated
- Get specific - Generalities are useless, examples are gold
- Iterate quickly - Update hypothesis after each batch of interviews
- Document everything - Your future self will thank you
Common Pitfalls#
- Asking leading questions
- Only talking to people who agree with you
- Falling in love with solution before validating problem
- Insufficient interviews (need 10+ for patterns)
- Ignoring negative signals
- Confusing "interesting" with "will pay"