Problem Validation Workflow

Systematic approach to identifying and validating real problems worth solving, including customer interviews, market sizing, and competitor analysis

The Problem Validation workflow guides founders through the critical process of identifying and validating problems worth solving before investing time and resources into building solutions.

Overview#

PropertyValue
Phases4
TierFree
Typical Duration2-4 weeks
Best ForPre-idea founders, early validation, pivot exploration

Why Validation Matters#

Most startups fail not because of bad execution, but because they build solutions to problems that:

  • Don't exist or aren't painful enough
  • Affect too few people
  • People won't pay to solve
  • Have adequate existing solutions

Validation prevents wasted months building the wrong thing.

Validation Framework#

┌─────────────────────────────────────────────────────────────────────────┐ │ PROBLEM VALIDATION FUNNEL │ ├─────────────────────────────────────────────────────────────────────────┤ │ │ │ ┌─────────────────────────────────────────────────────────┐ │ │ │ PROBLEM HYPOTHESIS │ │ │ │ "I believe [customer] has [problem]" │ │ │ └───────────────────────┬─────────────────────────────────┘ │ │ │ │ │ ▼ │ │ ┌────────────────────────────────────┐ │ │ │ CUSTOMER INTERVIEWS │ │ │ │ Validate problem exists │ │ │ └────────────────┬───────────────────┘ │ │ │ │ │ ▼ │ │ ┌─────────────────────────┐ │ │ │ MARKET SIZING │ │ │ │ Validate big enough │ │ │ └───────────┬─────────────┘ │ │ │ │ │ ▼ │ │ ┌────────────────────┐ │ │ │ COMPETITOR ANALYSIS │ │ │ │ Room for you? │ │ │ └────────┬───────────┘ │ │ │ │ │ ▼ │ │ ┌───────────┐ │ │ │ VALIDATED │ │ │ │ PROBLEM │ │ │ └───────────┘ │ │ │ └─────────────────────────────────────────────────────────────────────────┘

Phases#

Phase 1: Problem Hypothesis (2-3 days)#

Agents: business-analyst

Clearly articulate the problem you believe exists.

Tasks:

  • Define target customer segment
  • Articulate the problem statement
  • Identify current workarounds
  • List assumptions to test
  • Prepare interview guide

Problem Hypothesis Template:

1## Problem Hypothesis Canvas 2 3### Customer Segment 4**Who has this problem?** 5- Demographics: [age, role, industry, company size] 6- Psychographics: [motivations, frustrations, goals] 7- Behaviors: [current actions, tools used, frequency] 8 9Example: 10> Engineering managers at B2B SaaS companies (50-500 employees) 11> who are responsible for developer productivity 12 13### Problem Statement 14**What problem do they have?** 15- Describe the pain in their words 16- What triggers the problem? 17- How often does it occur? 18- What's the impact? 19 20Example: 21> Spends 5+ hours/week context-switching between tools to understand 22> why deployments are failing, leading to longer incident resolution 23> times and frustrated engineers. 24 25### Current Solutions 26**How do they solve it today?** 27- Existing tools they use 28- Manual workarounds 29- Accepted pain (do nothing) 30 31Example: 32> - Manual log searching across 4 different systems 33> - Slack war rooms with engineers 34> - Post-mortems to prevent recurrence 35 36### Assumptions to Test 37**What must be true for this to be a real problem?** 381. [Assumption 1] 392. [Assumption 2] 403. [Assumption 3] 41 42Example: 431. Engineering managers actually track deployment health 442. Current tools don't provide unified view 453. This costs significant engineering time 464. They have budget for new tools

Phase 2: Customer Interviews (1-2 weeks)#

Agents: business-analyst

Talk to potential customers to validate (or invalidate) your hypothesis.

Tasks:

  • Identify 15-20 potential interviewees
  • Conduct 10+ customer interviews
  • Document findings systematically
  • Identify patterns and insights
  • Update hypothesis based on learnings

Customer Interview Guide:

1## The Mom Test Interview Framework 2 3### Rules 41. Talk about their life, not your idea 52. Ask about specifics in the past, not generics about the future 63. Talk less, listen more 74. Ask follow-up questions 85. Look for evidence, not opinions 9 10### Interview Structure (30-45 min) 11 12#### Opening (5 min) 13"Thanks for taking the time. I'm exploring [problem area] and would 14love to understand your experience. This isn't a sales call - I'm 15just trying to learn. Is it okay if I take notes?" 16 17#### Context Setting (5 min) 18- "Can you tell me about your role?" 19- "What does a typical day/week look like?" 20- "What tools do you use for [problem area]?" 21 22#### Problem Exploration (20 min) 23- "Walk me through the last time you [experienced problem area]" 24- "What happened? What did you do?" 25- "How often does this happen?" 26- "What did that cost you?" (time, money, frustration) 27- "What have you tried to solve this?" 28- "How did that work out?" 29- "What do you wish existed?" 30 31#### Digging Deeper 32- "Why is that important?" 33- "Can you give me an example?" 34- "What happened next?" 35- "How did that make you feel?" 36- "What would you do if [solution] existed?" 37 38#### Closing (5 min) 39- "Is there anything else I should know about this?" 40- "Who else should I talk to about this?" 41- "Would it be okay to follow up if I have more questions?" 42 43### Questions to Avoid 44- "Do you think it's a good idea?" 45- "Would you use this?" 46- "How much would you pay?" 47- "What features would you want?"

Interview Analysis Template:

1// lib/validation/interview-tracker.ts 2 3interface Interview { 4 id: string; 5 date: Date; 6 interviewee: { 7 name: string; 8 role: string; 9 company: string; 10 segment: string; 11 }; 12 problemValidation: { 13 hasProblem: boolean; 14 frequency: 'daily' | 'weekly' | 'monthly' | 'rarely'; 15 severity: 1 | 2 | 3 | 4 | 5; // 1 = minor, 5 = critical 16 currentSolutions: string[]; 17 willingToPay: boolean; 18 budgetRange?: string; 19 }; 20 quotes: string[]; 21 insights: string[]; 22 nextSteps: string[]; 23} 24 25// Scoring framework 26function calculateProblemScore(interviews: Interview[]): ProblemScore { 27 const n = interviews.length; 28 29 return { 30 problemExists: interviews.filter(i => i.problemValidation.hasProblem).length / n, 31 avgSeverity: interviews.reduce((sum, i) => sum + i.problemValidation.severity, 0) / n, 32 frequency: calculateFrequencyScore(interviews), 33 willingToPay: interviews.filter(i => i.problemValidation.willingToPay).length / n, 34 recommendation: determineRecommendation(interviews) 35 }; 36} 37 38// Thresholds 39// - Problem exists: > 70% should confirm 40// - Avg severity: > 3.5 (it's a real pain) 41// - Willing to pay: > 50% (validates monetization)

Phase 3: Market Sizing (3-5 days)#

Agents: business-analyst

Determine if the market is large enough to build a business.

Tasks:

  • Calculate TAM (Total Addressable Market)
  • Calculate SAM (Serviceable Addressable Market)
  • Calculate SOM (Serviceable Obtainable Market)
  • Validate with industry data
  • Assess market trends

Market Sizing Framework:

1## TAM/SAM/SOM Analysis 2 3### TAM - Total Addressable Market 4**Everyone who could possibly use this** 5 6Calculation methods: 71. Top-down: Industry reports, total spending in category 82. Bottom-up: Number of potential customers × average price 9 10Example (Developer Tools): 11> 28 million software developers worldwide 12> × $100/month average dev tool spend 13> = $33.6 billion TAM 14 15### SAM - Serviceable Addressable Market 16**The portion of TAM you can realistically serve** 17 18Filters: 19- Geographic limitations 20- Company size focus 21- Specific use case 22 23Example: 24> Focus: B2B SaaS companies, 50-500 employees, English-speaking 25> ~200,000 companies × 10 developers × $100/month 26> = $2.4 billion SAM 27 28### SOM - Serviceable Obtainable Market 29**What you can realistically capture in 3-5 years** 30 31Factors: 32- Competitive landscape 33- Go-to-market capability 34- Resources available 35 36Example: 37> Target 1% of SAM in 5 years 38> = $24 million ARR potential

Market Sizing Checklist:

1## Market Research Sources 2 3### Industry Data 4- [ ] Gartner/Forrester reports 5- [ ] Industry association reports 6- [ ] Government statistics (Census, BLS) 7- [ ] Publicly traded company filings (10-K, S-1) 8 9### Competitor Data 10- [ ] Competitor pricing pages 11- [ ] Competitor case studies (customer counts) 12- [ ] Crunchbase/PitchBook (funding, valuations) 13- [ ] LinkedIn (company sizes) 14 15### Primary Research 16- [ ] Survey your interviewees 17- [ ] Community polls (Reddit, Twitter) 18- [ ] Expert interviews 19 20### Validation Questions 21- [ ] Is TAM > $1B? (needed for VC-scale) 22- [ ] Is SAM > $100M? (meaningful market) 23- [ ] Is market growing > 10%/year? 24- [ ] Are there successful companies in adjacent spaces?

Phase 4: Competitor Analysis (3-5 days)#

Agents: business-analyst

Understand the competitive landscape and find your differentiation.

Tasks:

  • Identify direct and indirect competitors
  • Analyze competitor positioning
  • Identify gaps and opportunities
  • Define your differentiation
  • Validate differentiation with customers

Competitor Analysis Framework:

1## Competitive Analysis Matrix 2 3### Direct Competitors 4Companies solving the same problem for the same customer 5 6| Competitor | Target Customer | Pricing | Strengths | Weaknesses | Differentiation | 7|------------|-----------------|---------|-----------|------------|-----------------| 8| Competitor A | Enterprise | $500/mo | Brand, features | Expensive, complex | | 9| Competitor B | SMB | $50/mo | Easy to use | Limited features | | 10| Competitor C | Developers | Free/Pro | Community | No enterprise | | 11 12### Indirect Competitors 13Alternative solutions (including doing nothing) 14 15| Alternative | Description | When Chosen | Our Advantage | 16|-------------|-------------|-------------|---------------| 17| Spreadsheets | Manual tracking | Low budget | Automation | 18| Custom scripts | In-house solution | Developer teams | Maintained product | 19| Do nothing | Accept the pain | Low priority | Show ROI | 20 21### Competitive Positioning Map 22
High Price │ │ ○ Enterprise A │ ○ Legacy B │ │ ────────────────────┼──────────────────── Simple │ Complex │ ○ Modern C │ ★ Our │ Position │ │ Low Price

Legend: ○ = Competitor ★ = Our target position

### Differentiation Hypothesis **Why will customers choose us over alternatives?** Possible differentiators: - [ ] Price (cheaper, different model) - [ ] Ease of use (simpler, faster time-to-value) - [ ] Features (unique capability, better integration) - [ ] Focus (niche segment, specific use case) - [ ] Service (better support, implementation) - [ ] Technology (faster, more accurate, more scalable) Our differentiation: > [Clear statement of why we win]

Competitor Research Checklist:

1## Competitor Research Tasks 2 3### For Each Competitor 4- [ ] Sign up for free trial 5- [ ] Read all marketing copy 6- [ ] Watch demo videos 7- [ ] Read customer reviews (G2, Capterra) 8- [ ] Check social media presence 9- [ ] Read their blog/content 10- [ ] Note pricing and packaging 11- [ ] Identify target customer 12- [ ] List key features 13- [ ] Note integrations 14 15### Analysis Questions 16- What do customers love about them? 17- What do customers complain about? 18- What features are missing? 19- What customer segments are underserved? 20- Where is their marketing weak? 21- What's their pricing strategy?

Starting the Workflow#

1# Start problem validation workflow 2bootspring workflow start seed-validation 3 4# Create problem hypothesis 5bootspring seed hypothesis create 6 7# Track interview progress 8bootspring seed interviews list 9 10# Calculate market size 11bootspring seed market analyze

Deliverables#

A successful Problem Validation workflow produces:

  • Problem hypothesis document
  • 10+ customer interview summaries
  • Interview analysis with pattern identification
  • TAM/SAM/SOM market sizing
  • Competitor analysis matrix
  • Differentiation hypothesis
  • Go/no-go recommendation

Validation Decision Framework#

1## Should You Proceed? 2 3### Strong Validation (Green Light) 4- 70%+ of interviewees confirm problem 5- Average severity 4+/5 6- 50%+ willing to pay 7- SAM > $100M 8- Clear differentiation identified 9 10### Moderate Validation (Proceed with Caution) 11- 50-70% confirm problem 12- Average severity 3-4/5 13- Some willingness to pay 14- SAM $50-100M 15- Differentiation requires testing 16 17### Weak Validation (Pivot or Stop) 18- < 50% confirm problem 19- Average severity < 3/5 20- Few willing to pay 21- SAM < $50M 22- No clear differentiation 23 24### Red Flags 25- Nobody has the problem 26- Problem exists but nobody cares 27- Solving it requires behavior change 28- Market is declining 29- Winner-take-all with clear winner

Best Practices#

  1. Talk to strangers - Friends and family give biased feedback
  2. Seek disconfirmation - Try to prove yourself wrong
  3. Follow the energy - Note what makes people excited/frustrated
  4. Get specific - Generalities are useless, examples are gold
  5. Iterate quickly - Update hypothesis after each batch of interviews
  6. Document everything - Your future self will thank you

Common Pitfalls#

  • Asking leading questions
  • Only talking to people who agree with you
  • Falling in love with solution before validating problem
  • Insufficient interviews (need 10+ for patterns)
  • Ignoring negative signals
  • Confusing "interesting" with "will pay"