A product health scorecard for an e-commerce platform is a structured dashboard that aggregates the critical metrics across commerce performance, technical reliability, customer satisfaction, and business health — giving PMs a single view to assess whether the platform is performing well or requires intervention.
According to Lenny Rachitsky on Lenny's Podcast, the best product health scorecards are not vanity metric collections — they are early warning systems. The goal is to surface a problem 2-3 weeks before it becomes a crisis, not to report what already happened.
According to Gibson Biddle on Lenny's Podcast, at Netflix the product health scorecard was reviewed every Monday morning by the leadership team. The act of reviewing it together created shared ownership of the metrics and eliminated the "not my department" problem.
According to Annie Pearl on Lenny's Podcast, at Calendly the most important thing about the health scorecard was that every metric had a clear owner — not a team, but a specific individual who was responsible for explaining movements and driving interventions.
Product Health Scorecard: A concise, regularly updated view of a product's most critical performance, reliability, and customer satisfaction metrics — designed to enable rapid identification of problems and opportunities before they become crises.
The Ecommerce Platform Health Scorecard Framework
Dimension 1: Commerce Performance
| Metric | Description | Target | Alert Threshold | |--------|-------------|--------|----------------| | GMV (Daily) | Total transaction value | MoM growth: +5% | -10% vs 7-day avg | | Conversion Rate | Visitors → checkout completion | >3.5% | <2.5% | | AOV (Average Order Value) | Revenue / orders | >$85 | <$70 | | Cart Abandonment Rate | Carts created but not purchased | <70% | >80% | | Checkout Completion Rate | Checkout initiated → order placed | >80% | <70% | | Refund Rate | Refunds / total orders | <3% | >5% |
Dimension 2: Technical Reliability
| Metric | Description | Target | Alert Threshold | |--------|-------------|--------|----------------| | Uptime | Platform availability | 99.9% | <99.5% | | Page Load Time (Home) | P95 load time | <2s | >3s | | Checkout Latency | Time from payment submit to confirmation | <3s p95 | >5s | | Error Rate (4xx/5xx) | HTTP error responses | <0.5% of requests | >1% | | Payment Success Rate | Payment attempts → success | >98% | <95% | | Search Relevancy Score | User searches → clicked result | >60% click rate | <40% |
Dimension 3: Inventory and Supply
| Metric | Description | Target | Alert Threshold | |--------|-------------|--------|----------------| | Out-of-Stock Rate (Top 100 SKUs) | Top items unavailable | <5% | >15% | | Inventory Turnover | Days of inventory on hand | 30-60 days | >90 days | | Fulfillment SLA Achievement | Orders shipped on time | >95% | <85% | | Damaged/Incorrect Rate | Returns due to fulfillment errors | <1% | >2% |
Dimension 4: Customer Experience
| Metric | Description | Target | Alert Threshold | |--------|-------------|--------|----------------| | NPS | Net Promoter Score | >55 | <40 | | CSAT (Post-Purchase) | Customer satisfaction after delivery | >4.3/5 | <3.8/5 | | Support Ticket Volume | Tickets per 100 orders | <5 | >10 | | First Response Time | Time to first support response | <4 hours | >24 hours | | Product Return Rate | Items returned / orders | <10% | >15% |
Dimension 5: Growth Metrics
| Metric | Description | Target | Alert Threshold | |--------|-------------|--------|----------------| | New Customer Rate | % orders from new customers | >30% | <20% | | Returning Customer Rate | % orders from returning customers | >50% | <35% | | Email CTR | Email campaign click rate | >3% | <1.5% | | Mobile Conversion Rate | Mobile visitors → orders | >2.5% | <1.5% |
Scorecard Review Cadence
- Daily: Commerce performance and technical reliability (automated alerts for threshold breaches)
- Weekly: Full scorecard review with metric owners — 30-minute team standup
- Monthly: Trend analysis, deep-dive on any dimension below target for 3+ consecutive weeks
- Quarterly: Scorecard redesign — add new metrics as the platform evolves, retire lagging indicators
Color Coding for the Scorecard
- 🟢 Green: At or above target
- 🟡 Yellow: Between target and alert threshold (watch closely)
- 🔴 Red: At or below alert threshold (immediate owner action required)
- ⬛ No data: Instrumentation issue — escalate to engineering immediately
Common Pitfalls to Avoid
- Too many metrics: A scorecard with 50 metrics is one that nobody reads. Limit to 20-25 key indicators.
- No alert thresholds: A scorecard that only shows green/red at the end of the month is a lagging indicator. Set weekly alert thresholds.
- Metrics without owners: Every metric must have a named individual owner, not just a team.
- Ignoring mobile vs desktop split: Aggregate conversion rates hide major platform-specific problems.
Success Metrics for Your Health Scorecard
- Alert threshold breaches are identified and responded to within 24 hours, not weeks
- Team spends <20 minutes per week in the scorecard review
- Metric ownership drives accountability — every red metric has a recovery plan within 48 hours
For more PM frameworks, visit PM interview prep and daily PM challenges.
Learn product metrics best practices at Lenny's Newsletter.
Frequently Asked Questions
What should a product health scorecard for an ecommerce platform include?
Include commerce performance (GMV, conversion rate, AOV, cart abandonment), technical reliability (uptime, latency, error rate), inventory health (stockouts, fulfillment SLA), customer experience (NPS, CSAT, support volume), and growth metrics (new vs returning customer rate).
How often should you review an ecommerce product health scorecard?
Review technical and commerce performance metrics daily via automated alerts. Run a full scorecard team review weekly. Conduct monthly trend analysis and quarterly redesign of the scorecard itself.
What is a good ecommerce conversion rate benchmark?
A good ecommerce conversion rate is 2-4% of unique visitors. The top quartile of ecommerce sites converts at >4%. Mobile conversion is typically 30-40% lower than desktop. Benchmark against your own historical performance, not just industry averages.
What is the most important metric on an ecommerce product health scorecard?
Checkout conversion rate and payment success rate are the highest-impact metrics — they directly represent whether the platform is functioning as a revenue engine. A drop in either requires immediate root cause analysis.
How do you set alert thresholds for an ecommerce scorecard?
Base thresholds on historical variance: if checkout conversion averages 3.5% with a standard deviation of 0.2%, set the alert threshold at 2.9% (3 standard deviations below mean). This minimizes false positives while catching genuine performance drops.