Metrics to track for a mobile app push notification strategy must go beyond open rate — the three metrics that actually determine whether your push strategy is an asset or a liability are opt-out rate by message type, session depth after push open, and net push revenue attribution, because a push notification that is opened but generates no downstream action is noise, and noise at scale trains users to opt out.
Most mobile teams optimize push notifications for open rate. Open rate is a proxy metric. A notification that generates a 12% open rate but no session depth is training users to ignore your notifications. The metrics below tell you whether push is building retention or destroying it.
The Push Notification Metrics Hierarchy
Layer 1: Deliverability
↓ (must be healthy before optimizing the rest)
Layer 2: Opt-In Health (opt-in rate, opt-out rate)
↓ (must be trending positive)
Layer 3: Engagement Quality (open rate, session depth, conversion)
↓ (measure ROI)
Layer 4: Retention Impact (D7/D30 lift from push)
Layer 1: Deliverability Metrics
- Delivery rate: % of sent notifications successfully delivered (target: >95% for iOS, >90% for Android). Sub-90% indicates token hygiene issues — invalid tokens from uninstalled apps.
- Token expiration rate: % of push tokens that have gone invalid per month. Above 5% per month indicates poor token refresh hygiene.
How to maintain token hygiene: Remove or refresh push tokens after 3 consecutive delivery failures. Many teams skip this and accumulate large token databases that inflate send counts while degrading delivery rate.
Layer 2: Opt-In Health
Opt-In Rate
- iOS opt-in prompt acceptance rate: Industry average is 45–55%. Below 40% indicates the prompt is being shown at a low-trust moment (too early in onboarding, or before users have experienced core value).
- Android permission rate: Android 13+ requires explicit permission. Track separately from iOS — the Android prompt has different UX and timing best practices.
Opt-Out Rate
This is the most important long-term push health metric.
- Monthly opt-out rate by message type: Promotional notifications typically see 0.1–0.3% opt-out per send. Transactional notifications see <0.05%. If promotional opt-out rate exceeds 0.5% per send, frequency or content relevance is failing.
- Cumulative opt-out rate by cohort at 90 days: Target <15% of users who opt-in at install have opted out by day 90. Above 25% indicates systemic overuse or irrelevance.
According to Lenny Rachitsky's writing on mobile growth, opt-out rate is the push metric most correlated with long-term retention health — teams that let opt-out rate creep above 20% at 90 days typically see D30 retention decline 5–8 percentage points within 2 quarters as their most engaged users progressively disable push.
Layer 3: Engagement Quality
Open Rate (Message-Type Benchmarks)
| Message Type | Benchmark Open Rate | Notes | |---|---|---| | Transactional (order update, payment) | 15–25% | High relevance, low send volume | | Re-engagement (dormant users) | 8–12% | Low relevance by definition | | Promotional (sale, limited offer) | 3–8% | Frequency-sensitive | | Content updates (new content, features) | 5–10% | Dependent on personalization |
Session Depth After Push Open
Open rate alone cannot tell you whether a push notification created value. Session depth measures what users did after opening.
- Core action rate after push open: % of push-opened sessions that included the core action. Target: >40%. Below 20% means the notification is bringing users to the wrong screen or with the wrong expectation.
- Session length after push open vs. organic session: If push-opened sessions are 30%+ shorter than organic sessions, push is generating low-quality engagement.
According to Shreyas Doshi on Lenny's Podcast, session depth after push open is the metric that best distinguishes a productive push strategy from a deceptive one — apps that use misleading notifications to inflate open rates generate short, low-value sessions that train users to associate the app with wasted attention, accelerating opt-out.
Layer 4: Retention Impact
The ultimate test of a push strategy is whether users who receive push notifications retain better than those who do not.
Holdout experiment design:
- Maintain a 5–10% holdout group that receives no push notifications
- Compare D30 and D90 retention between push-enabled and holdout groups
- A healthy push strategy should show 5–15% retention lift for push-enabled users
Revenue attribution:
- For commerce apps: direct push-attributed revenue (sessions starting from push open that result in purchase within the same session)
- For subscription apps: push-assisted conversion rate (trials and renewals within 24 hours of push open)
FAQ
Q: What metrics should you track for a mobile push notification strategy? A: Track four layers: deliverability (delivery rate above 95%), opt-in health (opt-out rate below 0.3% per promotional send), engagement quality (open rate by message type, session depth after open), and retention impact (D30 lift for push-enabled users vs. holdout).
Q: What is a healthy push notification opt-out rate for a mobile app? A: Less than 0.3% opt-out per promotional notification send. Cumulative opt-out rate at 90 days after install should be below 15% of users who originally opted in. Above 25% cumulative indicates systemic overuse.
Q: Why is session depth after push open more important than open rate? A: Open rate measures whether users clicked — session depth measures whether the notification created value. Low session depth after open indicates misleading notifications or poor deep-link targeting, which trains users to opt out faster.
Q: How do you measure the retention impact of a push notification strategy? A: Maintain a 5-10% holdout group that receives no push and compare D30 and D90 retention against the push-enabled group. A healthy push strategy shows 5-15% retention lift for push-enabled users.
Q: What is a good iOS push notification opt-in rate? A: 45-55% is the industry average for iOS. Below 40% usually indicates the permission prompt is being shown before users have experienced enough core value to understand why push would be useful.
HowTo: Track Metrics for a Mobile App Push Notification Strategy
- Monitor delivery rate monthly and remove push tokens with 3 consecutive delivery failures to maintain above 95 percent delivery rate and prevent database bloat
- Track opt-out rate separately by message type with promotional opt-out targeted below 0.3 percent per send and cumulative 90-day opt-out below 15 percent of original opt-ins
- Benchmark open rate by message type against the appropriate benchmark and flag any message type consistently underperforming by 30 percent or more
- Measure session depth after push open by tracking core action completion rate and session length, targeting above 40 percent core action rate for push-opened sessions
- Run a 5 to 10 percent holdout experiment to measure D30 and D90 retention lift from push, targeting 5 to 15 percent retention improvement for push-enabled users