How Would You Measure Success for YouTube Shorts? - Google PM Interview Question

Google PM Interview: Step-by step walkthrough for measuring success for YouTube Shorts.

Check answers for more Product Metrics Questions: https://www.crackpminterview.com/t/product-metrics-questions

“How would you measure success for YouTube Shorts?”

This question a perfect test case that reveals your product sense, business acumen, and ability to think systematically about success.

In this post, I’ll walk you through a complete, interview-ready answer to this question. You’ll see exactly how to apply the 5-step approach to deliver a structured response that demonstrates strategic thinking and deep product understanding:

1. Clarify the Context: What questions to ask before diving into metrics

2. Define the North Star Metric: How to choose and articulate the most important metric

3. Build the Metrics Hierarchy: Primary, secondary, and guardrail metrics with clear reasoning

4. Map to User Journey: Applying the AARRR framework to cover the complete funnel

5. Acknowledge Trade-offs: Demonstrating mature thinking about complexity

By the end, you’ll have a complete template for answering this question and understand how to adapt this approach to any product metrics question.

For a deep-dive on “How to answer Product Metrics questions in PM Interview?” - read here

Now, let’s dive in and answer this question.

Step 1: Clarify the Context

Before jumping into metrics, always start by clarifying the context. This demonstrates thoughtfulness and gives you critical information to shape your answer.

Questions to Ask the Interviewer

Here are the essential questions you should ask:

Question 1: What’s the product stage we’re evaluating?

“Should I think about Shorts as it exists today - a relatively mature feature competing with TikTok and Instagram Reels - or should I imagine we’re at launch and defining initial success metrics?”

Why this matters: New products need to prove value and find product-market fit (focus on activation and initial engagement), while mature products need to optimize and scale (focus on retention and monetization). The metrics framework stays similar, but priorities and targets shift dramatically.

Question 2: How does Shorts monetize?

“I know YouTube’s primary business model is advertising. Should I assume Shorts monetizes the same way through ads, or is there a different monetization strategy like creator subscriptions or tipping?”

Why this matters: Different business models require completely different metrics. Ad-supported products focus on time spent and impressions; subscription products focus on retention and churn; transaction-based products focus on volume and frequency. The monetization model fundamentally shapes what success looks like.

Question 3: Which stakeholders should I prioritize?

“YouTube has two key user groups: viewers and creators. Should I consider success from both perspectives equally, or should I focus primarily on viewers with creators as secondary?”

Why this matters: Two-sided marketplaces require metrics for both sides. If creators aren’t successful, content supply dries up and the product fails regardless of viewer metrics. Understanding which stakeholder to prioritize helps structure the metrics hierarchy appropriately.

Question 4: How should Shorts relate to long-form content?

“How should I think about Shorts in relation to YouTube’s core long-form content? Is the goal for Shorts to be complementary and drive incremental engagement, or is some cannibalization of long-form content acceptable?”

Why this matters: Features within larger platforms must be evaluated on their impact to the overall ecosystem, not just in isolation. Cannibalization concerns significantly affect which metrics matter most. If Shorts must be purely incremental, guardrails around long-form content health become critical.

Question 5: Any other constraints or context I should know?

“Are there any technical constraints, competitive pressures, or strategic priorities I should be aware of when defining success metrics?”

Why this matters: Real-world context shapes what’s feasible and what matters most. Understanding if there are regulatory concerns, technical limitations, or specific competitive benchmarks helps you propose realistic and relevant metrics.

Example Clarifying Conversation

You: “Great question! Before I dive into metrics, let me make sure I understand the context correctly. First, should I think about Shorts as it exists today - a relatively mature feature competing with TikTok and Instagram Reels - or should I imagine we’re at launch?”

Interviewer: “Good question. Let’s assume Shorts has been live for about a year, so we’re past initial launch but still optimizing.”

You: “Got it. Second, I know YouTube’s primary business model is advertising. Should I assume Shorts monetizes the same way through ads?”

Interviewer: “Yes, it’s ad-supported like the rest of YouTube.”

You: “Perfect. Third, YouTube has two key user groups: viewers and creators. Should I consider success from both perspectives?”

Interviewer: “Definitely consider both. Both matter for ecosystem health.”

You: “Great. And finally, how should I think about Shorts in relation to YouTube’s core long-form content? Is the goal for Shorts to drive incremental engagement, or is some cannibalization acceptable?”

Interviewer: “We want Shorts to drive incremental engagement rather than replace long-form viewing, but we’re realistic that some redistribution might happen.”

What You Learned and Why It Matters

From this conversation, you’ve established:

• Product maturity: One year in, so we need metrics that show sustainable engagement, not just novelty

• Business model: Ad-supported, so time spent and ad impressions matter

• Dual stakeholders: Both creators and viewers need to be successful

• Platform relationship: Incremental growth preferred; cannibalization is a key risk to monitor

This context will directly inform your metric choices. You now know to include guardrails around long-form content health, metrics for both creators and viewers, and focus on sustainable engagement patterns rather than just acquisition.

---

Step 2: Define the North Star Metric

After clarifying context, the next step is identifying the single most important metric that captures the product’s core value. This is your North Star Metric.

Proposed North Star: Weekly Active Shorts Viewers

I propose Weekly Active Shorts Viewers as the North Star Metric - specifically, the number of unique users who watch at least one Short per week.

Why This Metric?

1) It reflects real user value (breadth of engagement)

Unlike total views, which could be driven by a small number of power users binge-watching hundreds of Shorts, Weekly Active Shorts Viewers ensures we’re creating value for a broad user base. Each person counted represents someone finding genuine value in Shorts.

If we have 10 million Shorts views, that could be:

• 100,000 users watching 100 Shorts each (narrow, potentially unhealthy)

• 5 million users watching 2 Shorts each (broad, healthier distribution)

The North Star makes this distinction clear.

2) It indicates habit formation (weekly vs daily)

Weekly usage suggests Shorts has become part of users’ routines, not just a one-time curiosity. This is critical for sustainable engagement and long-term product success.

We’re choosing “weekly” rather than “daily” because:

• Not too strict: Daily might exclude users who value Shorts but don’t use YouTube every day

• Not too loose: Monthly would be too forgiving and wouldn’t indicate strong habits

• Realistic for content consumption: People might watch Shorts a few times per week, which is healthy

3) It predicts business success (ad revenue potential)

More weekly active users directly translates to more ad inventory and revenue potential. If users return weekly, YouTube has recurring opportunities to monetize without relying on unsustainable binge behavior.

The math: 10 million weekly active users × 15 Shorts per week × ad impressions = predictable, scalable revenue

4) It’s balanced and actionable

The metric strikes the right balance:

• High enough to indicate meaningful engagement

• Achievable enough that product teams can influence it

• Simple enough that anyone in the company can understand it

• Measurable through standard analytics

5) It complements YouTube’s broader goals

Growing weekly actives on Shorts likely expands YouTube’s overall user base and engagement. Some users might discover YouTube through Shorts, while existing users get another reason to return to the platform.

Alternatives Considered and Rejected

1) Time spent on Shorts - Why not?

While time spent seems appealing (more time = more ads = more revenue), it has serious downsides:

• Incentivizes addictive content: Optimizing purely for time spent might lead to promoting clickbait or endless-scroll content that keeps users watching but doesn’t create real value

• Could harm user well-being: Extended passive scrolling might lead to user regret and negative sentiment

• Might cannibalize long-form: If users spend hours on Shorts, they’re not watching longer videos, which typically have higher RPM (revenue per thousand impressions)

Time spent is a valuable secondary metric, but it’s dangerous as a North Star without guardrails.

2) Total Shorts views - Why not?

This is a classic vanity metric:

• Doesn’t indicate breadth: 100 million views from 1 million users is very different from 100 million views from 50 million users

• Doesn’t predict retention: Users might watch one Short once and never return

• Easily gamed: Auto-play and algorithmic manipulation can inflate views without delivering value

Total views belongs in the secondary metrics, not as the North Star.

3) Daily Active Shorts Users - Why not?

Daily might seem better than weekly for showing strong engagement, but:

• Too strict for content consumption: Unlike messaging apps (Slack, WhatsApp) where daily usage makes sense, content consumption is naturally more sporadic

• Could create pressure: Requiring daily usage might make the experience feel like an obligation rather than entertainment

• Excludes valuable users: Someone who watches Shorts 3x per week is a highly engaged user but wouldn’t count in DAU

Weekly strikes the better balance for this type of product.

---

---

Step 3: Build the Metrics Hierarchy

Your North Star tells you where you’re going, but you need supporting metrics to understand how you’re getting there, what’s driving success, and what might go wrong.

Think of this as a pyramid with the North Star at the top, supported by layers of increasingly granular metrics.

Primary Metrics

These are the 1-2 key metrics that directly drive the North Star. If these go up, Weekly Active Shorts Viewers will likely increase.