Analytics and experiments

Product analytics and metrics interview questions

Product analytics questions sound simple and aren’t. Checkout conversion fell from 3.1% to 2.6% last Tuesday: what do you check first? Interviewers want a structured investigation that starts with whether the number itself is right, before looking for a story.

Other questions ask you to choose a north-star metric and the guardrails that stop it being gamed, spot the trap in a ratio whose denominator changed, separate a real change from a shift in the mix of users, and say how you’d measure whether a marketing campaign caused anything at all.

Try one now

Standard

Checkout conversion on a grocery delivery app fell from 3.1% to 2.6% last Tuesday and hasn't recovered. What are your leading hypotheses, and which would you check first?

Free, no sign-up. The interviewer asks follow-ups on your reasoning, then rates your answer.

What the 15 questions cover

  • Metric definitions and their traps (ratios, denominators)5
  • Incrementality and holdout tests4
  • Guardrail and counter metrics3
  • Segmentation and mix shift3
  • Investigating a metric change3
  • Choosing a north-star metric2
  • Funnel analysis2
  • Customer lifetime value2
  • Campaign targeting and response modelling2
  • Acquisition cost and payback1
  • Attribution (last-touch, multi-touch)1
  • Churn prediction and retention1
  • Pricing and promotions1

A question can cover more than one topic, so the counts add up to more than 15.

How the practice works

  1. The AI interviewer asks the question and follows up on your answer, the way an interviewer would.
  2. Stuck? Ask for a hint. Each one gives a little more away, so you can get unstuck without being handed the answer.
  3. Get a written debrief. Four ratings, each from Needs work to Interview-ready, tied to what you actually said, and what to study next.

More analytics and experiments questions

See all categories