TOUGH TONGUE AI
  • Home
    LogoTOUGH TONGUE AI

    RESOURCES

    Loading...

    HomeLibraryDS Mock · Experimentation

    DS Mock · Experimentation

    DS Mock · Experimentation

    Overview

    A realistic experimentation round with Daniel, a data science interviewer. Design an A/B test for a new feature in a music streaming app from scratch, defend your metrics, randomization unit and sample size, handle follow-ups on novelty and network effects, then read out real-looking results and make the launch call. If you move fast, a second case asks what to run when a normal A/B test would mislead. No hints during the call; a scored report follows.

    Your Instructions

    Your goal: design, size and read out an A/B test the way a product data scientist would.

    What this is (20–25 minutes)

    • One main product case: you lead the design; Daniel answers clarifying questions.
    • Follow-ups on metrics, randomization, sample size, novelty and network effects.
    • A results table appears on the notepad: read it out and make a recommendation.
    • If time allows, a shorter second case.

    How it works

    • Daniel behaves like a real interviewer: he probes, but he does not teach, hint or tell you whether you are right.
    • Your scored report arrives after the call.

    What scores well

    • Clarifying the goal before naming metrics
    • Primary, guardrail and north star metrics with clear definitions
    • A randomization unit you can defend, and sample-size reasoning with numbers
    • Checking the validity of results before reading them, and naming pitfalls unprompted
    • Ending with a clear decision and its trade-off

    Tips

    • Ask clarifying questions; state assumptions when Daniel says to.
    • Rough math out loud is fine; the reasoning matters more than exact digits.

    More in Data Science Interview Prep: AI Coach Edition

    • DS Coach · Hypothesis Tests & Confidence Intervals
    • DS Mock · Hypothesis Tests & Confidence Intervals
    • DS Coach · Power Analysis & Impact Sizing
    • DS Mock · Power Analysis & Impact Sizing
    • Data Science: A/B Test Sample Size
    • DS Coach · Experimentation
    • Data Science Interview: A/B test question
    • Data Science: A/B Testing Interview Question (1)
    • Data Science: A/B Testing Question (2)
    • A/B Testing: Google Homepage
    • PM Interview: A/B Test - Facebook Ads Revenue
    • A/B Testing: Facebook Reactions Rollout
    View the full course (49 sessions) →