Get started now!
Course Curriculum
Product Sense via Machine Learning
Product and Metrics - Case Studies
How to improve a given metric
LockedMarketplace - Focusing on supply or demand?
LockedActionable insights vs spurious relationships
LockedBehavioral vs demographic variables
LockedHow to create key growth metrics
LockedHow to come up with new feature ideas?
LockedHow to estimate user LifeTime Value?
LockedUser Similarity
LockedDesign metrics for customer service
LockedProduct Development - Should we test this new feature?
LockedMetrics - Understanding what drives them
LockedMetrics - How to find bugs
LockedHow to predict user behavior?
LockedMetrics - How to create an effective metric
LockedMetrics - Self-selection bias
LockedMetrics - Trade-off between short term vs long term effects
LockedHow to improve revenue from ads
LockedMetrics - How to create an effective metric for gaming apps
LockedPersonalization
Fraud and Machine Learning - Case Studies
A/B Testing - Practice
A/B testing - Case Studies
Test by Market
LockedOpportunity costs
LockedTesting long term metrics
LockedNovelty Effect
LockedTest by market - Drawbacks
LockedMultiple A/B tests at the same time
LockedNetwork Effect
LockedSample Size
LockedTest first version of a data product
LockedStatistically sound A/B test
LockedWhen to rerun the same test again
LockedWhen not to run an A/B test
LockedNew Product Case Studies - Miscellaneous
INSIGHTS: Should users be asked for their CC info when starting a free trial?
PreviewINSIGHTS: How much would you charge for a new product?
LockedINSIGHTS: What was the data-driven hypothesis behind testing FB stories?
LockedINSIGHTS: Trade-off between revenue and user experience metrics
LockedINSIGHTS: What did you do when you got unexpected results?
LockedINSIGHTS: How would you place ads on a page?
LockedINSIGHTS: Would you test a feature allowing users to easily switch account?
PreviewINSIGHTS: Would you merge two similar products or run them separately?
LockedINSIGHTS: Categorical variables in regressions. Better one-hot-encoding or multiple regressions?
LockedINSIGHTS: How would you make Airbnb booking process smoother?
LockedINSIGHTS: Can a bug actually improve your metric? What to do if that happens?
LockedINSIGHTS: How to improve a marketplace?
LockedA/B TESTING: Can you do a t-test on a dummy variable like conversion (0/1/)?
LockedA/B TESTING: How would you test the success of a new ad campaign?
LockedA/B TESTING: Define test statistical significance in layman’s terms. Why 0.05?
LockedA/B TESTING: What would you do if test p-value is slightly above signficance level?
LockedA/B TESTING: What to do if after a test some metrics are up and some down?
LockedA/B TESTING: How to test different prices?
LockedA/B TESTING: When would you design an A/B test as a sequence of multiple tests?
LockedA/B TESTING: How can you halve the width of a t-test confidence interval?
LockedA/B TESTING: How to check if a metric is actually up after a successful test?
LockedA/B TESTING: How to avoid the A/B test issue of over-optimizing for the current user base?
LockedA/B TESTING: When would you increase a test significance level?
LockedMETRICS: Conversion rate down, but absolute number of conversions up. Is it good or bad?
LockedMETRICS: How choosing an average-based metric vs a percentile one would impact product development?
LockedMETRICS: When to run a test on multiple metrics?
LockedMETRICS: When is accuracy a bad metric for a model?
LockedMETRICS: What kind of analysis is required after a logging-related bug?
LockedMETRICS: What kind of analysis is required after a product-related bug?
LockedMETRICS: In most metrics, you expect the average to be larger or smaller than the median?
LockedLive Assistant App
Projects with Solutions
Collection of tech company blog posts/case studies
A/B testing overview from Netflix, Scribd, MS
LockedTheory behind A/B test from Google, StitchFix, Stackoverflow
LockedA/B testing with connected users from Google, Instacart
LockedCommon Issues in A/B testing from Wallmart Labs, Google
LockedProduct Development from Airbnb, FB, Linkedin, Google, Netflix
LockedData Challenges with Solutions
Introduction
LockedINSIGHTS: Workplace Diversity Analysis
LockedSolution: Workplace Diversity Analysis
LockedINSIGHTS: Funnel Analysis
LockedSolution: Funnel Analysis
LockedINSIGHTS: Subscription Retention Rate
LockedSolution: Subscription Retention Rate
LockedINSIGHTS: Sessionize user activity
LockedSolution: Sessionize user activity
LockedINSIGHTS: Video Sharing Analysis
LockedSolution: Video Sharing Analysis
LockedMETRICS: Ads Analysis
LockedSolution: Ads Analysis
PreviewMETRICS: Hotel Search Data
LockedSolution: Hotel Search Data
LockedA/B Testing: User Referral Program
LockedSolution: User Referral Program
LockedA/B TESTING: Pricing Test
LockedSolution: Pricing Test
LockedML: Applying for a loan
LockedSolution: Applying for a loan
LockedML: Optimization of Employee Shuttle Stops
LockedSolution: Optimization of Employee Shuttle Stops
LockedML: Clustering Grocery Items
LockedSolution: Clustering Grocery Items
LockedML: Credit Card Transactions
LockedSolution: Credit Card Transactions
LockedML: Song Recommendation
LockedSolution: Song Recommendation
LockedMetrics - SQL Exercises
New Coding Course
LockedMetrics: Time delta between consecutive events
LockedSOLUTION: Time delta between consecutive events
LockedMetrics: Segment by mobile, web, and cross-device users
LockedSOLUTION: Segment by mobile, web, and cross-device users
LockedMetrics: Identify power users based on their history
LockedSOLUTION: Identify power users based on their history
LockedMetrics: Estimate total and running values
LockedSOLUTION: Estimate total and running values
LockedMetrics: Summary stats - Custom implementation of the median vs average
LockedSOLUTION: Summary stats - Custom implementation of the median vs average
LockedMetrics : Rank users within groups
LockedSOLUTION: Rank users within groups
Locked