Data Scientist / Senior Data Scientist - App Performance

WHY DATA SCIENCE & ANALYTICS?

The Data Science & Analytics organization's mission is to increase our speed, frequency and competence of making decisions at scale by instilling a data-influenced approach to building products. We cover a wide area of the data spectrum including analytical data engineering, product analytics, experimentation, causal inference, statistical modeling and machine learning. Aligned and partnering with product groups, we use this vast tool belt to discover new opportunities and unmet use cases, influence and craft the product roadmap and prioritization, build data products and measure the impact on our community of players and developers.

WHY App Health?

Roblox is used by over 70 million people every day, across almost all devices (mobile, desktop, console, VR, etc.). Our users expect outstanding app performance: lightning-quick launches, buttery smooth animations, and rock-solid stability. As a Data Scientist on the team, you will partner with engineers, product managers, and leaders across the company in our efforts to build the best app experience on any device for Roblox. This area is pivotal to our company’s success, directly impacting all users and being one of Roblox's highest priorities. You will define critical metrics and measure the impact of key performance improvements while using statistics, analytics, and experiments to influence decisions and strategies related to enhancing the performance and reliability of the Roblox app.

You Are:

• Passionate about data. You have the curiosity and self-drive to continuously learn new techniques and tools to extract value from data.
• Highly determined. You thrive with freedom and autonomy and are excited by the ambiguity that comes from exploring a new problem space.
• A strong communicator. You understand that analysis must be presented in meaningful ways and engage in upbeat discussions about the findings. You can explain technical concepts to a non-technical audience.
• A capable statistician. You understand the value of characterizing data by its distribution. Covariance, Bias, and Conditional Probability are concepts that you rely on every day.
• An expert transforming data with SQL and a scripting language such as Python or R. You’re experienced in automating efforts and crunching massive volumes of data.
• Experienced in developing models to draw insights from data. You use regression, data mining, and other statistical techniques to build new, scalable solutions to tackle complicated business problems. You understand when to apply the appropriate methodology to improve impact pragmatically.

You Will:

• Define and measure success metrics for App performance. Determine which performance metrics matter to end users and how app performance impacts user engagement and monetization.
• Establish an understanding of the trade-offs between different performance levers and use these insights to influence strategies, ensuring right-sized investments that optimize business growth and user experience.
• Access raw data, transform it, analyze it, and present it in a compelling and understandable way. Perform deep dives to uncover new insights and opportunities.
• Operationalize and scale metrics monitoring by building tools that enable quick slicing and dicing of data as well as root cause analysis. Collaborate with engineers to detect and investigate abnormal trends, finding opportunities for improvement.
• Use A/B experiments and causal inference methods to evaluate the success of feature launches.
• Navigate ambiguity and work with partners across various organizations, including User, Growth, Engine, and Creator teams.

You Have:

• An advanced degree or equivalent experience in Statistics, Applied Math, Physics, Engineering, Computer Science, Economics, or a related quantitative field.
• 5+ years of proven experience in a data science role, preferably with a background in app performance.
• Strong experience working with large datasets and proficiency in SQL, R/Python, and data visualization tools.
• Deep knowledge and practical application of statistical methods, causal inference techniques, and experimental design.
• Ability to drive an area as an individual contributor and leader with vision.
• Ability to apply creative, first-principles reasoning to solve ambiguous problems.
• Strong interpersonal skills to present analytics results and data storytelling effectively, influencing engineering teams and leaders.