How Netflix builds a culture of excellence | Elizabeth Stone (CTO)

How Netflix builds a culture of excellence | Elizabeth Stone (CTO)

High Talent Density at Netflix

The discussion delves into the importance of high talent density at Netflix and its impact on the company's culture and success.

Importance of High Talent Density

  • Reed Hastings, the founder of Netflix, emphasized the significance of high talent density as a foundational element for building a thriving company.
  • Creating a workplace where people thrive and feel fulfilled is crucial, focusing not only on talent density but also on excellence and outcomes.
  • Upholding standards that may not align with typical human behavior is necessary to maintain high talent density within the organization.

Insights from Elizabeth Stone

Elizabeth Stone, Chief Technology Officer at Netflix, shares her journey and insights into how an economics background has influenced her career trajectory.

Career Insights

  • Elizabeth discusses how her economics background has contributed to her career growth across various companies.
  • Exploring Netflix's unique culture centered around high talent density, radical candor, and freedom and responsibility.
  • Elizabeth reflects on lessons learned from biking and triathlons that she applies to her work life.

Transition to CTO Role

The conversation shifts towards Elizabeth Stone's transition from VP of Data to CTO at Netflix, highlighting the differences in roles and responsibilities.

Transition to CTO Role

  • As CTO, Elizabeth experiences increased context switching and a steeper learning curve due to the broader scope within the engineering organization.
  • The role change brings about higher stakes meetings but also a sense of excitement due to the increased impact of decisions made as CTO.

Detailed Discussion on the Role of Economics in Tech Companies

In this section, the speaker delves into the significance of economics within tech companies, highlighting its value as a complementary skill set to data science and its role in problem-solving and simplifying challenges.

Economics as a Valuable Skill Set

  • : Economics is viewed as a flavor of data science, offering technical skills and problem-solving frameworks that complement other data science disciplines.
  • : The speaker emphasizes that economics can provide valuable perspectives for various challenges, making problems more approachable and offering insights beneficial in business contexts.

Benefits of an Economic Perspective

  • : While not explicitly recognized as an economist at Netflix, the speaker's economic training influences their thought processes, demonstrating the usefulness of an economic perspective across different roles within tech companies.
  • : The increasing recognition of economists' value in tech teams signifies a shift towards appreciating diverse skill sets like economics for problem-solving and decision-making.

Utilizing Economic Thinking in Career Advancement

This segment explores how economic thinking aids career progression by understanding incentives, unintended consequences, and rational decision-making processes crucial for internal leadership and strategic planning.

Leveraging Economic Frameworks

  • : Understanding incentives and unintended consequences plays a pivotal role in internal leadership dynamics such as setting priorities, motivating teams, defining problems to solve, as well as external considerations like market positioning and competition analysis.

Introduction and Background

The speaker discusses her background in quantitative work, the importance of communication in economic cases, and how she leverages her introverted nature to observe and learn from others.

Leveraging Observational Skills

  • Emphasizes learning through observing others' actions and reflecting on their authenticity.
  • Highlights dedication, teamwork, translating complex tech concepts for non-tech individuals, and the value of observation in learning.
  • Dedication is about caring for excellence rather than working long hours; setting high standards for oneself.

Dedication and Excellence

The speaker elaborates on dedication not solely based on long working hours but on maintaining high standards and being responsive to commitments.

Demonstrating Dedication

  • Shares examples of dedication: being responsive, following through on commitments promptly, and showing urgency in responding to others.
  • Motivation stems from a sense of responsibility towards those relying on her; emphasizes showing up well for the team.

Translating Technical Challenges

Discusses the challenge of introducing live content at Netflix, requiring collaboration between content strategy and technology teams.

Navigating Technical Challenges

  • Explains the need to build confidence with content teams by translating technical approaches effectively.
  • Stresses the importance of understanding content strategies to ensure technical success and aligning business goals with technical requirements.

Learning from Failures

Reflecting on failures as opportunities for growth while maintaining high standards in work performance.

Embracing Failure as Learning

  • Mentions a quote emphasizing doing a world-class job consistently; shares personal experiences related to maintaining high standards.

Setting High Standards and Providing Feedback

The speaker discusses the importance of setting high standards, providing feedback, and helping team members improve to meet those standards effectively.

Setting High Standards

  • The speaker emphasizes the significance of having a high bar for performance and creating an aura of reliability and follow-through.
  • Leading by example is crucial in setting expectations for the team; holding everyone to the same standards fosters a culture of excellence.

Providing Feedback

  • Clear communication of expectations is vital as assumptions about clarity can lead to misunderstandings; giving direct feedback on performance gaps is essential.
  • Feedback should be specific, outlining what improvements are needed to meet expected standards; actively engaging in helping individuals bridge these gaps is key.

Helping Team Improvement

  • Collaborative efforts to enhance work quality are highlighted; working together on tasks and guiding team members through improvement processes can elevate overall performance.
  • Creating a safe space for feedback and improvement is crucial; offering support behind the scenes post-events allows for constructive criticism without added pressure.

Balancing High Expectations with Avoiding Burnout

The discussion shifts towards maintaining high standards while preventing burnout among team members.

Time Management vs. Quality

  • Emphasizes that meeting objectives efficiently may not always require excessive time investment; discerning when additional polish adds value is crucial.

Preventing Burnout

  • Encourages focusing on meaningful discussions rather than perfectionism in every detail; quarterly reviews aim at candid conversations rather than exhaustive polishing.

Setting Expectations for Conversations

In this segment, the speaker emphasizes the importance of setting expectations for conversations rather than focusing solely on perfecting documents. Feedback should be geared towards facilitating meaningful discussions.

Importance of Conversation Focus

  • Setting up the conversation is more crucial than perfecting a document.
  • Emphasizes spending time on framing the conversation and desired outcomes.
  • Encourages thoughtful preparation over excessive polishing of documents.
  • Feedback should steer towards shaping conversations effectively.

Netflix Culture: Key Elements

The discussion delves into Netflix's unique culture, highlighting three key elements that define its work environment: high talent density, candid communication, and freedom with responsibility.

Elements of Netflix Culture

  • High Talent Density: Focuses on hiring top performers and maintaining performance standards.
  • Candid Communication: Emphasizes direct feedback and open dialogue for improvement.
  • Freedom with Responsibility: Removes unnecessary processes to empower employees.
  • Reflects Reed Hastings' vision for a thriving workplace with exceptional outcomes.

Maintaining High Talent Density at Netflix

The speaker elaborates on how maintaining high talent density at Netflix is foundational to its culture. Hiring top talent, providing candid feedback, and making tough decisions are essential aspects to uphold this standard.

Upholding Talent Density

  • Hiring top talent is fundamental to sustaining Netflix's culture.
  • Direct feedback and continuous improvement are necessary to maintain high standards.
  • Making timely decisions about role fit or company alignment ensures excellence.

The Keeper Test and Performance Reviews at Netflix

The discussion revolves around the concept of the Keeper Test at Netflix, emphasizing the importance of regular feedback over traditional performance reviews.

Introducing Reflections for Tough Conversations

  • Encouraging behavior through reflections to facilitate tough conversations.
  • Operationalizing behavioral norms within the company culture.

Implementing the Keeper Test in Managerial Roles

  • Emphasizing the mental model aspect for managers at Netflix.
  • Integrating the Keeper Test into regular manager-direct report interactions.

Operationalizing Feedback and Compensation at Netflix

This segment delves into how Netflix operationalizes feedback and compensation without traditional performance reviews.

Feedback Mechanisms and Cultural Practices

  • Absence of formal performance reviews; focus on 360-degree feedback annually.
  • Linking performance to promotions and compensation within day-to-day operations.

Real-Time Feedback Culture

  • Emphasizing ongoing real-time feedback over delayed cycles.
  • Importance of timely direct feedback for continuous improvement.

Maintaining Excellence and Managing Expectations

Addressing concerns about high expectations, stress, and maintaining a healthy work culture at Netflix.

Balancing High Standards with Employee Well-being

  • Discussing potential stress from meeting high standards like passing the Keeper Test.
  • Personal experience highlighting ease from open conversations about performance.

Navigating High Expectations in a Competitive Environment

  • Acknowledging challenges of excellence amidst talented peers.

Concrete Steps for Hiring Excellence

The discussion revolves around maintaining a high bar for hiring excellence and attracting top talent while emphasizing the importance of identifying exceptional individuals.

Strategies for Hiring Excellence

  • Netflix pays top market salaries to attract and retain talent, focusing on being highly competitive without creating dependency solely on compensation.
  • Emphasizes hiring individuals who can identify problems and innovate solutions rather than just fulfilling specific job requirements, aiming to strengthen the team collectively.
  • Focuses on seeking candidates with additive skills and perspectives that elevate the team's overall performance, fostering a culture of continuous improvement.

Maintaining Excellence in Talent Acquisition

The conversation delves into the significance of maintaining a culture of excellence in talent acquisition to ensure high performance across the organization.

Cultivating Talent Density

  • Stressing the importance of working with top performers to maintain a high standard within the company, highlighting how one underperformer can impact the entire team negatively.
  • Advocates for freedom and responsibility in work environments, allowing employees space to explore innovative solutions without rigid processes, fostering impactful contributions.

Strategies for Building Exceptional Teams

Explores practices unique to Netflix that contribute to building exceptional teams by prioritizing talent density and fostering an environment conducive to innovation.

Building Exceptional Teams

  • Netflix's approach emphasizes freedom and responsibility in problem-solving, enabling employees to drive significant innovations in engineering systems and experimentation.

New Section

In this section, the speaker discusses the importance of talent density in fostering a culture of experimentation and innovation within the organization.

Talent Density and Innovation

  • The organization's ability to question things, experiment with solutions, and prioritize effectively relies heavily on high talent density.
  • Having exceptional individuals allows for less strict guardrails in decision-making processes, enabling more responsibility and freedom for employees.
  • Encouraging strong judgment among team members is crucial for driving innovation and success within the company.

New Section

This part delves into how freedom and lack of strict processes can lead to unexpected innovations within the organization.

Innovations Through Freedom

  • Examples of products, features, or policies that emerged from a culture of freedom include unlimited vacation time and performance reviews tailored to individual needs.
  • Innovations in content delivery networks, encoding, discovery, and personalization were driven by individual contributors' ideas rather than top-down directives.

New Section

The discussion shifts towards maintaining a balance between operational efficiency at scale while preserving the core cultural values of the organization.

Balancing Efficiency and Culture

  • Success at Netflix often stems from creating space for team members to innovate freely without stifling creativity.
  • Striking a balance between operational efficiency at scale and preserving cultural beauty remains a current challenge for the organization.

New Section

The speaker elaborates on fostering transparency through candid communication practices within the organizational culture.

Cultivating Transparency

  • Transparent leadership involves sharing information openly with the team to provide context rather than control over operations.

Chaos Monkeys and Data Team Structure

In this section, the discussion revolves around the concept of Chaos Monkeys at Netflix and the structure of the data and insights team.

Chaos Monkeys at Netflix

  • The idea of Chaos Monkeys involves running a program on infrastructure to induce controlled failures, testing system stability.
  • Netflix uses intentional learning through experiments to test resilience in Engineering Systems rather than pure chaos.
  • The company conducts low-profile tests like Cloud games beta to ensure system performance without risking member experience.

Data Team Structure at Netflix

  • Netflix maintains a centralized data team with diverse functions across all areas of the business for effective data management.
  • This unique structure allows for functional expertise, better career paths, and objective decision-making based on data insights.

Anecdotal Evidence and Team Collaboration

In this segment, the speaker discusses the importance of anecdotal evidence within the same organization for credibility. Additionally, she emphasizes the critical role of consumer insights teams in maintaining a consumer orientation and highlights the benefits of team collaboration.

Importance of Anecdotal Evidence and Team Collaboration

  • Anecdotal evidence within the same organization enhances credibility by avoiding conflicting data sources.
  • Consumer insights teams play a crucial role in maintaining a consumer orientation and collaborating effectively on problem-solving.
  • Emphasizes combining expertise from different functional areas to elevate team performance without overdoing collaboration.

Staying Connected with Teams and Being Present

This part delves into how the speaker stays connected with individual teams despite her higher position in the organization. Furthermore, it explores strategies for being present and engaged during interactions.

Strategies for Staying Connected and Being Present

  • Speaker prioritizes staying close to individual teams through regular office hours and "ask me anything" sessions to maintain connections.
  • Allocating time for one-on-one conversations fosters approachability and open communication channels within the team.
  • Emphasizes being fully present during one-on-one interactions while acknowledging challenges in multitasking during larger meetings.

Building Relationships and Professional Connections

This section focuses on building relationships, professional connections, and investing in others as a valuable asset for personal growth and career development.

Nurturing Relationships for Growth

  • Investing in positive connections professionally can lead to reciprocal benefits over time.

Reflecting on Personal and Professional Practices

Elizabeth discusses the importance of focusing on activities that energize and resonate with oneself, emphasizing introspection for personal and professional growth.

Prioritizing Energizing Activities

  • Elizabeth highlights the significance of paying attention to activities that provide energy and align with one's strengths, suggesting a focus on enhancing these aspects as a superpower.

Introspection for Groundedness

  • Reflecting on feelings, excitement, and enjoyment aids in grounding oneself, potentially improving managerial and leadership skills through increased presence.

Daily Reflection Practice

  • While not structured with meditation or journaling, Elizabeth engages in daily check-ins during quiet mornings to assess emotions like anxiety and excitement, building a reflective muscle.

Morning Routine Insights

  • Drawing inspiration from Jeff Bezos' morning approach of "puttering around," Elizabeth values quiet mornings for reflection without immediate responsibilities, fostering a sense of calmness.

Book Recommendations and Media Preferences

Elizabeth shares book recommendations and favorite recent movies/TV shows while delving into her interview strategies and product preferences.

Book Recommendations

  • Murakami's "What I Talk About When I Talk About Running" is recommended for its introspective nature linking running to writing. Additionally, "A Fine Balance" by Mistry is praised for its portrayal of human complexity.

Media Favorites

  • "Triangle of Sadness" stands out as a phenomenal film recommendation. For TV shows, "Beef House" on Netflix is highlighted for its unique storyline and humor.

Interview Strategies

  • High Talent Density interviews focus on candidates who could excel in the interviewer's role. Questions often revolve around priorities and potential changes if the candidate were in the interviewer's position.

Product Preferences

  • Embracing an analog lifestyle despite holding a CTO title, Elizabeth appreciates her Fellow pour-over coffee maker as part of her morning ritual. She also expresses love for her Peloton bike as a long-standing favorite product.

Life Motto and Athletic Benefits

Elizabeth reflects on a meaningful life motto shared by her mother while discussing the mental resilience gained from being an athlete.

Meaningful Life Motto

  • Emphasizing finding joy in everyday moments, Elizabeth recalls her mother's advice to appreciate something good each day amidst life's busyness.

Athletic Resilience Benefits

Discussion on Reflecting on Netflix Culture

In this segment, the speakers encourage listeners to reflect on how they can enhance their presence in their lives following a discussion on Netflix culture and interactions with others.

Ways to Enhance Personal Presence

  • Encouragement for listeners to reach out with questions or comments.
  • Request for listeners to consider how they can improve their interactions with colleagues based on reflections from the Netflix culture discussion.

Closing Remarks and Call to Action

The conversation concludes with expressions of gratitude and a call to action for engagement from the audience.

Concluding Thoughts

  • Elizabeth expresses appreciation for participation and suggests leaving comments on YouTube or Substack.
  • Gratitude is extended by both speakers as they bid farewell and wish the audience a great weekend.
Video description

Elizabeth Stone is the chief technology officer of Netflix. She previously served as vice president of product data science and engineering, and as vice president of data and insights, at Netflix. Before Netflix, Elizabeth was vice president of science at Lyft, chief operating officer at Nuna, a trader at Merrill Lynch, and an economist at Analysis Group. In our conversation, we discuss: • Elizabeth’s advice for career advancement • Netflix’s unique high-performance culture • How, and why, Netflix maintains a high bar for excellence • Intentional leadership practices • How to foster an “open door” culture within your team • The Keeper Test and how it contributes to maintaining a high bar for excellence • The power of transparent communication • Much more — Brought to you by: • Vanta—Automate compliance. Simplify security: https://vanta.com/lenny • Sendbird—The (all-in-one) communications API platform for mobile apps: https://sendbird.com/lenny • Explo—Embed customer-facing analytics in your product: http://explo.co/lenny Find the full transcript at: https://www.lennyspodcast.com/how-netflix-builds-a-culture-of-excellence-elizabeth-stone-cto/ Where to find Elizabeth Stone: • LinkedIn: https://www.linkedin.com/in/elizabeth-stone-608a754/ Where to find Lenny: • Newsletter: https://www.lennysnewsletter.com • X: https://twitter.com/lennysan • LinkedIn: https://www.linkedin.com/in/lennyrachitsky/ In this episode, we cover: (00:00) Elizabeth’s background (04:36) Life as CTO vs. VP of Data (05:57) The role of economists in tech companies (08:32) Using economics to understand incentives (10:07) Success and career growth (20:15) Setting expectations (25:02) Advice for how to avoid burnout (27:44) Netflix culture: high talent density (30:31) Netflix culture: candor and directness (31:45) The Keeper Test (39:01) Maintaining a high bar for excellence (43:54) Netflix culture: freedom and responsibility (46:18) Unconventional processes at Netflix (47:55) Examples of candor (51:44) Data and insights team structure (01:00:12) Staying close to teams (01:02:31) Advice on being present (01:07:40) Lightning round Referenced: • What to Know About the Netflix Cup, Today’s First-Ever Live Sports Event: https://www.netflix.com/tudum/articles/netflix-cup-live-event-date-news • Ann Miura Ko interview | The Tim Ferriss Show (Podcast): https://www.youtube.com/watch?v=h2GO0Ks_VGg • Netflix culture: https://jobs.netflix.com/culture • No Rules Rules: Netflix and the Culture of Reinvention: https://www.amazon.com/No-Rules-Netflix-Culture-Reinvention/dp/1984877860 • Reed Hastings on LinkedIn: https://www.linkedin.com/in/reedhastings/ • Netflix’s “Keeper Test” and Why You Need It | Lorne Rubis: https://www.highlights.lornerubis.com/2015/08/the-netflix-keeper-test-and-the-courage-to-take-it/ • The Hunger Games: https://en.wikipedia.org/wiki/The_Hunger_Games • Nan Yu on LinkedIn: https://www.linkedin.com/in/thenanyu/ • Work Life Philosophy: https://jobs.netflix.com/work-life-philosophy • The Scoop: Netflix’s historic introduction of levels for software engineers: https://blog.pragmaticengineer.com/netflix-levels/ • Chaos Monkey: https://www.techtarget.com/whatis/definition/Chaos-Monkey • Ali Rauh on LinkedIn: https://www.linkedin.com/in/ali-rauh/ • Keith Henwood on LinkedIn: https://www.linkedin.com/in/keith-henwood/ • Jeff Bezos’ Morning Routine of Puttering Around—How It Works: https://medium.com/illumination/jeff-bezos-morning-routine-of-puttering-around-how-it-works-9d73f359ac8d • What I Talk About When I Talk About Running: A Memoir: https://www.amazon.com/What-Talk-About-When-Running/dp/0307389839 • A Fine Balance: https://www.amazon.com/Fine-Balance-Rohinton-Mistry/dp/140003065X • Triangle of Sadness on Hulu: https://www.hulu.com/movie/triangle-of-sadness-f60937bd-45f4-469a-938f-db95026953a1 • Beef on Netflix: https://www.netflix.com/title/81447461 • Fellow pour-over coffee set: https://fellowproducts.com/products/stagg-xf-pour-over-set • Peloton bikes: https://www.onepeloton.com/shop/bike Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email podcast@lennyrachitsky.com. Lenny may be an investor in the companies discussed.