"Hybrid approach with an unusual twist: core product teams have no KPIs (essentially banned), making decisions on taste and intuition toward a 100-year vision, while the growth team uses long-term holdout experiments that often reveal short-term metrics are misleading."
"At Shopify, a small handful of people — Tobi, Glen, and a few deputized group leads — hold the quality and taste bar for the entire core product, and nothing ships without their explicit approval."
"Roadmap priorities should be driven by a 100-year CEO vision, not quarterly planning"
Evidence from the Archive
Shopify
30-40% of experiments showing short-term lift have no GMV lift a year later
Shopify's three product groups: core (100-year vision, no KPIs), merchant services (medium-term), growth (experiments with long-term holdouts)
Leads a 600+ person growth org at Shopify (~10% of US e-commerce, $235B GMV in 2023), with unique access to year-long holdout experiment data that most companies never collect. Their core argument: Hybrid approach: core product teams have no KPIs (essentially banned), while the growth team uses experiments with year-long holdout groups that often reveal short-term metrics are misleading.
The evidence is specific: Shopify's three product groups: core (100-year vision, no KPIs), merchant services (medium-term), growth (experiments with long-term holdouts). Furthermore, 30-40% of experiments showing short-term lift have no GMV lift a year later. Reducing monetary friction for new merchants: conventional wisdom said lower-quality merchants, but actually unlocked entrepreneurs who needed more time to succeed.
In Archie Abrams's own words: "In quite a few cases, you get a lift on a metric up front, a more short-term metric. Number of people who become a paying shopper, number of people who make their first sale in Shopify. And then you look a year later, and there's actually no incremental lift on GMV from that cohort." (Describing what long-term holdouts reveal about the unreliability of short-term metrics.)
Shopify
Shopify maintains holdout groups for every experiment and automatically revisits results at 3, 6, 9, and 12 months
30-40% of experiments showing short-term metric lift showed no incremental GMV lift a year later
Leads a 600+ person growth org at Shopify (~10% of US e-commerce, $235B GMV in 2023), with unique access to year-long holdout experiment data that most companies never collect. Their core argument: Core product teams should NOT have KPIs -- use taste and a 100-year vision instead. Growth teams should experiment aggressively but with long-term holdouts, because 30-40% of short-term wins wash out over a year.
The evidence is specific: Shopify maintains holdout groups for every experiment and automatically revisits results at 3, 6, 9, and 12 months. Furthermore, 30-40% of experiments showing short-term metric lift showed no incremental GMV lift a year later. Core product teams operate with zero KPIs, making decisions based on Tobi Lutke's 100-year vision and craft judgment.
In Archie Abrams's own words: "The core product teams don't have metrics or KPIs. They're essentially banned. And instead, decisions are made based on taste, and intuition, and building towards this long-term vision." (Introducing Shopify's contrarian no-KPI approach for core product teams.)
Shopify
Shopify: 10% of US e-commerce, $235B GMV in 2023 (roughly Finland's GDP), achieved without core team KPIs
Long-term holdout experiments: automatic re-evaluation at 3, 6, 9, 12 months showing 30-40% of 'wins' have no lasting effect
Leads 600+ people across product, design, engineering, data ops, and growth marketing at Shopify -- a company representing 10% of US e-commerce -- making his case against KPIs backed by extraordinary scale and a uniquely rigorous long-term experimentation culture. Their core argument: Ban KPIs for core product teams - use loose OKRs only for coordination.
The evidence is specific: Shopify: 10% of US e-commerce, $235B GMV in 2023 (roughly Finland's GDP), achieved without core team KPIs. Furthermore, long-term holdout experiments: automatic re-evaluation at 3, 6, 9, 12 months showing 30-40% of 'wins' have no lasting effect. Monetary friction experiments: reducing early costs for new merchants causally improved long-term success by giving them more time to find product-market fit.
In Archie Abrams's own words: "The core product teams don't have metrics or KPIs. They're essentially banned. And instead, decisions are made based on taste, and intuition, and building towards this long-term vision." (Describing Shopify's radical no-KPI approach.)
Shopify
Shopify represents 10% of US e-commerce with $235B GMV in 2023 -- roughly the economy of Finland -- built on a model...
Shopify represents 10% of US e-commerce with $235B GMV in 2023 -- roughly the economy of Finland -- built on a model that accepts high churn
Leads an org of 600+ people at Shopify driving growth for a platform that represents 10% of US e-commerce (~$235B GMV in 2023, roughly the size of Finland's economy), with unique experience running multi-year experiment holdouts that reveal how short-term metrics deceive. Their core argument: Optimizing for churn is better than optimizing for retention -- lower barriers, accept failure, let power law economics work.
The evidence is specific: Shopify represents 10% of US e-commerce with $235B GMV in 2023 -- roughly the economy of Finland -- built on a model that accepts high churn. Furthermore, 30-40% of Shopify's experiments showing short-term metric lifts produce zero incremental GMV when measured a year later -- the most common finding from their holdout program. Reducing monetary friction (trial extensions, lower first-month costs) unlocked a class of merchants who would have quit without extra runway, contradicting the conventional wisdom that discounts attract low-quality customers.
In Archie Abrams's own words: "Most businesses do ultimately fail. And so the way we look at it is can we lower the barriers to getting started and get as many people in the door trying their hand at entrepreneurship?" (Explaining why Shopify optimizes for churn, not retention.)
Shopify
Shopify's core product group operates with no KPIs or metrics -- they are literally banned -- relying instead on...
Shopify's core product group operates with no KPIs or metrics -- they are literally banned -- relying instead on Tobi's 100-year vision for commerce
Leads a 600+ person org at Shopify covering product, design, engineering, data ops, and growth marketing for a platform that handles 10% of US e-commerce, with unique experience operating under three simultaneous but fundamentally different roadmap philosophies within one company. Their core argument: Roadmap priorities should be driven by a 100-year CEO vision, not quarterly planning -- different work types need different roadmap approaches.
The evidence is specific: Shopify's core product group operates with no KPIs or metrics -- they are literally banned -- relying instead on Tobi's 100-year vision for commerce. Furthermore, the three product groups at Shopify each use different roadmap approaches: core (vision-driven), merchant services (medium-term practical), growth (experiment-driven). Long-term experiment holdouts at Shopify automatically revisit every experiment 1-3 years later, revealing that 30-40% of short-term winners had no lasting impact.
In Archie Abrams's own words: "Their priorities in product roadmap are driven by a 100-year vision that comes from Tobi, the CEO." (On how Shopify's roadmap is driven by long-term CEO vision, not dates.)
Shopify
At Shopify, nothing ships in core product without an 'okay-to' approval from Glen, Carl, or Archie — a three-person gate for a 600-person org
A tiny central group holds the taste bar for every release; Glen Coates reviews every single one in depth before it ships
Archie runs a 600-person growth org at Shopify and describes how Tobi Lütke's taste gets operationalized through a small number of deputized approvers. Glen Coates, who runs core product, goes 'incredibly deep' into every release. Every project has a video with Figmas attached, and nothing can ship without an 'okay-to' from Glen, Carl, or Archie for their respective groups.
The model deliberately rejects metrics-driven local optimization. Core product runs on taste against a 100-year vision, and the leadership team meets in person every six weeks to hash out disagreements project by project. The argument is that distributed taste sounds democratic but produces incoherence — a tight central group holding the line is what keeps 600 people anchored to one bar.
In Archie's own words: "It's subjective, but it's objective in the sense that it's kind of a small number of people who really hold what that bar is and needs to be. I think if it's just subjective, let's just ship what we want without a couple people really holding that quality and that taste bar, that's where things go really sideways." (Defending Shopify's centralized taste model against the alternative of distributed subjectivity.)