1. 程式人生 > >Key Metrics for Popular Growth Models

Key Metrics for Popular Growth Models

This week, we’ll provide a look to how some of the most data-sophisticated companies use growth models to define meaningful goals and track progress towards key metrics.

Growth models (popularized by our friend Andrew Chen) are feedback loops that project how one cohort of users leads to the acquisition of the next cohort of users. Viewing growth with this reinforcing model simplifies a complex system with tons of moving pieces to a set of functions and assumptions.

Note that these growth models are not always intended for setting growth projections, but more so to test sensitivity and find out where you should focus your efforts for highest impact.

Some common examples of growth models include paid acquisition, viral invite loop, user generated SEO content loop, and two-sided marketplaces.

a graphical representation of a SEO/content generation growth model

This is the SEO/Content generation growth model.

Defining your company’s growth using a model helps identify high leverage “inputs” (areas of your business that you have control over) that can amplify compounding growth over time. Additionally, these high impact growth models help you choose which metrics to measure—and set goals against—to get a clear understanding of your growth progress.

We’ll dive into four common models and show how to derive a set of high-signal metrics for each one:

  • User generated content (e.g. Yelp, Stack Overflow, Genius)
  • Viral invite loop (e.g. Venmo, Snapchat, Zynga)
  • Paid acquisition (e.g. Handy, New Relic’s campaigns)
  • Two-sided marketplaces (e.g. Uber, Lyft, Airbnb, Segment)

Growth Models

Before looking at the four growth models, let’s quickly walk through the steps to determine the key metrics:

  1. identify your growth model
  2. create a mathematical model in a spreadsheet with assumptions
  3. deduce key metrics by conducting sensitivity analysis on your spreadsheet

Identifying your growth model requires thinking holistically about each cohort of your users and how they can acquire the next cohort of users. This means looking step-by-step at your user journey and mapping them to discrete actions. The final cohort then “becomes” the next base cohort from which the actions in the loop starts again.

After identifying the feedback loop, then it’s time to mathematically define each step. Note that the final total number of users in the first time period will become the starting number of users in the next time period. We start by keeping things as simple as possible and using percentages in the spreadsheets below.

Lastly, you can deduce key metrics with sensitivity analysis on the mathematical model. Due to the compounding nature of the growth feedback loop, some assumptions have a greater amplifying force on growth over time (e.g. conversion to sign ups vs. conversion to paid). We’ll illustrate this in our examples below.

1. User Generated SEO Content

A user generated content loop is a popular self-reinforcing growth model used by companies like Yelp, Genius, Stack Overflow, Quora, etc. The step-by-step user story here is:

  • users sign up
  • % of the users create new content
  • Google indexes the content
  • non-users search and find the content
  • % of those non-users eventually sign up

graph representing user generated content growth model

Here is a mathematical model in Google sheets to represent the user generated content functions. With this model, we can identify areas of high leverage by adjusting assumptions and seeing their impacts growth. For example, we can see if improving the conversion rate of users who generate content or focusing on acquiring new users would generate more money.

change in growth based on a few different cases and assumptions for the seo content growth loop

Graph above is taken from the aforementioned Google spreadsheet.

The “2x generate content” case assumes the % of users who generate content is twice as much as the Base Case, whereas the 2x sign up case assumes the conversion to sign up is doubled. This model suggests improving the sign up conversion has more compounding effects than content generation conversion.

So, if you’re running this type of business, the key metrics you should be watching are:

  • % of existing users who generate content
  • % of visitors from search who are new
  • % of sign ups who are new visitors

Removing ourselves from the mathematical model to do a quick gut check, it makes sense that these are the key metrics that’ll move the needle the most. If we can incentivize users to generate more content or optimize the conversion from visitors to sign ups, we can see compounded growth over time.

2. Viral Invite Loop

This is a popular model for many social games or apps (e.g. Snapchat, Venmo) that ask users to invite friends via importing their address books. Many companies experienced massive growth leveraging this viral loop, back when Facebook launched their graph API so you could ask all of your friends to help harvest your Green Wheat in Farmville.

The step-by-step user story here is:

  • user signs up
  • % of the users invite their friends
  • % of those friends sign up

image representing viral invite loop growth model

Here’s a mathematical model in Google sheets to represent this growth model. Again, we use this model to see which assumptions move the needle the most. For example, we can see the impact on growth if we improve each percentage point of number of users who invite their friends.

change in growth based on different assumptions for viral invite loop model

Graph above is taken from the aforementioned Google spreadsheet.

The second “Double any key assumption” is the case where either the % of users invite or the % of invited users sign up are doubled. The math happens to work out that way.

For this model, “amplifying” metrics are:

  • % of users who invite friends
  • % of sign ups per invitee

It makes sense that these are the metrics that can significantly add growth over time. If users were more incentivized to invite their friends, then that leads to a greater pool of users who can convert to registration. Seeing that these areas are higher leverage, it makes sense to optimize for those metrics so that you can reap the growth benefits later.

3. Paid Acquisition

The paid acquisition growth model is slightly less exciting, but it’s how many companies scale efficiently. Existing users don’t directly help you acquire new users, but they generate revenue that you can to reinvest in paid marketing. For example, for a company that earns $100 reinvests that money into new acquiring new users. From that cohort, the company makes $80 to reinvest again. This model assumes that the cost of acquiring the user is less than the lifetime value of each user (most VC’s and founders say that the aquisition cost should be 1/3rd of the lifetime value).

The step-by-step user story here is:

  • company uses money to get X users
  • % of X users upgrade and pay total of $Y
  • company reinvests $Y to get next cohort of users

image representing the paid acquisition loop

change in growth based on different assumptions for the paid acquisition growth loop

Graph above is taken from the aforementioned Google spreadsheet.

We see that doubling the conversion rate to paid has a higher impact than doubling “margin” (calculated as LTV - CAC).

You can see in the model that the main assumptions for this are:

  • % of customers convert to paying
  • CAC: Customer Acquisition Cost
  • LTV: Customer Lifetime Value

It’s not trivial to optimize any of these three metrics (it probably will take resources across several teams within a company). However, each KPI can significantly improve the effectiveness of a single marketing dollar spent. Higher LTVs and lower CACs can make the dollar work for acquiring more users, and a higher percent of paying customers leads to a larger marketing budget.

4. Two-sided Marketplaces

The two-sided marketplace model has become more and more popular, as technology helps buyers and sellers transact more easily with one another. For example, Uber, Etsy, Segment, and Grubhub all represent marketplaces.

Growth in a two-sided marketplace relies heavily on the increasing value one side gets from the other. What value do drivers get from more riders, riders from more drivers? Each network effect can be modeled out. If you want to dive deeper in how we do marketplace growth analysis at Segment, check out our post on modeling two-sided marketplaces.

To illustrate the reinforcing nature of growth for two-sided marketplaces, here is the set of the six key growth dynamics (ideas heavily borrowed from this HBR article):

diagram of the six growth dynamics in a two-sided marketplace

  • Buyer-to-Seller Cross-side — prospective buyers tell prospective sellers that they prefer to do business on the platform. “It was hard to find your place. How come you don’t list on Airbnb?”
  • Seller-to-Buyer Cross-side — prospective sellers expose prospective buyers to the platform. “Buy my adorable elephant mittens on Etsy.”
  • Buyer Same-side — buyers love the new transaction experience, and tell other prospective buyers to use the platform. “Why would you use a taxi? You should check out Lyft.”
  • Seller Same-side — sellers love the new transaction experience, and tell other prospective sellers to use the platform. “I made a good chunk of change while I was on vacation, renting my place on Airbnb. You should try it out!”
  • Direct to Buyers — the marketplace tells buyers about itself directly. “Wow, Uber has a lot of billboards here.”
  • Direct to Sellers — the marketplace tells sellers about itself directly. “I searched for jobs in Cincinnati and found Lyft.”

Here’s a sample mathematical model that we used for two-sided marketplaces. Note that this example is a little more involved than the previous ones—the template is a fictitious Segment, with one side being “customers” and the other being integration “partners”.

For more information, we kindly direct you to this section of “How we model growth for two-sided marketplaces”, where we look at tinkering with a single assumption to project growth. The key takeaways are that you

You have a few more metrics to focus on in this model:

  • direct acquisition of buyers
  • direct acquisition of vendors
  • average # of buyer signups driven by each new vendor
  • average # vendor signups driven by each new buyer

Often, the highest contributors to growth depend on your company stage. For example, if its too early for any of the cross-side or same-side marketplace growth dynamics to be a major contributor to growth, then you should focus on growing one side of the marketplace. For example, at Segment, we started by building up our catalog of integrations partners ourselves to attract customers. Then, as we gained more traction and had a critical mass of integrations, figuring out how to work better with our partners to drive more customers to Segment models as a very high growth potential.

Measuring and Hitting the Right Metrics

Using a growth model makes it easier to derive a set of metrics to track and set goals against. The model, when represented mathematically in a spreadsheet, enables you to easily adjust the assumptions to determine which focus area can lead to the most compounded growth.

I’ll repeat, because it’s important, that these models are best used holistically for sensitivity analysis and not for financial planning and projections.

However, once you identify the set of metrics that are most impactful, it’s a matter of holding teams accountable to one or two metrics and really focusing on tasks and experiments that can move these numbers. What we’ve found to be most effective is to hold each team accountable to one (or two, max) of these metrics; then prioritize experiments that can improve those metrics.

While we covered four common growth models in this post, there are many others! If you have any ideas, please share them by tweeting at us!

相關推薦

Key Metrics for Popular Growth Models

This week, we’ll provide a look to how some of the most data-sophisticated companies use growth models to define meaningful goals and track progre

mysql錯誤(Incorrect key file for table)

blog ont sql錯誤 key http text window table font Incorrect key file for table ‘C:\Windows\TEMP\#sql578_6e2_68d.MYI‘; try to repair it mysql

27-如何度量分類算法的性能好壞(Scoring metrics for classification)

清晰 如果 hold 同時 under 實踐 能力 nfs 一個數 最近兩天擁抱了北京這個城市,感覺大氣粗獷,整個人都更有精神了。紫禁城好大,頤和園更大,不自量力的我買了聯票,結果根本沒法逛完。北京人民也熱情,坐在船上,開船大爺不停招呼:這邊可以拍十七孔橋了,視野好面積

apt-get update 時出現W: There is no public key available for the following key IDs:

apt-get update 時出現W: There is no public key available for the following key IDs: apt-get install debian-keyring debian-archive-keyring 安裝key源 ap

English trip V1 - 7.My dream car 我夢想的撤 Teacher:Lamb Key: famous for

In this lesson you will learn to describe an object(目標).    課上內容(Lesson) famous for   以…著稱,聞名   國家(名詞)   和  &n

微信小程式:warning:Now you can provide attr "wx:key" for a "wx:for" to improve performance.

今天樓主在學習微信小程式開發的時候,在使用wx:for這個標籤遍歷陣列的時候發現了這個警告(不消除警告也可以正常執行,但是看著不爽),經過網上的查詢得到了解決辦法,現在分享給大家: 官方解釋:   wx:key 如果列表中專案的位置會動態改變或者有新的專案新增到列表中,

Shape controllable geometry completion for point cloud models

Abstract Introduction Related Work Formulation of our geometry completion algorithm Algorithm overview Determi

English trip V1 - 19.Where Am I? 我在哪裡?Teacher:Patrick Key:Ask for and directions

In this  lesson you will learn to ask for and give directions. 本節課你將學習到學會問路和指路。   課上內容(Lesson) 人類的幾種感: 正義感 justice 責任感  respo

Ask HN: What are good performance metrics for System Administrators?

This has come up in the company I work for. Other teams have metrics (QA tests made, dev stores completed, etc). System administration seems to be devoid o

Why Data Normalization is necessary for Machine Learning models

Why Data Normalization is necessary for Machine Learning modelsNormalization is a technique often applied as part of data preparation for machine learning.

Four key considerations for enterprises starting their journey into machine learning Business Technology

It is enabling functionality ranging from personal shopping recommendations to automated customer support through to financial fraud detection and complian

What Are We Measuring? The Importance of Defining Inputs For Crypto Asset Models

What Are We Measuring? The Importance of Defining Inputs For Crypto Asset ModelsThere Is An Increasing Need To Clearly Define Inputs for Crypto Asset Model

How semiconductor companies are adopting IoT and AI to drive new revenue growth models

The semiconductor industry is one of the fastest growing sectors in technology. Information provided by the Semiconductor Industry Association (SIA) reveal

How we built an app that manages reviews for popular consumer brands

How we built an app that manages reviews for popular consumer brandsHello, I am Adrian, one of the founders at FeedCheck, an app that manages reviews for p

Evaluation Metrics for Recommender Systems – Towards Data Science

Recommender systems are growing progressively more popular in online retail because of their ability to offer personalized experiences to unique users. Mea

How to Use Metrics for Deep Learning with Keras in Python

Tweet Share Share Google Plus The Keras library provides a way to calculate and report on a suit

New – Custom Metrics for Amazon CloudWatch

You can now store your business and application metrics in Amazon CloudWatch. You can view graphs, set alarms, and initiate automated actions bas

AWS Marketplace: Alliance Key Manager for AWS

Townsend Security's Alliance Key Manager for AWS allows enterprises to properly manage their encryption keys while meeting security requirements i

Application Metrics for Node.js

IBM API Connect Want the simplicity of a single API management tool? IBM API Connect automatically monitors APIs during the development lifecycle i

License Key Reset for SPSS 22

Hello, I would like to request 3 license keys for SPSS be reset for use on new computers. Could an administrator please create a private r