Review Sorting Methodology

G2 puts logic in place to ensure the reviews shown on product pages are the most helpful to buyers. When the page is sorted by default, the sort is calculated with a custom algorithm that includes the following data points.

  • Recency of the review
  • Amount of feedback provided in the review
  • Attribution (Did the reviewer keep their name and company public)
  • Whether the reviewer is a current user of the solution (Included a screen shot)
  • Community engagement with the review

G2 Star Rating Methodology

The G2 Star Rating is calculated by aggregating reviewers' answers to our Likely to Recommend question (1–10 scale) and dividing the average in half.

You will see half stars because the visual is rounded up to the nearest half.

Alternatives Sorting Methodology

The top alternatives sorting algorithm is meant to surface the products most similar in functionality and which buyers can leverage for similar uses. Three sources of information are used to determine the sort, as listed below:

  • The breadth of overlap in categories as determined by G2 research analysts, as an indicator of similarity of function
  • The depth of category overlap based on the number of reviews attributed to each category, as an indicator of overlap of usage 
  • The number of product to product comparisons made by G2 users, as an indicator of overlap of interest from buyers

The Satisfaction rating is affected by the following:

  • Customer satisfaction with end user-focused product attributes based on user reviews
    • For services providers: Satisfaction with client-focused provider attributes based on client reviews
  • Popularity and statistical significance based on the number of reviews received by G2
  • Quality of reviews received (reviews that are more thoroughly completed will be weighted more heavily)
  • Age of reviews (more-recent reviews provide relevant and up-to-date information that is reflective of the current state of a product or services provider)
  • Customers' satisfaction with administration-specific product or provider attributes based on user reviews
  • Overall customer satisfaction and Net Promoter Score® (NPS) based on ratings by G2 users

Note: The customer Satisfaction score is normalized for each Grid®, meaning the scores are relative.

G2's Market Presence score is a combination of 15 metrics from G2's user reviews, publicly available information, and third-party sources.

Both the software vendor and the individual product are measured on various criteria. The criteria are listed below in order of importance. Product metrics receive greater weight than vendor metrics.

Each input is normalized by category and segment. This means that scores are relative to other products in the category/segment and may change from segment to segment. The scores are then scaled from 0–100.


Grid® Report Inclusion Criteria

For a category to be data ready for a Grid® Report, it requires:

  • 6+ products with 10+ reviews in the category
  • 150+ reviews in the category overall
  • All key players in that category included

Market Presence Scoring Criteria

Criteria Measured For Metrics
  Product Vendor  
Number of Employees X X Employee Count (based on social networks and public sources)
Reviews X   Review Count (weighted by recency)
Web Presence X X  
Social Presence X X  
Growth X X Employee Growth, Web Presence Growth
Vendor Age   X  
Employee Satisfaction and Engagement   X  

Grid® Decay

To keep G2's algorithms fresh and up to date, a decay is applied to reviews based on their last updated date. Reviews are worth less toward both the Satisfaction score and the Market Presence score as they age.

The exponential decay is compounded daily. The rate roughly equates to -3% per month or -30% per year.

Reviews also receive bonus weight based on the source and quality of the review. Bonus weights are internal to G2.

Grid Decay

Best Software Sellers and Software Products Lists - Scoring Methodologies

To be included in one of G2’s Software Sellers or Software Products “Best Of” lists, a software seller or software product must receive at least 50 approved and published reviews* during the evaluation period. For the “Best Of” lists, the evaluation period is January 1 to December 31 each year**, and scores reflect only data from reviews submitted during that time. The Market Presence score reflects the data that is as recent as the cut date.

Scoring Methodologies

Best Software Sellers Lists

  • Software sellers are ranked based on a combination of Satisfaction and Market Presence scores for each seller.
  • Satisfaction is an aggregate score based on a seller’s products across their assigned categories. All products with 5 or more reviews in the evaluation period and 10 or more reviews overall are included in this score.
  • Market Presence inputs are aggregated by software seller and then normalized across all eligible sellers. Market Presence is scored relative to all sellers with 10 or more reviews.
  • The region-based lists (ANZ, India, and EMEA) follow the Best Software Sellers Lists methodology for sellers, but only considers sellers from a particular region. A number of factors are used to determine which region software sellers are grouped in, including, but not limited to, where the company was founded, where its executive team resides, and where the majority of its workforce is located.

Best Software Products Lists

  • Products are ranked based on reviews across all categories they are a part of. Category rankings for Satisfaction and Market Presence are normalized as usual. 
  • The score for a product is first calculated for each individual category, and then those category scores are combined. The overall score is weighted based on the competitiveness*** of each category. 
  • The “Highest Satisfaction” list is based solely on G2’s Satisfaction algorithm (rather than G2 Score), normalized within categories. The score for a product is first calculated for each individual category, and then those category scores are combined. The overall score is weighted based on the competitiveness*** of each category.
  • The “Fastest Growing Products” list is based on G2's Momentum algorithm, normalized across categories.
  • The persona-based lists (e.g., Best Software for Sales Products) follow the Best Software Products Lists methodology but only include reviews within a smaller subset of categories relevant to a particular persona.
  • The segment-based lists (Small-Business, Mid-Market, and Enterprise) follow the Best Software Products methodology, but only consider reviews submitted by users working in the named segment size. G2 defines small-business as a company with 1-50 employees, mid-market as a company with 51-1,000 employees, and enterprise as a company with 1,001+ employees.

Notes on the "Best Of" Scoring Methodologies:

Keep in mind that, for G2’s annual “Best Of” lists, the scores only reflect reviews submitted in the evaluation period. Other G2 reports might include more or less data which would potentially show different rankings for software sellers and software products.

Also, broadly-defined “Other” categories such as “Other Marketing Software” and “Other IT Security Software” were excluded to ensure we were evaluating products with relevant comparative scoring.

* Business partner reviews count toward the 50 reviews threshold needed to be eligible for G2’s “Best Of” lists, but they are not calculated as part of the rankings. 

** The 2020 “Best Of” list evaluation period was extended and ran through March of 2020, instead of the usual end date of December 31, 2019.

*** Competitiveness, in this instance, is determined by how many products are competing in each category and how many reviews those products receive.

v2.0

Business Partners

Users who have a business relationship with a vendor, such as resellers, can often provide valuable insight and are not restricted from leaving reviews on G2. However, because of the potential bias of such relationships, business partner reviews do not count toward the Star Rating, G2 score, Satisfaction or Market Presence scores, Best Of Lists, or other G2 ranking algorithms. These are flagged with a "Business Partner" label on the review.

Additional Report Scoring Methodologies

 

Segmented Grid® Scoring Methodology

When viewing Grids® by segment size, the same Grid® scoring methodology applies. However, the review data used is only from reviewers who are employed by a company within a particular company segment. G2 uses the following definitions for company segments:

  • Small-Business review: A review from someone who works at a company with 50 or fewer employees
  • Mid-Market review: A review from someone who works at a company with 51–1,000 employees
  • Enterprise review: A review from someone who works at a company with 1,001+ employees

Segmented Market Presence scores measure both the scale of a product within a category as well as the degree to which the product focuses on a given segment.

Regional Scoring Methodology

G2 rates products and vendors based on reviews gathered from our user community, as well as data aggregated from online sources and social networks. We apply unique algorithms  (v4.0) to this data to calculate the Satisfaction and Market Presence scores in real time. 

When viewing categories by region or specific country, the same Satisfaction scoring methodology applies. However, the review data used is only from reviews sourced from a particular region or specific country. Review region is determined by where the reviewer was located when the review was written.

Regional Market Presence is designed to measure a product’s market share, vendor size, and web presence both within the region and globally. G2 uses a combination of over 15 metrics from G2’s reviews, publicly available information, and third-party sources to ensure the scoring is not only accurate but transparent, scalable, and dynamic.

G2 uses the following definitions for regions:

Usability Scoring Methodology

G2 rates products and vendors based on reviews gathered from our user community, as well as data aggregated from online sources and social networks. We apply a unique, patent-pending algorithm to this data to calculate the product's Usability score. The information shown reflects scores calculated using the G2 usability algorithm v1.0 BETA in real time.

The Usability score is affected by the following (in order of importance):

  • Customer satisfaction with the ease of use for each product based on reviews by G2 users
  • Customer satisfaction with the ease of admin for each product based on reviews by G2 users
  • Customer responses to the Meets Requirements question on G2
  • User adoption percentage based on reviews and by G2 users
  • The number of reviews received on G2; buyers trust a product with more reviews, and a greater number of reviews indicates a more representative and accurate reflection of the customer experience

Usability Index Inclusion Criteria

For a category to be data ready for a Usability Index Report, it requires:

  • 6+ products with 10+ reviews and 5+ answers to the following questions
    • Ease of Use
    • Ease of Admin
    • Meets Requirements
    • What percentage of users adopted the product?
  • 150+ reviews in the category overall
  • All key players in that category included

Results Scoring Methodology

G2 rates products and vendors based on reviews gathered from our user community, as well as data aggregated from online sources and social networks. We apply a unique, patent-pending algorithm to this data to calculate the product's Results score. The information shown reflects scores calculated using the G2 results algorithm v1.0 BETA in real time.

The Results score is affected by the following (in order of importance):

  • Customers' estimated ROI for the product based on reviews by G2 users
  • Customers' reported time to go live with the product based on reviews by G2 users
  • Customers' satisfaction with the product's ability to meet their requirements based on reviews by G2 users
  • Customers' likelihood to recommend each product based on reviews by G2 users
  • User adoption percentage based on reviews and by G2 users
  • The number of reviews received on G2; buyers trust a product with more reviews, and a greater number of reviews indicates a more representative and accurate reflection of the customer experience

Results Index Inclusion Criteria

For a category to be data ready for a Results Index Report, it requires:

  • 6+ products with 10+ reviews and 5+ answers to the following questions
    • Meets Requirements
    • What percentage of users adopted the product?
    • Estimated ROI
    • How likely are you to recommend this product to a friend?
  • 150+ reviews in the category overall
  • All key players in that category included

Implementation Scoring Methodology

G2 rates products and vendors based on reviews gathered from our user community, as well as data aggregated from online sources and social networks. We apply a unique, patent-pending algorithm to this data to calculate the product's Implementation score. The information shown reflects scores calculated using the G2 implementation algorithm v1.0 BETA in real time.

The Implementation score is affected by the following (in order of importance):

  • Customer satisfaction with the set-up process for each product based on reviews by G2 users
  • Amount of time (in months) required for each product to go live based on reviews by G2 users
  • User adoption percentage based on reviews and by G2 users
  • Implementation method used by customers according to answers by G2 users
  • The number of reviews received on G2; buyers trust a product with more reviews, and a greater number of reviews indicates a more representative and accurate reflection of the customer experience

Implementation Index Inclusion Criteria

For a category to be data ready for a Implementation Index Report, it requires:

  • 6+ products with 10+ reviews and 5+ answers to the following questions
    • How long did it take you to go live?
    • Ease of Setup
    • How did you implement?
    • What percentage of users adopted the product? 
  • 150+ reviews in the category overall
  • All key players in that category included

Relationship Scoring Methodology

G2 rates products and vendors based on reviews gathered from our user community, as well as data aggregated from online sources and social networks. We apply a unique, patent-pending algorithm to this data to calculate the product's Relationship score. The information shown reflects scores calculated using the G2 relationship algorithm v1.0 BETA in real time.

The Relationship score is affected by the following (in order of importance):

  • Customer satisfaction with the ease of doing business with each product based on reviews by G2 users
  • Customer satisfaction with the quality of support based on reviews by G2 users
  • Customer response to the Likely to Recommend question on G2
  • The number of reviews received on G2; buyers trust a product with more reviews, and a greater number of reviews indicates a more representative and accurate reflection of the customer experience

Relationship Index Inclusion Criteria

For a category to be data ready for a Relationship Index Report, it requires:

  • 6+ products with 10+ reviews and 5+ answers to the following questions
    • Ease of Doing Business With
    • Quality of Support
    • How likely are you to recommend this product to a friend?
  • 150+ reviews in the category overall
  • All key players in that category included

Momentum Grid® Methodology

Momentum Methodology

Each variable is normalized by category and aggregated to create a Momentum score. The inputs impacting G2's Momentum score are as follows:

  • Employee Growth, Review Growth, Social Growth, and Web Growth
  • Year-over-year change

Satisfaction Methodology

The Satisfaction rating is affected by the following (in order of importance):

  • Customer satisfaction with end user-focused product attributes based on user reviews
  • Popularity and statistical significance based on the number of reviews received by G2
  • Quality of reviews received (reviews that are more thoroughly completed will be weighted more heavily)
  • Age of reviews (more-recent reviews provide relevant and up-to-date information that is reflective of the current state of a product)
  • Customers' satisfaction with administration-specific product attributes based on user reviews
  • Overall customer satisfaction and Net Promoter Score® (NPS) based on ratings by G2 users

Product Suite Methodology

Product suites are groupings of individually-sold products from a single vendor that work together to solve a broader business problem.

Solutions covered by the product suite methodology are product suites or single products from one vendor that provide the functionality of a core set of categories, plus related additional categories. Solution categories are identified by a grouping of G2 software categories, as described below:

  • Core Categories: A solution must offer all required features of these categories as defined by G2’s research team.
  • Additional Categories: Solutions may provide the features of these categories in complement to the core categories. Solutions can provide the features of any or none of these additional categories and still be included in the category.

Inclusion & Eligibility

To be included in a Grid®, a solution must have 10 or more reviews across the defined core categories. An eligible solution’s positioning will be further influenced by additional categories where it has 10 or more reviews.

Satisfaction 

The solution Satisfaction score is an aggregate of the offering’s category Satisfaction scores, with core categories receiving greater weight than additional categories. The factors used in the calculation of solution Satisfaction scores are the same as those in the G2 Satisfaction score.

Note: The satisfaction sub-scores are normalized for each Grid®, meaning the scores are relative. For core categories, the scores are normalized against only the solutions eligible for the Grid®. For additional categories, the scores are normalized against all products with 10 reviews in the category.

Market Presence

Market Presence is designed to measure a solution’s market share, vendor size, and influence in the solution category. Solution Market Presence is based on the same factors used to score Market Presence, aggregated across each product that makes up the solution and has 10 reviews in a solution category.

Updating Vendor Information in G2 Reports

Updates to your product or company information displayed in published G2 reports must be submitted to our support team. Our team can make changes to the following in published reports:

  • Product or company name
  • Product or company website
  • Company location
  • Product logo

The following metrics are used in our Market Presence scoring and cannot be updated in published reports or drafts:

  • Year founded
  • Revenue
  • LinkedIn information
  • Twitter information
  • Glassdoor information
  • Alexa rank

All updates to metrics affecting our Market Presence and Momentum algorithms are updated on a monthly basis. Vendors are updated at the same time to ensure that they are being measured on an even playing field. We do these updates ahead of report releases, so it is possible for metrics like the Number of Employees, LinkedIn followers, Twitter followers, etc., to be a bit lower than what you might find at the source. If you have any questions, contact our support team.