About the Interactive Media Bias Chart

Author:

Date:

This Interactive Media Bias Chart® is a data visualization that displays measures, generated by analysts and staff of Ad Fontes Media, of news (and “news-like”) articles and sources. It reflects our most up-to-date ratings of all our rated articles and shows over time.

We also frequently publish static versions of the Media Bias Chart®, which display a select number of these sources. As you can see, not all our rated sources are easily visible at once on a single version of the Media Bias Chart, so in various versions (e.g. Version 6.0 released in June 2020) and subsequent monthly editions (e.g., Version 6.0, July 2020 Edition), we swap sources in and out for visibility. Lots of people use these static versions to share on social media or use in classrooms and presentations. We update our ratings frequently, rating new articles every single week. As a result, placements on our static versions may vary from placements on our interactive chart. Moving forward, you can find the most up-to-date ratings on the interactive version.

Features

On the Interactive Media Bias Chart, you can explore information about news sources and articles in several ways.

  • Hover over any source to see its overall reliability and bias score, URL, and reach data
  • Hover over any article to see its individual reliability and bias score. You can also click on its URL to see the article for yourself and judge how you would have rated it
  • Click on “Display article data” to see each rated article on a scatterplot around its overall source placement.
  • Click on “Display source audience size” to see reach bubbles behind each source.
  • Zoom in to any area of the chart for a better view of each source, and to see the smaller reach bubbles
  • Search for all news sources on the chart by typing the name in the search function. Once you select a news source, it will appear on the chart, with or without its article data. You can select as many sources as you want at once to compare and contrast!
  • Filter by reliability or bias scores with the corresponding sliders
  • Select special views such as “Fox vs. CNN vs. MSNBC”
  • Download any custom view of the Media Bias Chart you create! Note that this feature is for subscribing News Nerd Members. All downloaded versions are licensed for use under our Standard License.

Methodology Summary

The following description is a summary of our methodology. For more detail, please see our Methodology page.

Sources

Overall news source scores are generated based on scores of individual articles. Each individual article is rated by least three human analysts balanced by left, right, and center self-reported political viewpoints. That is, at least one person who has rated the article self-identifies as being right-leaning, one as center, and one as left-leaning. Sometimes articles are rated by larger panels of analysts for various reasons.

For each news source, we pick a sample of articles that are most prominently featured on that source’s website over several news cycles. We typically have at least 10-15 articles rated per source, but for larger sources (such as the New York Times and Washington Post) we have over 100 articles in our sample. We rate all types of articles, including those labeled analysis or opinion by the news source, and the dominant factor for how we select articles from a page is prominence.

Each overall source score is a weighted average of the individual article scores. Our weighting algorithm has changed over time to try to capture the effect that individual articles with low reliability or high bias have on overall perceptions of the news source and is subject to change in the future. Notably, in the most recent update of this interactive chart, (August 2020), we updated our weighting algorithm to increase weighting of bias scores.

While previous iterations have weighted low reliability scores heavily, they have not weighted bias scores. In the current weighting algorithm, bias scores falling into the skews left/right, hyper-partisan left/right, and most extreme left/right categories receive increasingly heavier weights. The most notable effect of this change was that certain sources near the top middle received slightly greater net bias scores. For example, The New York Times and Washington Post moved a few points to the left, and WSJ moved a few points to the right. We believe this weighting better accounts for the impression of bias that these sources’ opinion and analysis content conveys.

Articles

Each analyst has gone through extensive training on Ad Fontes Media’s rating methodology, which is based on content analysis of articles.

Each analyst gives each article ratings on three individual reliability sub-factors of 1) Expression, 2) Veracity, and 3) Headline/Graphic, and then the analyst gives the article an “Overall” reliability rating. Each of these ratings are on a numerical scale between 0-64, with 0 being the least reliable and 64 being the most reliable.

Each analyst also gives each article ratings on three individual bias sub-factors of 1) Language, 2) Political Position, and 3) Comparison, and then the analyst gives the article an “Overall” bias rating. Each of these ratings are on a numerical scale between -42 (left) and +42 (right).

The analysts’ scores are then averaged, and the average score is shown on the chart.

Reach Metric

Since we first started producing the Media Bias Chart, one of the top requests for features has always been to display the “reach” of each source, because people have been interested in the impact certain sources have on audiences.

However, an “overall reach” number is hard to quantify for all these different kinds of news sources. All have web traffic, but they also have Facebook page likes and Twitter followers. Some have print circulation, apps, email lists, podcast downloads, TV programs, and YouTube channels. Further complicating things is that these various channels overlap; i.e., sometimes a Facebook page like makes the story show up in the feed and then takes them to the website, which counts as web traffic.

Additionally, many of these metrics are individually hard to track down. There are a variety of publicly available measures, but some metrics more reliable than others. Further, they change quickly over time.

To come up with an “overall reach” number that captures a high-level view of how popular one source is compared to others, we generated our own composite metric.

We gathered publicly available reach data for monthly website visits to each news source from SimilarWeb. SimilarWeb measures “total visits” per month for each site using a variety of data points in their own methodology. Other website measurement tools (e.g., Google Analytics), calculate monthly “unique” visitors, which is often a number smaller than similar measures of “total visits,” but how much smaller that number is varies from site to site. For example, some people may visit CNN.com every day, and some may visit it only once per month. Those frequencies might (or might not) be very different for a site like NewYorker.com.

Because so many people get their news from their social media feeds, we also gathered publicly available information on each news source’s Facebook page likes and Twitter followers. It’s nearly impossible to figure out how much news content from a particular source actually gets viewed by someone who likes a Facebook page or follows a Twitter account, but we counted it to get a general sense of comparable popularity. For some sources, their social media presences are more significant than their website visits, and for some, one social media platform is far more significant than the other. (e.g., large Twitter followings but relatively smaller Facebook page likes, and vice versa).

We wanted to account for each of the measurements of website visits, Facebook page likes, and Twitter followers, but the SimilarWeb “total visits” number often dwarfed the Facebook and Twitter numbers. We wanted to avoid that because we wanted to capture something closer to estimated “monthly unique visits” and because we wanted to factor in the influence of Facebook and Twitter on reach, because that influence is significant. Therefore, took the SimilarWeb numbers and divided them by four for all sites. Then we added that number to the number of Facebook page likes and Twitter followers to come up with an “Ad Fontes Media Composite Reach Metric.”

For the cable news channels, we also wanted to come up with a comparable monthly number. Nielsen ratings are the gold standard for measuring that statistic, but those numbers are often not publicly available. The most recent published Nielsen ratings we could find on the major cable news channels (FOX, MSNBC, and CNN) were from a Hollywood Reporter article in April 2020. We took the average numbers for “all day viewing” and multiplied them by 30 to get a rough estimate of how many people watch in a month. This number is the Ad Fontes Media Composite Reach Metric for TV.

The Ad Fontes Media Composite Reach Metric remains a very rough estimate of “reach” for all the reasons listed herein. We will continue gathering data and add metrics such as print publication, podcast downloads, etc. to improve this metric over time.

We hope you enjoy exploring our data on the Media Bias Chart, and we’ll keep adding as much as we can to it as our company grows. If you want to help us grow and get access to the most updated downloads of the Media Bias Chart all the time, please consider becoming a member!

Join over 40,000 others and stay informed
about updates to the
Media Bias Chart
(and more)
by subscribing to our newsletter!

 

Email: