Digression: Defining the “Center”
While the main goal of our research is to provide a measure that allows us to compare the ideological positions of media outlets to political actors, a separate goal is to express whether a news outlet is left or right of center. To do the latter, we must define center. This is a little more arbitrary than the first exercise. For instance, the results of the previous section show that the average NY Times article is approximately as liberal as the average Joe Lieberman (D-Ct.) speech. While Lieberman is left of center in the U.S. Senate, many would claim that, compared to all persons in the entire world, he is centrist or even right-leaning. And if the latter is one’s criterion, then nearly all of the media outlets that we examine are right of center.
However, we are more interested in defining centrist by U.S. views, rather than world views or, say, European views. One reason is that the primary consumers for the 20 news outlets that we examine are in the U.S. If, for example, we wish to test economic theories about whether U.S. news producers are adequately catering to the demands of their consumers, then U.S. consumers are the ones on which we should focus. A second reason is that the popular debate on media bias has focused on U.S. views, not world views. For instance, in Bernard Goldberg’s (2002) insider account of CBS News, he only claims that CBS is more liberal than the average American, not the average European or world citizen.
Given this, one of the simplest definitions of centrist is simply to use the mean or median ideological score of the U.S. House or Senate. We focus on mean scores since the median tends to be unstable.[30] This is due to the bi-modal nature that ADA scores have followed in recent years. For instance, in 1999 only three senators, out of a total of 100, received a score between 33 and 67. In contrast, 33 senators would have received scores in this range if the scores had been distributed uniformly, and the number would be even larger if scores had been distributed uni-modally.[31]
We are most interested in comparing news outlets to the centrist voter, who, for a number of reasons, might not have the same ideology as the centrist member of Congress. For instance, because Washington, D.C. is not represented in Congress and because D.C. residents tend to be more liberal than the rest of the country, the centrist member of Congress should tend to be more conservative than the centrist voter.
Another problem, which applies only to the Senate, involves the fact that voters from small states are overrepresented. Since in recent years small states have tended to vote more conservatively than large states, this would cause the centrist member of the Senate to be more conservative than the centrist voter.
A third reason, which applies only to the House, is that gerrymandered districts can skew the relationship between a centrist voter and a centrist member of the House. For instance, although the total votes for Al Gore and George W. Bush favored Gore slightly, the median House district slightly favored Bush. Specifically, if we exclude the District of Columbia (since it does not have a House member), Al Gore received 50.19% of the two-party vote. Yet in the median House district (judging by Gore-Bush vote percentages), Al Gore received only 48.96% of the two-party vote. (Twelve districts had percentages between the median and mean percentages.) The fact that the latter number is smaller than the former number means that House districts are drawn to favor Republicans slightly. Similar results occurry-region> First, to account for the D.C. bias, we can add phantom D.C. legislators to the House and Senate. Of course, we necessarily do not know the ADA scores of such legislators. However, it is reasonable to believe that they would be fairly liberal, since D.C. residents tend to vote overwhelmingly Democratic in presidential elections. (They voted 90.5% for Gore in 2000, and they voted 90.6% for Kerry in 2004.) For each year, we gave the phantom D.C. House member and senators the highest respective House and Senate scores that occurred that year. Of course, actual D.C. legislators might not be quite so liberal. However, one of our main conclusions is that the media are liberal compared to U.S. voters. Consequently, it is better err on the side of making voters appear more liberal than they really are than the opposite.[32]
The second problem, the small-state bias in the Senate, can be overcome simply by weighting each senator’s score by the population of his or her state. The third problem, gerrymandered districts in the House, is overcome simply by the fact that we use mean scores instead of the median.[33]
In Figure 1, we list the mean House and Senate scores over the period 1947-99 when we use this methodology (i.e. including phantom D.C. legislators and weighting senators’ scores by the population of their state). The focus of our results is for the period 1995-99. We chose 1999 as the end year simply because this is the last year for which Groseclose, Levitt, and Snyder (1999) computed adjusted ADA scores. However, any conclusions that we make for this period should also hold for the 2000-04 period, since in the latter period the House and Senate had almost identical party ratios. We chose 1995 as the beginning year, because it is the first year after the historic 1994 elections, where Republicans gained 52 House seats and eight Senate seats. This year, it is reasonable to believe, marks the beginning of separate era of American politics. As a consequence, if one wanted to test hypotheses about the typical U.S. voter of, say, 1999, then the years 1998, 1997, 1996, and 1995 would also provide helpful data. However, prior years would not.
Over this period the mean score of the Senate (after including phantom D.C. senators and weighting by state population) varied between 49.28 and 50.87. The mean of these means was 49.94. The similar figure for the House was 50.18. After rounding, we use the midpoint of these numbers, 50.1, as our estimate of the adjusted ADA score of the centrist U.S. voter.[34]
A counter view is that the 1994 elections did not mark a new era. Instead, as some might argue, these elections were an anomaly, and the congresses of the decade or so before the 1994 elections are a more appropriate representation of voter sentiment of the late 1990s and early 2000s. Although we do not agree, we think it is a useful straw man. Consequently, we construct an alternative measure based on the congresses that served between 1975 and 1994. We chose 1975, because this was the first year of the “Watergate babies” in Congress. As Figure 1 shows, this year produced a large liberal shift in Congress. This period, 1975-94, also happens to be the most liberal 20-year period for the entire era that the ADA has been recording vote scores. As we show later, even if we use this period to define centrist, all but two of the media outlets in our sample are still left of center.
The average ADA score of senators during the 1975-94 period (after including phantom D.C. senators and weighting according to state population) was 53.51. The similar figure for the House was 54.58. After rounding, we use the midpoint of these two scores to define 54.0 as the centrist U.S. voter during 1975-94.[35]
Further Results: How Close are Media Outlets to the Center?
Next, we compute the difference of a media outlet’s score from 50.1 to judge how centrist it is. We list these results in Table 4. Most striking is that all but two of the outlets we examine are left of center. Even more striking is that if we use the more liberal definition of center (54.0)—the one constructed from congressional scores from 1975-94—it is still the case that eighteen of twenty outlets are left of center.
The first, second, and third most centrist outlets are respectively Newshour with Jim Lehrer, CNN’s Newsnight with Aaron Brown, and ABC’s Good Morning America. The scores of Newsnight and Good Morning America were not statistically different from the center, 50.1. Although the point estimate of Newshour was more centrist than the other two outlets, its difference from the center is statistically significant. The reason is that its margin of error is smaller than the other two, which is due primarily to the fact that we collected more observations for this outlet. Interestingly, in the four presidential and vice-presidential debates of the 2004 election, three of the four moderators were selected from these three outlets. The fourth moderator, Bob Schieffer, works at an outlet that we did not examine, CBS’s Face the Nation.
The fourth and fifth most centrist outlets are the Drudge Report and Fox News’ Special Report with Brit Hume. Their scores are significantly different from the center at a 95% significance level. Nevertheless, top five outlets in Table 4 are in a statistical dead heat for most centrist. Even at an 80% level of significance, none of these outlets can be called more centrist than any of the others.
The sixth and seventh most centrist outlets are ABC World News Tonight and NBC Nightly News. These outlets are almost in a statistical tie with the five most centrist outlets. For instance, each has a score that is significantly different from Newshour’s at the 90% confidence level, but not at the 95% confidence level. The eighth most centrist outlet, USA Today, received a score that is significantly different from Newshour’s at the 95% confidence level.
Fox News’ Special Report is approximately one point more centrist than ABC’s World News Tonight (with Peter Jennings) or NBC’s Nightly News (with Tom Brokaw). In neither case is the difference statistically significant. Given that Special Report is one hour long and the other two shows are a half-hour long, our measure implies that if a viewer watched all three shows each night, he or she would receive a nearly perfectly balanced version of the news. (In fact, it would be slanted slightly left by 0.4 ADA points.)
Special Report is approximately thirteen points more centrist than CBS Evening News (with Dan Rather). This difference is significant at the 99% confidence level. Also at 99% confidence levels, we can conclude that NBC Nightly News and ABC World News Tonight are more centrist than CBS Evening News.
The most centrist newspaper in our sample is USA Today. However, its distance from the center is not significantly different from the distances of the Washington Times or the Washington Post. Interestingly, our measure implies that if one spent an equal amount of time reading the Washington Times and Washington Post, he or she would receive a nearly perfectly balanced version of the news. (It would be slanted left by only 0.9 ADA points.)
If instead we use the 54.1 as our measure of centrist (which is based on congressional scores of the 1975-94 period), the rankings change, but not greatly. The most substantial is the Fox News’ Special Report, which drops from fifth to fifteenth most centrist. The Washington Times also changes significantly. It drops from tenth to seventeenth most centrist.
Another implication of the scores concerns the New York Times. Although some claim that the liberal bias of the New York Times is balanced by the conservative bias of other outlets, such as the Washington Times or Fox News’ Special Report, this is not quite true. The New York Times is slightly more than twice as far from the center as Special Report. Consequently, to gain a balanced perspective, a news consumer would need to spend twice as much time watching Special Report as he or she spends reading the New York Times. Alternatively, to gain a balanced perspective, a reader would need to spend 50% more time reading the Washington Times than the New York Times.
Potential Biases
A frequent concern of our method is a form of the following claim: “The sample of think tanks has a rightward [leftward] tilt rather than an ideological balance. E.g. it does not include Public Citizen and many other “Nader” groups. [E.g., it does not include the National Association of Manufacturers or the Conference of Catholic Bishops.] Consequently this will bias estimates to the right
.” However, the claim is not true, and here is the intuition: If the sample of think tanks were (say) disproportionately conservative, this, of course, would cause media outlets to cite conservative think tanks more frequently (as a proportion of citations that we record in our sample). This might seem to cause the media to appear more conservative. However, at the same time it causes members of Congress to appear more conservative. Our method only measures the degree to which media is liberal or conservative, relative to Congress. Since it is unclear how such a disproportionate sample would affect the relative degree to which the media cite conservative [or liberal] think tanks, there is no a priori reason for this to cause a bias to our method.
In fact, a similar concern could be leveled against regression analysis. As a simple example, consider a researcher who regresses the arm lengths of subjects on their heights. Suppose instead of choosing a balance of short and tall subjects, he or she chooses a disproportionate number of tall subjects. This will not affect his or her findings about the relationship between height and arm length. That is, he or she will find that arm length is approximately half the subject’s height, and this estimate, “half,” would be the same (in expectation) whether he or she chooses many or few tall subjects. For similar reasons, to achieve unbiased estimates in a regression, econometrics textbooks place no restrictions on the distribution of independent variables. They only place restrictions upon, e.g., the correlation of the independent variables and the error term.
Another frequent concern of our method takes a form of the following claim: “Most of the congressional data came from years in which the Republicans were the majority party. Since the majority can control the rules, and hence debate time given to each side, this will cause the sample to have a disproportionate number of citations by Republicans. In turn, this will cause media outlets to appear to be more liberal than they really are.” First, it is not true that the majority party gives itself a disproportionate amount of debate time. Instead, the usual convention is for debate time to be divided equally between proponents and opponents of any issue. This means that the majority party actually gives itself less than the proportionate share. However, this convention is countered by two other factors, which tend to give the majority and minority party their proportionate share of speech time: 1) Many of the speeches in the Congressional Record are not part of the debate on a particular bill or amendment but are from “special orders” (generally in the evening after the chamber has adjourned from official business) or “one minutes” (generally in the morning before the chamber has convened for official business). For these types of speeches there are no restrictions of party balance, and for the most part, any legislator who shows up at the chamber is allowed to make such a speech. 2) Members often place printed material “into the Record”. We included such printed material as a part of any member’s speech. In general, there are no restrictions on the amount of material that a legislator can place into the Record (or whether he or she can do this). Thus, e.g. if a legislator has run out of time to make his or her speech, he or she can request that the remainder be placed in written form “into the Record.”
But even if the majority party were given more (or less) than its proportionate share of speech time, this would not bias our estimates. With each media outlet, our method seeks the legislator who has a citation pattern that is most similar to that outlet. For instance, suppose that the New York Times cites liberal think tanks about twice as often as conservative think tanks. Suppose (as we actually find) that Joe Lieberman is the legislator who has the mix of citations most similar to the New York Times—that is, suppose he also tends to cite liberal think tanks twice as often as conservative think tanks. Now consider a congressional rules change that cuts the speech time of Democrats in half. Although this will affect the number of total citations that Lieberman makes, it will not affect the proportion of citations that he makes to liberal and conservative think tanks. Hence, our method would still give the New York Times an ADA score equal to Joe Lieberman’s.[36]