Using data from Wolfram Alpha or some other source, replot the NASA graph here http://ripetungi.com/the-rise-and-fall-of-nasas-budget/ either: 1. Controlling for inflation, 2. Tracking expenditure as a percentage of GDP, or 3. Tracking expenditure as a percentage of government spending. Defend your choice, and note any differences in the shape of the graph that result.
From Marion Nestle’s book on Food Politics: Questions: What is wrong with this graph? In what ways is it deceptive? How would you fix it? What might be a better format?
If you look at this chart, you could be forgiven for thinking where you shop makes you fat. Well, not forgiven, exactly — but look at these huge differences! Less than 5% of Whole Foods shoppers are obese, whereas almost 40% of Albertson’s customers are. So is it something based on what they sell? Nope. [...]
First, read How to Construct a Bogus Survey. Second, consider this poll from The Washington Post’s website. Walk through what would happen if you set up the poll in various different ways. Be ridiculous where it helps. For the moment, ignore issues of non-response and response bias. Name at least one strength and one weakness [...]
Norfolk (VA) and San Francisco (CA) both have approximately the same average temperature (57 degrees Fahrenheit). But that temperature differs month by month. Questions: 1. Looking at the above graphs, which of the two cities has the highest standard deviation in monthly temperature? 2. People generally use heat and cooling technology to keep the [...]
From the NY Times: Ninety-four percent of students who earn a bachelor’s degree borrow to pay for higher education — up from 45 percent in 1993, according to an analysis by The New York Times of the latest data from the Department of Education. This includes loans from the federal government, private lenders and relatives. [...]
Stat Lit Chart of the Day This chart could mean that the more education you get, the more you drink. What is another explanation for the increase in average annual expenditures on alcohol?
A Note to Instructors We’ve broken this text up into chapters. In our estimation, each chapter could take one to two weeks depending on how much time in your class is dedicated to other activities and needs. A four-hour, twice-a-week-class with no other content or class-time obligations should be able to do a chapter a [...]
Which intersection in town is the most dangerous? How much more expensive will college be if I graduate a year late? Which product line has given our business the best overall return in the past two years? At what rate is global temperature rising? How expensive was the most recent election compared to previous elections? [...]
Much of college is about the marathon – the 20-page term paper, the semester-long project. This course is not about marathons. This course is about sprinting. It’s about the 10 minute brainstorming session. It’s about speed chess. What we hope you will develop by the end of this course is the ability to critique a [...]
Every sprint needs a track. This checklist is our track. The Fair Comparison Checklist (COMPARABLE) is meant to provide you a quick way to break down a comparison and critique it. As we go through the course, the categories presented here will have more meaning. For now, we want to introduce the checklist, and, if [...]
Let’s take a brief detour, since we asked you to memorize the above checklist, and since we will be asking you to memorize other things as well. A little instruction here can make your life easier, not just in this class, but in all your classes. Memorization is a lost art. Most students memorize by [...]
This section deals with the following elements of the COMPARABLE framework: C: Were appropriate comparison groups chosen? Was like compared to like? A1: Which factors were accounted for/controlled for (population, inflation, income) and which were not? There are many rules that apply to making fair comparisons, but there is one rule that leads, in one [...]
This section deals primarily with the following elements of the COMPARABLE framework: E: What is the story of the edges? What is the story of the center? How are they different and what does that mean? THE STORY OF THE CENTER We’ve been looking at various comparisons, in many cases using what statisticians call measures [...]
1. Consider the following quote: We often talk of social statistics, especially those that seem as straightforward as age, as if a bureaucrat were poised with a clipboard, peering through every window, counting; or, better still, had some machine to do it for them. The unsurprising truth is that, for many of the statistics we [...]
The following questions can be answered in one to two sentences. While a variety of answers might make sense, there are right and wrong answers here. Think carefully about your answers. Write down your answers and bring them to class. We will review your answers either in class or in a net-mediated peer instruction activity. [...]
Remember — questions will not only test the previous chapter. They will test all previous content (In this case everything from the golden rule, to subpopulations, to averages, to distributions). Figuring out which concept to apply to each problem is often the crucial skill, so we don’t indicate which concept comes into play. In some cases [...]
After completing chapter one, you have the basics of the COMPARABLE framework. Week Two will introduce you to time-based comparisons, term definition, the art of performing mental experiments, and the many uses of percentages.
This section deals primarily with the following elements of the COMPARABLE framework: M: Do a mental experiment. In the process of writing this book, I’ve come to the conclusion that one of the most important parts of any comparer’s toolkit is hypothetical thinking. Hypothetical thinking comes in many forms, but the key skill is gaining [...]
This section deals primarily with the following elements of the COMPARABLE framework: L: Would the comparison benefit from a longitudinal/cross-sectional analysis? B: Were base rates considered? Were relative and absolute increases considered? P: Were the pictorial/graphical representations fair and unbiased? Did they help illustrate the data or were they eye-candy? Note to instructors: We are [...]
So what do we mean when we say something like “Asthma has risen?” The naive answer is that “More people have asthma.” But what exactly are we counting? What has gone up? We can measure asthma in a number of ways: Emergency room visits A survey where we ask people about asthma medication New diagnoses [...]
One of the quickest ways to become a smart consumer of statistics is to translate raw numbers into percentages, and raw increases into percentage gain. Percentages are not just an alternate way to present a statistic. They can give you a broader sense of the relative size of the statistic you are looking at. They [...]
1. A politician tells you that median personal income has risen, but median household income has fallen. Look up these terms if you are unsure of their meaning, and brainstorm some reasons that personal income might rise while household income might fall. Write them down. 2. Is it possible to go the other way (personal [...]
This question can be used any time after the “Defining Terms” section. Many public health experts worry that if the price of alcohol is too low that people will drink more, and more health and safety problems will result. This is currently (as of this writing in 2012) a debate that is going on [...]
Questions: 1. Rick Santorum, a candidate for the 2012 Republican nomination, claimed that “62 percent of kids who go into college with a faith commitment leave without it.” [Source: http://bit.ly/A77XED] What is being explicitly compared here? Is it a longitudinal or cross-sectional comparison? If 62 percent is the “part”, what is the “whole”? 2. Of [...]
Does the sign above tell you whether you are more likely to drown if you are not wearing a life jacket? Think about it a bit. Derek Bruff, the mathematician who took this picture, points out the sign doesn’t tell you anything unless you know what percentage of people wear lifejackets on the lake. Imagine [...]
Thinking about Randomness Randomness (and probability) is one of the more difficult things to understand. In this course we do not go into nearly the detail that most statistics courses go into on randomness. Instead, we are going to try to get across a few main points. The point we want to get across here [...]
You probably already know about and have used weighted means — they are one of the most popular ways for professors to calculate grades. For example, if quizzes are going to be 30% of the grade and the midterm + final is going to be 70% of the grade then if your grades look [...]
One of the most common comparison controls we use is controlling for population, both when looking at something societal (percentage of people out of work) and at experimental results (percentage of people experiencing a positive outcome). Percentages and Natural Frequencies Take for example this list of the top 15 countries in terms of number of [...]
1. Notice the difference between the number of prisoners indicated in the NationMaster data, and the number of prisoners indicated by the BJS statistics. Read the definition on the BJS statistics carefully, and then come up with a definition that explains why the NationMaster stats are higher.
Displaying Simple Part-Whole Relationships When percentages are part of a common whole, the usual way to display them is a pie chart. The pie chart has its share of problems as a graphical representation of data (particularly when people go all 3D on them), but the one thing a pie chart does is [...]
The following insight is an old saw of research on statistical intuition by now, but was revolutionary when Kahneman & Tversky came up with it in the early 70s. It is a good explanation of what goes wrong when we think about prediction. As you consider the next question, please assume that Steve was selected [...]
Critical Thinking is about more than intelligence: Even after controlling for differences in cognitive ability, reasoning performance correlated with degree of open-mindedness and epistemic flexibility (cultivating reflectiveness rather than impulsivity, seeking and processing information that disconfirms one’s belief, being willing to change one’s beliefs in the face of contradictory evidence). Further, these dispositions tended to [...]
Example from A Theory-Based Meta-Analysis of Research on Instruction by RJ Marzano: The next two techniques displayed in Table 7.2 employed the information processing function of idea representation. Techniques that provided students with metacognitive strategies for using visual memory had an effect size of 1.04, indicating a percentile gain of 35 points. Presumably, these strategies help [...]
What do you think this bar chart is saying? Is it an effective use of a bar chart? Why or why not? How would you present this data?
From A. N. Whitehead’s An Introduction to Mathematics, some insight into why practice is important: “It is a profoundly erroneous truism, repeated by all copy-books and by eminent people when they are making speeches, that we should cultivate the habit of thinking of what we are doing. The precise opposite is the case. Civilization advances by extending [...]
This is a great walk-through of the issues of sensitivity and specificity in medical test design and interpretation. It is a good supplement to the explanations in this text. Everyone that gets medical tests done or will get medical tests done (which, let’s face it, is everyone) should be familiar with these principles, but it’s often hard [...]
How Visa Predicts Divorce From TDB: Hunch then looks for statistical correlations between the information that all of its users provide, revealing fascinating links between people’s seemingly unrelated preferences. For instance, Hunch has revealed that people who enjoy dancing are more apt to want to buy a Mac, that people who like The Count on [...]
1. Consider the following issue: 17.1. A major controversy has occurred about apparent contradictions in biostatistical data as researchers try to convince Congress to allocate more funds for intramural and extramural investigations supported by the NIH. Citing improved survival rates for conditions such as cervical cancer, breast cancer, and leukemia, clinicians claim we are “winning [...]
When things have a seasonal cycle, it’s often difficult to make direct comparisons. Ideally you compare to last year this time, or the ten year average of this time last year, but what people really want is a sense of how high it will go. This article does a decent job with that — look, [...]
Making Fair Comparisons: An Approach to Quantitative Literacy Written by: Mike Caulfield Editors & Contributors: Becca Berkey, Elli Caldwell This work is heavily influenced by the work of Milo Schield, Neil Lutsky, and Nathan Grawe. The questions we ask here are questions they ask, although the presentation and focus of this text is someone different. This [...]
My new favorite term from epidemiology: J-Curve. Distribution matters, even with something as shades-of-grey as risk. For instance, yhere’s a lot of things that increase your mortality in a more-or-less linear way. The more you smoke, the greater your all-cause mortality risk, for example. This isn’t to say you increase your chance of death by [...]
From EnergyStar.gov: Lifecycle impact analyses, like the one shown above, are invaluable tools in making fair comparisons. It’s easy, for example, to get hung up on the small amount of mercury in a CFL bulb, a percentage of which can escape into the environment if the bulb is crushed in a landfill. But the biggest contributor [...]
This is the new story out — it’s a mancovery! From Bloomberg: Men, who lost more than twice as many jobs as women during the worst economic slump since the Great Depression, have landed 88 percent of the non-farm jobs created since the recession ended in June 2009. The share of men saying the economy [...]
In the COMPARABLE framework the “E” is for “Edges”, and part of the “question of edges” is whether there are significant subpopulations. In the case of unemployment of recent college grads, the answer is yes: The center would tell you only that the average unemployment for college grads is about 9%. But the lowest rates [...]
This is an amazing chart — sad in one way, but uplifting in another, because it shows how stats-informed public policy can make a difference. The chart represents the incidence of SIDS (“crib death”) in Norway plotted out against the rise and fall of parents that put their children to sleep on their stomach. (Which [...]
As we say in the COMPARABLE checklist, the story is often somewhere in the edges. Take this chart of the proportion of a food dollar which goes to the farmer vs. post-farm activities. At first it seems to show declining farm revenue as the the market bill (which includes everything from transportation to preparation) climbs: [...]
In medicine, researchers often rely on surrogate outcomes (also called surrogate endpoints). Take, for example, something like heart health. We know that a good ratio of good cholesterol to bad cholesterol is a predictor of heart health and increased longevity. So we come up with a pill that changes that ratio for the better. And [...]
Focused question: While “surrogate outcomes” and “clinical outcomes” are terms generally used in medicine, the same concept can be applied to a wide range of disciplines. Come up with the equivalent of a “surrogate outcome” and its corresponding “clinically meaningful outcome” for each of the following disciplines: Education Economics/Economy Politics
The following is a chart of the Mac OS “Flashback” virus infections over a series of days in 2012. The title of the article is “Flashback waning, but still infecting about 140,000 Macs” 1. Is this a longitudinal comparison? 2. What are the comparison groups? 3. Is this a measure of prevalence or incidence? 4. [...]
The following graph is from Architect Magazine. The caption reads: “The construction boom of the 2000s often cited as the reason for the boom in housing prices doesn’t break precedent—or break records. At a time when U.S. population growth was slower, the 1970s saw two housing booms that produced more housing starts than the 2000s. The high [...]
When making comparisons between countries, climates, people, or anything else there are differences which can make a fair comparison difficult. Some disciplines talk about lurking variables, some talk about confounders — for the moment we are just going to talk about this stuff as the “things your comparison might need to account or control for.” [...]
Read the following comparison: Consumers now owe more on their student loans than their credit cards. Americans owe some $826.5 billion in revolving credit, according to June 2010 figures from the Federal Reserve. (Most of revolving credit is credit-card debt.) Student loans outstanding today — both federal and private — total some $829.785 billion, according to Mark [...]
Dream Act rally in Washington, D.C. From the June 9 edition of Fox News’ The O’Reilly Factor: CARLSON: So, at University of California schools – just to get this in. O’REILLY: Right. CARLSON: In 2009, about 35 percent of the in-state tuition people or students were illegals. O’REILLY: Really? That’s an interesting stat, Carlson. [Fox News, The [...]
Adapted from Wikipedia; see Wikipedia for references and additional explanation. Please note that some of this definition may be specific to the U.S. The median household income is commonly used to generate data about geographic areas and divides households into two equal segments with the first half of households earning less than the median [...]
From the Census definition: Median income is the amount which divides the income distribution into two equal groups, half having incomes above the median, half having incomes below the median. The medians for households, families, and unrelated individuals are based on all households, families, and unrelated individuals, respectively. The medians for people are based on [...]
From the U.S. Census definition: The race of individuals was identified by a question that asked for self-identification of the person’s race. Respondents were asked to select their race from a “flashcard” listing racial groups. The population is divided into five groups on the basis of race: White; Black; American Indian, Eskimo or Aleut; Asian [...]
Let’s talk about risk for a second. And in particular, lets talk about bacon. If the article above is to be believed, eating two slices of bacon daily can increase your risk of pancreatic cancer by almost 20%. So here’s a simple question — if you eat bacon daily at those levels, what is your [...]
Imagine a tank of water that has a pipe in and a pipe out. As water flows in, water also flows out. Ignore the flow rates on this diagram, and just think for a minute — if the water level in the tank is rising, what can we say about the inflow and outflow? The [...]
The following tags will be used on posts to indicate the programmatic student learning outcomes they support: SLO-ADS: Apply basic methods of descriptive statistics. SLO-UAS: Use appropriate software to create charts, tables, spreadsheets. SLO-IVD: Read and interpret visually represented data. SLO-DGM: Distinguish among various types of growth models. SLO-CRP: Critically read and interpret quantitative problems. [...]
You Meet a Guy Named John Base rates are extremely important, but we neglect them all the time. In fact, we do worse than that, because we exaggerate the importance of data apart from base rates. In an article about the statistics of predicting marriage success, reporter Laurie Abraham gives a classic example of how we ignore [...]
As part of our focus on doing mental experiments, we want to introduce you to the wonderful world of guesstimating. While guesstimating — the ability to guess at what a statistic might be using only information available to you — is seen by some as a trivial magic trick, in reality it is an extremely [...]
How has student borrowing for education changed over time? Here’s one look at that question, shown as a bar chart: Visually the impact is striking — but as with all comparisons we need to make sure we actually understand the terms of the comparison. First, you need to ask what is being measured. When longitudinal [...]
In the COMPARABLE framework, the “Question of Edges” is a placeholder to remind us that measures of central tendency such as mean, median, and mode are helpful, but only tell us so much. One way to get a sense of the distribution of values is to use quintiles. With quintiles, we start out by imagining [...]
Quick review of our idea of “representativeness”: When we hear a percentage (For example, 41% of college students are male vs. 59% female) used to advance a theory (fewer men want to go to college) we can make predictions based on assumptions (if the reason for the non-representation is lack of applicants then SAT participation [...]
a. Focusing mainly on the idea of survey-based comparison. If Obama is beating Romney in the polls on the edge of MoE, what can we say? What can we not say? b. Show how this applies longitudinally as well – if Obama’s approval rating increases, but the increases is within MoE, what can we say? [...]
a. A cut-point is any point on a continuous scale we use to define a separation between states or conditions. b. Examples: High blood pressure, Failing grades, Psychological conditions based on tests, Recessions. c. Cut-points aren’t arbitrary (usually). But they always involve some non-numerical judgment on what is important. d. In the context of comparison, [...]
a. Pretty standard – getting students to understand what the difference is between these, and when to use each. b. Example: On the retest I jumped from the 40th percentile to the 90th. What does that mean? What does that not mean?
a. Example: The rich pay a larger percentage of tax revenue than anyone else vs. The rich pay a larger percentage of their income than anyone else. b. Dueling percentage redux:
Politicians and media use the terms “bipartisan” and “landslide” all the time. But what do they mean? In this activity you will try to come up with a working, operationalized definition of these terms. 1. Research the use and definitions of these terms. Look at multiple sources. 2. For “bipartisan” find a use that shows [...]
Via Truth & Justice’s Facebook Page. Find a figure (or a couple of figures) on homelessness in America. Find a figure on the number of houses in America. What percentage of houses would have to be unoccupied for this to be true? Does it sound plausible? Do a mental experiment — if we reduced homelessness [...]
The hourly compensation of a typical worker grew in tandem with productivity from 1948–1973. That can be seen in Figure A, which presents both the cumulative growth in productivity per hour worked of the total economy (inclusive of the private sector, government, and nonprofit sector) since 1948 and the cumulative growth in inflation-adjusted hourly compensation for private-sector [...]
Read this: http://www.reuters.com/article/2012/05/01/us-mammograms-risks-idUSBRE84010B20120501 Explain how it can be good for high-risk women to get mammograms, but bad for low-risk women to.
We are interested in how music purchasing behavior has shifted over the recent past. What are the strengths and weaknesses of each graph in helping us understand that? Make sure to specify what each graph controls for. From Jailbreaking the Degree: From Evolver.fm:
There is no excerpt because this is a protected post.
From Promoting Oral Health:The Use of Salt Fluoridation to Prevent Dental Caries by Saskia Estupiñán-Day. This chart shows the incidence of decayed, missing, and filled teeth in children in a town that used fluoridation against a set of control towns that did not. 1. For the purposes of this graph, how was “fluoridation” defined? 2. Would this [...]
The settler Thomas Austin released 24 wild rabbits on his Australian farm, called Barwon Park, in 1859, and some other Australian farmers later followed his example. Rabbits are sexually mature at about six months, and they have a 31-day gestation period. Given a favorable environment, rabbits can easily increase their population fourfold in a year. [...]
In a widely reported study, psychologists found the following: In this study, we had a unique opportunity to examine psychopathy and its correlates in a sample of 203 corporate professionals selected by their companies to participate in management development programs. The correlates included demographic and status variables, as well as in-house 360° assessments and performance [...]
Read the following excerpt from Fat Economics: 1. What is the prevalence of obesity among American children (ages 6 to 13)? 2. What is the prevalence of obesity among Italian children (ages 6 to 13)?
The final Harry Potter film made $1,328,111,219 in 2011. The final Lord of the Rings film made $1,119,929,521 in 2003. Use WolframAlpha to adjust these figures for inflation. Which film had the higher gross, adjusted for inflation?
When we are measuring the price of anything, it’s tempting to measure “list” price — that is, what the asking price of a thing is. In many cases that’s fine — the asking price for a two liter of Diet Coke is most likely the same as the selling price. So if we average what [...]
From Nathan Yau’s Visualize This. This is a great graphic, and as Yau points out in his book it does everything right. It answers a simple question. It annotates what needs to be annotated, and rather than clutter the graph up with reference lines it tries to indicate broad trends in a graceful, uncluttered way. [...]
1. What is the whole of this graph? 2. Assume in Q1 2011 that approximately 8% of people were unemployed by the measure this graph uses. According to the graph, what percentage of people in America have been unemployed 52 weeks or more?
The graph above shows salaries of 2006 graduates of law school as measured in 2007. 1. The study did not include people out of work. How might the graph shape change if it included people out of work? Would the median salary be lower or higher? 2. Look up the term “bimodal distribution”. Does this [...]
To get an A or B in this class, the student must Come to class prepared and participate (20% of grade): Reading quizzes to test preparation (10%) Participation points (awarded for engaged attendance) (10%) This class relies on student participation to work. Missing more than three classes is grounds for failure. Early in the year [...]
The above graph shows average taxes for 15 countries. Notice the difference between the straight average, and the average weighted by population (25.3 vs. 27.2). 1. Do a mental experiment to figure out the following: Does this difference between the weighted average and the straight average mean that a smaller country (or number of smaller [...]
Some people say that we couldn’t have known there was a real estate bubble. But quite a few economists pointed out well before the crash that the “price/rent” ratio — that is, the average cost of owning a house/apartment divided by the average cost of renting — was well outside of historical norms. This led economist [...]
Here are the long term trends in support for same-sex marriage, as pulled from a recent Gallup poll: Questions: 1. The graph shows an increase in support using 1996 as a baseline year. What year would you have to use as a baseline year to show a decrease in support for gay marriage. Draw a [...]
Game of Thrones, Season 2 is getting illegally downloaded. A lot. In fact, it’s on track to be the most pirated show of 2012, and maybe 2011 as well: Maybe that’s interesting to you, maybe not. Here’s what’s interesting to me: notice the horizontal axis of the graph. What this represents is number of days [...]
1. Look at the following graph: Notice the difference between the average tax weighted by population, and the average tax. Make up a set of six imaginary countries with different populations and tax rates where the weighted average tax is less than the unweighted average tax. What trends do you notice? 2. 3. A 2006 [...]
What follows is a COMPARABLE Analysis. As always, remember that the analysis is not an argument about the article — it is a sort of scratchpad of strengths and weaknesses of a comparison that you complete before evaluating it more holistically. Article: More batteries to blame for kids’ ER visits (Reuters Health) – The number [...]
A longitudinal study with 95 newlywed couples examined the power of the Oral History Interview to predict stable marital relationships and divorce. A principal-components analysis of the interview with the couples (Time 1) identified a latent variable, perceived marital bond, that was significant in predicting which couples would remain married or divorce within the first [...]
A recent headline: Here’s how the ACS is implemented (from Wikipedia): The ACS has an initial sample of approximately 3 million housing unit addresses and group quarters in the United States, with sample selected from all counties and county-equivalents, American Indian and Alaska Native area, and Hawaiian Homeland, and in Puerto Rico annually. Data are collected primarily by mail, with follow-ups by [...]
Via http://dailyinfographic.com/ : Questions: 1. “For every 100 single women in their 20s, there are 120 single men” — If this is true, what else might be true? Explain some ways this pattern could occur. Make sure to double check your hypothesis by running a small mental experiment. 2. Come up with an more outlandish theory for [...]
Via http://dailyinfographic.com/ Questions: 1. On average, how many drowning deaths were there in bathtubs, pools, and hot tubs in August? 2. The graphic states that 71% of deaths occurred in May, June, July, and August. If deaths were equally distributed throughout the year, what amount of deaths would we expect in these months instead? 3. Compute [...]
From http://dailyinfographic.com: Questions: “CTR” is “Click-through rate”, and it represents the percentage of people that see a given ad that actually click on it. 1. Assume the figure they cite is correct. 100,000 people see a Facebook ad. How many click the ad? 2. Assume the figure they cite is correct. 100,000 people see a [...]