Getting Around

Hello my name is Jeevan Padiyar. This is my personal and professional blog.  It's a place for me to think out loud and learn, talk about things that inspire me, and share my observations with the world. If you feel like my musings are misguided or just plain wrong please feel free to reach out and correct me. I would relesh the opportunity for discourse. Thanks for visiting.

Who is Jeevan?

 

Other Places you can find me on the web:

Photo Blog

Link Blog

« The statistics of A/B testing pt 1 | Main | Is your company investible? »
Sunday
Aug292010

Is your data lying to you?

As the book industry continues to change, we are inundated with statistics about user behavior:

  • 49% of e-book readers are bought as gifts [Bowker]
  • 28% of US adults are avid (5+ hours/week) readers [Verso] - 64MM avid readers
  • The heart of the U.S. romance novel readership is women aged 31-49 who are currently in a romantic relationship. [Romance Writers of America]

These statistical nuggets are great because in isolation they give us a glimpse into why people do what they do, and how we can adjust our business to match market needs. But how often do we blindly accept data because it comes with pretty graphs and sound bites that seem to make sense? Probably more often than we'd like to admit.

The best way to ensure that we are not led astray, is to look at what biases have been introduced into a study before using its data to make a decision.   Bias is systematic favoritism in the data collection process which causes misleading results.  Two types of bias are hazards in studies: selection bias and measurement bias.

  • Selection Bias can occur when the group that is surveyed does not accurately reflect the target of the study, or is simply too small to matter. For example, if a study claims to describe the behavior of all readers in the U.S. but only surveys 30 stay-at-home moms in Indiana, it is hardly representative of every reader in the country.
  • Measurement Bias occurs when the questions asked favor a specific outcome. A survey question like "Do you agree that e-books are replacing print books as the preferred medium?" will deliver very different results than one that asks readers to choose their preferred medium from among e-books, purchased p-books or books checked out from the library.

As you read a study, ask yourself the following questions to determine if the authors tried to mitigate bias. Remember: the target population is the group that you want to generalize about, and the sample is the group that you actually survey in order to make those generalizations.

1.       Is the target population (sometimes called the sampling frame) well-defined? If it isn't, the study may contain people outside the target, or it may exclude people who are relevant. In researching e-book reader purchase behavior, a well-defined population could be American consumers who purchased an e-book reader either online or in a physical store over the last 2 years. But if a study only looked at online shoppers at Christmas, the results could be skewed towards gift givers, and they could not be generalized to consumers who bought e-book readers in stores.

2.       Is the sample randomly selected from the target population?  In a truly random sample, every member of the target population has the same chance of being included in the study. When asking this question be wary of surveys that are conducted exclusively on the web, but draw generalizations about all people. These types of studies have participants that are not randomly selected, as they only capture a slice of the traffic to a given domain, and at best can only ever speak to the habits of the users of the particular site conducting research.

3.       Does the sample represent the target population? Here it is important to look at all of the characteristics of the target population to see if they are mirrored in the sample. If you are looking to figure out the book purchase habits of Americans, make sure the sample has the same diversity of ethnicity, geographic distribution and age as is reported in the latest U.S. census. 

4.       Is the sample large enough? The larger the sample the more accurate the results. A quick way to estimate if a sample is large enough to produce a reasonably small margin of error is to divide 1 by the square root of the sample size (Margin of Error=√Sample Size). So a 1,500 person survey would produce a margin of error of 2.58%. It is also important that the sample size in this calculation be the number of people who responded to survey, not the number of survey requests that were sent out.

5.       What is the response rate for the survey? The response rate is defined as the number of people in a target population who actually responded to a given survey.  If the response rate is too low, a study may only reflect people who have a strong opinion about the topic, making the results biased toward their opinions and not the larger and less vociferous target population. A "good" response rate is dependent upon the margin of error that a study is looking to achieve (or that it claims), and the size of the target population being studied. There are two factors to consider here. The first one is a no-brainer: The higher the response rate, the more accurate the study. The second is a little more subtle. The larger the target poplulation being examined, the lower the response rate required for the same level of accuracy. The  linked figure helps explain the correlation graphically. (According to the chart, for a study that is looking to achieve a margin of error of +/- 5%, and is studying a population of 2000 people, the response rate needs to approach 20% to achieve the desired result.) At the end of the day, know the response rate and make sure it closely matches the stated margin of error that study purports to achieve.

6.       Do the questions appear to be leading the respondents into a particular answer? If they do, run the other way! This means that the researchers' agenda is adding a measurement bias and the results aren't worth the paper they are printed on. Also be wary of any study that doesn't share its sampling method, sample characteristics and survey questions.

In the end, the goal of a survey is to accurately describe a larger population. This can only be done if great care is taken to 1) ensure that the results wouldn't change much if another sample was taken under the same conditions and to 2) reduce biases that can be introduced into the system.



PrintView Printer Friendly Version

Reader Comments (5)

Picking Out phon sacs a main is uncheckable at metres because no official blueprint exists for manufacturing a Coach bag. Thus a detail on one authentic bag may be completely unfitting with the details on another analogous and equally honest-to-god bag. And it is this Coach truth that makes differentiating the genuine from the phony bags tall at times, and it is also what concessions the scammers a lot of joggle room when formulating the fictitious bags. The idea behind this cosmos of hedged bean sac is to make chichi furnishings vente de sacs that can be raisable. Nowadays people are fed up of the furniture that is hard to shift from one place to another. However you can shift the emplacement of these bean sacks without any difficulty. That is one of the main rationalities why this sac a main pas cher production is widely used by people all over the domain. They are very handy bags that also meliorate the look of your house. They are forthcoming in out-of-the-way sizes and shapes in the market. Moreover they are gettable in divers types as well. These types accept bean sacks for seats, dalliers and other furnishings as well. Then the name of a fool vente de sacs chair was holometabolic from foot chair to FUF chair. But the chair stiffs the same and no lively change was made; only the name was adjusted. Both foof chair and love sac are same in coming into court. Both sac a main chair and love sac are made of memory foam and both will come in odd size and shape. The bean bag chair is entirely antithetic from Fofo chair and love sac. The bean bag is made of polystyrene pearls and the fool chair and love sac is made of memory foam. While equating the bean bag chair and vente de sacs chair and love sac the chair will less favourable than fool chair and love sac and the chair pull in a trend to flatten by transit of time.

June 13, 2011 | Unregistered Commentersac a main pas cher

Thank you for this article. That's all I can say. You most definitely have made this blog into something special. You clearly know what you are doing, you've covered so many

bases.Thanks!
Personalized Steelers Jersey on sale
Wes Welker Jersey
Youth Patriots Jersey
joe flacco jersey
antonio brown ersey authentic

84 pittsburgh steelers white reebok nfl jersey

November 18, 2011 | Unregistered CommenterNew England Patriots Jerseys

Arizona Cardinals quarterback Kevin Kolb said he was able topractice "a Authentic Maurkice Pouncey Jersey little Authentic Dez Bryant Jersey bit" on Wednesday after tests Authentic Cedric Benson Jersey evaluating theconcussion he sustained early in Sunday's Authentic Mark Ingram Jersey victory over SanFrancisco."The symptoms are down," he said. "It's just a matter ofmaking sure they are Authentic Brian Urlacher Jersey down long enough to where I can Authentic Rey Maualuga Jersey get out thereand then be in full-speed action. That's the key right now. It's atouchy subject, Authentic Antonio Brown Jersey and we want Authentic Ryan Clark Jersey to make sure that we err on Authentic Darren McFadden Jersey the rightside."Unlike the situation with the Cleveland Browns and theirquarterback, Colt McCoy, the Cardinals benched Kolb after he took Official Nick Collins Jersey aknee to the head on Arizona's third offensive play against the49ers. Authentic Johnny Knox Jersey He immediately Authentic Patrick Chung Jersey went Authentic Ziggy Hood Jersey to the locker room for evaluation and itwas determined he should not return to Authentic Rob Gronkowski Jersey the game."I don't know Authentic Jason Witten Jersey how they handled it in Cleveland," Authentic Richard Seymour Jersey Arizona coachKen Whisenhunt said. "All Authentic Robert Meachem Jersey I Authentic Michael Oher Jersey can speak about is the way our guysdid it Authentic Johnathan Joseph Jersey and they did a great job with it. ... The number one thingis, if there is ever a doubt, Authentic Brian Urlacher Jersey you err to Authentic Troy Polamalu Jersey the side of caution Authentic Arian Foster Jersey andthat's the way we are going to proceed."Kolb said he plans to practice more Authentic Keiland Williams Jersey as Authentic Devin Hester Jersey the Authentic Ray Rice Jersey week goes on in hopesof being able to play Sunday against Authentic Jarret Johnson Jersey the Browns.He said the football culture is better Official Stanford Routt Jersey at dealing withconcussions than it used Authentic Andy Dalton Jersey to be."I think that Authentic Tom Brady Jersey there Authentic Wes Welker Jersey are so Authentic Torrey Smith Jersey many studies coming Authentic Ndamukong Suh Jersey out now thatprove long-term effects Authentic Devin Hester Jersey and Authentic Jermaine Gresham Jersey things like that," Kolb said."Obviously, our health is Authentic Jacoby Ford Jersey number Authentic Jay Cutler Jersey one, especially when it comes Authentic Calvin Johnson Jersey toyour brain. I want to be out there as Authentic Bernard Scott Jersey much as anybody, but it'sjust something you don't Authentic A.J. Green Jersey push."This is Kolb's second concussion in as Authentic Jerod Mayo Jersey many seasons. He wassidelined with one after he started last season's opener forPhiladelphia and wound up losing the starting job Authentic Israel Idonije Jersey to hisreplacement, Authentic Israel Idonije Jersey Michael Vick. That eventually led to the trade thatbrought Kolb to Arizona.Under Authentic Charles Woodson Jersey the NFL's revised rules, Kolb was required to see a doctornot affiliated with the Authentic Matt Schaub Jersey Cardinals Authentic Nick Fairley Jersey to have his conditionindependently evaluated. He Authentic Tony Scheffler Jersey said he did so on Tuesday and that thevisit "went good."Kolb said some of the symptoms of a concussion don't begin toshow up for him until Authentic Andre Smith Jersey the adrenaline of the football game begins Authentic Matthew Stafford Jersey tofade."When your adrenaline is going, when you are in the game, Authentic Joe Flacco Jersey itcovers up," he said. "It Authentic Pierre Thomas Jersey tends to cover up some of the symptoms.As you start calming down, during Authentic Michael Oher Jersey or Authentic Haloti Ngata Jersey after the game, then, from myexperience, a lot Authentic Ray Lewis Jersey of things start to rush on you; the vision, thesensitivity to light and noise, and all those things."Kolb was Authentic Aaron Hernandez Jersey making Authentic Joe Flacco Jersey just his second start after being sidelined forsix games with a right Authentic B.J. Raji Jersey turf toe Authentic Chad Ochocinco Jersey and Authentic Jahvid Best Jersey bruise to the Authentic Rob Gronkowski Jersey side of that samefoot. The previous week, he had come on strong in Authentic Rashard Mendenhall Jersey the second Authentic DeMarcus Ware Jersey halfto help Arizona beat Dallas in overtime."It's Authentic Mike Wallace Jersey beyond frustrating, just because we played a Authentic Clay Matthews Jersey good secondhalf there against the Cowboys and had a good Authentic Marques Colston Jersey week at practice,"he said. "We were ready to go out there and do what we ended updoing, which is great for our team. I wish I could have been a partof it, but they did a great job again of picking right up androlling along."John Skelton Authentic Ray Lewis Jersey relieved Kolb last Sunday and threw three touchdownpasses as the Cardinals Authentic Tom Brady Jersey rallied to beat the 49ers Authentic Michael Huff Jersey 21-19.Arizona has won three in a row and five of six. Official Carson Palmer Jersey A victory Sundaywould even the Cardinals' season record at 7-7 with two Authentic Aaron Rodgers Jersey games toplay.

December 14, 2011 | Unregistered CommenterMike Wallace Jersey Outlet

With NFL games enjoying seemingly invincible Maurkice Pouncey Jersey Outlet ratings while mosteverything Cheap Julius Peppers Jersey else on TV goes down, down, down, the league'straditional broadcast partners embraced a Cheap Ricky Williams Jersey deal that sends theirrights fees up, up, up.CBS, Fox and NBC renewed their contracts for nine years throughthe 2022 season, the NFL announced Wednesday. The average fees fromthe Cheap Pierre Thomas Jersey three networks will increase by an average of 7 percentannually, a person familiar with the details said. Cheap Mike Jenkins Jersey That will takethe total revenue from them from the current $1.93 billion per yearto $3.1 billion by 2022.The person spoke Cheap Jacoby Jones Jersey on Jordy Nelson Jersey Authentic condition of Cheap Wes Welker Jersey anonymity because the figuresweren't made public.The current agreements expire Cheap Tom Brady Jersey after the 2013 season."(The deals) will Cheap Cedric Benson Jersey ensure Cheap Robert Meachem Jersey the NFL will stay on free televisionfor another 11 Cheap Tony Romo Jersey years, which I think is great Rashard Mendenhall Jersey Outlet for fans,"Commissioner Roger Goodell said at the Troy Polamalu Jersey Outlet owners' meetings outsideDallas. "It will continue Mike Wallace Jersey Outlet to allow us to grow our audience. It's atribute to the players and (union Cheap Roman Harper Jersey chief DeMaurice) Ray Lewis Jersey Outlet Smith forextending our labor agreement for 10 Jerod Mayo Jersey Outlet years. I think that kind ofstability gave us the ability to get these contractextensions."Earlier this season, the Denarius Moore Jersey Authentic NFL and ESPN reached Cheap Lardarius Webb Jersey an eight-yearextension to keep Cheap Matt Schaub Jersey "Monday Night Football" on the cable channelthrough Julius Peppers Jersey Outlet the 2021 season, increasing the rights fee from $1.1 to Terrelle Pryor Jersey Authentic 1.9billion annually.The new contracts also will allow NFL Network to expand thenumber of Thursday night games it airs beginning next year. Thecurrent schedule includes eight games during the second half of Cheap Chad Ochocinco Jersey theseason.Goodell said the broadcast committee hadn't Cheap Johnny Knox Jersey yet decided onwhether to create a separate Thursday package to sell to an outsidenetwork.NFL games account for 23 of the 25 most-watched programs amongall television shows this fall and draw more than Michael Oher Jersey Outlet twice as manyaverage viewers as broadcast prime-time shows. No wonder Jermichael Finley Jersey Authentic networkexecutives piled on the superlatives Wednesday."This is incredibly powerful programming," said Cheap Marques Colston Jersey NBC SportsGroup Chairman Mark Lazarus."It's as sure as you can get with anything today," said FoxSports Co-President Eric Shanks."It's an unbelievably important product to associate ourselveswith," said CBS Sports Authentic Terrelle Pryor Jersey Chairman Sean McManus.The Cheap Tyron Smith Jersey three networks will each televise Joe Flacco Jersey Outlet three Super Bowls duringthe length of the contracts, continuing the current rotation.The nine-year terms are John Kuhn Jersey Authentic the longest for NFL televisionagreements with Authentic Michael Huff Jersey over-the-air networks. The previous longest werethe eight-year deals with CBS, Fox and ABC from 1998-2005."With live broadcasts becoming more and Cheap Miles Austin Jersey more important, havingthe cream of the crop Cheap Nick Fairley Jersey of live programing for the next 11 years ispretty Cheap Matt Forte Jersey incredible," Shanks said.Locking in the NFL is the cornerstone Ray Rice Jersey Outlet for the rest Rob Gronkowski Jersey Outlet of networks'economic planning, he Johnny Knox Jersey Outlet said."I'm sure even today Cheap Ray Lewis Jersey our Matt Forte Jersey Outlet ad sales Wes Welker Jersey Outlet guys' phones are ringing offthe hook, even though the deal doesn't start for another twoyears," Shanks said.CBS will continue Cheap Rey Maualuga Jersey to show the AFC package on Sunday afternoonsas it has since 1998, while Fox Greg Jennings Jersey Authentic still has the NFC Terrell Suggs Jersey Outlet package that itfirst acquired in 1994."Sunday Night Football" will remain on NBC, Cheap Patrick Chung Jersey which picked it upin 2006. The network will add the annual Thanksgiving prime-timegame starting in 2012, exchange Ryan Grant Jersey Authentic one of its current wild- cardmatchups for a divisional playoff game, and create a Sunday morningpregame show in 2014 on NBC Sports Tom Brady Jersey Outlet Network (the future Michael Bush Jersey Authentic name ofcable partner Versus).It also gets three Super Bowls Cheap Jay Ratliff Jersey in nine years compared with twoin eight seasons Cheap Ray Rice Jersey under the old deal.The Thanksgiving night Cheap Lance Briggs Jersey game had been on NFL Network."It's Lance Briggs Jersey Outlet one of the most Authentic Michael Bush Jersey important advertising Nick Collins Jersey Authentic days of the year,"Lazarus said. "We think this will elevate Thanksgiving not onlyfor NBC Cheap Mark Ingram Jersey but for the NFL."Flexible scheduling will stay in effect to ensure qualitylate-season matchups on Sunday late afternoons and nights. It James Starks Jersey Authentic willbe expanded in 2014 to allow some AFC games to air Ryan Clark Jersey Outlet on Fox and NFCgames Cheap Tony Scheffler Jersey on CBS, and for NBC to start switching out its prime-timematchups earlier in the Cheap Johnathan Joseph Jersey season.Shanks said the "cross-flexing" would allow more of thecountry to see certain appealing matchups.The Cheap Michael Oher Jersey deals include "TV everywhere" rights Cheap Jermaine Gresham Jersey for the networks tosimulcast games online and on tablets - though not mobile phones,for Sebastian Janikowski Jersey Authentic which Verizon has a separate Cheap Roy Williams Jersey agreement.McManus acknowledged the NFL had Cheap Terence Newman Jersey become "increasingly morevaluable.""To know there's labor peace," he said. "To Cheap Terrell Suggs Jersey know the ratingshave just been Cheap Rob Gronkowski Jersey so consistent year Cheap Keiland Williams Jersey after year after year, and adgrowth has been so consistent year after year after year."

December 14, 2011 | Unregistered CommenterMike Wallace Jersey Outlet

Authentic Jerod Mayo Jersey, Jordy Nelson Jersey, Authentic Haloti Ngata Jersey, New Orleans Saints Jersey Outlet, Cheap Troy Polamalu Jersey, Jordy Nelson Jersey Authentic, Cheap Brian Urlacher Jersey, Drew Brees Jersey On Sale, Joe Flacco Jersey, Ray Lewis Jersey, Jimmy Graham Jersey, Cheap Jimmy Graham Jersey, Jimmy Graham Jersey, Troy Polamalu Jersey, Troy Polamalu Jersey, Cheap Drew Brees Jersey, Clay Matthews Jersey Authentic, Jimmy Graham Jersey, Cheap Devin Hester Jersey, Cheap Bears Jerseys On Sale, Green Bay Packers Jersey Cheap on Sale, San Francisco 49ers Jersey outlet, Cheap Mike Wallace Jersey, Clay Matthews Jersey, Cheap Matthew Stafford Jersey, Cheap Packers Jerseys On Sale, Aaron Rodgers Jersey On Sale, Steelers Jerseys Authentic, Authentic Joe Flacco Jersey, Jimmy Graham Jersey On Sale, Authentic Detroit Lions Jersey, Authentic Ray Lewis Jersey, Authentic Troy Polamalu Jersey, Brian Westbrook Jersey Youth, Cheap Saints Jerseys On Sale, Drew Brees Jersey On Sale, Authentic Tim Tebow Jersey, Devin Hester Jersey, Calvin Johnson Jersey, Brandon Marshall Jersey, Jimmy Graham Jersey, Patriots Jerseys Authentic, Authentic Rob Gronkowski Jersey, Authentic Drew Brees Jersey, Authentic Haloti Ngata Jersey, Jimmy Graham Jersey On Sale, Authentic Brandon Marshall Jersey, Tom Brady Jersey, Ravens Jerseys Authentic, Aaron Rodgers Jersey, New Orleans Saints Jersey on Sale, Victor Cruz Jersey on Sale, Denver Broncos Jersey outlet, Authentic Jimmy Graham Jersey, Jason Pierre-Paul Jersey on Sale, Authentic Mike Wallace Jersey, Alex Smith Jersey, Cheap Ndamukong Suh Jersey, Patrick Willis Jersey, Eli Manning Jersey

PostPost a New Comment

Enter your information below to add a new comment.

My response is on my own website »
Author Email (optional):
Author URL (optional):
Post:
 
Some HTML allowed: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <strike> <strong>