Skip to Main Content
HBS Online
  • Courses
    Open Courses Mega Menu
    • Business Essentials
      • Credential of Readiness (CORe)
      • Business Analytics
      • Economics for Managers
      • Financial Accounting
    • Leadership & Management
      • Leadership Principles
      • Management Essentials
      • Negotiation Mastery
      • Organizational Leadership
      • Strategy Execution
      • Power and Influence for Positive Impact
      • Leadership, Ethics, and Corporate Accountability
      • Leading Change and Organizational Renewal
      • Dynamic Teaming
      • Transforming Customer Experiences
    • Credential of Leadership, Impact, and Management in Business (CLIMB)
    • Credential of Digital Innovation and Strategy
    • Entrepreneurship & Innovation
      • Entrepreneurship Essentials
      • Disruptive Strategy
      • Negotiation Mastery
      • Design Thinking and Innovation
      • Launching Tech Ventures
      • Winning with Digital Platforms
      • Leading Change and Organizational Renewal
      • Entrepreneurial Marketing
      • Transforming Customer Experiences
    • Strategy
      • Strategy Execution
      • Business Strategy
      • Economics for Managers
      • Disruptive Strategy
      • Global Business
      • Sustainable Business Strategy
    • Marketing
      • Digital Marketing Strategy
      • Creating Brand Value
      • Entrepreneurial Marketing
    • Digital Transformation
      • Winning with Digital Platforms
      • AI Essentials for Business
    • Finance & Accounting
      • Financial Accounting
      • Leading with Finance
      • Alternative Investments
      • Sustainable Investing
      • Strategic Financial Analysis
    • Business in Society
      • Sustainable Business Strategy
      • Global Business
      • Sustainable Investing
      • Power and Influence for Positive Impact
      • Leadership, Ethics, and Corporate Accountability
      • Business and Climate Change
    • All Courses
  • For Organizations
    Open For Organizations Mega Menu
    • Corporate Learning
      Help your employees master essential business concepts, improve effectiveness, and expand leadership capabilities.
    • Academic Solutions
      Integrate HBS Online courses into your curriculum to support programs and create unique educational opportunities.
    • Need Help?
      • Frequently Asked Questions
      • Contact Us
    • Insights
      Open Insights Mega Menu
      • Business Insights Blog
        • Career Development
        • Communication
        • Decision-Making
        • Earning Your MBA
        • Entrepreneurship & Innovation
        • Finance
        • Leadership
        • Management
        • Negotiation
        • Strategy
      • All Topics
      • Learner on computer exploring HBS Online business lessons
        Sample Business Lessons and E-Books

        Gain new insights and knowledge from leading faculty and industry experts.

      • HBS Online Parlor Room podcast logo
        Podcast

        The Parlor Room: Where business concepts come to life. Listen now on your favorite podcast platform.

    • More Info
      Open More Info Mega Menu
      • Learning Experience
        Master real-world business skills with our immersive platform and engaged community.
      • Certificates, Credentials, & Credits
        Learn how completing courses can boost your resume and move your career forward.
      • Learning Tracks
        Take your career to the next level with this specialization.
      • Financing & Policies
        • Employer Reimbursement
        • Payment & Financial Aid
        • Policies
      • Connect
        • Student Stories
        • Community
      • Need Help?
        • Frequently Asked Questions
        • Request Information
        • Support Portal
      • Enroll Now
    Login
    My Courses
    Access your courses and engage with your peers
    My Account
    Manage your account, enrollment, and payments.
    HBS Home
    • About HBS
    • Academic Programs
    • Alumni
    • Faculty & Research
    • Baker Library
    • Giving
    • Harvard Business Review
    • Initiatives
    • News
    • Recruit
    • Map / Directions
    HBS Online
    • Courses
    • Business Essentials
    • Leadership & Management
    • Credential of Leadership, Impact, and Management in Business (CLIMB)
    • Credential of Digital Innovation and Strategy
    • Entrepreneurship & Innovation
    • Strategy
    • Marketing
    • Digital Transformation
    • Finance & Accounting
    • Business in Society
    • For Organizations
    • Insights
    • More Info
    • About
    • Support Portal
    • Media Coverage
    • Founding Donors
    • Leadership Team
    • Careers
    • My Courses
    • My Account
    • Enroll Now
    • …→
    • Harvard Business School→
    • HBS Online→
    • Business Insights→

    Business Insights

    Harvard Business School Online's Business Insights Blog provides the career insights you need to achieve your goals and gain confidence in your business skills.

     
    Filter Results Arrow Down Arrow Up

    Topics

    Topics

    • Accounting
    • Analytics
    • Business Essentials
    • Business in Society
    • Career Development
    • Communication
    • Community
    • ConneXt
    • Decision-Making
    • Digital Transformation
    • Earning Your MBA
    • Entrepreneurship & Innovation
    • Finance
    • Leadership
    • Management
    • Marketing
    • Negotiation
    • News & Events
    • Productivity
    • Staff Spotlight
    • Strategy
    • Student Profiles
    • Technology
    • Work-Life Balance

    Courses

    Courses

    • AI Essentials for Business
    • Alternative Investments
    • Business Analytics
    • Business Strategy
    • Business and Climate Change
    • CLIMB
    • CORe
    • Creating Brand Value
    • Credential of Digital Innovation and Strategy
    • Design Thinking and Innovation
    • Digital Marketing Strategy
    • Disruptive Strategy
    • Dynamic Teaming
    • Economics for Managers
    • Entrepreneurial Marketing
    • Entrepreneurship Essentials
    • Financial Accounting
    • Global Business
    • Launching Tech Ventures
    • Leadership Principles
    • Leadership, Ethics, and Corporate Accountability
    • Leading Change and Organizational Renewal
    • Leading with Finance
    • Management Essentials
    • Negotiation Mastery
    • Organizational Leadership
    • Power and Influence for Positive Impact
    • Strategic Financial Analysis
    • Strategy Execution
    • Sustainable Business Strategy
    • Sustainable Investing
    • Transforming Customer Experiences
    • Winning with Digital Platforms
    Subscribe to the Blog
    *
    Please complete this required field.
    Email must be formatted correctly.
    Please complete all required fields.
    RSS feed

    Filters

    Topics

    Topics

    • Accounting
    • Analytics
    • Business Essentials
    • Business in Society
    • Career Development
    • Communication
    • Community
    • ConneXt
    • Decision-Making
    • Digital Transformation
    • Earning Your MBA
    • Entrepreneurship & Innovation
    • Finance
    • Leadership
    • Management
    • Marketing
    • Negotiation
    • News & Events
    • Productivity
    • Staff Spotlight
    • Strategy
    • Student Profiles
    • Technology
    • Work-Life Balance

    Courses

    Courses

    • AI Essentials for Business
    • Alternative Investments
    • Business Analytics
    • Business Strategy
    • Business and Climate Change
    • CLIMB
    • CORe
    • Creating Brand Value
    • Credential of Digital Innovation and Strategy
    • Design Thinking and Innovation
    • Digital Marketing Strategy
    • Disruptive Strategy
    • Dynamic Teaming
    • Economics for Managers
    • Entrepreneurial Marketing
    • Entrepreneurship Essentials
    • Financial Accounting
    • Global Business
    • Launching Tech Ventures
    • Leadership Principles
    • Leadership, Ethics, and Corporate Accountability
    • Leading Change and Organizational Renewal
    • Leading with Finance
    • Management Essentials
    • Negotiation Mastery
    • Organizational Leadership
    • Power and Influence for Positive Impact
    • Strategic Financial Analysis
    • Strategy Execution
    • Sustainable Business Strategy
    • Sustainable Investing
    • Transforming Customer Experiences
    • Winning with Digital Platforms
    Subscribe to the Blog
    *
    Please complete this required field.
    Email must be formatted correctly.
    Please complete all required fields.
    RSS feed

    5 Types of Statistical Bias to Avoid in Your Analyses

    3 hands filling out a survey
    • 13 Jun 2017
    Jenny Gutbezahl Author Staff
    tag
    • Analytics
    • Business Analytics

    In statistics, researchers draw a sample from a population and use their observations to make generalizations about the entire population. For example, you might present a subset of visitors with different versions of a web page to get an estimate of how all visitors to the page would react to each version.

    Because there’s always random variability, or error, the sample can’t be expected to be a perfect representation of the population. However, if it's a reasonably large, well-selected sample, you can expect that the statistics you calculate from it are fair estimates of the population parameters.

    Even so, certain factors can influence the sampling and collection of data, causing the resulting statistic or model to be unrepresentative of the population. These factors, or biases, are common and can result in unreliable analyses.

    What Is Statistical Bias?

    Statistical bias is anything that leads to a systematic difference between the true parameters of a population and the statistics used to estimate those parameters. In other words, bias refers to a flaw in the experiment design or data collection process, which generates results that don’t accurately represent the population.

    In business, statistics are commonly used to aid the decision-making process. For example, a manager at a healthcare clinic might use historical data to project how many patients are expected to visit in a week to estimate staffing needs. Several forms of bias, however, have the potential to impact this analysis, causing the manager to make a decision based on faulty information—and possibly bring serious consequences to the business.

    Here are three of the most common types of bias and what can be done to minimize their effects.

    Related: The Advantages of Data-Driven Decision Making

    Types of Statistical Bias to Avoid

    1. Sampling Bias

    In an unbiased random sample, every case in the population should have an equal likelihood of being part of the sample. However, most data selection methods are not truly random.

    Take exit polling, for example. In exit polling, volunteers stop people as they leave a polling place and ask them who they voted for. This method leads to the exclusion of those who vote by absentee ballot. Furthermore, research suggests the volunteers are more likely to gather data from people similar to themselves.

    Polling volunteers are more likely to be young, college-educated, and white compared to the general population. It's understandable that a white college student would be more likely to approach someone who looks like they could be one of their classmates than a middle-aged woman, struggling to keep three children under control. This means not every person has the same chance of being selected for an exit poll.

    2. Bias in Assignment

    In a well-designed experiment, where two or more groups are treated differently and then compared, it’s important that there aren’t pre-existing differences between groups. Every case in the sample should have an equal likelihood of being assigned to each experimental condition.

    Let's say the creators of an online business course think that the more times they get a visitor to come to their website, the more likely they are to enroll. In fact, people who visit the site five times are more likely to enroll than people who visit three times, who are, in turn, more likely to enroll than people who visit only once.

    One might mistakenly conclude that more site visits lead to more enrollment. However, there are systematic differences between the groups that precede their visits to the site. The same factors that motivate a potential student to visit the site five times, rather than once, may also make them more likely to enroll in the course. Because each person didn’t have an equal chance of being in each experimental group—visiting the site five, three, and one time, respectively—it can’t be concluded that the number of site visits leads to enrollment in the course.

    Business Analytics | Become a data-driven leader | Learn More

    3. Omitted Variables

    When analyzing trends in data, it’s important to consider all variables, including those not accounted for in the experimental design. Just because two variables are correlated doesn’t mean one caused the other—there could be additional variables at play.

    For example, in 1980, Robert Matthews discovered an extremely high correlation between the number of storks in various European countries and the human birth rates in those countries. Using Holland as an example, where only four pairs of storks were living in 1980, the birth rate was less than 200,000 per year; while Turkey, with a shocking 25,000 pairs of storks had a birth rate of 1.5 million per year.

    The correlation between the two variables was an extremely significant 0.62. Matthews used this example—drawing from the myth that storks deliver newborn babies—to illustrate that correlation doesn’t imply causation. The high correlation between the two variables doesn’t imply that a high stork population causes an increase in birth rate. Rather, there’s a third variable at play: geographic area. Large countries have more people living in them—hence higher birth rates and a higher stork population.

    Rerunning the analysis and including area as an independent variable solves this mystery. While it may not be possible to identify all omitted variables, a good research model explores all variables that might impact the dependent variable.

    4. Self-Serving Bias

    One phenomenon to keep in mind when analyzing survey data is self-serving bias. When asked to self-report, people tend to downplay the qualities they perceive to be less desirable and overemphasize qualities they perceive to be desirable.

    For example, a study might find a strong positive correlation between being a good driver and being good at math. However, if the data were collected using a self-report tool, such as a survey, the correlation could be a side effect of self-serving bias. People who are trying to present themselves in the best possible light might overstate their driving ability and their math aptitude.

    5. Experimenter Expectations

    If researchers have pre-existing ideas about the results of a study, they can accidentally have an impact on the data, even if they're trying to remain objective. For example, interviewers or focus group facilitators can subtly influence participants through unconscious verbal or non-verbal cues.

    Experimenter effects have even been observed with non-human participants. In 1907, a horse named Clever Hans was famous for successfully completing complex mathematical operations and tapping out the answer with his hoof. It was later discovered that he was responding to the involuntary body language of the person posing the problems. To avoid experimenter bias, studies that require human intervention to gather data often use blind data collectors who don't know what’s being tested.

    A Beginner's Guide to Data and Analytics | Access Your Free E-Book | Download Now

    Better Data for Better Business Decisions

    Although it’s difficult to completely avoid bias, it’s critical that analysts, data scientists, and other business professionals are aware of its sources so they can minimize its effects.

    Paying close attention to the data collection process and analysis can help you identify possible flaws and reduce their impact on the final results. Doing so can lead to better models and more reliable insights. Armed with these insights, you can make data-backed business decisions that keep your organization moving in the right direction.

    To learn how to unlock the power of your organization’s data, explore our eight-week online course Business Analytics or download our Beginner’s Guide to Data & Analytics.

    This post was updated on February 2, 2021. It was originally published on June 13, 2017.

    About the Author

    Jenny is a former member of the Course Delivery team who worked on the Business Analytics course for the Credential of Readiness (CORe) program. Jenny holds a B.F.A. in theater from New York University and a Ph.D. in Social Psychology from the University of Massachusetts at Amherst. She's active in the greater Boston arts and theater community and enjoys solving and creating diabolically difficult word puzzles.
     
    All FAQs

    Top FAQs

    How are HBS Online courses delivered?

    +–

    We offer self-paced programs (with weekly deadlines) on the HBS Online course platform.

    Our platform features short, highly produced videos of HBS faculty and guest business experts, interactive graphs and exercises, cold calls to keep you engaged, and opportunities to contribute to a vibrant online community.

    Are HBS Online programs available in languages other than English?

    +–

    We expect to offer our courses in additional languages in the future but, at this time, HBS Online can only be provided in English.

    All course content is delivered in written English. Closed captioning in English is available for all videos. There are no live interactions during the course that requires the learner to speak English. Coursework must be completed in English.

    Do I need to come to campus to participate in HBS Online programs?

    +–

    No, all of our programs are 100 percent online, and available to participants regardless of their location.

    How do I enroll in a course?

    +–

    Certificate Programs

    HBS Online welcomes committed learners wherever they are—in the world and their careers—irrespective of their professional experience or academic background. To extend the reach of HBS Online, we no longer require an application for our certificate programs. (Applications are still required for our credential programs: CORe and CLIMB.) You can now immediately enroll and start taking the next step in your career.

    All programs require the completion of a brief online enrollment form before payment. If you are new to HBS Online, you will be required to set up an account before enrolling in the program of your choice.

    Our easy online enrollment form is free, and no special documentation is required. All participants must be at least 18 years of age, proficient in English, and committed to learning and engaging with fellow participants throughout the program.

    Updates to your enrollment status will be shown on your account page. HBS Online does not use race, gender, ethnicity, or any protected class as criteria for enrollment for any HBS Online program.

    Credential Programs

    HBS Online's CORe and CLIMB programs require the completion of a brief application. The applications vary slightly, but all ask for some personal background information. You can apply for and enroll in programs here. If you are new to HBS Online, you will be required to set up an account before starting an application for the program of your choice.

    Our easy online application is free, and no special documentation is required. All participants must be at least 18 years of age, proficient in English, and committed to learning and engaging with fellow participants throughout the program.

    Updates to your application and enrollment status will be shown on your account page. We confirm enrollment eligibility within one week of your application for CORe and three weeks for CLIMB. HBS Online does not use race, gender, ethnicity, or any protected class as criteria for admissions for any HBS Online program.

    Does Harvard Business School Online offer an online MBA?

    +–

    No, Harvard Business School Online offers business certificate programs.

    What are my payment options?

    +–

    We accept payments via credit card, wire transfer, Western Union, and (when available) bank loan. Some candidates may qualify for scholarships or financial aid, which will be credited against the Program Fee once eligibility is determined. Please refer to the Payment & Financial Aid page for further information.

    We also allow you to split your payment across 2 separate credit card transactions or send a payment link email to another person on your behalf. If splitting your payment into 2 transactions, a minimum payment of $350 is required for the first transaction.

    In all cases, net Program Fees must be paid in full (in US Dollars) to complete registration.

    What are the policies for refunds and deferrals?

    +–

    After enrolling in a program, you may request a withdrawal with refund (minus a $100 nonrefundable enrollment fee) up until 24 hours after the start of your program. Please review the Program Policies page for more details on refunds and deferrals. If your employer has contracted with HBS Online for participation in a program, or if you elect to enroll in the undergraduate credit option of the Credential of Readiness (CORe) program, note that policies for these options may differ.

     

    Sign up for News & Announcements


    • • Please complete this required field.
    • • Email must be formatted correctly.
    • • Please complete all required fields.

    Subject Areas

    • Business Essentials
    • Leadership & Management
    • Entrepreneurship & Innovation
    • Strategy
    • Marketing
    • Finance & Accounting
    • Business & Society
    • Digital Transformation

    Quick Links

    • FAQs
    • Contact Us
    • Request Info
    • Enroll Now
    • Support Portal

    About

    • About Us
    • Media Coverage
    • Founding Donors
    • Leadership Team
    • Careers @ HBS Online

    Legal

    • Legal
    • Policies
    Harvard Business School
    Copyright © President & Fellows of Harvard College
    • Site Map
    • Trademark Notice
    • Digital Accessibility