Skip to Main Content
HBS Online
  • Courses
    Open Courses Mega Menu
    • Business Essentials
      • Credential of Readiness (CORe)
      • Business Analytics
      • Economics for Managers
      • Financial Accounting
    • Leadership & Management
      • Leadership Principles
      • Management Essentials
      • Negotiation Mastery
      • Organizational Leadership
      • Strategy Execution
      • Power and Influence for Positive Impact
    • Entrepreneurship & Innovation
      • Entrepreneurship Essentials
      • Disruptive Strategy
      • Negotiation Mastery
      • Design Thinking and Innovation
    • Strategy
      • Strategy Execution
      • Business Strategy
      • Economics for Managers
      • Disruptive Strategy
      • Global Business
      • Sustainable Business Strategy
    • Finance & Accounting
      • Financial Accounting
      • Leading with Finance
      • Alternative Investments
      • Sustainable Investing
    • Business in Society
      • Sustainable Business Strategy
      • Global Business
      • Sustainable Investing
      • Power and Influence for Positive Impact
    • All Courses
  • For Organizations
    Open For Organizations Mega Menu
    • Corporate Learning
      Help your employees master essential business concepts, improve effectiveness, and expand leadership capabilities.
    • Academic Solutions
      Integrate HBS Online courses into your curriculum to support programs and create unique educational opportunities.
    • Need Help?
      • Frequently Asked Questions
      • Contact Us
    • Black, Latinx, and underrepresented minority professionals
      Pathways to Business

      Stories designed to inspire future business leaders.

  • Insights
    Open Insights Mega Menu
    • Business Insights Blog
      • Career Development
      • Communication
      • Decision-Making
      • Earning Your MBA
      • Entrepreneurship & Innovation
      • Finance
      • Leadership
      • Management
      • Negotiation
      • Strategy
    • All Topics
    • Sample Business Lessons and E-Books

      Gain new insights and knowledge from leading faculty and industry experts.

    • Free Guide

      Learn how to formulate a successful business strategy.

  • More Info
    Open More Info Mega Menu
    • Learning Experience
      Master real-world business skills with our immersive platform and engaged community.
    • Certificates, Credentials, & Credits
      Learn how completing courses can boost your resume and move your career forward.
    • Learning Tracks
      Take your career to the next level with this specialization.
    • Financing & Policies
      • Employer Reimbursement
      • Payment & Financial Aid
      • Policies
    • Connect
      • Student Stories
      • Community
    • Need Help?
      • Frequently Asked Questions
      • Request Information
    • Apply Now
Login
My Courses
Access your courses and engage with your peers
My Account
Manage your account, applications, and payments.
HBS Home
  • About HBS
  • Academic Programs
  • Alumni
  • Faculty & Research
  • Baker Library
  • Giving
  • Harvard Business Review
  • Initiatives
  • News
  • Recruit
  • Map / Directions
HBS Online
  • Courses
  • Business Essentials
  • Leadership & Management
  • Entrepreneurship & Innovation
  • Strategy
  • Finance & Accounting
  • Business in Society
  • For Organizations
  • Insights
  • More Info
  • About
  • Media Coverage
  • Founding Donors
  • Leadership Team
  • Careers
  • My Courses
  • My Account
  • Apply Now
  • …→
  • Harvard Business School→
  • HBS Online→
  • Business Insights→

Business Insights

Harvard Business School Online's Business Insights Blog provides the career insights you need to achieve your goals and gain confidence in your business skills.

 
Filter Results Arrow Down Arrow Up

Topics

Topics

  • Accounting
  • Analytics
  • Business Essentials
  • Business in Society
  • Career Development
  • Communication
  • Community
  • ConneXt
  • Decision-Making
  • Earning Your MBA
  • Entrepreneurship & Innovation
  • Finance
  • Leadership
  • Management
  • Marketing
  • Negotiation
  • News & Events
  • Productivity
  • Staff Spotlight
  • Strategy
  • Student Profiles
  • Technology
  • Work-Life Balance

Courses

Courses

  • Alternative Investments
  • Business Analytics
  • Business Strategy
  • CORe
  • Design Thinking and Innovation
  • Disruptive Strategy
  • Economics for Managers
  • Entrepreneurship Essentials
  • Financial Accounting
  • Global Business
  • Leadership Principles
  • Leading with Finance
  • Management Essentials
  • Negotiation Mastery
  • Organizational Leadership
  • Power and Influence for Positive Impact
  • Strategy Execution
  • Sustainable Business Strategy
  • Sustainable Investing
Subscribe to the Blog
RSS feed

Filters

Topics

Topics

  • Accounting
  • Analytics
  • Business Essentials
  • Business in Society
  • Career Development
  • Communication
  • Community
  • ConneXt
  • Decision-Making
  • Earning Your MBA
  • Entrepreneurship & Innovation
  • Finance
  • Leadership
  • Management
  • Marketing
  • Negotiation
  • News & Events
  • Productivity
  • Staff Spotlight
  • Strategy
  • Student Profiles
  • Technology
  • Work-Life Balance

Courses

Courses

  • Alternative Investments
  • Business Analytics
  • Business Strategy
  • CORe
  • Design Thinking and Innovation
  • Disruptive Strategy
  • Economics for Managers
  • Entrepreneurship Essentials
  • Financial Accounting
  • Global Business
  • Leadership Principles
  • Leading with Finance
  • Management Essentials
  • Negotiation Mastery
  • Organizational Leadership
  • Power and Influence for Positive Impact
  • Strategy Execution
  • Sustainable Business Strategy
  • Sustainable Investing
Subscribe to the Blog
RSS feed

A Beginner’s Guide to Hypothesis Testing in Business

Business professionals performing hypothesis testing
  • 30 Mar 2021
Tim Stobierski Author Contributors
tag
  • Analytics
  • Business Analytics

Becoming a more data-driven decision-maker can bring several benefits to your organization, enabling you to identify new opportunities to pursue and threats to abate. Rather than allowing subjective thinking to guide your business strategy, backing your decisions with data can empower your company to become more innovative and, ultimately, profitable.

If you’re new to data-driven decision-making, you might be wondering how data translates into business strategy. The answer lies in generating a hypothesis and verifying or rejecting it based on what various forms of data tell you.

Below is a look at hypothesis testing and the role it plays in helping businesses become more data-driven.


Free E-Book: A Beginner's Guide to Data & Analytics

Access your free e-book today.

DOWNLOAD NOW

What Is Hypothesis Testing?

To understand what hypothesis testing is, it’s important first to understand what a hypothesis is.

A hypothesis or hypothesis statement seeks to explain why something has happened, or what might happen, under certain conditions. It can also be used to understand how different variables relate to each other. Hypotheses are often written as if-then statements; for example, “If this happens, then this will happen.”

Hypothesis testing, then, is a statistical means of testing an assumption stated in a hypothesis. While the specific methodology leveraged depends on the nature of the hypothesis and data available, hypothesis testing typically uses sample data to extrapolate insights about a larger population.

Hypothesis Testing in Business

When it comes to data-driven decision-making, there’s a certain amount of risk that can mislead a professional. This could be due to flawed thinking or observations, incomplete or inaccurate data, or the presence of unknown variables. The danger in this is that, if major strategic decisions are made based on flawed insights, it can lead to wasted resources, missed opportunities, and catastrophic outcomes.

The real value of hypothesis testing in business is that it allows professionals to test their theories and assumptions before putting them into action. This essentially allows an organization to verify its analysis is correct before committing resources to implement a broader strategy.

As one example, consider a company that wishes to launch a new marketing campaign to revitalize sales during a slow period. Doing so could be an incredibly expensive endeavor, depending on the campaign’s size and complexity. The company, therefore, may wish to test the campaign on a smaller scale to understand how it will perform.

In this example, the hypothesis that’s being tested would fall along the lines of: “If the company launches a new marketing campaign, then it will translate into an increase in sales.” It may even be possible to quantify how much of a lift in sales the company expects to see from the effort. Pending the results of the pilot campaign, the business would then know whether it makes sense to roll it out more broadly.

Related: 9 Fundamental Data Science Skills for Business Professionals

Key Considerations for Hypothesis Testing

1. Alternative Hypothesis and Null Hypothesis

In hypothesis testing, the hypothesis that’s being tested is known as the alternative hypothesis. Often, it’s expressed as a correlation or statistical relationship between variables. The null hypothesis, on the other hand, is a statement that’s meant to show there’s no statistical relationship between variables being tested. It’s typically the exact opposite of whatever is stated in the alternative hypothesis.

For example, consider a company’s leadership team who historically and reliably sees $12 million in monthly revenue. They want to understand if reducing the price of their services will attract more customers and, in turn, increase revenue.

In this case, the alternative hypothesis may take the form of a statement such as: “If we reduce the price of our flagship service by five percent, then we’ll see an increase in sales and realize revenues greater than $12 million in the next month.”

The null hypothesis, on the other hand, would indicate that revenues wouldn’t increase from the base of $12 million, or might even decrease.

2. Significance Level and P-Value

Statistically speaking, if you were to run the same scenario 100 times, you’d likely receive somewhat different results each time. If you were to plot these results in a distribution plot, you’d see the most likely outcome is at the tallest point in the graph, with less likely outcomes falling to the right and left of that point.

distribution plot graph

With this in mind, imagine you’ve completed your hypothesis test and have your results, which indicate there may be a correlation between the variables you were testing. To understand your results' significance, you’ll need to identify a p-value for the test, which helps note how confident you are in the test results.

In statistics, the p-value depicts the probability that, assuming the null hypothesis is correct, you might still observe results that are at least as extreme as the results of your hypothesis test. The smaller the p-value, the more likely the alternative hypothesis is correct, and the greater the significance of your results.

3. One-Sided vs. Two-Sided Testing

When it’s time to test your hypothesis, it’s important to leverage the correct testing method. The two most common hypothesis testing methods are one-sided and two-sided tests, or one-tailed and two-tailed tests, respectively.

Typically, you’d leverage a one-sided test when you have a strong conviction about the direction of change you expect to see due to your hypothesis test. You’d leverage a two-sided test when you’re less confident in the direction of change.

4. Sampling

To perform hypothesis testing in the first place, you need to collect a sample of data to be analyzed. Depending on the question you’re seeking to answer or investigate, you might collect samples through surveys, observational studies, or experiments.

A survey involves asking a series of questions to a random population sample and recording self-reported responses.

Observational studies involve a researcher observing a sample population and collecting data as it occurs naturally, without intervention.

Finally, an experiment involves dividing a sample into multiple groups, one of which acts as the control group. For each non-control group, the variable being studied is manipulated to determine how the data collected differs from that of the control group.

A Beginner's Guide to Data & Analytics | Access Your Free E-Book | Download Now

Learning How to Perform Hypothesis Testing

Hypothesis testing is a complex process involving different moving pieces that can allow an organization to effectively leverage its data and inform strategic decisions.

If you’re interested in better understanding hypothesis testing and the role it can play within your organization, one option is to complete a course that focuses on the process. Doing so can lay the statistical and analytical foundation you need to succeed.

Are you interested in improving your data literacy? Download our Beginner’s Guide to Data & Analytics to learn how you can leverage the power of data for professional and organizational success.

About the Author

Tim Stobierski is a marketing specialist and contributing writer for Harvard Business School Online.
 
All FAQs

Top FAQs

How are HBS Online courses delivered?

+–

We offer self-paced programs (with weekly deadlines) on the HBS Online course platform.

Our platform features short, highly produced videos of HBS faculty and guest business experts, interactive graphs and exercises, cold calls to keep you engaged, and opportunities to contribute to a vibrant online community.

Do I need to come to campus to participate in HBS Online programs?

+–

No, all of our programs are 100 percent online, and available to participants regardless of their location.

How do I enroll in a course?

+–

All programs require the completion of a brief application. The applications vary slightly from program to program, but all ask for some personal background information. You can apply for and enroll in programs here. If you are new to HBS Online, you will be required to set up an account before starting an application for the program of your choice.

Our easy online application is free, and no special documentation is required. All applicants must be at least 18 years of age, proficient in English, and committed to learning and engaging with fellow participants throughout the program.

After submitting your application, you should receive an email confirmation from HBS Online. If you do not receive this email, please check your junk email folders and double-check your account to make sure the application was successfully submitted.

Updates to your application and enrollment status will be shown on your Dashboard. We confirm enrollment eligibility within one week of your application.

Does Harvard Business School Online offer an online MBA?

+–

No, Harvard Business School Online offers business certificate programs.

What are my payment options?

+–

We accept payments via credit card, wire transfer, Western Union, and (when available) bank loan. Some candidates may qualify for scholarships or financial aid, which will be credited against the Program Fee once eligibility is determined. Please refer to the Payment & Financial Aid page for further information.

We also allow you to split your payment across 2 separate credit card transactions or send a payment link email to another person on your behalf. If splitting your payment into 2 transactions, a minimum payment of $350 is required for the first transaction.

In all cases, net Program Fees must be paid in full (in US Dollars) to complete registration.

What are the policies for refunds and deferrals?

+–

After enrolling in a program, you may request a withdrawal with refund (minus a $100 nonrefundable enrollment fee) up until 24 hours after the start of your program. Please review the Program Policies page for more details on refunds and deferrals. If your employer has contracted with HBS Online for participation in a program, or if you elect to enroll in the undergraduate credit option of the Credential of Readiness (CORe) program, note that policies for these options may differ.

 

Sign up for News & Announcements

Subject Areas

  • Business Essentials
  • Leadership & Management
  • Entrepreneurship & Innovation
  • Strategy
  • Finance & Accounting
  • Business & Society

Quick Links

  • FAQs
  • Contact Us
  • Request Info
  • Apply Now

About

  • About Us
  • Media Coverage
  • Founding Donors
  • Leadership Team
  • Careers @ HBS Online

Legal

  • Legal
  • Policies
Harvard Business School
Copyright © President & Fellows of Harvard College
  • Site Map
  • Trademark Notice
  • Digital Accessibility