Discussion: View Thread

  • 1.  AoM 2009 PDW - Alternatives to Null Hypothesis Significance Testing

    Posted 05-13-2009 20:35

    AoM Professional Development Workshop (Sponsors: RM, BPS, OB, TIM, ENT, NDSC)

    The Case Against Null Hypothesis Significance Testing: Flaws, Alternatives, and Action Plans


    Academy of Management Meeting in Chicago, IL
    Saturday, August 8, 2009 at 11:10 AM – 1:10 PM
    Sheraton Chicago in Chicago 10

    Organizers & Presenters:
    William H. Starbuck, University of Oregon
    Andreas Schwab, Iowa State University

    Eric Abrahamson, Columbia University
    Donald E. Hatfield, Virginia Tech

    The purpose of this workshop is to increase awareness among management researchers of the severe limitations of Null Hypothesis Significance Testing (NHST) and to introduce alternative approaches based on effect size measures and confidence intervals.  

    NHST has been criticized by methodologists on various grounds (Cohen, 1994; Cortina & Folger, 1998; Schmidt, 1996; Starbuck, 2006; Thompson, 1996).  Their criticism suggests that the extensive use of NHST in quantitative management research has led to the accumulation of deceptive findings in the management literature.  In a field that aspires to provide useful advice to managers, researchers need to focus on practically important effects that are robust across a wide variety of settings.  To identify practically meaningful findings, methodologists have recommended the reporting of effect sizes and confidence intervals as an alternative to NHST.  Recently, approaches for estimating confidence intervals for effect size measures have also been introduced (Cummings & Finch, 2001; Kline, 2004).  The application of alternatives to NHST by management researchers, however, has been limited by both a lack of sensitivity regarding the inherent problems of NHST and a limited familiarity with alternative approaches.  Our two-hour workshop addresses these issues in the following three modules:

    • Critique of NHST (2 speakers)
    • Alternatives to NHST (1 speaker)
    • Round-table discussion for hands-on advice

    No pre-registration is required to attend this session.

    For further information on this session, please contact Andreas Schwab (aschwab@iastate.edu).

     



  • 2.  AoM 2009 PDW - Alternatives to Null Hypothesis Significance Testing

    Posted 07-30-2009 15:28

    AoM Professional Development Workshop (Sponsors: RM, BPS, OB, TIM, ENT, NDSC)

    The Case Against Null Hypothesis Significance Testing: Flaws, Alternatives, and Action Plans


    <st1:placetype w:st="on">Academy</st1:placetype> of <st1:placename w:st="on">Management</st1:placename> Meeting in <st1:place w:st="on"><st1:city w:st="on">Chicago</st1:city>, <st1:state w:st="on">IL</st1:state></st1:place>
    Saturday, August 8, 2009 at 11:10 AM – 1:10 PM
    Sheraton <st1:city w:st="on">Chicago</st1:city> in <st1:city w:st="on">Chicago</st1:city> Ballroom 10

    Organizers & Presenters:
    William H. Starbuck, <st1:placetype w:st="on">University</st1:placetype> of <st1:placename w:st="on">Oregon</st1:placename>
    <st1:personname w:st="on">Andreas Schwab</st1:personname>, <st1:place w:st="on"><st1:placename w:st="on">Iowa</st1:placename> <st1:placetype w:st="on">State</st1:placetype> <st1:placetype w:st="on">University</st1:placetype></st1:place>

    Donald E. Hatfield, Virginia Tech

    <st1:personname w:st="on">Eric Abrahamson</st1:personname>, <st1:place w:st="on"><st1:placename w:st="on">Columbia</st1:placename> <st1:placetype w:st="on">University</st1:placetype></st1:place>

    The purpose of this workshop is to increase awareness among management researchers of the severe limitations of Null Hypothesis Significance Testing (NHST) and to introduce alternative approaches based on effect size measures and confidence intervals.  

    NHST has been criticized by methodologists on various grounds (Cohen, 1994; Cortina & Folger, 1998; Schmidt, 1996; Starbuck, 2006; Thompson, 1996).  Their criticism suggests that the extensive use of NHST in quantitative management research has led to the accumulation of deceptive findings in the management literature.  In a field that aspires to provide useful advice to managers, researchers need to focus on practically important effects that are robust across a wide variety of settings.  To identify practically meaningful findings, methodologists have recommended the reporting of effect sizes and confidence intervals as an alternative to NHST.  Recently, approaches for estimating confidence intervals for effect size measures have also been introduced (Cummings & Finch, 2001; Kline, 2004).  The application of alternatives to NHST by management researchers, however, has been limited by both a lack of sensitivity regarding the inherent problems of NHST and a limited familiarity with alternative approaches.  Our two-hour workshop addresses these issues in the following three modules:

    • Critique of NHST
    • Alternatives to NHST
    • Round-table discussion for hands-on advice

    No pre-registration is required to attend this session.

    For further information on this session, please contact <st1:personname w:st="on">Andreas Schwab</st1:personname> (aschwab@iastate.edu).