We believe that harmans singlefactor test with cfa setting should be the minimum standard for addressing cmv, which is the first recommendation shown in. For examining the extent to which common method variance is present in the data, most commonly used method is harmans single factor test. Apr 26, 2011 this paper seeks to discuss reliability problems associated with questionnaires, commonly employed in library and information science. Simulation introduction there seems to be quite widespread agreement among quantitative information systems is researchers that common method variance, defined by podsakoff, mackenzie, lee, and podsakoff 2003 as variance that is attributable to the measurement. Second,the measurement model withthe addition of an unmeasured latent common method variance cmv factor did notimprovethe fit. It is unlikely a single factor will emerge from the data. Pls vid9 common method variance and harmans single factor. The approach is tested by using monte carlo simulation. Cmb harmans single factor test cenfetelli2008israddressing the what and how of online services to address the potential concern of common method bias from the use of a field survey technique, we conducted an exploratory factor analysis and applied the harman 1967 one factor. Lindell and whitney introduced a partial correlation technique, now referred to as the correlational marker technique, for controlling method variance using a marker variable that is theoretically unrelated to substantive variables in a study. Only the cfa marker technique turns out to provide some value.
For example, it is possible that variations in six observed variables mainly reflect the. From a prescriptive perspective, it is better to measure the dependent and criterion variables using different methods. Turn your pdf or hard copy worksheet into an editable digital worksheet. All variables were examined through an exploratory factor analysis using the unrotated principal axis factoring procedure.
Two of these posthoc techniques are harmans singlefactor test, also known as harmans onefactor test 15, and the correlation matrix procedure 2. Following this technique, researchers introduce all the scale items. Harmans singlefactor test, and 4 the markervariable technique. Following this technique, researchers introduce all the scale items into an exploratory factorial analysis and examine the unrotated factor solution to obtain the number of components with eigenvalues greater than 1 that explain the aggregate variance. Harman onefactor analysis is often used to check whether variance in the data can be largely attributed to a single factor. Ramayah, sulaiman sajilan journal of management sciences volume 4, issue 2 2017 146175 83 citations 10. Harman s single factor test is one technique to identify common method variance. However i am not sure which method should i use when i do factor analysis with stata. Common method variance cmv is the amount of spurious correlation between variables that is created by using the same methodoften a surveyto measure each variable. Method biases are one of the main sources of measurement error, and most researchers agree that common method variance is a potential problem in behavioral research p. While this test bears harmans name, whose work is often cited as the primary source of the test, the application of exploratory factor analysis efa specifically to the detection of common method variance does not appear in harmans texts 1967, 1976, and thus, the test s name originates from other sources. Controlling common method variance while measuring the. Apr, 2012 fixedeffects can only eliminate unmodeled variance due to constant effects.
Emotional intelligence, emotional labor, and job satisfaction. Pdf testing and controlling for common method variance. Harman single factor technique common latent factor. In contrast with the harman singlefactor test, the marker variable technique lindell and whitney 2001 attempts to control for cmv by including a measure of the assumed source of method variance as a covariate in the statistical analysis podsakoff et al. Given the efficacy of the markervariable technique in comparison with other techniques, we used the markervariable tech nique to infer the effect of cmv on correlations between variables in previously published. Controlling common method variance while measuring the impact. Harman suggests that this single factor should not account for 50% or more of the variance present this is a test for the degree of common variance. Mtmm technique using confirmatory factor analy sis cfa, 3 harmans singlefactor test, and 4 the markervariable technique.
Techniques to control for common method variance in monomethod. Among these, the most popular has been harman s single factor test. Estimating the effect of common method varianceappendices in contrast with the harman singlefactor test, the marker variable technique lindell and whitney 2001 attempts to control for cmv by. Pls vid9 common method variance and harmans single factor test. Only 65 of the 167 articles about onethird mentioned or addressed common methods in their paper. Remedy 4 marker variable this method teases out truer common variance than the basic common latent factor method because it is finding the common variance between unrelated latent factors. Method variance and method bias in industrial and organizational psychology.
Common biases and judgment errors in decision making organizational behavior by jennifer lombardo duration. Estimating the effect of common method varianceappendices. Common method variance, procedural remedies, statistical remedies, harmans. Similar findings are indicated for other asian countries. Harmans singlefactor test was adopted to test the possibility of common method bias. All the variables were entered into an exploratory factor. Harmans singlefactor test is a simple and widespread statistical tool that detects cmv 5. How to prevent, detect and control common method variance in. If cmb is present a singlefactor will emerge from the factor analysis. Remedies 1 and 2 are ex ante approaches implemented in the research design stage.
Podsakoff university of florida interest in the problem of method biases has a long history in the behavioral sciences. Harman single factor, common latent factor, and common marker variable. Although relatively widespread among electronic commerce researchers, these techniques only allow researchers to detect cmv. Moreover, all 11 variables were loaded on one factor to examine the fit of the confirmatory factor analysis model. Several studies have debated over the prevalence of common method variance cmv in organizational research. A harmans onefactor test for common method variance was performed. Common method variance was established using harmans singlefactor test. Learn how to conduct harmans single factor test with spss. Data were analyzed using descriptive statistics, correlation analysis, con. In the literature, there are several preventive, detective, and corrective techniques that can be employed to assuage concerns about the possibility of common method effects underlying observed results. By contrast, the directly measured latent factor technique, tagged. Thus, any common variance is likely due to a common method bias, rather than natural correlations. Dec 27, 2018 learn how to conduct harmans single factor test with spss. Nov 29, 2009 cmb harmans single factor test cenfetelli2008israddressing the what and how of online services to address the potential concern of common method bias from the use of a field survey technique, we conducted an exploratory factor analysis and applied the harman 1967 one factor.
This paper should serve as a framework for researchers, who wish to evaluate the potential biasing effects of method variance in their research, pertaining to behavioural aspects. It focuses on the effects of common method variance cmv, which is a form of bias, and ways of countering these effects. Moreover, none of the articles provide a diagnosis or test for method related biases in their research. We show how researchers can utilize proc factor and proc calis in sas 9.
Testing and controlling for common method variance. What is the significance of harmans single factor test and. Practical implications for the use of this set of social exchange constructs in organizational contexts are discussed. Mackenzie, and jeongyeon lee indiana university nathan p. Factor analysis is a statistical method used to describe variability among observed, correlated variables in terms of a potentially lower number of unobserved variables called factors. A comparison of alternative approaches and a reanalysis of past research naresh k. Given the efficacy of the markervariable technique in comparison with other techniques, we used the markervariable tech. Harmans single factor test for common method variance. A study that has significant common method bias is one in which a majority of the variance can be explained by a single factor. Harmans single factor analysis harmans onefactor test, ex post statistical tests, was conducted to test the presence of common method effect.
Controlling for common method variance with partial least squares. Additionally, other statistical procedures can be applied to partial out common factors or to control for them. Measuring social exchange constructs in organizations. Controlling for common method variance with partial least. In the latter case, items were allowed to load on their theoretical constructs, as well as on a latent common methods variance factor, applying confirmatory factor analysis cfa. Apr, 2012 dear statalister, i am trying to perform an harmans singlefactor test with stata to check for common method variance. Harmans single factor test was performed to address the common method variance issue. Keywords keywords emotional intelligence, wellbeing, common method variance, harman s single factor test, marker variable technique. Fixedeffects can only eliminate unmodeled variance due to constant effects. Dear statalister, i am trying to perform an harmans singlefactor test with stata to check for common method variance. To identify whether a single factor does account for the majority of the total variance of all the measurements, common method variance cmv was tested.
Harmans singlefactor test was conducted through explanatory factor analysis to examine the common method variance issue e. Countering method bias in questionnairebased user studies. Analysis efa in which a model of a single method factor reflected by all the items is typically compared with a multiplesubstantivefactors model using the harmans single factor test podsakoff, organ 26. Only nine articles used both harmans test and at least one other correction method to control. Among these, the most popular has been harmans singlefactor test.
B4 is calculated as per the formula recommended by hunter and schmidt 2004. Itcan thereforebesaidthattherewas no single factor that accounted for the majority of the covariance spector, 2006. Estimating the effect of common method varianceappendices in contrast with the harman singlefactor test, the marker variable technique lindell and whitney 2001 attempts to. The issue of common method variance cmv has become almost legendary among todays business researchers. Common method variance, procedural remedies, statistical remedies, harman s singlefactor test, partial correlation procedures, correlation matrix procedure, mlmv approach. This paper seeks to discuss reliability problems associated with questionnaires, commonly employed in library and information science.
The issue of common method variance cmv has become almost legendary among today s business researchers. A rigorous future study is warranted to validate the psychometric structure across different cultural settings. In efa one examines the unrotated factor solution to determine the number of factors that are necessary to account for the variance in the variables. If a single factor emerges or one general factor will account for the majority. In efa one examines the unrotated factor solution to determine the number of factors that are necessary to. What is the significance of harmans single factor test.
Common method bias in public management studies pure. In contrast with the harman singlefactor test, the marker variable technique lindell. Common methods variance detection in business research. In the exploratory approach the single factor that got extracted accounted for 38. Results showed eight factors with eigenvalues greater than one. For a step by step guide, refer to the video tutorials. Harman one factor analysis is often used to check whether variance in the data can be largely attributed to a single factor. Furthermore, harmans one factor test for common method variance suggested that the variance in the data could not be explained by a single construct. Harmans singlefactor test load all the items into an exploratory factor analysis and examines the unrotated solution. If a single factor emerges or one general factor accounts for most of the covariance among the variables, then a significant common method variance effect is present. First, harmans singlefactor test examines the unrotated factor solution involving all items of interest in an exploratory factor analysis efa. For example if the dependent variable is innovation outcomes, you may want to look at patent filings rather than include questions in the survey itself.
Dec 17, 2012 if a single factor emerges or one general factor accounts for most of the covariance among the variables, then a significant common method variance effect is present. Given the variance explained by the first factor falls below the threshold of 50%, common method bias does not appear to be a significant factor in this study. Pls marker variable approach to diagnosing and controlling. For example principal factor confirms the presence of cmv while principalcomponent factor rejects it. The goal of testing for common method variance is to determine to what. Common method variance, procedural remedies, statistical remedies, harmans singlefactor test, partial correlation procedures, correlation. It aims to focus on the effects of common method variance cmv, which is a form of bias, and ways of countering these effects. Typically authors devoted a single sentence to the issue and invoked it as a limitation of prior research when applying a novel methodology in their own research. Harmans single factor test is criticised as lacking sufficient foundation, and it is concluded that it should. Harmans single factor test is one technique to identify common method variance. Common method variance, procedural remedies, statistical remedies, harmans singlefactor test, partial correlation procedures, correlation matrix. Common method variance refers to variance that is attributable to the measurement method rather than to the constructs the measures are supposed to represent.
Unfortunately, as we will see in the next section, conducting a confirmatory factor analysis is not a very effective way of identifying common method bias. The result of the test showed that three factors accounted for a cumulative variance of 63 per cent and five factorsaccountedfor87percent ofthetotalvariance. A harmans one factor test for common method variance was. Common method variance, procedural remedies, statistical remedies, harmans singlefactor test, partial correlation procedures, correlation matrix procedure, mlmv approach. This second technique introduces a new latent variable in such a way that all manifest variables are related to it, those paths are constrained to be equal and the variance of the common factor is constrained to be 1 see figure 3. Apr 10, 2018 similar findings are indicated for other asian countries. Cmv may lead to erroneous conclusions about relationships between variables by. On this basis, we conclude that the widely used harmans single factor test is insufficient as a test for common method bias. Purpose this paper seeks to discuss reliability problems associated with questionnaires, commonly employed in library and information science. Of this group, half the articles 32 used harmans singlefactor test or something similar to test for cmv. To test for a common method bias you can do a few different tests. The most commonly used method for accessing the extent of method variance is the harmans singlefactor test cf. This test has been used to compare a single factor structure to a multiple factors structure in terms of the total variance explained. Dec 19, 2017 pls vid9 common method variance and harmans single factor test.
44 1547 781 61 474 1098 259 525 941 1371 1142 396 348 1621 1050 1021 173 1635 552 1526 1369 666 1121 1274 1129 8 1115 1441 1118