About the Author(s)


Xander van Lill Email symbol
Department of Industrial Psychology and People Management, College of Business and Economics, University of Johannesburg, Johannesburg

Department of Product and Research, JVR Africa Group, Johannesburg, South Africa

Anneke Stols symbol
Department of Product and Research, JVR Africa Group, Johannesburg, South Africa

Department of Psychology, Faculty of Social Sciences, University of East Anglia, Norwich, United Kingdom

Pakeezah Rajab symbol
Department of Product and Research, JVR Africa Group, Johannesburg, South Africa

Department of Psychology, Faculty of Humanities, University of Pretoria, Pretoria

Jani Wiggett symbol
Department of Product and Research, JVR Africa Group, Johannesburg, South Africa

Citation


Van Lill, X.V., Stols, A., Rajab, P., & Wiggett, J. (2023). The validity of a general factor of emotional intelligence in the South African context. African Journal of Psychological Assessment, 5(0), a123. https://doi.org/10.4102/ajopa.v5i0.123

Original Research

The validity of a general factor of emotional intelligence in the South African context

Xander van Lill, Anneke Stols, Pakeezah Rajab, Jani Wiggett

Received: 16 Oct. 2022; Accepted: 12 Dec. 2022; Published: 23 Mar. 2023

Copyright: © 2023. The Author(s). Licensee: AOSIS.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Emotional intelligence (EI) plays an important role in the prediction of important work-related outcomes, such as work performance. Southern African scholars frequently deploy total scores of EI without considering its hierarchical structure. This study investigated the presence of a general factor, as manifested among the subscales of the EQ-i 2.0, using an archival dataset of 16 581 employees in Southern Africa. Orthogonal first-order, single-factor, higher-order, oblique lower-order and bifactor models were specified to investigate the hierarchical structure of EI. The evidence supports the notion that a total score could be calculated for EI based on the EQ-i 2.0. A total EI score also appears to be predictive of employees’ individual work performance, as measured by their managers. It might, therefore, be practically meaningful for practitioners to calculate or use a total score when making selection decisions about employees based on the EQ-i. 2.0.

Contribution: The findings of the present study offer insights into the theoretical and empirical structure of EI based on statistical techniques that have not been used on the construct in the Southern African context. Concurrent validity evidence further provides additional support that an overall quantitative score, based on the EQ-i. 2.0, has utility in hiring practices, where the aim is to predict future work performance.

Keywords: Emotional Quotient Inventory 2.0; trait-based emotional intelligence; general factor; individual work performance; employee selection.

Introduction

Many jobs place high emotional demands on employees; for example, managers or health care workers might be required to – on a daily basis – accurately perceive, understand and regulate their own emotions in the service of fellow employees or patients (Glomb et al., 2004). Employees’ willingness to expend emotional labour or manage their feelings to project a certain public display is becoming increasingly important to performance in many job roles and, ultimately, the social functioning of human enterprise. The relationship between emotional intelligence (EI) and valued work-related outcomes, such as job performance, is well established. Joseph and Newman (2010) reported a correlation of 0.47 between EI and job performance but found a reduced correlation of 0.29 after further refinements in their meta-analytical study (Joseph et al., 2015). A recent meta-analytical study conducted by Sackett et al. (2021) revealed that trait-based EI and cognitive ability appeared to be equally relevant predictors of job performance, both with an estimated validity coefficient of 0.30 and 0.31 respectively.

A host of studies on the predictive validity of EI has been conducted in South Africa. The most recent study, conducted by Sloan and Geldenhuys (2021), investigated the moderating effect of self-focused EI in predicting managers’ In-role and Extra-role performance, which yielded positive, significant correlations with EI of 0.27 and 0.32, respectively. Nel and De Villiers (2004) reported an even higher positive and significant correlation of 0.53 between overall EI and job performance in the call centre environment. In contrast to the findings of Sloan and Geldenhuys (2021) and Nel and De Villiers (2004), Hayward et al. (2008) reported a non-significant and negligible effect of EI on job performance for managers in a parastatal. However, Hayward et al. (2008) attributed the negligible effect to the limited variance in the performance variable.

While South African research on the predictive validity of EI looks promising, there is international debate regarding the legitimacy of using a general factor of EI, as performed by Nel and De Villiers (2004) and Hayward et al. (2008), when predicting job performance. A point of concern expressed includes limited investigation of the hierarchical structure of EI before a general score is calculated and used to predict work-related outcomes (Dasborough et al., 2021). This problem appears to be endemic to studies conducted in South Africa, with very few investigations conducted on the hierarchical structure of EI before inspecting the predictive validity of a general score of EI. Van Zyl (2014) conducted the only identifiable study in South Africa that inspected a higher-order model for EI, but did not find evidence, in terms of model-data fit based on a confirmatory factor model, to support a general factor of EI. Since the study conducted by Van Zyl (2014), specific factor analytical procedures have been recommended by Credé and Harms (2015), which might shed some additional light on the hierarchical structure of EI in South Africa. However, before the hierarchical structure of EI is addressed, more attention needs to be paid to the theoretical structure of EI in this study.

The theoretical structure of emotional intelligence

Emotional intelligence is conceptualised differently across various measures, that is, different models are used in its measurement. These models include (1) ability-based EI measures, like the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT) (Mayer et al., 2003), (2) self-report (or peer-report) EI measures based on the same theoretical model as the MSCEIT (Mayer et al., 2003) and (3) measures of mixed EI models, which extend beyond the theoretical model included in the aforementioned two categories (Ashkanasy & Daus, 2005; Dasborough et al., 2021). Such mixed EI measures are considered assorted, because they include various items phrased similarly to those used in measuring personality and behavioural preferences (Ashkanasy & Daus, 2005). In contrast to the ability-based EI measured by the MSCEIT (Mayer et al., 2003), the self-report EI measures from the two latter models are often termed ‘trait-based EI’, as it has to do with individuals’ perceptions of their own emotional skills (Joseph et al., 2015; Petrides et al., 2016). All three of these models include scientifically sound EI-related constructs that could greatly contribute to what we know about work performance (Dasborough et al., 2021; Joseph et al., 2015).

Within the categories of ability-based EI and trait/mixed EI, the two theoretical models that have received a lot of attention when exploring the relationships between EI and job performance were the models that underpin the MSCEIT (Mayer et al., 2003) and the Bar-On Emotional Quotient Inventory (Joseph et al., 2015). This article focuses on the revised version of the latter model, namely the EQ-i 2.0 model (Wiechorek, 2011).

The EQ-i 2.0 model was established based on 25 years of research on the different aspects that constitute EI, including how these interrelate. The EQ-i 2.0 model has a multidimensional structure that provides an indication of a person’s total EI, which is contextualised by the different facets believed to underlie EI. The total EI score reflects a ‘snapshot’ of a person’s overall EI and can be defined as (Wiechorek, 2011):

[A] set of emotional and social skills that influence the way we perceive and express ourselves, develop and maintain social relationships, cope with challenges, and use emotional information in an effective and meaningful way. (p. 49)

This broad definition also speaks to the different facets included in the EQ-i 2.0, which encompass 15 constructs that can be collapsed into five comparable categories or composites. A visual depiction of the theoretical structure of the EQ-i 2.0, including the proposed general factor, is presented in Figure 1.

FIGURE 1: General, composite and subscale dimensions of the EQ-i 2.0.

The meaning of the composites and subscales’ measures, as demonstrated in Figure 1, is described in the Wiechorek (2011) user’s handbook. The first three subscales, noted below, collectively quantify an individual’s Self-perception, which describes how people see themselves:

  • 1. Self-regard: Having self-respect and confidently accepting one’s gifts and flaws.
  • 2. Self-actualisation: Consistently working to better oneself or to reach goals of importance.
  • 3. Emotional self-awareness: Understanding one’s emotions and how they affect oneself.

The second, the Self-expression composite scale, considers how people express their inner perception of themselves, which is jointly portrayed through the subscales noted below:

  • 4. Emotional expression: To share one’s emotions in a constructive way.
  • 5. Assertiveness: To respectfully communicate one’s feelings and views.
  • 6. Independence: Relying on oneself and not depending on others emotionally.

The Interpersonal composite scale considers the nature of the relationships that people build with others. The subscales that collectively inform this composite are:

  • 7. Interpersonal relationships: To form and uphold trusting relationships that are agreeable to all parties.
  • 8. Empathy: Recognising and understanding others’ feelings and showing concern for them.
  • 9. Social responsibility: Being socially conscious and helpful towards others in the community.

The Decision making composite scale considers how people use emotional information to effectively make decisions, which is jointly established through:

  • 10. Problem-solving: Understanding how one’s emotions impact decisions and solving problems despite these emotions.
  • 11. Reality testing: To be aware of the reality of a situation and display one’s objectivity.
  • 12. Impulse control: Being able to withstand an urge to act or make rash decisions.

The Stress management composite scale measures peoples’ ability to deal with stressors, utilising multiple coping strategies and showing resilience despite setbacks and incorporates:

  • 13. Stress tolerance: To cope with and manage stressful situations to achieve a positive outcome.
  • 14. Flexibility: To flexibly adapt one’s actions, feelings and thoughts to change.
  • 15. Optimism: To remain positive and resilient despite facing obstacles.

The scales, measured at every level of the EQ-i 2.0, were designed with a specific function in mind. The subscales serve to provide a more foundational understanding of employees’ relative strengths and weaknesses, which is valuable for development purposes. Compared to a general factor, subscales are qualitatively more meaningful during psychometric feedback. Psychometric feedback on subscales provides the opportunity to suggest actionable steps that employees could take to increase their overall EI at work. An EI total, or even a composite EI score, might be perceived as too ambiguous and less meaningful from a development perspective. By contrast, the composite and overall dimensions of the structure might provide more encompassing, and therefore also more consistent, dimensions that can be utilised for selection purposes (Wiechorek, 2011).

A study conducted by Van Zyl (2014) supported the existence of the composites, as set out in Figure 1. Van Zyl (2014) was, however, unable to find support for a general factor of EI among the subscales of the EQ-i 2.0. However, Van Zyl (2014) did not inspect the recently suggested sequence for the inspection of hierarchical structure (Credé & Harms, 2015), which was explored in the current study. The present researchers were particularly interested in the general factor of EI as based on subscales of the EQ-i 2.0 and specified a bifactor model.

The theoretical structure of individual work performance

Van Lill and Taylor’s (2022) framework underlying the Individual Work Performance Review (IWPR) was utilised to conceptualise and measure performance in the present study. Five broad performance dimensions are differentiated by Van Lill and Taylor (2022), including in-role, extra-role, adaptive, leadership and counterproductive performance. According to Van Lill and Taylor (2022, pp. 3–5):

  1. In-role performance refers to: ‘Actions that are official or known requirements for employees (Carpini et al., 2017; Motowidlo & Van Scotter, 1994). These behaviours could be viewed as the technical core (Borman & Motowidlo, 1997) that employees must demonstrate to be perceived as proficient and able to contribute to the achievement of organisational goals’ (Carpini et al., 2017).

  2. Extra-role performance refers to: ‘future- or change-orientated acts (Carpini et al., 2017), aimed at benefitting co-workers and the team (Organ, 1997), that are discretionary or not part of the employee’s existing work responsibilities’ (Borman & Motowidlo, 1997).

  3. Adaptive performance relates to: ‘employees’ demonstration of the ability to cope with and effectively respond to crises or uncertainty’ (Carpini et al., 2017; Pulakos et al., 2000).

  4. Leadership performance refers to: ‘the effectiveness with which an employee can influence co-workers to achieve collective goals’ (Campbell & Wiernik, 2015; Hogan & Sherman, 2020; Yukl, 2012).

  5. Counterproductive performance reflects on the: ‘intentional or unintentional acts (Spector & Fox, 2005) by an employee that negatively affect the effectiveness with which an organisation achieves its goals and cause harm to its stakeholders’ (Campbell & Wiernik, 2015; Marcus et al., 2016).

Each of the five broad performance dimensions is represented by four narrow performance dimensions, as shown in Figure 2. Evidence in support of the five factors and definitions of the narrow dimensions can be obtained from Van Lill and Taylor (2022). As portrayed in Figure 2, it is theorised that a general factor stands at the apex of all the performance dimensions identified in the IWPR. Van Lill and Van der Vaart (2022) found that a general factor explained a similar amount of variance in South Africa as that reported by Viswesvaran et al.’s (2005) meta-analytical study. The present study focused on the predictive validity of total EI for general and broad dimensions of individual work performance.

FIGURE 2: Broad and narrow dimensions of the Individual Work Performance Review.

Predictive validity of a general factor of emotional intelligence

The evidence suggests that the criterion validity of EI is replicable in the South African context (Nel & De Villiers, 2004; Sloan & Geldenhuys, 2021). However, it is less clear what specific work-related behaviours EI predicts when compared to more established international scientific literature. Performance is a multidimensional construct, and Van Lill and Taylor (2022) suggest a five-factor model for individual behaviours at work, namely in-role, extra-role, adaptive, leadership and counterproductive performance. The only local evidence that differentiated between performance dimensions was the study conducted by Sloan and Geldenhuys (2021), which focused on both in-role and extra-role performance as work-related outcomes.

Meta-analytical evidence to date suggests that EI is predictive of in-role performance, also referred to as ‘task performance’ (Joseph et al., 2015; Sackett et al., 2021). Emotional self-regulation is more frequently recognised as a core part of functioning in social enterprises and, therefore, the ability to succeed at essential tasks (Joseph et al., 2015).

There is also evidence in support of the relationship between EI and extra-role performance. Employees with higher EI might be more empathetic and prosocial, which could, in turn, lead to greater displays of extra-role performance or actions aimed at doing more than what is required by their job descriptions (Miao et al., 2017).

Emotional intelligence might also assist employees in better coping with negative emotions that arise from interpersonal strain or frustrating tasks. Consequently, they are less inclined to engage in deviant intrapersonal or interpersonal behaviours that undermine collective goals (Miao et al., 2017).

It further appears that EI could assist individuals in coping with the strain associated with the complexities of change at work. In this respect, EI could help individuals to downregulate negative emotions in response to uncertainty and help them increase positive feelings, in order to stay focussed on solutions in response to change. Emotional intelligence is, therefore, also argued to be related to adaptive performance (Yang et al., 2022).

Finally, EI might translate into greater self-confidence, self-awareness and empathy, which are essential components of interpersonal influence and, therefore, leadership performance (Harms & Credé, 2010). An overview of the evidence presented suggests that EI is likely to be related to all five performance dimensions, namely in-role, extra-role, adaptive, leadership and counterproductive performance.

The EQ-i 2.0 has been used across multiple industries in the United States of America, with accumulating evidence of the instrument’s utility in differentiating between high- and low-performing individuals (Stein & Book, 2011). However, limited research has been conducted on the predictive validity of the general factor of the EQ-i 2.0 in South Africa, which was one of the areas of focus of the current study.

Research objective and hypotheses

The objective of this study was to determine the structural and criterion validity of a general dimension of EI in the EQ-i 2.0 assessment. Based on the current evidence reported in the present study, the following hypotheses were formulated:

Study 1

H1: The general factor of EI explains covariance between the items, independent of the covariance that the 15 facets explain in the same set of items.

Study 2

H2: General EI has a significant positive effect on overall job performance.

H2A: General EI has a significant positive effect on in-role performance.

H2B: General EI has a significant positive effect on extra-role performance.

H2C: General EI has a significant positive effect on adaptive performance.

H2D: General EI has a significant positive effect on leadership performance.

H2E: General EI has a significant negative effect on counterproductive performance.

Method

Participants

For Study 1, a sample of 16 581 working adults living in Southern Africa was obtained via an online platform. The mean age of the respondents was 37.94 years (standard deviation [SD] = 8.86). Most respondents self-identified as male (n = 9427; 57%), followed by females (n = 7154; 43%). The sample further included individuals who indicated their ethnicity as follows: black (n = 6755; 41%), white (n = 4915; 30%), coloured (mixed ancestry; n = 1675; 10%) and Indian or Asian (n = 1838; 11%). The researchers computed the power for the test model (degrees of freedom [df]= 6667), based on the computer software developed by Preacher and Coffman (2006). The models returned a value of unity, which suggested that an incorrect model would be correctly rejected (α = 0.05; null root mean square error of approximation [RMSEA] = 0.05; alternative RMSEA = 0.08).

For Study 2, a total of 108 performance ratings of South African employees, who were also administered the EQ-i 2.0, were completed by managers in two participating organisations, selected via a census or stratified sampling strategy. The sample represented the finance and professional services sectors. The mean age of employees was 38.88 years (SD = 7.78 years). Most of the employees self-identified as white (n = 65; 60%), followed by black African (n = 18; 17%), Indian (n = 16; 15%), coloured (individuals of mixed ancestry; n = 8; 7%) and Asian (1; 1%). The sample comprised more women (n = 65; 60%) than men (n = 43; 40%). Most of the employees were registered professionals (n = 53; 49%), followed by low-level managers (25; 23%), mid-level managers (n = 16; 15%), skilled employees (n = 12; 11%) and top-level managers (2; 2%). The present researchers inspected the statistical power required for linear bivariate regression by using G*Power (Faul et al., 2007). The calculation suggested that 64 participants should be sufficient (α = 0.05; Power = 0.80) to detect a slope of 0.30, per prior meta-analytical validity estimates reported (Sackett et al., 2021). The present sample was roughly double the recommended size based on this calculation.

Instruments

The EQ-i 2.0 assessment consists of 133 items; that is an average of eight items in each of the 15 subscales (i.e. three subscales per composite). Eight items contribute to a Well-being indicator, also referred to as the ‘happiness scale’, while seven of these items are also used as a validity measurement. The EQ-i 2.0 model comprises a 1-5-15 structure, where the 15 subscales underlie the five composites that all contribute to one total EI ‘snapshot’ (see Figure 1). A five-point Likert-type frequency scale provides the response options for each item. The response options range from 1 = Never/Rarely to 5 = Almost Always/Always, with a qualitative interpretation guide connected to the meaning of each option (Wiechorek, 2011). The internal consistency reliabilities for the South African sample on most of the EQ-i 2.0 subscales were satisfactory (α and ω ≥ 0.71). Only one subscale had an unsatisfactory internal consistency reliability coefficient of 0.66, namely independence. However, this reliability coefficient was still considered marginally acceptable (see Table 1).

TABLE 1: Descriptive statistics for the EQ-i 2.0 subscale factors.

The IWPR (Van Lill & Taylor, 2022) consists of 80 items (4 items for each of the 20 narrow performance dimensions) that cover five factors, namely In-role performance, Extra-role performance, Adaptive performance, Leadership performance and Counterproductive performance (Van Lill & Taylor, 2022). Per the guidelines of Aguinis (2019), each item was measured using a five-point behavioural frequency scale. Word anchors defined the extreme points of each scale, namely, 1 = Never demonstrated and 5 = Always demonstrated. Qualitative interpretation of numeric values between the extreme points is provided, to better approximate an interval rating scale, namely 2 = Rather infrequently demonstrated, 3 = Demonstrated some of the time and 4 = Quite often demonstrated. Van Lill and Taylor (2022) demonstrated the internal consistency reliability of all the narrow dimensions of the IWPR (α and ω ≥ 0.83).

Procedure

The data on the EQ-i 2.0 (n = 16 581) were collected as part of several archival projects, for different client projects on the JVR Online platform. Data were collected via online assessments for either selection or development purposes. A concurrent set of data was separately collected by asking managers of the 108 employees, who simultaneously completed the EQ-i 2.0, to rate their employees’ performance. A study conducted by Van Lill and Van der Merwe (2022) revealed that employees greatly inflate self-ratings on the IWPR (Van Lill & Taylor, 2022) when compared to managerial ratings, because of leniency bias. Managers might therefore provide a more conservative and accurate estimate of work performance (Van Lill & Van der Merwe, 2022). Managerial ratings also come with the added benefit of reduced method bias, because of another rating source used in addition to self-ratings on the EQ-i 2.0 (Podsakoff et al., 2012).

Data analysis
Study 1: Confirmatory factor analysis

Confirmatory factor analysis (CFA) was performed using Version 0.6–12 of the lavaan package (Rosseel, 2012; Rosseel et al., 2022) in R (R Core Team, 2016) to first inspect the inter-factor correlations between all the narrow EI factors, whereafter the hierarchical factor structure of the broad performance factors was investigated. A prior study conducted a higher-order factor analysis to inspect the general factor of EI in the EQ-i 2.0 (Van Zyl, 2014). Recent best practice guidelines recommend testing a sequence of five models before the presence of hierarchical structure of a psychometric measure is confirmed or refuted, namely (1) orthogonal first-order, (2) single-factor, (3) higher-order, (4) oblique lower-order and (5) bifactor models (Credé & Harms, 2015). A visual example of the different factor models is portrayed for composite Stress Management in Figure 3. Single-factor models (all items load on one factor) and orthogonal first-order models (factor models with uncorrelated lower-order factors) represent parsimonious models, and, if these models display greater fit, it might discredit the existence of hierarchical structure in the data. By contrast, better fit for lower-order (factor models with correlated factors), higher-order (items load on lower-order factors, which, in turn, load onto second-order factors) and bifactor models (items are specified simultaneously on uncorrelated first- and second-order factors) provides more support for hierarchical structure (Credé & Harms, 2015).

FIGURE 3: Factor structure of stress management (a) orthogonal first-order model, (b) single-factor model, (c) higher-order model, (d) oblique lower-order model, (e) bifactor model.

First-order factors, as specified in higher-order models, mediate the relationship between manifest variables and second-order factors and, therefore, do not explain unique variance in the manifest variables over and above the EI subscales (Beaujean, 2014; McAbee et al., 2014). Bifactor models differ in this respect by accounting for the unique variance that a general factor explains in the manifest variables, beyond the variance explained by the uncorrelated lower-order EI subscales (Beaujean, 2014; McAbee et al., 2014). Bifactor models were, therefore, used to test the existence of a general factor in EI, as manifested among the subscales of the EQ-i 2.0.

Diagonally weighted least squares (DWLS) estimation, with robust standard errors, was performed to inspect the hierarchical factor structure of EI (DiStefano & Morgan, 2014; Li, 2016). This method provides accurate estimates when larger samples are used (n > 500) when the data are multivariate non-normal, and is less sensitive when the data are based on an ordinal rating scale with five or more categories (DiStefano & Morgan, 2014; Li, 2016). The multivariate skewness (1234726.00; p < 0.001) and kurtosis (1200.95, p < 0.001) for the entire set of 118 items suggested that the data were non-normally distributed. Model-data fit was considered acceptable if the RMSEA and standardised root mean squared residual (SRMR) were ≤ 0.08 (Brown, 2015; Browne & Cudeck, 1992), and the comparative fit index (CFI) and Tucker–Lewis index (TLI) were > 0.95 (Brown, 2015; Hu & Bentler, 1999). Even when CFIs display a marginally good fit to the data (CFI and TLI in the range of 0.90 to 0.95), models might still be considered to display an acceptable fit if other indices (SRMR and RMSEA) are also within the acceptable range (Brown, 2015).

Study 2: Regression analysis

The researchers conducted separate linear regressions by means of the lm function in R (R Core Team, 2016). For the different models, a summed raw total EI score was regressed on a general dimension, as well as separate broad dimensions, of Individual work performance.

Ethical considerations

The current study was low in risk, but precautions were taken to ensure that participation was voluntary and anonymous, that no harm was caused, that the questions were filled in truthfully and that informed consent was given to use the results for research purposes.

Ethical clearance to conduct this study was obtained from the University of Johannesburg Department of Industrial Psychology and People Management Research Ethics Committee (reference number: IPPM-2022-598).

Results

Study 1: Confirmatory factor analysis

The mean item score and SD for each subscale of the EQ-i 2.0, along with the alpha and omega reliability estimates and standardised inter-factor correlations, are reported in Table 1. The inter-factor correlations were obtained by conducting an oblique lower-order confirmatory factor model. The fit statistics for the oblique lower-order confirmatory factor model of the entire EQ-i 2.0 (χ2 [df] = 254827.62 [6680]; CFI = 0.97; TLI = 0.97; SRMR = 0.05; RMSEA = 0.05 [0.05; 0.05]) were satisfactory (Brown, 2015). The oblique lower-order model, which fit statistics are also reported in Table 2, allows group factors to covary and enables an inspection of the inter-factor correlations between the dimensions for descriptive purposes.

TABLE 2: Fit statistics of different EQ-i 2.0 factor models.

The size of the relationships reported in Table 1 was mostly in the medium-to-large range, alluding to the possibility of a general factor. However, 95% of the standardised upper limit inter-factor correlations (UL) were below the cut-off recommended by Rönkkö and Cho (2020), namely UL < 0.80, suggesting a fair degree of discriminant validity at the subscale level. In a select few cases (5% of UL), insufficient evidence for discriminant validity existed. However, the lower levels of discriminant validity could be attributable to established theoretical relationships that have been reported between the scales in the past (Rönkkö & Cho, 2020; Wiechorek, 2011).

Table 1 also contains the inter-item consistency reliabilities. All the subscales obtained coefficient alpha ordinal and McDonald’s omega values (α and ω ≥ 0.71) above the recommended threshold (Cortina, 1993; Cortina et al., 2020). Only the independence subscale had an ω-value of 0.66, which was still accepted, as the α ordinal value was 0.77. These results suggest that the subscales reliably measure the respective scale constructs.

The fit of different factor models proposed by Credé and Harms (2015) was subsequently investigated to determine whether a general factor or alternative configurations explained the covariances between the subscale dimensions of the EQ-i 2.0. The different models are reported in Table 2.

The results reported in Table 2 indicated that the more parsimonious models, namely the orthogonal first-order and single-factor models, displayed a weaker fit to the data (Credé & Harms, 2015). By contrast, the more complex models (oblique lower-order, higher-order and bifactor models) displayed superior fit, supporting the existence of hierarchical structure in the data. The present study focussed on the manifestation of a general factor of EI and, therefore, necessitated a further inspection of the satisfactory fitting bifactor model, instead of the slightly better fitting oblique lower-order factor model.

It is recommended that bifactor statistical indices be calculated to determine the practical meaningfulness of general versus group factors in a bifactor analysis (Rodriguez et al., 2016a, 2016b), such as the explained common variance (ECV), coefficient omega hierarchical (ωh), construct replicability (H), factor determinacy (FD), percentage uncontaminated correlations (PUC) and relative percentage bias (ARPB). Group factors are considered plausible when ωh, H and FD2 are > 0.50, 0.70 and 0.70, respectively (Dueber, 2017; Reise et al., 2013). Explained common variance for the general factor > 0.70 and PUC > 0.80 are indicative of unidimensionality (Reise et al., 2013). Relative percentage bias below 10% – 15% indicates little difference in the factor loadings between a single-factor model and the general factor in a bifactor model (Rodriguez et al., 2016a). Bifactor statistical indices were calculated using Version 0.2.0 of the Bifactor Indices Calculator package (Dueber, 2020) in R (R Core Team, 2016). The bifactor statistical indices are reported in Table 3.

TABLE 3: Bifactor statistical indices for EQ-i 2.0 subscale factors.

The General EI factor accounted for over half of the common variance. The ECV > 0.50, including the high PUC > 0.80, suggests the presence of a strong general factor (Reise et al., 2013). These results were further supported by the ARPB value of 5%, which was well below the 10% – 15% mark, indicating no serious concern of measurement bias if the model was treated as unidimensional (Rodriguez et al., 2016a).

The subscale values all had a large difference between the ω and ωh values, with ωh ranging from 0.14 to 0.54. This normally suggests that the subscales mostly do not add additional unique variance, and that the factor model is unidimensional. However, Morin (2023) cautions against the use of ω and ωhs, as both tend to underestimate the reliability of group factors. The general trend of the FD and H coefficients, as well as the evidence of the discriminant validity of the group factors presented in Table 1, suggests that the subscales in the EQ-i 2.0 add additional interpretive value for development purposes (Dueber, 2017; Reise et al., 2013). The subscales also still explain the remaining 42% of the variance in the items. Consequently, at a cursory view of the hierarchical structure and without discounting the value of the subscales, it can be argued that a general EI factor exists, which supports Hypothesis 1.

Study 2: Regression analysis

Linear regressions were conducted to determine the relationship between overall EI and individual work performance. The regression coefficients of the different relationships are reported in Table 4.

TABLE 4: Total emotional intelligence regressed on general and broad dimensions of individual work performance.

In comparison to meta-analytical evidence, the validity estimate (R = 0.39) for General performance appears to be slightly higher in the present study compared to other meta-analytical estimates, namely ρ = 0.29 (Joseph et al., 2015) and ρ = 0.30 (Sackett et al., 2021). However, the estimate was still in the same direction and, similar to prior findings, moderate in size. Hypothesis 2 was, therefore, confirmed. The correlations for the broad dimensions of performance also appeared mostly moderate in size (R = 0.25 to 0.42; M = 0.35) and in the theorised directions. Therefore, Hypotheses 2A to 2E could also be confirmed. The regression coefficient for Leadership performance appeared to be pronounced, which could be attributed to the high emotional labour often associated with interpersonal influence (Glomb et al., 2004).

Discussion

Study 1 supported the existence of a strong general factor of EI, which explained 58% of the common variance. Practically, the findings suggest that a total score of EI, based on the EQ-i 2.0, could be calculated. A total score might enable scientists to include an overall EI score in regression analyses. A total score could also aid practitioners in including an overall EI score in selection decisions, especially when other psychometric results must be considered simultaneously. However, a nuanced interpretation based on the subscales still has merit, as it further ‘colours’ a person’s strengths and weaknesses, especially for use in development feedback and work-based counselling. An overall EI score might come across as more ambiguous and less actionable from a development perspective, compared to a more nuanced interpretation (Wiechorek, 2011).

In terms of Study 2, total EI appeared to have a pattern of relations with performance that replicates international results on the predictive validity of EI. Employees who display a fair degree of EI might be valued by supervisors as stable, well-functioning individuals and therefore be perceived as high performers. More specifically, EI could be a valuable psychological resource in uncertain conditions, such as the strain placed on employees during the coronavirus disease 2019 pandemic (Moroń & Biolik-Moroń, 2021). In such conditions, based on the findings of the present study, EI might assist employees in adapting to change (Adaptive performance) and initiate the necessary interpersonal influence (Leadership performance) to ensure that organisational goals are achieved, whether within or away from the office setting. The predictive validity of total EI for one of the most valued work-related outcomes in psychology, namely individual work performance (Campbell & Wiernik, 2015), gives credence to the utility of such a score in employee selection processes.

Limitations and recommendations for future research

Mean group gender differences have been reported for EI in the past, with scholars suggesting that men might be adversely affected in selection procedures if a total score of EI is used in isolation to make a hiring decision (Joseph & Newman, 2010). Multi-group CFAs suggest that composite scales in the EQ-i 2.0 are invariant across gender groups. An inspection of mean group differences further revealed only small effect size differences (Stols & Van Lill, 2022). Further research could inspect the invariance and mean group gender differences of a general dimension of EI based on the EQ-i 2.0 in the Southern African context.

The predictive validity of total EI was mainly based on professional and managerial staff, many of whom were employed in the financial and health sector, for whom high EI might be a more pronounced occupational requirement. Most other Southern African studies appeared to have sampled managerial employees, and future studies could inspect whether these relationships are replicable for other job families in South Africa, such as skilled/semiskilled, clerical, military and law enforcement jobs.

Conclusion

Prior studies in South Africa frequently used total scores on EI to predict work-related outcomes without considering the hierarchical structure of the measure (Hayward et al., 2008; Nel & De Villiers, 2004; Sloan & Geldenhuys, 2021). This study inspected and presented evidence in favor of the calculation of a general factor of EI based on the EQ-i 2.0. The evidence further suggests that the total EI score, in accordance with the findings of Nel and De Villiers (2014) and Sloan and Geldenhuys (2021), yields meaningful validity estimates for work-related outcomes, such as work performance. Consequently, using the total EI score in a report might be meaningful when, for example, selection decisions need to be made about employees.

Acknowledgements

We would like to thank our colleagues at JVR Africa Group for enriching our understanding, through conversation, on the structure and predictive validity of emotional intelligence.

Competing interests

All four authors are employees of JVR Africa Group, which is the distributor of the EQi 2.0 in South Africa.

Authors’ contributions

X.v.L., A.S., P.R. and J.W. developed the conceptual framework and devised the method. X.v.L and A.S. analysed the data.

Funding information

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Data availability

Coefficients based on the bifactor analysis are available upon reasonable request.

Disclaimer

The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.

References

Aguinis, H. (2019). Performance management (4th ed.). Chicago Business Press.

Ashkanasy, N.M., & Daus, C.S. (2005). Rumors of the death of emotional intelligence in organizational behavior are vastly exaggerated. Journal of Organizational Behavior, 26(4), 441–452. https://doi.org/10.1002/job.320

Beaujean, A.A. (2014). Latent variable modeling using R: A step-by-step guide. Routledge.

Borman, W.C., & Motowidlo, S.J. (1997). Task performance and contextual performance: The meaning for personnel selection research. Human Performance, 10(2), 99–109. https://doi.org/10.1207/s15327043hup1002_3

Brown, T.A. (2015). Confirmatory factor analysis for applied research (2nd ed.). The Guilford Press.

Browne, M.W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005

Campbell, J.P., & Wiernik, B.M. (2015). The modeling and assessment of work performance. Annual Review of Organizational Psychology and Organizational Behavior, 2(1), 47–74. https://doi.org/10.1146/annurev-orgpsych-032414-111427

Carpini, J.A., Parker, S.K., & Griffin, M.A. (2017). A look back and a leap forward: A review and synthesis of the individual work performance literature. Academy of Management Annals, 11(2), 825–885. https://doi.org/10.5465/annals.2015.0151

Cortina, J.M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037/0021-9010.78.1.98

Cortina, J.M., Sheng, Z., Keener, S.K., Keeler, K.R., Grubb, L.K., Schmitt, N., Tonidandel, S., Summerville, K.M., Heggestad, E.D., & Banks, G.C. (2020). From alpha to omega and beyond! A look at the past, present, and (possible) future of psychometric soundness in the Journal of Applied Psychology. Journal of Applied Psychology, 105(12), 1351–1381. https://doi.org/10.1037/apl0000815

Credé, M., & Harms, P.D. (2015). 25 years of higher-order confirmatory factor analysis in the organizational sciences: A critical review and development of reporting recommendations. Journal of Organizational Behavior, 36(6), 845–872. https://doi.org/10.1002/job.2008

Dasborough, M.T., Ashkanasy, N.M., Humphrey, R.H., Harms, P.D., Credé, M., & Wood, D. (2021). Does leadership still not need emotional intelligence? Continuing ‘The Great EI Debate’. The Leadership Quarterly, 33(6), 101539. https://doi.org/10.1016/j.leaqua.2021.101539

DiStefano, C., & Morgan, G.B. (2014). A comparison of diagonal weighted least squares robust estimation techniques for ordinal data. Structural Equation Modeling, 21(3), 425–438. https://doi.org/10.1080/10705511.2014.915373

Dueber, D.M. (2017). Bifactor indices calculator: A Microsoft Excel-based tool to calculate various indices relevant to bifactor CFA models. UKnowledge, University of Kentucky.

Dueber, D.M. (2020). Bifactor indices calculator. Retrieved from https://cran.r-project.org/web/packages/BifactorIndicesCalculator/BifactorIndicesCalculator.pdf

Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146

Glomb, T.M., Kammeyer-Mueller, J.D., & Rotundo, M. (2004). Emotional labor demands and compensating wage differentials. Journal of Applied Psychology, 89(4), 700–714. https://doi.org/10.1037/0021-9010.89.4.700

Harms, P.D., & Credé, M. (2010). Emotional intelligence and transformational and transactional leadership: A meta-analysis. Journal of Leadership and Organizational Studies, 17(1), 5–17. https://doi.org/10.1177/1548051809350894

Hayward, B.A., Baxter, J., & Amos, T.L. (2008). Employee performance, leadership style and emotional intelligence: An exploratory study in a South African parastatal. Acta Commercii, 8(1), a57. https://doi.org/10.4102/ac.v8i1.57

Hogan, R., & Sherman, R.A. (2020). Personality theory and the nature of human nature. Personality and Individual Differences, 152, 1–5. https://doi.org/10.1016/j.paid.2019.109561

Hu, L., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Joseph, D.L., Jin, J., Newman, D.A., & O’Boyle, E.H. (2015). Why does self-reported emotional intelligence predict job performance? A meta-analytic investigation of mixed EI. Journal of Applied Psychology, 100(2), 298–342. https://doi.org/10.1037/a0037681

Joseph, D.L., & Newman, D.A. (2010). Emotional intelligence: An integrative meta-analysis and cascading model. Journal of Applied Psychology, 95(1), 54–78. https://doi.org/10.1037/a0017286

Li, C.-H. (2016). Confirmatory factor analysis with ordinal data: Comparing robust maximum likelihood and diagonally weighted least squares. Behavior Research Methods, 48(3), 936–949. https://doi.org/10.3758/s13428-015-0619-7

Marcus, B., Taylor, O.A., Hastings, S.E., Sturm, A., & Weigelt, O. (2016). The structure of counterproductive work behavior: A review, a structural meta-analysis, and a primary study. Journal of Management, 42(1), 203–233. https://doi.org/10.1177/0149206313503019

Mayer, J.D., Salovey, P., Caruso, D.R., & Sitarenios, G. (2003). Measuring emotional intelligence with the MSCEIT V2.0. Emotion, 3(1), 97–105. https://doi.org/10.1037/1528-3542.3.1.97

McAbee, T.S., Oswald, L.F., & Connelly, S.B. (2014). Bifactor models of personality and college student performance. European Journal of Personality, 28(6), 604–619. https://doi.org/10.1002/per.1975

Miao, C., Humphrey, R.H., & Qian, S. (2017). Are the emotionally intelligent good citizens or counterproductive? A meta-analysis of emotional intelligence and its relationships with organizational citizenship behavior and counterproductive work behavior. Personality and Individual Differences, 116, 144–156. https://doi.org/10.1016/j.paid.2017.04.015

Morin, A.J.S. (2023). Exploratory structural equation modeling. In R.H. Hoyle (Ed.), Handbook of structural equation modeling (2nd ed., pp. 503–524). Guilford.

Moroń, M., & Biolik-Moroń, M. (2021). Trait emotional intelligence and emotional experiences during the COVID-19 pandemic outbreak in Poland: A daily diary study. Personality and Individual Differences, 168, 1–11. https://doi.org/10.1016/j.paid.2020.110348

Motowidlo, S.J., & Van Scotter, J.R. (1994). Evidence that task performance should be distinguished from contextual performance. Journal of Applied Psychology, 79(4), 475–480. https://doi.org/10.1037/0021-9010.79.4.475

Nel, H., & De Villiers, W.S. (2004). The relationship between emotional intelligence and job performance in a call centre environment. SA Journal of Industrial Psychology, 30(3), a159. https://doi.org/10.4102/sajip.v30i3.159

Organ, D.W. (1997). Organizational citizenship behavior: It’s construct clean-up time. Human Performance, 10(2), 85–97. https://doi.org/10.1207/s15327043hup1002_2

Petrides, K.V., Mikolajczak, M., Mavroveli, S., Sanchez-Ruiz, M.-J., Furnham, A., & Pérez-González, J.-C. (2016). Developments in trait emotional intelligence research. Emotion Review, 8(4), 335–341. https://doi.org/10.1177/1754073916650493

Podsakoff, P.M., MacKenzie, S.B., & Podsakoff, N.P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63(1), 539–569. https://doi.org/10.1146/annurev-psych-120710-100452

Preacher, K.J., & Coffman, D.L. (2006). Computing power and minimum sample size for RMSEA [Computer software]. Retrieved from http://quantpsy.org/

Pulakos, E.D., Arad, S., Donovan, M.A., & Plamondon, K.E. (2000). Adaptability in the workplace: Development of a taxonomy of adaptive performance. Journal of Applied Psychology, 85(4), 612–624. https://doi.org/10.1037/0021-9010.85.4.612

R Core Team. (2016). R: A language and environment for statistical computing. Reference Index. Retrieved from https://cran.r-project.org/doc/manuals/r-release/fullrefman.pdf

Reise, S.P., Bonifay, W.E., & Haviland, M.G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95(2), 129–140. https://doi.org/10.1080/00223891.2012.725437

Rodriguez, A., Reise, S.P., & Haviland, M.G. (2016a). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249

Rodriguez, A., Reise, S.P., & Haviland, M.G. (2016b). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150. https://doi.org/10.1037/met0000045

Rönkkö, M., & Cho, E. (2020). An updated guideline for assessing discriminant validity. Organizational Research Methods, December, 25(1), 6–14. https://doi.org/10.1177/1094428120968614

Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

Rosseel, Y., Jorgensen, T., & Rockwood, N. (2022). Latent variable analysis. Retrieved from https://cran.r-project.org/web/packages/lavaan/index.html

Sackett, P.R., Zhang, C., Berry, C.M., & Lievens, F. (2021). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040–2068. https://doi.org/10.1037/apl0000994

Sloan, M., & Geldenhuys, M. (2021). Regulating emotions at work: The role of emotional intelligence in the process of conflict, job crafting and performance. SA Journal of Industrial Psychology, 47, a1875. https://doi.org/10.4102/sajip.v47i0.1875

Spector, P.E., & Fox, S. (2005). The stressor–emotion model of counterproductive work behavior. In P.E. Spector & S. Fox (Eds.), Counterproductive work behavior (pp. 151–174). American Psychological Association.

Stein, S.J., & Book, H.E. (2011). The EQ edge: Emotional intelligence and your success. John Wiley & Sons.

Stols, A., & Van Lill, X. (2022). Emotional Quotient Inventory 2.0 (EQ-i 2.0): A South African English technical manual supplement. Multi Healthy Systems and JVR Africa Group.

Van Lill, X., & Taylor, N. (2022). The validity of five broad generic dimension of performance in South Africa. South African Journal of Human Resource Management, 20(0), 1–15. https://doi.org/10.4102/sajhrm.v20i0.1844

Van Lill, X., & Van der Merwe, G. (2022). Differences in self- and managerial ratings on generic performance dimensions. SA Journal of Industrial Psychology, 48, 1–10. https://doi.org/10.4102/sajip.v48i0.2045.

Van Lill, X., & Van der Vaart, L. (2023). The validity of a general factor of individual work performance in the South African context. Manuscript submitted for publication.

Van Zyl, C.J.J. (2014). The psychometric properties of the Emotional Quotient Inventory 2.0 in South Africa. SA Journal of Industrial Psychology, 40(1), a1192. https://doi.org/10.4102/sajip.v40i1.1192

Viswesvaran, C., Schmidt, F.L., & Ones, D.S. (2005). Is there a general factor in ratings of job performance? A meta-analytic framework for disentangling substantive and error influences. Journal of Applied Psychology, 90(1), 108–131. https://doi.org/10.1037/0021-9010.90.1.108

Wiechorek, D. (2011). Emotional Quotient Inventory 2.0: User’s handbook. Multi-Health Systems.

Yang, H., Weng, Q., Li, J., & Wu, S. (2022). Exploring the relationship between trait emotional intelligence and adaptive performance: The role of situational strength and self-efficacy. Personality and Individual Differences, 196, 111711. https://doi.org/10.1016/j.paid.2022.111711

Yukl, G. (2012). Effective leadership behavior: What we know and what questions need more attention. Academy of Management Perspectives, 26(4), 66–85. https://doi.org/10.5465/amp.2012.0088


 

Crossref Citations

1. Emotional intelligence predicting subject-specific academic success: EQ-i Youth in South Africa
Anneke Stols, Petro Erasmus, Wandile F. Tsabedze
African Journal of Career Development  vol: 6  issue: 1  year: 2024  
doi: 10.4102/ajcd.v6i1.114