Abstract of Validation Study for the Global Competence Aptitude Assessment®

Laura Roberts, Ph.D., Right Angle Research Services

Global Competence was conceptualized as two separate scales, an Internal Readiness scale and an External Readiness scale. Moreover, we conceptualized the Internal Readiness scale to be comprised of the following subscales:  self-awareness, willingness to take risks, open-mindedness, and perceptive/respectful of diversity. Similarly, we believed the External Readiness scale to be composed of these subscales:  globally aware, knowledgeable about world history, interculturally competent, and effective across cultures.

Research Methods

The sample pool consisted of 98 people ages 18-35 studying business or related fields or working in international business settings. Respondents were participating in a highly selective leadership program for global entrepreneurs. Respondents reported between 1 and 5 years of professional work experience outside their home country. The mean number of years abroad was 2.96 (SD = 1.49). Respondents spoke a number of languages, yet each was deemed proficient in English by the program selection committee.

GC Internal Readiness Scale

Because the GC Internal Readiness items were scored with a Likert-type response, a Cronbach's alpha coefficient was the appropriate statistic to examine internal consistency. The Cronbach's alpha coefficient for the 38 item scale of 0.85 was well within the range of acceptable values for a scale of this type. Thus, it was concluded that the items were internally consistent and they appeared to be measuring a single underlying construct.

Criterion Validity: The analyst proposed a positive correlation between scores on the GC Internal Readiness scale and the single-item GC self appraisal. In addition, the criterion validity analysis for the GC Internal Readiness scale was based on the theory that the characteristics of an individual that determine Internal Readiness strength are relatively stable attributes of personality. We believe GC Internal Readiness is determined by a person's intrinsic knowledge. Thus, we expected to find a non-significant correlation between Internal Readiness skill and number of years spent outside one's home country.

Both hypotheses were supported in the data. There was a correlation between the GC Internal Readiness scale and respondents' GC self appraisals (r =0.32, p < 0.03) and a non-significant correlation between the GC Internal Readiness scale and number of years spent outside one's home country (r = 0.17, p < 0.25).

GC External Readiness Scale

Reliability Tests:   The first set of analyses generated a Kuder-Richardson coefficient to determine whether the items were internally consistent. We targeted a Kuder-Richardson criterion of 0.70 to indicate an acceptable level of internal consistency. The 54 GC External Readiness items showed an internal consistency coefficient of 0.706 which exceeded the criterion of 0.70.

Criterion Validity:   The GC External Readiness scale consisted of items measuring factual knowledge about topics such as geography, history, cultural customs, language, religion, and currency, as well as cultural sensitivity, judgment, business sense. Because GC External Readiness skills are dependent, in part, upon global knowledge and factual information, we reasoned that more international experience would be linked to higher GC External Readiness scores. Thus, it was expected that GC External Readiness scores would be positively correlated with the number of years spent living or working outside of one's home country. We also included in the questionnaire a single-item self appraisal of global competence on a scale from 1 (low) to 10 (high). We expected the GC External Readiness scale to be positively correlated with responses to this single-item assessment.

The analyses showed the hypotheses were supported by the data. There was a moderate to large, significant correlation between the GC External Readiness scale and the GC self appraisal (r = 0.48, p < 0.001) and between the GC External Readiness scale and years spent outside one's home country (r = 0.43, p < 0.003).

Summary

This validation study showed that both the GC Internal and External Readiness scales exhibited internal consistency within the acceptable range for scales of this type. Tests of criterion validity examined hypotheses derived from theory about the latent constructs believed to be contained within the data. These analyses provided some evidence of criterion validity for both the construct and the instrument.  More specifically, we found evidence consistent with the notion that GC Internal Readiness is a relatively stable, internal, trait-like characteristic and is less influenced by experience. In contrast, GC External Readiness appears to be more heavily impacted by external experiences. Further evidence of criterion validity showed both Internal and External Readiness scores were correlated with a single-item self appraisal. Based on these findings, it can be concluded that the Global Competence Aptitude Assessment® measures two latent constructs entitled GC Internal Readiness and GC External Readiness with acceptable criterion validity and reliability.