OVS Psychometrics

Statistical Analysis

Several statistical analyses have been conducted over nearly a decade to ensure that the Vital Signs tools are robust and accurate. These findings are from the 2013 analysis of the VS database.

Structure

Scales: 5 climate scales + 4 outcome scales Mean score: 100
Standard deviation: 15

Norming & Validation: Based on over 15,000 responses from over 100 organizations, the OVS database represents a robust norm group representing small, medium, and large enterprise, government agencies, and nonprofits from all over the globe. Industries include technology, manufacturing, finance, hospitality, healthcare, education, plus a range of professional services. The majority of respondents are from US, Italy, UAE, Singapore, Malaysia, China, and Canada; as shown below, they tend to be educated professionals.

The model has been subjected to two factor analyses and extensive psychometric validation. These analyses confirm the structure of the tools, with a 5-factor and predictive validity and its reliability (below).

Cronbach Alpha

One way to report on the reliability of a psychometric measure is to calculate the internal consistency of its underlying scales. Internal consistency refers to the extent to which items assigned to a scale are correlated to one another. Cronbach’s coefficient alpha was used to calculate the internal consistency of the VS drivers. This statistic can range from -1.0 to +1.0 and indicates to what extent the items in a factor measure the same construct. An alpha with a positive value, and greater than 0.6, is considered statistically reliable.

Predicting Outcomes

There is a strong relationship between climate and the outcomes.

A multiple regression analysis was used to test the relationship between the OVS scales and the four outcomes. Collectively, 60% of the variation in the performance outcomes is predicted by the organizational climate (R2=.5998). This relationship can be seen visually in this scatter graph:

Open

The climate scores also predict variation in each individual outcome:

• Retention = 36.33%

• Productivity = 36.68%

• Customer Focus = 42.62%

• Future Success = 60.27%

Below is the model in its predictive validity showing how different factors contribute to explain the link between climate and overall performance.

Report of the Forward procedure for dependent variables, n = 5350, P> 0.5 (by Regression Analysis OVS 2013, Lorenzo Fariselli, 2013):

The following tables show how different factors contribute to each of the four OVS performance outcomes.

Report of the Forward procedure for dependent variables, n = 5350, P> 0.5 (by Regression Analysis OVS 2013, Lorenzo Fariselli, 2013):

Norm Group Characteristics

The Vital Signs database includes organizations, teams, and individuals from around the globe. The following graphs provide an overview of the norm base:

Open

Norm base variation

The mean score on climate is 100; there are slight variations by demographics as follows: