TVS Psychometrics 2.0

Statistical Analysis

Several statistical analyses have been conducted throughout the course of a decade to ensure that the Vital Signs tools are robust and accurate. These findings are from the 2022 analysis of the Team Vital Signs (TVS) database.

Structure

Scales: 5 climate scales + 4 outcome scales
Mean score: 100
Standard deviation: 15

Norming & Validation: Based on data collected from over 6,200 responses across more than 340 team projects conducted between January 2019 to December 2021, the TVS database represents a robust norm sample representing small, medium, and large teams from all over the globe. The TVS questionnaire is offered in Arabic, Chinese, Czech, English, Indonesian, Italian, Japanese, Korean, Lithuanian, Polish, Portuguese (Brazil), and Spanish. Reports are offered in Chinese, English, Italian, Lithuanian, Korean, Portuguese, and Spanish.

The model has been subjected to two factor analyses and extensive psychometric validation. These analyses confirm the structure of the tool, with a 5-factor and predictive validity and its reliability (below).

Cronbach Alpha

One way to report on the reliability of a psychometric measure is to calculate the internal consistency of its underlying scales. Internal consistency refers to the extent to which items assigned to a scale are correlated to one another. Cronbach’s alpha coefficients were used to calculate the internal consistency of the VS drivers. Alpha levels can range from -1.0 to +1.0 and indicate to what extent the items in a factor reliably measure the same construct. An alpha with a positive value, and greater than 0.6, is considered statistically reliable.

Scale

Cronbach‘s Coefficient Alpha

Scale

Cronbach‘s Coefficient Alpha

Trust

0.868

Teamwork

0.898

Motivation

0.855

Execution

0.889

Change

0.726

Predicting Outcomes

There is a strong relationship between team climate and outcomes.

A multiple regression analysis was used to test the relationship between the TVS scales and the four outcomes. Collectively, 83% of the variation in the performance outcomes is predicted by the team climate (R2=0.8292).

The climate scores also predict variation in each individual outcome:

  • Satisfaction = 61.71%

  • Results = 55.71%

  • Agility = 77.08%

  • Sustainability = 74.41%

Below is the model in its predictive validity showing how different factors contribute to explain the link between climate and overall performance.

Predicting Total Performance

R2 Partial

R2 Model

Predicting Total Performance

R2 Partial

R2 Model

Trust

0.7253

0.7253

Motivation

0.0694

0.7947

Change

0.0285

0.8232

Teamwork

0.0054

0.8286

Execution

0.0006

0.8292

 n = 6210, P<0.001

The following tables show how different factors contribute to each of the four TVS performance outcomes.

Predicting Satisfaction

R2 Partial

R2 Model

Predicting Satisfaction

R2 Partial

R2 Model

Motivation

0.5791

0.5791

Trust

0.0282

0.6073

Teamwork

0.0073

0.6146

Change

0.0025

0.6171

Execution

0.0000

0.6171

 n = 6210, P<0.001

Predicting Results

R2 Partial

R2 Model

Predicting Results

R2 Partial

R2 Model

Motivation

0.5070

0.5070

Trust

0.0360

0.5430

Change

0.0072

0.5502

Teamwork

0.0059

0.5561

Execution

0.0010

0.5571

 n = 6210, P<0.001

Predicting Agility

R2 Partial

R2 Model

Predicting Agility

R2 Partial

R2 Model

Change

0.6850

0.6850

Execution

0.0753

0.7603

Trust

0.0065

0.7668

Teamwork

0.0022

0.7690

Motivation

0.0018

0.7708

 n = 6210, P<0.001

Predicting Sustainability

R2 Partial

R2 Model

Predicting Sustainability

R2 Partial

R2 Model

Trust

0.7054

0.7054

Motivation

0.0378

0.7432

Change

0.0008

0.7440

Execution

0.0001

0.7441

Teamwork

0.0000

0.7441

 n = 6210, P<0.001