TVS Psychometrics 2.0
Statistical Analysis
Several statistical analyses have been conducted throughout the course of a decade to ensure that the Vital Signs tools are robust and accurate. These findings are from the 2022 analysis of the Team Vital Signs (TVS) database.
Structure
Scales: 5 climate scales + 4 outcome scales
Mean score: 100
Standard deviation: 15
Norming & Validation: Based on data collected from over 6,200 responses across more than 340 team projects conducted between January 2019 to December 2021, the TVS database represents a robust norm sample representing small, medium, and large teams from all over the globe. The TVS questionnaire is offered in Arabic, Chinese, Czech, English, Indonesian, Italian, Japanese, Korean, Lithuanian, Polish, Portuguese (Brazil), and Spanish. Reports are offered in Chinese, English, Italian, Lithuanian, Korean, Portuguese, and Spanish.
The model has been subjected to two factor analyses and extensive psychometric validation. These analyses confirm the structure of the tool, with a 5-factor and predictive validity and its reliability (below).
Cronbach Alpha
One way to report on the reliability of a psychometric measure is to calculate the internal consistency of its underlying scales. Internal consistency refers to the extent to which items assigned to a scale are correlated to one another. Cronbach’s alpha coefficients were used to calculate the internal consistency of the VS drivers. Alpha levels can range from -1.0 to +1.0 and indicate to what extent the items in a factor reliably measure the same construct. An alpha with a positive value, and greater than 0.6, is considered statistically reliable.
Scale | Cronbach‘s Coefficient Alpha |
---|---|
Trust | 0.868 |
Teamwork | 0.898 |
Motivation | 0.855 |
Execution | 0.889 |
Change | 0.726 |
Predicting Outcomes
There is a strong relationship between team climate and outcomes.
A multiple regression analysis was used to test the relationship between the TVS scales and the four outcomes. Collectively, 83% of the variation in the performance outcomes is predicted by the team climate (R2=0.8292).
The climate scores also predict variation in each individual outcome:
Satisfaction = 61.71%
Results = 55.71%
Agility = 77.08%
Sustainability = 74.41%
Below is the model in its predictive validity showing how different factors contribute to explain the link between climate and overall performance.
Predicting Total Performance | R2 Partial | R2 Model |
---|---|---|
Trust | 0.7253 | 0.7253 |
Motivation | 0.0694 | 0.7947 |
Change | 0.0285 | 0.8232 |
Teamwork | 0.0054 | 0.8286 |
Execution | 0.0006 | 0.8292 |
n = 6210, P<0.001
The following tables show how different factors contribute to each of the four TVS performance outcomes.
Predicting Satisfaction | R2 Partial | R2 Model |
---|---|---|
Motivation | 0.5791 | 0.5791 |
Trust | 0.0282 | 0.6073 |
Teamwork | 0.0073 | 0.6146 |
Change | 0.0025 | 0.6171 |
Execution | 0.0000 | 0.6171 |
n = 6210, P<0.001
Predicting Results | R2 Partial | R2 Model |
---|---|---|
Motivation | 0.5070 | 0.5070 |
Trust | 0.0360 | 0.5430 |
Change | 0.0072 | 0.5502 |
Teamwork | 0.0059 | 0.5561 |
Execution | 0.0010 | 0.5571 |
n = 6210, P<0.001
Predicting Agility | R2 Partial | R2 Model |
---|---|---|
Change | 0.6850 | 0.6850 |
Execution | 0.0753 | 0.7603 |
Trust | 0.0065 | 0.7668 |
Teamwork | 0.0022 | 0.7690 |
Motivation | 0.0018 | 0.7708 |
n = 6210, P<0.001
Predicting Sustainability | R2 Partial | R2 Model |
---|---|---|
Trust | 0.7054 | 0.7054 |
Motivation | 0.0378 | 0.7432 |
Change | 0.0008 | 0.7440 |
Execution | 0.0001 | 0.7441 |
Teamwork | 0.0000 | 0.7441 |
n = 6210, P<0.001