Living Updates from The Living SEB Skills Project

Authors
Affiliation

Tommaso Feraco

University of Padova

Margherita Calderan

University of Padova

Gerardo Pellegrino

University of Padova

Project overview

The Living SEB Skills Project is an ongoing initiative aimed at building a transparent, cumulative, and continuously updated resource for the study of social, emotional, and behavioral (SEB) skills (Soto, Napolitano, and Roberts 2021). Within this framework, SEB skills are organized into five broad domains: Self-management skills, which concern the capacity to plan, persist, and complete goal-directed tasks; Innovation skills, which reflect the ability to engage with new ideas and think creatively; Social engagement skills, which involve efficiently communicating and participating in social interactions; Cooperation skills, which support positive and constructive relationships with others; and Emotional resilience skills, which refer to the capacity to regulate emotions and cope effectively with stress and difficulties. Together, these domains provide an integrative way of studying skills that are often discussed under labels such as soft skills, social-emotional skills, or 21st-century skills.

The main goal of the Living SEB Skills Project is to make research in this area easier to monitor, synthesize, and use by maintaining a database that is updated regularly and organized so that new evidence can be incorporated over time. This makes it possible to track the development of the field, reduce fragmentation, and support a more cumulative and reproducible approach to research synthesis.

This monthly report is part of that broader effort. Its purpose is to provide an updated overview of the current state of the database and to summarize some of the main results that may emerge from the most recent release. Because the project follows a living approach, the contents of the database may expand over time as new studies become available and are screened, coded, and added to the resource. For this reason, the results reported here should be interpreted as the most up-to-date picture currently available rather than as a final or definitive summary of the literature.

The sections that follow first describe the data currently included in the project and then present selected results obtained from the latest version of the database.

The Database

At the time of writing, the systematic search identified 356 publications (Scopus = 187; WOS = 169). After removing duplicates, screening titles and abstracts, and reviewing full texts, 30 studies were retained for the living review and 19 studies met criteria for quantitative synthesis. These include a total of 26 independent samples (see Figure 1), with sample sizes ranging from 137 to 5075 (median = 621).

Across these studies, a total of 17221 correlation coefficients were coded, representing 5850 unique pairwise associations. Of these, 14292 correlations (3857 unique associations) involved at least one SEB domain or facet measured with a BESSI instrument.

Figure 1: PRISMA flow chart

Gender Differences

Using the correlations available, it is possible to gauge information also on group differences. To do so, we use a three-level random-effects model.

Because gender was coded 0 = male and 1 = female, positive correlations indicate higher scores among females, whereas negative correlations indicate higher scores among males.

A total of 154 effect sizes from 15 studies and 22 samples were included. For each SEB domain, the median available sample size was 651 (minimum sample size = 137; maximum sample size = 5075).

The full set of results is available in Table 1 and Figure 2.

Table 1: Meta-analytical associations between SEB skills and Biological Sex

Skill

N (k)

r

CI

PI

se

q

tau2

Cooperation

21752 (22)

0.04*

0.01; 0.08

-0.09; 0.18

0.02

118 (21)*

0.00

Emotional resilience

21752 (22)

-0.20***

-0.28; -0.13

-0.49; 0.12

0.04

256 (21)*

0.02

Innovation

21615 (21)

0.02

-0.02; 0.06

-0.16; 0.20

0.02

205 (20)*

0.01

Self-management

21937 (22)

0.02

-0.02; 0.06

-0.14; 0.18

0.02

185 (21)*

0.01

Social engagement

21752 (22)

-0.07**

-0.11; -0.03

-0.23; 0.09

0.02

110 (21)*

0.01

Figure 2: Meta-analytical associations between the five SEB domains and Biological Sex.

Of the five meta-analysed correlations with biological sex, one were larger than |0.10|, with significant effects (p < 0.01) ranging between -0.2 (i.e., Emotional resilience) and 0.04 (i.e., Cooperation).

SEB Skills and Academic Achievement

Onother interesting question we may tackle using the Living SEB Skills Project’s database, is do SEB skills matter for academic achievement.

We Try to answer this question at three different levels:

  • Are SEB skills singularly associated with academic achievement?
  • Do SEB skills predict academic achievement beyond the Big Five?
  • Does any specific skill show incremental validity beyond the other skills?

The Association Between SEB Skills and Academic Achievement

To test the bivariate associations between the five SEB skill domains and academic achievement, we use a three-level random-effects model.

A total of 50 effect sizes from 9 studies and 10 samples were included. For each SEB domain, the median available sample size was 796 (minimum sample size = 319; maximum sample size = 5075).

The full set of results is available in Table 2 and Figure 3.

Table 2: Meta-analytical associations between SEB skills and academic achievement

Skill

N (k)

r

CI

PI

se

q

tau2

Cooperation

12672 (10)

0.10**

0.03; 0.17

-0.10; 0.29

0.03

48 (9)*

0.01

Emotional resilience

12672 (10)

0.06*

0.01; 0.11

-0.08; 0.20

0.02

24 (9)*

0.00

Innovation

12672 (10)

0.11*

0.03; 0.19

-0.14; 0.35

0.04

86 (9)*

0.01

Self-management

12672 (10)

0.24***

0.18; 0.30

0.04; 0.42

0.03

59 (9)*

0.01

Social engagement

12672 (10)

0.11**

0.04; 0.17

-0.08; 0.29

0.03

38 (9)*

0.01

Figure 3: Meta-analytical associations between the five SEB domains and academic achievement.

Of the five meta-analysed correlations with academic achievement, four were larger than 0.10, with significant effects (p < 0.01) ranging between 0.1 (i.e., Cooperation) and 0.24 (i.e., Self-management).

SEB Skills or Big Five Traits?

Using one-stage meta-analytic structural equation modelling (OSMASEM) procedures (Jak and Cheung 2020), five saturated regression models were estimated, each including one SEB domain and its matched Big Five trait as predictors of academic achievement.

MASEM analyses were based on varying number of effect sizes per pairwise correlation (i.e., different correlation matrices), with the minimum available effects per correlation being 3 and the maximum being 24. As a consequence, also sample sizes and precision differed, with the minimum being 2712 (i.e., correlations between personality traits and academic achievement) and the maximum being 22911 (i.e., correlations between SEB domains). Correlation matrices were taken from 24 samples included in 17 different studies.

Given the low number of studies available for some variables, we set between-study variance to zero and estimated a common effect across studies. This approach avoids attempting to estimate random‐effects components that would be unstable or poorly identified in sparse conditions.

Table 3: OSMASEM regression and correlation coefficients for the five models

Outcome

Predictor

Estimate

se

CI

z

Academic achievement

~

BF Openness

-0.065*

0.02

[-0.11; -0.02]

-2.55

Academic achievement

~

Innovation

0.16***

0.02

[0.12; 0.2]

8.40

BF Openness

~~

Innovation

0.673***

0.01

[0.66; 0.69]

109.86

Academic achievement

~

BF Conscientiousness

0.127***

0.03

[0.08; 0.18]

4.92

Academic achievement

~

Self-management

0.172***

0.02

[0.13; 0.21]

8.67

Self-management

~~

BF Conscientiousness

0.693***

0.01

[0.68; 0.7]

118.26

Academic achievement

~

BF Extraversion

-0.02

0.03

[-0.07; 0.03]

-0.71

Academic achievement

~

Social engagement

0.115***

0.02

[0.07; 0.16]

5.34

Social engagement

~~

BF Extraversion

0.719***

0.00

[0.71; 0.73]

133.70

Academic achievement

~

BF Agreeableness

0.067**

0.02

[0.02; 0.11]

2.82

Academic achievement

~

Cooperation

0.051**

0.02

[0.02; 0.08]

3.08

Cooperation

~~

BF Agreeableness

0.594***

0.01

[0.58; 0.61]

82.27

Academic achievement

~

BF Neuroticism

0.055*

0.03

[0; 0.11]

2.10

Academic achievement

~

Emotional resilience

0.083***

0.02

[0.04; 0.12]

4.14

BF Neuroticism

~~

Emotional resilience

-0.684***

0.01

[-0.7; -0.67]

-115.35

From Table 3, three of the SEB skills and one of the personality traits showed significant associations (p < 0.01) with academic achievement larger than |0.1| beyond the corresponding trait/skill. Specifically, Innovation (b = 0.16; 95% CI [0.12; 0.2]; p < 0.001), Self-management (b = 0.17; 95% CI [0.13; 0.21]; p < 0.001), Social engagement (b = 0.12; 95% CI [0.07; 0.16]; p < 0.001) and BF Conscientiousness (b = 0.13; 95% CI [0.08; 0.18]; p < 0.001) showed significant and practically meaningful associations with academic achievement, while all other associations were lower than |0.08| and non-significant. It should be noted, however, that to estimate a complete OSMASEM model, a more refined analysis would require enlarging the research to all studies testing the association between the Big Five and academic achievement to produce better estimates of the covariance between the Big Five themselves and academic achievement and possibly obtain more precise estimates and lower convergence issues.

The Golden Skill for Academic Achievement

To test whether any specific SEB skill shows incremental predictive validity for academic achievement beyond all other skills we performed an additional one-stage meta-analytic structural equation modelling (OSMASEM) estimating one multiple regression model including all SEB domains as predictors of academic achievement.

Table 4: OSMASEM regression coefficients for the multiple regression model including all five skill domains

Outcome

Predictor

Estimate

se

CI

z

Academic achievement

~

Cooperation

-0.052***

0.01

[-0.07; -0.04]

-6.23

Academic achievement

~

Emotional resilience

-0.109***

0.01

[-0.13; -0.09]

-12.87

Academic achievement

~

Innovation

0.013

0.01

[0; 0.03]

1.61

Academic achievement

~

Self-management

0.237***

0.01

[0.22; 0.25]

29.18

Academic achievement

~

Social engagement

-0.012

0.01

[-0.03; 0]

-1.40

From Table 4, two of the SEB skills showed significant associations (p < 0.01) larger than |0.1| with academic achievement beyond the other skill domains. Specifically, Emotional resilience (b = -0.11; 95% CI [-0.13; -0.09]; p < 0.001), Self-management (b = 0.24; 95% CI [0.22; 0.25]; p < 0.001) showed significant and practically meaningful associations with academic achievement, while all other associations were lower than |0.05| and/or non-significant.

Methods

All methods, including preregistration, transparency, data gathering procedures, and coding information are reported in the main article.

Analyses

When referring to three-level random-effects model, we nested effects within samples and studies. In line with Borenstein and colleagues (2021), Fisher’s z transformations were applied and then back-transformed to Pearson’s r for interpretation. The metafor package was used for these analyses (Viechtbauer 2010).

On the other hand, OSMASEM models were used to estimate the structural models of interest in a single step by fitting a structural equation model directly to the meta-analytic covariance structure while simultaneously modeling sampling variance and between-study heterogeneity. This approach allows regression paths to be estimated within an SEM framework using the full pooled covariance matrix. The metaSEM (Cheung 2024) and lavaan (Rosseel 2012) R packages were used for these analysis.

Reproducibility via the Living SEB App

All analyses can be reproduced in the Meta-analysis and MetaSEM modules of the Living SEB App. Users can select specific subsets of studies, download data and R code, and generate updated reports.

References

Borenstein, Michael, Larry V. Hedges, Julian P. T. Higgins, and Hannah R. Rothstein. 2021. Introduction to Meta-Analysis. John Wiley & Sons.
Cheung, Mike W.-L. 2024. metaSEM: Meta-Analysis Using Structural Equation Modeling. https://cran.r-project.org/web/packages/metaSEM/index.html.
Jak, Suzanne, and Mike W. -L. Cheung. 2020. “Meta-Analytic Structural Equation Modeling with Moderating Effects on SEM Parameters.” Psychological Methods 25 (4): 430–55. https://doi.org/10.1037/met0000245.
Rosseel, Yves. 2012. “Lavaan: An R Package for Structural Equation Modeling and More Version 0.5-12 (BETA),” 37.
Soto, Christopher J., Christopher M. Napolitano, and Brent W. Roberts. 2021. “Taking Skills Seriously: Toward an Integrative Model and Agenda for Social, Emotional, and Behavioral Skills.” Current Directions in Psychological Science 30 (1): 26–33. https://doi.org/10.1177/0963721420978613.
Viechtbauer, Wolfgang. 2010. “Conducting meta-analyses in R with the metafor package.” Journal of Statistical Software 36 (3): 1–48. https://doi.org/10.18637/jss.v036.i03.