This function extracts intraclass correlation coefficients (ICC) from a multilevel model. It can be used to decompose the variance in the outcome variable of a specification curve analysis (e.g., the regression coefficients). This approach summarises the relative importance of analytical choices by estimating the share of variance in the outcome (e.g., the regression coefficient) that different analytical choices or combinations therefor account for. To use this approach, one needs to estimate a multilevel model that includes all analytical choices as grouping variables (see examples).

icc_specs(model, percent = TRUE)

## Arguments

model

a multilevel (i.e., mixed effects) model that captures the variances of the specification curve.

percent

a logical value indicating whether the ICC should also be printed as percentage. Defaults to TRUE.

## Value

a tibble including the grouping variable, the random effect variances, the raw intraclass correlation coefficient (ICC), and the ICC in percent.

## References

• Hox, J. J. (2010). Multilevel analysis: techniques and applications. New York: Routledge.

plot_variance() to plot the variance decomposition.

## Examples

# Step 1: Run spec curve analysis
results <- run_specs(df = example_data,
y = c("y1", "y2"),
x = c("x1", "x2"),
model = c("lm"))

# Step 2: Estimate a multilevel model without predictors
model <- lme4::lmer(estimate ~ 1 + (1|x)  + (1|y), data = results)

# Step 3: Estimate intra-class correlation
icc_specs(model)
#>        grp         vcov          icc     percent
#> 1        x  0.669097576 0.0310285827  3.10285827
#> 2        y 20.890686733 0.9687800785 96.87800785
#> 3 Residual  0.004126013 0.0001913388  0.01913388