Skip to contents

7-point acceptability ratings in a 2 x 2 factorial design: dependency length (short or long) by structure (non-island or island). Island effects show up as an interaction: long dependencies out of islands are worse than the two main effects predict. 48 participants rate 32 items, each item in one condition per participant (four counterbalanced lists).

Usage

acceptability

Format

A tibble with 1536 rows and 6 columns:

participant

Participant ID, P01 to P48.

list

Counterbalancing list, 1 to 4.

item

Item ID, i01 to i32.

length

Dependency length, "short" or "long".

structure

"non-island" or "island".

rating

Rating from 1 (unacceptable) to 7 (acceptable).

Source

data-raw/acceptability.R

Details

True model: a cumulative logit model with thresholds at -2.5, -1.5, -0.5, 0.5, 1.5 and 2.5 on a latent scale 1.5 - 0.6 * long - 0.4 * island - 0.9 * long * island. By-participant intercepts (SD 0.8) and interaction slopes (SD 0.3); by-item intercepts (SD 0.4). The design follows Experiment 1 of Sprouse, Wagers and Phillips (2012), who crossed gap position (matrix or embedded clause, i.e. a short or long dependency) with structure and used a 7-point scale; for whether islands they found both main effects and a superadditive interaction. The number of participants and items, the effect sizes and the ratings are simulated.

References

Sprouse, J., Wagers, M. & Phillips, C. (2012). A test of the relation between working-memory capacity and syntactic island effects. Language, 88(1), 82-123. doi:10.1353/lan.2012.0004

Examples

round(tapply(acceptability$rating, acceptability[c("length", "structure")], mean), 2)
#>        structure
#> length  non-island island
#>   short       4.93   4.59
#>   long        4.35   3.47
# \donttest{
if (requireNamespace("ordinal", quietly = TRUE)) {
  acceptability$rating <- factor(acceptability$rating, ordered = TRUE)
  m <- ordinal::clmm(rating ~ length * structure + (1 | participant) + (1 | item),
                     data = acceptability)
  coef(summary(m))
}
#>                              Estimate Std. Error    z value     Pr(>|z|)
#> 1|2                        -3.6771551  0.2058736 -17.861228 2.363806e-71
#> 2|3                        -2.5896971  0.1910676 -13.553826 7.520567e-42
#> 3|4                        -1.6227912  0.1838091  -8.828678 1.059206e-18
#> 4|5                        -0.6520935  0.1801399  -3.619928 2.946854e-04
#> 5|6                         0.3802505  0.1798892   2.113804 3.453200e-02
#> 6|7                         1.4589691  0.1850230   7.885338 3.136845e-15
#> lengthlong                 -0.7158584  0.1290831  -5.545717 2.927521e-08
#> structureisland            -0.4314951  0.1299172  -3.321309 8.959616e-04
#> lengthlong:structureisland -0.5824154  0.1828319  -3.185523 1.444924e-03
# }