eohi/eohi1/results - exp1 - mixed anova DGEN.md
2026-01-22 17:55:35 -05:00

80 KiB

Rscript : ΓöÇΓöÇ Attaching core tidyverse packages

ΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇ tidyverse 2.0.0 ΓöÇΓöÇ

At C:\Users\irina\AppData\Local\Temp\ps-script-1e88d1ff-8e66-4d9a-90cf-0f9caea5137a.ps1:7 char:47

+ ... OHI\eohi1"; Rscript "mixed anova - DGEN.r" > "results - exp1 - mixed ...

+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

  + CategoryInfo : NotSpecified: (ΓöÇΓöÇ Attachin...se 2.0.0 ΓöÇΓöÇ:String) [], RemoteException

  + FullyQualifiedErrorId : NativeCommandError

 

Γ£ö dplyr 1.1.4 Γ£ö readr 2.1.5

Γ£ö forcats 1.0.0 Γ£ö stringr 1.5.1

Γ£ö ggplot2 3.5.1 Γ£ö tibble 3.2.1

Γ£ö lubridate 1.9.3 Γ£ö tidyr 1.3.1

Γ£ö purrr 1.0.2

ΓöÇΓöÇ Conflicts ΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇ

ΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇΓöÇ tidyverse_conflicts() ΓöÇΓöÇ

Γ£û dplyr::filter() masks stats::filter()

Γ£û dplyr::lag() masks stats::lag()

ℹ Use the conflicted package (http://conflicted.r-lib.org/) to force all conflicts to become errors

Loading required package: carData

Attaching package: 'car'

The following object is masked from 'package:dplyr':

  recode

The following object is masked from 'package:purrr':

  some

Loading required package: lme4

Loading required package: Matrix

Attaching package: 'Matrix'

The following objects are masked from 'package:tidyr':

  expand, pack, unpack

************

Welcome to afex. For support visit: http://afex.singmann.science/

- Functions for ANOVAs: aov_car(), aov_ez(), and aov_4()

- Methods for calculating p-values with mixed(): 'S', 'KR', 'LRT', and 'PB'

- 'afex_aov' and 'mixed' objects can be passed to emmeans() for follow-up tests

- Get and set global package options with: afex_options()

- Set sum-to-zero contrasts globally: set_sum_contrasts()

- For example analyses see: browseVignettes("afex")

************

Attaching package: 'afex'

The following object is masked from 'package:lme4':

  lmer

Welcome to emmeans.

Caution: You lose important information if you filter this package's results.

See '? untidy'

Warning message:

package 'effsize' was built under R version 4.4.3

Registered S3 methods overwritten by 'parameters':

  method from

  display.parameters_distribution datawizard

  plot.parameters_distribution datawizard

  print_md.parameters_distribution datawizard

[1] "Dataset dimensions: 1063 x689"

[1] "Number of participants: 1063"

[1] "All required DGEN variables found!"

[1] "Long data dimensions: 8504 x6"

[1] "Number of participants: 1063"

[1] "Descriptive statistics by TIME and DOMAIN:"

# A tibble: 8 × 11

  TIME DOMAIN n mean variance sd median q1 q3 min max

 

1 Past Preferences 1063 4.45 8.17 2.86 5 2 7 0 10

2 Past Personality 1063 4.67 8.12 2.85 5 2 7 0 10

3 Past Values 1063 4.41 8.50 2.91 4 2 7 0 10

4 Past Life 1063 5.46 8.02 2.83 6 3 8 0 10

5 Future Preferences 1063 4.14 7.97 2.82 4 2 6 0 10

6 Future Personality 1063 4.23 7.92 2.81 4 2 6 0 10

7 Future Values 1063 3.92 7.94 2.82 3 2 6 0 10

8 Future Life 1063 5.05 8.11 2.85 5 3 7 0 10

[1] "Descriptive statistics by TEMPORAL_DO, TIME, and DOMAIN:"

# A tibble: 16 × 7

  TEMPORAL_DO TIME DOMAIN n mean variance sd

 

 1 01PAST Past Preferences 536 4.52 8.58 2.93

 2 01PAST Past Personality 536 4.79 8.18 2.86

 3 01PAST Past Values 536 4.49 8.35 2.89

 4 01PAST Past Life 536 5.73 7.71 2.78

 5 01PAST Future Preferences 536 4.16 8.16 2.86

 6 01PAST Future Personality 536 4.32 8.00 2.83

 7 01PAST Future Values 536 4.01 8.04 2.84

 8 01PAST Future Life 536 5.20 8.21 2.87

 9 02FUT Past Preferences 527 4.39 7.76 2.79

10 02FUT Past Personality 527 4.55 8.04 2.84

11 02FUT Past Values 527 4.34 8.65 2.94

12 02FUT Past Life 527 5.19 8.20 2.86

13 02FUT Future Preferences 527 4.13 7.79 2.79

14 02FUT Future Personality 527 4.14 7.83 2.80

15 02FUT Future Values 527 3.83 7.84 2.80

16 02FUT Future Life 527 4.90 7.97 2.82

[1] "Data after removing missing values: 8504 x6"

[1] "Missing values by TIME and DOMAIN:"

# A tibble: 8 × 5

  TIME DOMAIN n_total n_missing pct_missing

 

1 Past Preferences 1063 0 0

2 Past Personality 1063 0 0

3 Past Values 1063 0 0

4 Past Life 1063 0 0

5 Future Preferences 1063 0 0

6 Future Personality 1063 0 0

7 Future Values 1063 0 0

8 Future Life 1063 0 0

[1] "Outlier summary (IQR method):"

# A tibble: 8 × 11

  TIME DOMAIN n mean sd q1 q3 iqr lower_bound upper_bound

 

1 Past Preferences 1063 4.45 2.86 2 7 5 -5.5 14.5

2 Past Personality 1063 4.67 2.85 2 7 5 -5.5 14.5

3 Past Values 1063 4.41 2.91 2 7 5 -5.5 14.5

4 Past Life 1063 5.46 2.83 3 8 5 -4.5 15.5

5 Future Preferences 1063 4.14 2.82 2 6 4 -4 12

6 Future Personality 1063 4.23 2.81 2 6 4 -4 12

7 Future Values 1063 3.92 2.82 2 6 4 -4 12

8 Future Life 1063 5.05 2.85 3 7 4 -3 13

# ℹ 1 more variable: n_outliers

[1] "Anderson-Darling normality test results:"

# A tibble: 8 × 5

  TIME DOMAIN n ad_statistic ad_p_value

 

1 Past Preferences 1063 13.8 0

2 Past Personality 1063 13.6 0

3 Past Values 1063 16.3 0

4 Past Life 1063 13.0 0

5 Future Preferences 1063 17.4 0

6 Future Personality 1063 16.9 0

7 Future Values 1063 21.7 0

8 Future Life 1063 12.1 0

[1] "Homogeneity of variance across TIME within each DOMAIN:"

# A tibble: 4 × 3

  DOMAIN levene_F levene_p

 

1 Preferences 0.115 0.735

2 Personality 0.0390 0.843

3 Values 1.50 0.221

4 Life 0.453 0.501

[1] "Homogeneity of variance across DOMAIN within each TIME:"

# A tibble: 2 × 3

  TIME levene_F levene_p

 

1 Past 1.43 0.233

2 Future 0.818 0.484

[1] "=== CHECKING TEMPORAL_DO VALUES ==="

[1] "Unique TEMPORAL_DO values:"

[1] 01PAST 02FUT

Levels: 01PAST 02FUT

[1] "TEMPORAL_DO value counts:"

01PAST 02FUT

  4288 4216

[1] "\n=== OBSERVED F-MAX RATIOS: TEMPORAL_DO within each TIME × DOMAIN combination ==="

# A tibble: 8 × 5

  TIME DOMAIN past_var fut_var f_max_ratio

 

1 Past Preferences 8.58 7.76 1.11

2 Past Personality 8.18 8.04 1.02

3 Past Values 8.35 8.65 1.04

4 Past Life 7.71 8.20 1.06

5 Future Preferences 8.16 7.79 1.05

6 Future Personality 8.00 7.83 1.02

7 Future Values 8.04 7.84 1.03

8 Future Life 8.21 7.97 1.03

[1] "\n=== HARTLEY'S F-MAX TEST RESULTS ==="

# A tibble: 8 × 5

  TIME DOMAIN observed_ratio critical_95 significant

 

1 Past Preferences 1.11 1.23 FALSE

2 Past Personality 1.02 1.12 FALSE

3 Past Values 1.04 1.14 FALSE

4 Past Life 1.06 1.18 FALSE

5 Future Preferences 1.05 1.17 FALSE

6 Future Personality 1.02 1.15 FALSE

7 Future Values 1.03 1.15 FALSE

8 Future Life 1.03 1.15 FALSE

[1] "Data size for ANOVA: 8504 rows"

[1] "Number of participants: 1063"

[1] "Design factors: TIME (2), DOMAIN (4), TEMPORAL_DO (2)"

[1] "Complete cases: 8504 out of 8504"

[1] "Design is balanced: each participant has data for all TIME × DOMAIN combinations"

[1] "\n=== MIXED ANOVA RESULTS (with sphericity corrections) ==="

Warning: Data is unbalanced (unequal N per group). Make sure you specified a well-considered value for the type

argument to ezANOVA().

[1] "ANOVA Results:"

  Effect DFn DFd SSn SSd F

1 (Intercept) 1 1061 175403.313893 45334.099 4105.1420831

2 TEMPORAL_DO 1 1061 104.781437 45334.099 2.4523065

3 TIME 1 1061 363.139680 5710.697 67.4683362

4 DOMAIN 3 3183 1524.702983 10462.463 154.6203659

5 TEMPORAL_DO:TIME 1 1061 4.340056 5710.697 0.8063464

6 TEMPORAL_DO:DOMAIN 3 3183 33.288120 10462.463 3.3757534

7 TIME:DOMAIN 3 3183 9.191110 7100.516 1.3733886

8 TEMPORAL_DO:TIME:DOMAIN 3 3183 4.974741 7100.516 0.7433545

  p

1 0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000

2 0.11765050104906209227362268165961722843348979949951171875000000000000000000000000000000000000000000

3 0.00000000000000061782799119098067114168315594469049756298772990703582763671875000000000000000000000

4 0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000150209

5 0.36940636618506739186074128156178630888462066650390625000000000000000000000000000000000000000000000

6 0.01763146579785550976948726997761696111410856246948242187500000000000000000000000000000000000000000

7 0.24898565439172731794670312410744372755289077758789062500000000000000000000000000000000000000000000

8 0.52613525007520434151331301109166815876960754394531250000000000000000000000000000000000000000000000

  p<.05 ges

1 * 0.71883337333

2 0.00152492417

3 * 0.00526511333

4 * 0.02174032681

5 0.00006325496

6 * 0.00048495927

7 0.00013394807

8 0.00007250462

[1] "\nMauchly's Test of Sphericity:"

  Effect W p

5 DOMAIN 0.8712463 0.000000000000000000000000000009197155

6 TEMPORAL_DO:DOMAIN 0.8712463 0.000000000000000000000000000009197155

7 TIME:DOMAIN 0.9366421 0.000000000000139056847839002402420980

8 TEMPORAL_DO:TIME:DOMAIN 0.9366421 0.000000000000139056847839002402420980

  p<.05

5 *

6 *

7 *

8 *

[1] "\nGreenhouse-Geisser and Huynh-Feldt Corrections:"

               **Effect       GGe**

5 DOMAIN 0.9120175

6 TEMPORAL_DO:DOMAIN 0.9120175

7 TIME:DOMAIN 0.9556034

8 TEMPORAL_DO:TIME:DOMAIN 0.9556034

  p[GG]

5 0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000001345237

6 0.0210110642827151770928306717678424320183694362640380859375000000000000000000000000000000000

7 0.2499237624236494703655608873305027373135089874267578125000000000000000000000000000000000000

8 0.5204622528563578320870419702259823679924011230468750000000000000000000000000000000000000000

  p[GG]<.05 HFe

5 * 0.9146073

6 * 0.9146073

7 0.9584655

8 0.9584655

  p[HF]

5 0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000007847038

6 0.02090266902721321304325918788435956230387091636657714843750000000000000000000000000000000000

7 0.24986536855461360939756332300021313130855560302734375000000000000000000000000000000000000000

8 0.52083559605373963563579309266060590744018554687500000000000000000000000000000000000000000000

  p[HF]<.05

5 *

6 *

7

8

=== CORRECTED DEGREES OF FREEDOM ===

               **Effect Original\_DFn Original\_DFd   GG\_DFn   GG\_DFd   HF\_DFn**

1 DOMAIN 3 3183 2.736053 2902.952 2.743822

2 TEMPORAL_DO:DOMAIN 3 3183 2.736053 2902.952 2.743822

3 TIME:DOMAIN 3 3183 2.866810 3041.686 2.875396

4 TEMPORAL_DO:TIME:DOMAIN 3 3183 2.866810 3041.686 2.875396

**HF\_DFd GG\_epsilon HF\_epsilon**

1 2911.195 0.9120175 0.9146073

2 2911.195 0.9120175 0.9146073

3 3050.796 0.9556034 0.9584655

4 3050.796 0.9556034 0.9584655

=== CORRECTED F-TESTS ===

DOMAIN:

Original: F(3, 3183) = 154.620

GG-corrected: F(2.74, 2902.95) = 154.620, p = 0.000000

HF-corrected: F(2.74, 2911.20) = 154.620, p = 0.000000

TEMPORAL_DO:DOMAIN:

Original: F(3, 3183) = 3.376

GG-corrected: F(2.74, 2902.95) = 3.376, p = 0.021011

HF-corrected: F(2.74, 2911.20) = 3.376, p = 0.020903

TIME:DOMAIN:

  Original: F(3, 3183) = 1.373

  GG-corrected: F(2.87, 3041.69) = 1.373, p = 0.249924

  HF-corrected: F(2.88, 3050.80) = 1.373, p = 0.249865

TEMPORAL_DO:TIME:DOMAIN:

  Original: F(3, 3183) = 0.743

  GG-corrected: F(2.87, 3041.69) = 0.743, p = 0.520462

  HF-corrected: F(2.88, 3050.80) = 0.743, p = 0.520836

[1] "\n=== EFFECT SIZES (GENERALIZED ETA SQUARED) ==="

[1] "Generalized Eta Squared:"

  Effect ges

1 (Intercept) 0.71883

2 TEMPORAL_DO 0.00152

3 TIME 0.00527

5 DOMAIN 0.02174

4 TEMPORAL_DO:TIME 0.00006

6 TEMPORAL_DO:DOMAIN 0.00048

7 TIME:DOMAIN 0.00013

8 TEMPORAL_DO:TIME:DOMAIN 0.00007

[1] "\n=== POST-HOC COMPARISONS ==="

[1] "Main Effect of TIME:"

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TIME emmean SE df lower.CL upper.CL

 Past 4.75 0.0752 1324 4.60 4.90

 Future 4.34 0.0752 1324 4.19 4.48

Results are averaged over the levels of: TEMPORAL_DO, DOMAIN

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nPairwise Contrasts:"

contrast estimate SE df t.ratio p.value

Past - Future 0.413 0.0503 1061 8.214 <.0001

Results are averaged over the levels of: TEMPORAL_DO, DOMAIN

[1] "\nMain Effect of DOMAIN:"

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 DOMAIN emmean SE df lower.CL upper.CL

 Preferences 4.30 0.0786 1579 4.14 4.45

 Personality 4.45 0.0786 1579 4.30 4.61

 Values 4.17 0.0786 1579 4.01 4.32

 Life 5.26 0.0786 1579 5.10 5.41

Results are averaged over the levels of: TEMPORAL_DO, TIME

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nPairwise Contrasts:"

 contrast estimate SE df t.ratio p.value

Preferences - Personality -0.153 0.0556 3183 -2.747 0.0362

 Preferences - Values 0.132 0.0556 3183 2.375 0.1057

Preferences - Life -0.957 0.0556 3183 -17.204 <.0001

Personality - Values 0.285 0.0556 3183 5.122 <.0001

Personality - Life -0.804 0.0556 3183 -14.456 <.0001

Values - Life -1.089 0.0556 3183 -19.579 <.0001

Results are averaged over the levels of: TEMPORAL_DO, TIME

P value adjustment: bonferroni method for 6 tests

[1] "\nMain Effect of TEMPORAL_DO:"

NOTE: Results may be misleading due to involvement in interactions

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.222 0.142 1061 1.566 0.1177

Results are averaged over the levels of: TIME, DOMAIN

[1] "\n=== TEMPORAL_DO × TIME INTERACTION ==="

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TEMPORAL_DO TIME emmean SE df lower.CL upper.CL

 01PAST Past 4.88 0.106 1322 4.67 5.09

 02FUT Past 4.62 0.106 1326 4.41 4.82

 01PAST Future 4.42 0.106 1322 4.22 4.63

 02FUT Future 4.25 0.106 1326 4.04 4.46

Results are averaged over the levels of: DOMAIN

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nSimple Effects of TIME within each TEMPORAL_DO:"

TEMPORAL_DO = 01PAST:

contrast estimate SE df t.ratio p.value

Past - Future 0.458 0.0709 1061 6.471 <.0001

TEMPORAL_DO = 02FUT:

contrast estimate SE df t.ratio p.value

Past - Future 0.368 0.0715 1061 5.151 <.0001

Results are averaged over the levels of: DOMAIN

[1] "\nSimple Effects of TEMPORAL_DO within each TIME:"

TIME = Past:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.267 0.15 1324 1.776 0.0759

TIME = Future:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.177 0.15 1324 1.175 0.2400

Results are averaged over the levels of: DOMAIN

[1] "\n=== TIME × DOMAIN INTERACTION ==="

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TIME DOMAIN emmean SE df lower.CL upper.CL

 Past Preferences 4.45 0.0872 2333 4.28 4.62

 Future Preferences 4.14 0.0872 2333 3.97 4.31

 Past Personality 4.67 0.0872 2333 4.50 4.84

 Future Personality 4.23 0.0872 2333 4.06 4.40

 Past Values 4.41 0.0872 2333 4.24 4.58

 Future Values 3.92 0.0872 2333 3.75 4.09

 Past Life 5.46 0.0872 2333 5.29 5.63

 Future Life 5.05 0.0872 2333 4.88 5.22

Results are averaged over the levels of: TEMPORAL_DO

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nSimple Effects of DOMAIN within each TIME:"

TIME = Past:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.2187 0.072 6141 -3.036 0.0145

 Preferences - Values 0.0424 0.072 6141 0.588 1.0000

 Preferences - Life -1.0058 0.072 6141 -13.960 <.0001

 Personality - Values 0.2611 0.072 6141 3.624 0.0018

 Personality - Life -0.7871 0.072 6141 -10.924 <.0001

 Values - Life -1.0482 0.072 6141 -14.549 <.0001

TIME = Future:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.0868 0.072 6141 -1.205 1.0000

 Preferences - Values 0.2217 0.072 6141 3.078 0.0126

 Preferences - Life -0.9076 0.072 6141 -12.597 <.0001

 Personality - Values 0.3086 0.072 6141 4.283 0.0001

 Personality - Life -0.8207 0.072 6141 -11.391 <.0001

 Values - Life -1.1293 0.072 6141 -15.674 <.0001

Results are averaged over the levels of: TEMPORAL_DO

P value adjustment: bonferroni method for 6 tests

[1] "\nSimple Effects of TIME within each DOMAIN:"

DOMAIN = Preferences:

contrast estimate SE df t.ratio p.value

Past - Future 0.311 0.0754 3524 4.126 <.0001

DOMAIN = Personality:

contrast estimate SE df t.ratio p.value

Past - Future 0.443 0.0754 3524 5.875 <.0001

DOMAIN = Values:

contrast estimate SE df t.ratio p.value

Past - Future 0.490 0.0754 3524 6.506 <.0001

DOMAIN = Life:

contrast estimate SE df t.ratio p.value

Past - Future 0.409 0.0754 3524 5.429 <.0001

Results are averaged over the levels of: TEMPORAL_DO

[1] "\n=== TEMPORAL_DO × DOMAIN INTERACTION ==="

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TEMPORAL_DO DOMAIN emmean SE df lower.CL upper.CL

 01PAST Preferences 4.34 0.111 1575 4.12 4.56

 02FUT Preferences 4.26 0.111 1584 4.04 4.48

 01PAST Personality 4.56 0.111 1575 4.34 4.78

 02FUT Personality 4.34 0.111 1584 4.13 4.56

 01PAST Values 4.25 0.111 1575 4.03 4.47

 02FUT Values 4.08 0.111 1584 3.86 4.30

 01PAST Life 5.47 0.111 1575 5.25 5.68

 02FUT Life 5.04 0.111 1584 4.83 5.26

Results are averaged over the levels of: TIME

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nSimple Effects of DOMAIN within each TEMPORAL_DO:"

TEMPORAL_DO = 01PAST:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.2183 0.0783 3183 -2.787 0.0321

 Preferences - Values 0.0886 0.0783 3183 1.132 1.0000

 Preferences - Life -1.1269 0.0783 3183 -14.390 <.0001

 Personality - Values 0.3069 0.0783 3183 3.919 0.0005

 Personality - Life -0.9086 0.0783 3183 -11.602 <.0001

 Values - Life -1.2155 0.0783 3183 -15.521 <.0001

TEMPORAL_DO = 02FUT:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.0873 0.0790 3183 -1.105 1.0000

 Preferences - Values 0.1755 0.0790 3183 2.222 0.1579

 Preferences - Life -0.7865 0.0790 3183 -9.959 <.0001

 Personality - Values 0.2628 0.0790 3183 3.328 0.0053

 Personality - Life -0.6992 0.0790 3183 -8.854 <.0001

 Values - Life -0.9620 0.0790 3183 -12.182 <.0001

Results are averaged over the levels of: TIME

P value adjustment: bonferroni method for 6 tests

[1] "\nSimple Effects of TEMPORAL_DO within each DOMAIN:"

DOMAIN = Preferences:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.0825 0.157 1579 0.524 0.6002

DOMAIN = Personality:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.2134 0.157 1579 1.357 0.1749

DOMAIN = Values:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.1694 0.157 1579 1.077 0.2818

DOMAIN = Life:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.4228 0.157 1579 2.688 0.0073

Results are averaged over the levels of: TIME

[1] "\n=== THREE-WAY INTERACTION ANALYSIS ==="

[1] "Estimated Marginal Means:"

 TEMPORAL_DO TIME DOMAIN emmean SE df lower.CL upper.CL

 01PAST Past Preferences 4.52 0.123 2321 4.28 4.76

 02FUT Past Preferences 4.39 0.123 2344 4.14 4.63

 01PAST Future Preferences 4.16 0.123 2321 3.92 4.40

 02FUT Future Preferences 4.13 0.123 2344 3.89 4.37

 01PAST Past Personality 4.80 0.123 2321 4.55 5.04

 02FUT Past Personality 4.55 0.123 2344 4.31 4.79

 01PAST Future Personality 4.32 0.123 2321 4.08 4.56

 02FUT Future Personality 4.14 0.123 2344 3.90 4.38

 01PAST Past Values 4.49 0.123 2321 4.24 4.73

 02FUT Past Values 4.34 0.123 2344 4.09 4.58

 01PAST Future Values 4.02 0.123 2321 3.77 4.26

 02FUT Future Values 3.83 0.123 2344 3.58 4.07

 01PAST Past Life 5.73 0.123 2321 5.49 5.97

 02FUT Past Life 5.19 0.123 2344 4.95 5.43

 01PAST Future Life 5.20 0.123 2321 4.96 5.45

 02FUT Future Life 4.90 0.123 2344 4.65 5.14

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nSimple Effects of TIME within each TEMPORAL_DO × DOMAIN combination:"

TEMPORAL_DO = 01PAST, DOMAIN = Preferences:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.364 0.106 3524 3.428 0.0006

TEMPORAL_DO = 02FUT, DOMAIN = Preferences:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.258 0.107 3524 2.411 0.0160

TEMPORAL_DO = 01PAST, DOMAIN = Personality:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.476 0.106 3524 4.483 <.0001

TEMPORAL_DO = 02FUT, DOMAIN = Personality:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.410 0.107 3524 3.829 0.0001

TEMPORAL_DO = 01PAST, DOMAIN = Values:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.470 0.106 3524 4.430 <.0001

TEMPORAL_DO = 02FUT, DOMAIN = Values:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.510 0.107 3524 4.769 <.0001

TEMPORAL_DO = 01PAST, DOMAIN = Life:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.524 0.106 3524 4.940 <.0001

TEMPORAL_DO = 02FUT, DOMAIN = Life:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.294 0.107 3524 2.748 0.0060

[1] "\n=== COHEN'S D FOR SIGNIFICANT TWO-WAY INTERACTIONS ==="

[1] "\n=== COHEN'S D FOR TEMPORAL_DO × TIME INTERACTION ==="

Significant pairwise comparisons (p < 0.05):

contrast TEMPORAL_DO estimate SE df t.ratio p.value

Past - Future 01PAST 0.4584888 0.07085809 1061 6.471 <.0001

Past - Future 02FUT 0.3681214 0.07146058 1061 5.151 <.0001

Results are averaged over the levels of: DOMAIN

Cohen's d calculated from raw data:

Comparison: Past - Future | 01PAST

  n1 = 2144, n2 = 2144

Cohen's d: 0.15841

  Effect size interpretation: negligible

  p-value: 0.00000

Comparison: Past - Future | 02FUT

  n1 = 2108, n2 = 2108

Cohen's d: 0.12907

  Effect size interpretation: negligible

  p-value: 0.00000

No significant pairwise comparisons found.

[1] "\n=== COHEN'S D FOR TIME × DOMAIN INTERACTION ==="

Significant pairwise comparisons (p < 0.05):

contrast DOMAIN estimate SE df t.ratio p.value

Past - Future Preferences 0.3109352 0.07536529 3523.81 4.126 <.0001

Past - Future Personality 0.4428067 0.07536529 3523.81 5.875 <.0001

Past - Future Values 0.4902928 0.07536529 3523.81 6.506 <.0001

Past - Future Life 0.4091857 0.07536529 3523.81 5.429 <.0001

Results are averaged over the levels of: TEMPORAL_DO

Cohen's d calculated from raw data:

Comparison: Past - Future | Preferences

  n1 = 1063, n2 = 1063

Cohen's d: 0.10962

  Effect size interpretation: negligible

  p-value: 0.00004

Comparison: Past - Future | Personality

  n1 = 1063, n2 = 1063

  Cohen's d: 0.15646

  Effect size interpretation: negligible

  p-value: 0.00000

Comparison: Past - Future | Values

  n1 = 1063, n2 = 1063

Cohen's d: 0.17095

  Effect size interpretation: negligible

  p-value: 0.00000

Comparison: Past - Future | Life

  n1 = 1063, n2 = 1063

Cohen's d: 0.14446

  Effect size interpretation: negligible

  p-value: 0.00000

Significant pairwise comparisons (p < 0.05):

 contrast TIME estimate SE df t.ratio p.value

 Preferences - Personality Past -0.2187208 0.07204929 6140.98 -3.036 0.0145

 Preferences - Life Past -1.0058218 0.07204929 6140.98 -13.960 <.0001

 Personality - Values Past 0.2611126 0.07204929 6140.98 3.624 0.0018

 Personality - Life Past -0.7871010 0.07204929 6140.98 -10.924 <.0001

 Values - Life Past -1.0482136 0.07204929 6140.98 -14.549 <.0001

 Preferences - Values Future 0.2217494 0.07204929 6140.98 3.078 0.0126

 Preferences - Life Future -0.9075714 0.07204929 6140.98 -12.597 <.0001

 Personality - Values Future 0.3085987 0.07204929 6140.98 4.283 0.0001

 Personality - Life Future -0.8207221 0.07204929 6140.98 -11.391 <.0001

 Values - Life Future -1.1293208 0.07204929 6140.98 -15.674 <.0001

Results are averaged over the levels of: TEMPORAL_DO

P value adjustment: bonferroni method for 6 tests

Cohen's d calculated from raw data:

Comparison: Preferences - Personality | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.07681

  Effect size interpretation: negligible

  p-value: 0.01446

Comparison: Preferences - Life | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.35418

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Values | Past

  n1 = 1063, n2 = 1063

  Cohen's d: 0.09073

  Effect size interpretation: negligible

  p-value: 0.00175

Comparison: Personality - Life | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.27756

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.36538

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Preferences - Values | Future

  n1 = 1063, n2 = 1063

  Cohen's d: 0.07838

  Effect size interpretation: negligible

  p-value: 0.01257

Comparison: Preferences - Life | Future

  n1 = 1063, n2 = 1063

  Cohen's d: -0.32051

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Values | Future

  n1 = 1063, n2 = 1063

  Cohen's d: 0.10956

  Effect size interpretation: negligible

  p-value: 0.00011

Comparison: Personality - Life | Future

  n1 = 1063, n2 = 1063

  Cohen's d: -0.29009

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | Future

  n1 = 1063, n2 = 1063

  Cohen's d: -0.39881

  Effect size interpretation: small

  p-value: 0.00000

[1] "\n=== COHEN'S D FOR TEMPORAL_DO × DOMAIN INTERACTION ==="

Significant pairwise comparisons (p < 0.05):

 contrast DOMAIN estimate SE df t.ratio p.value

 01PAST - 02FUT Life 0.4227906 0.1572823 1579.2 2.688 0.0073

Results are averaged over the levels of: TIME

Cohen's d calculated from raw data:

Comparison: 01PAST - 02FUT | Life

  n1 = 1072, n2 = 1054

  Cohen's d: 0.14893

  Effect size interpretation: negligible

  p-value: 0.00726

Significant pairwise comparisons (p < 0.05):

 contrast TEMPORAL_DO estimate SE df t.ratio

 Preferences - Personality 01PAST -0.2182836 0.07830983 3183 -2.787

 Preferences - Life 01PAST -1.1268657 0.07830983 3183 -14.390

 Personality - Values 01PAST 0.3069030 0.07830983 3183 3.919

 Personality - Life 01PAST -0.9085821 0.07830983 3183 -11.602

 Values - Life 01PAST -1.2154851 0.07830983 3183 -15.521

 Preferences - Life 02FUT -0.7865275 0.07897567 3183 -9.959

 Personality - Values 02FUT 0.2628083 0.07897567 3183 3.328

 Personality - Life 02FUT -0.6992410 0.07897567 3183 -8.854

 Values - Life 02FUT -0.9620493 0.07897567 3183 -12.182

 p.value

  0.0321

  <.0001

  0.0005

  <.0001

  <.0001

  <.0001

  0.0053

  <.0001

  <.0001

Results are averaged over the levels of: TIME

P value adjustment: bonferroni method for 6 tests

Cohen's d calculated from raw data:

Comparison: Preferences - Personality | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.07591

  Effect size interpretation: negligible

  p-value: 0.03207

Comparison: Preferences - Life | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.39333

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Values | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: 0.10722

  Effect size interpretation: negligible

  p-value: 0.00054

Comparison: Personality - Life | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.31964

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.42622

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Preferences - Life | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: -0.27911

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Values | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: 0.09213

  Effect size interpretation: negligible

  p-value: 0.00531

Comparison: Personality - Life | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: -0.24666

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: -0.33596

  Effect size interpretation: small

  p-value: 0.00000

[1] "\n=== COHEN'S D FOR THREE-WAY INTERACTION ==="

[1] "The pairwise comparisons show the TIME effects within each TEMPORAL_DO × DOMAIN combination:"

TEMPORAL_DO = 01PAST, DOMAIN = Preferences:

contrast estimate SE df t.ratio p.value

Past - Future 0.3638060 0.1061305 3523.81 3.428 0.0006

TEMPORAL_DO = 02FUT, DOMAIN = Preferences:

contrast estimate SE df t.ratio p.value

Past - Future 0.2580645 0.1070329 3523.81 2.411 0.0160

TEMPORAL_DO = 01PAST, DOMAIN = Personality:

contrast estimate SE df t.ratio p.value

Past - Future 0.4757463 0.1061305 3523.81 4.483 <.0001

TEMPORAL_DO = 02FUT, DOMAIN = Personality:

contrast estimate SE df t.ratio p.value

Past - Future 0.4098672 0.1070329 3523.81 3.829 0.0001

TEMPORAL_DO = 01PAST, DOMAIN = Values:

contrast estimate SE df t.ratio p.value

Past - Future 0.4701493 0.1061305 3523.81 4.430 <.0001

TEMPORAL_DO = 02FUT, DOMAIN = Values:

contrast estimate SE df t.ratio p.value

Past - Future 0.5104364 0.1070329 3523.81 4.769 <.0001

TEMPORAL_DO = 01PAST, DOMAIN = Life:

contrast estimate SE df t.ratio p.value

Past - Future 0.5242537 0.1061305 3523.81 4.940 <.0001

TEMPORAL_DO = 02FUT, DOMAIN = Life:

contrast estimate SE df t.ratio p.value

Past - Future 0.2941176 0.1070329 3523.81 2.748 0.0060

[1] "\nCohen's d calculations for significant TIME effects within each TEMPORAL_DO × DOMAIN combination:"

TEMPORAL_DO = 01PAST, DOMAIN = Preferences:

  Past vs Future comparison

  n_Past = 536, n_Future = 536

Cohen's d: 0.12574

  Effect size interpretation: negligible

  p-value: 0.00062

  Estimated difference: 0.36381

TEMPORAL_DO = 02FUT, DOMAIN = Preferences:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.09256

  Effect size interpretation: negligible

  p-value: 0.01596

  Estimated difference: 0.25806

TEMPORAL_DO = 01PAST, DOMAIN = Personality:

  Past vs Future comparison

  n_Past = 536, n_Future = 536

Cohen's d: 0.16725

  Effect size interpretation: negligible

  p-value: 0.00001

  Estimated difference: 0.47575

TEMPORAL_DO = 02FUT, DOMAIN = Personality:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.14547

  Effect size interpretation: negligible

  p-value: 0.00013

  Estimated difference: 0.40987

TEMPORAL_DO = 01PAST, DOMAIN = Values:

  Past vs Future comparison

  n_Past = 536, n_Future = 536

Cohen's d: 0.16420

  Effect size interpretation: negligible

  p-value: 0.00001

  Estimated difference: 0.47015

TEMPORAL_DO = 02FUT, DOMAIN = Values:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.17779

  Effect size interpretation: negligible

  p-value: 0.00000

  Estimated difference: 0.51044

TEMPORAL_DO = 01PAST, DOMAIN = Life:

  Past vs Future comparison

  n_Past = 536, n_Future = 536

Cohen's d: 0.18584

  Effect size interpretation: negligible

  p-value: 0.00000

  Estimated difference: 0.52425

TEMPORAL_DO = 02FUT, DOMAIN = Life:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.10343

  Effect size interpretation: negligible

  p-value: 0.00603

  Estimated difference: 0.29412

[1] "\n=== ANALYSIS COMPLETE ==="

[1] "All significant and marginal effects have been analyzed with Cohen's d calculations."