eohi/eohi1/results exp1 - mixed anova - domain means.md
2025-12-23 15:47:09 -05:00

67 KiB
Raw Blame History

  TIME DOMAIN n mean variance sd median q1 q3 min max

 

1 Past Preferences 1063 0.783 0.518 0.720 0.6 0.2 1.2 0 5.8

2 Past Personality 1063 0.962 0.566 0.752 0.8 0.4 1.4 0 5

3 Past Values 1063 0.784 0.554 0.744 0.6 0.2 1 0 4.6

4 Past Life 1063 1.22 1.08 1.04 1 0.4 1.8 0 6

5 Future Preferences 1063 0.644 0.348 0.590 0.6 0.2 1 0 5.8

6 Future Personality 1063 0.866 0.424 0.651 0.8 0.4 1.2 0 4.2

7 Future Values 1063 0.587 0.281 0.530 0.4 0.2 0.8 0 4.4

8 Future Life 1063 1.11 0.930 0.964 0.8 0.4 1.4 0 6

[1] "Descriptive statistics by TEMPORAL_DO, TIME, and DOMAIN:"

# A tibble: 16 × 7

  TEMPORAL_DO TIME DOMAIN n mean variance sd

 

 1 01PAST Past Preferences 536 0.759 0.515 0.718

 2 01PAST Past Personality 536 0.948 0.571 0.756

 3 01PAST Past Values 536 0.748 0.565 0.752

 4 01PAST Past Life 536 1.23 1.08 1.04

 5 01PAST Future Preferences 536 0.640 0.326 0.571

 6 01PAST Future Personality 536 0.909 0.433 0.658

 7 01PAST Future Values 536 0.614 0.287 0.535

 8 01PAST Future Life 536 1.18 1.05 1.02

 9 02FUT Past Preferences 527 0.808 0.521 0.722

10 02FUT Past Personality 527 0.977 0.562 0.750

11 02FUT Past Values 527 0.820 0.540 0.735

12 02FUT Past Life 527 1.21 1.08 1.04

13 02FUT Future Preferences 527 0.648 0.371 0.609

14 02FUT Future Personality 527 0.822 0.411 0.641

15 02FUT Future Values 527 0.559 0.274 0.524

16 02FUT Future Life 527 1.03 0.801 0.895

[1] "Data after removing missing values: 8504 x6"

[1] "Missing values by TIME and DOMAIN:"

# A tibble: 8 × 5

  TIME DOMAIN n_total n_missing pct_missing

 

1 Past Preferences 1063 0 0

2 Past Personality 1063 0 0

3 Past Values 1063 0 0

4 Past Life 1063 0 0

5 Future Preferences 1063 0 0

6 Future Personality 1063 0 0

7 Future Values 1063 0 0

8 Future Life 1063 0 0

[1] "Outlier summary (IQR method):"

# A tibble: 8 × 11

  TIME DOMAIN n mean sd q1 q3 iqr lower_bound upper_bound

 

1 Past Preferences 1063 0.783 0.720 0.2 1.2 1 -1.3 2.7

2 Past Personality 1063 0.962 0.752 0.4 1.4 1 -1.1 2.9

3 Past Values 1063 0.784 0.744 0.2 1 0.8 -1 2.2

4 Past Life 1063 1.22 1.04 0.4 1.8 1.4 -1.7 3.9

5 Future Preferences 1063 0.644 0.590 0.2 1 0.8 -1 2.2

6 Future Personality 1063 0.866 0.651 0.4 1.2 0.8 -0.8 2.4

7 Future Values 1063 0.587 0.530 0.2 0.8 0.6 -0.7 1.7

8 Future Life 1063 1.11 0.964 0.4 1.4 1 -1.1 2.9

# ℹ 1 more variable: n_outliers

[1] "Anderson-Darling normality test results:"

# A tibble: 8 × 5

  TIME DOMAIN n ad_statistic ad_p_value

 

1 Past Preferences 1063 32.9 0

2 Past Personality 1063 27.2 0

3 Past Values 1063 39.9 0

4 Past Life 1063 32.4 0

5 Future Preferences 1063 30.5 0

6 Future Personality 1063 20.6 0

7 Future Values 1063 33.9 0

8 Future Life 1063 36.9 0

[1] "Homogeneity of variance across TIME within each DOMAIN:"

# A tibble: 4 × 3

  DOMAIN levene_F levene_p

 

1 Preferences 23.3 1.48e- 6

2 Personality 9.57 2.01e- 3

3 Values 42.3 9.50e-11

4 Life 6.78 9.27e- 3

[1] "Homogeneity of variance across DOMAIN within each TIME:"

# A tibble: 2 × 3

  TIME levene_F levene_p

 

1 Past 41.9 1.13e-26

2 Future 68.4 3.41e-43

[1] "=== CHECKING TEMPORAL_DO VALUES ==="

[1] "Unique TEMPORAL_DO values:"

[1] 01PAST 02FUT

Levels: 01PAST 02FUT

[1] "TEMPORAL_DO value counts:"

01PAST 02FUT

  4288 4216

[1] "\n=== OBSERVED F-MAX RATIOS: TEMPORAL_DO within each TIME × DOMAIN combination ==="

# A tibble: 8 × 5

  TIME DOMAIN past_var fut_var f_max_ratio

 

1 Past Preferences 0.515 0.521 1.01

2 Past Personality 0.571 0.562 1.02

3 Past Values 0.565 0.540 1.05

4 Past Life 1.08 1.08 1.00

5 Future Preferences 0.326 0.371 1.14

6 Future Personality 0.433 0.411 1.06

7 Future Values 0.287 0.274 1.05

8 Future Life 1.05 0.801 1.31

[1] "\n=== HARTLEY'S F-MAX TEST RESULTS ==="

# A tibble: 8 × 5

  TIME DOMAIN observed_ratio critical_95 significant

 

1 Past Preferences 1.01 1.35 FALSE

2 Past Personality 1.02 1.32 FALSE

3 Past Values 1.05 1.38 FALSE

4 Past Life 1.00 1.28 FALSE

5 Future Preferences 1.14 1.57 FALSE

6 Future Personality 1.06 1.32 FALSE

7 Future Values 1.05 1.34 FALSE

8 Future Life 1.31 1.63 FALSE

[1] "Data size for ANOVA: 8504 rows"

[1] "Number of participants: 1063"

[1] "Design factors: TIME (2), DOMAIN (4), TEMPORAL_DO (2)"

[1] "Complete cases: 8504 out of 8504"

[1] "Design is balanced: each participant has data for all TIME × DOMAIN combinations"

[1] "\n=== MIXED ANOVA RESULTS (with sphericity corrections) ==="

Warning: Data is unbalanced (unequal N per group). Make sure you specified a well-considered value for the type

argument to ezANOVA().

[1] "ANOVA Results:"

  Effect DFn DFd SSn SSd F

1 (Intercept) 1 1061 6421.3415321 1944.0057 3504.6417249

2 TEMPORAL_DO 1 1061 0.7456337 1944.0057 0.4069522

3 TIME 1 1061 39.6689739 534.1210 78.8000944

4 DOMAIN 3 3183 311.5536201 1597.6667 206.9007190

5 TEMPORAL_DO:TIME 1 1061 5.5224829 534.1210 10.9700889

6 TEMPORAL_DO:DOMAIN 3 3183 3.7663764 1597.6667 2.5012259

7 TIME:DOMAIN 3 3183 3.1154311 904.9444 3.6526803

8 TEMPORAL_DO:TIME:DOMAIN 3 3183 0.6564659 904.9444 0.7696720

  p

1 0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000

2 0.52365818585252021932774368906393647193908691406250000000000000000000000000000000000000000000000000000000000000000000000000000000

3 0.00000000000000000287200875432473479121828208171507412771461531519889831542968750000000000000000000000000000000000000000000000000

4 0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001337697

5 0.00095717428775204211818805610789695492712780833244323730468750000000000000000000000000000000000000000000000000000000000000000000

6 0.05766070356738214885972126921842573210597038269042968750000000000000000000000000000000000000000000000000000000000000000000000000

7 0.01204956368720257880999824351420102175325155258178710937500000000000000000000000000000000000000000000000000000000000000000000000

8 0.51088655666805471433633556443965062499046325683593750000000000000000000000000000000000000000000000000000000000000000000000000000

  p<.05 ges

1 * 0.5631728577

2 0.0001496810

3 * 0.0079015460

4 * 0.0588693257

5 * 0.0011075401

6 0.0007556171

7 * 0.0006251049

8 0.0001317836

[1] "\nMauchly's Test of Sphericity:"

  Effect W

5 DOMAIN 0.7291990

6 TEMPORAL_DO:DOMAIN 0.7291990

7 TIME:DOMAIN 0.6398967

8 TEMPORAL_DO:TIME:DOMAIN 0.6398967

  p

5 0.0000000000000000000000000000000000000000000000000000000000000000000003497441103331600766295633730962322261

6 0.0000000000000000000000000000000000000000000000000000000000000000000003497441103331600766295633730962322261

7 0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000005087186

8 0.0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000005087186

  p<.05

5 *

6 *

7 *

8 *

[1] "\nGreenhouse-Geisser and Huynh-Feldt Corrections:"

  Effect GGe

5 DOMAIN 0.8167568

6 TEMPORAL_DO:DOMAIN 0.8167568

7 TIME:DOMAIN 0.7529784

8 TEMPORAL_DO:TIME:DOMAIN 0.7529784

  p[GG]

5 0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000009854502

6 0.07011166013757348658419488174331490881741046905517578125000000000000000000000000000000000000000000000000000

7 0.02133521013451386214021532339302211767062544822692871093750000000000000000000000000000000000000000000000000

8 0.47760654722485240686324914349825121462345123291015625000000000000000000000000000000000000000000000000000000

p[GG]<.05 HFe

5 * 0.8187892

6 0.8187892

7 * 0.7546665

8 0.7546665

  p[HF]

5 0.00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000005637194

6 0.06995986011187707576119976238260278478264808654785156250000000000000000000000000000000000000000000000000000

7 0.02125162288085758605094000017743383068591356277465820312500000000000000000000000000000000000000000000000000

8 0.47786945437333261388346272724447771906852722167968750000000000000000000000000000000000000000000000000000000

p[HF]<.05

5 *

6

7 *

8

=== CORRECTED DEGREES OF FREEDOM ===

  **Effect Original\_DFn Original\_DFd GG\_DFn GG\_DFd HF\_DFn**

1 DOMAIN 3 3183 2.450271 2599.737 2.456368

2 TEMPORAL_DO:DOMAIN 3 3183 2.450271 2599.737 2.456368

3 TIME:DOMAIN 3 3183 2.258935 2396.730 2.263999

4 TEMPORAL_DO:TIME:DOMAIN 3 3183 2.258935 2396.730 2.263999

  **HF\_DFd GG\_epsilon HF\_epsilon**

1 2606.206 0.8167568 0.8187892

2 2606.206 0.8167568 0.8187892

3 2402.103 0.7529784 0.7546665

4 2402.103 0.7529784 0.7546665

=== CORRECTED F-TESTS ===

DOMAIN:

Original: F(3, 3183) = 206.901

GG-corrected: F(2.45, 2599.74) = 206.901, p = 0.000000

HF-corrected: F(2.46, 2606.21) = 206.901, p = 0.000000

TEMPORAL_DO:DOMAIN:

Original: F(3, 3183) = 2.501

GG-corrected: F(2.45, 2599.74) = 2.501, p = 0.070112

HF-corrected: F(2.46, 2606.21) = 2.501, p = 0.069960

TIME:DOMAIN:

Original: F(3, 3183) = 3.653

GG-corrected: F(2.26, 2396.73) = 3.653, p = 0.021335

HF-corrected: F(2.26, 2402.10) = 3.653, p = 0.021252

TEMPORAL_DO:TIME:DOMAIN:

  Original: F(3, 3183) = 0.770

  GG-corrected: F(2.26, 2396.73) = 0.770, p = 0.477607

  HF-corrected: F(2.26, 2402.10) = 0.770, p = 0.477869

[1] "\n=== EFFECT SIZES (GENERALIZED ETA SQUARED) ==="

[1] "Generalized Eta Squared:"

  Effect ges

1 (Intercept) 0.56317

2 TEMPORAL_DO 0.00015

3 TIME 0.00790

5 DOMAIN 0.05887

4 TEMPORAL_DO:TIME 0.00111

6 TEMPORAL_DO:DOMAIN 0.00076

7 TIME:DOMAIN 0.00063

8 TEMPORAL_DO:TIME:DOMAIN 0.00013

[1] "\n=== POST-HOC COMPARISONS ==="

[1] "Main Effect of TIME:"

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TIME emmean SE df lower.CL upper.CL

 Past 0.937 0.0166 1603 0.905 0.970

 Future 0.801 0.0166 1603 0.768 0.833

Results are averaged over the levels of: TEMPORAL_DO, DOMAIN

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nPairwise Contrasts:"

contrast estimate SE df t.ratio p.value

Past - Future 0.137 0.0154 1061 8.877 <.0001

Results are averaged over the levels of: TEMPORAL_DO, DOMAIN

[1**] "\nMain Effect of DOMAIN:"**

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 DOMAIN emmean SE df lower.CL upper.CL

 Preferences 0.714 0.0198 2875 0.675 0.752

 Personality 0.914 0.0198 2875 0.875 0.953

 Values 0.685 0.0198 2875 0.646 0.724

 Life 1.163 0.0198 2875 1.124 1.202

Results are averaged over the levels of: TEMPORAL_DO, TIME

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nPairwise Contrasts:"

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.2004 0.0217 3183 -9.223 <.0001

 Preferences - Values 0.0284 0.0217 3183 1.307 1.0000

 Preferences - Life -0.4497 0.0217 3183 -20.693 <.0001

 Personality - Values 0.2288 0.0217 3183 10.530 <.0001

 Personality - Life -0.2493 0.0217 3183 -11.470 <.0001

 Values - Life -0.4781 0.0217 3183 -22.000 <.0001

Results are averaged over the levels of: TEMPORAL_DO, TIME

P value adjustment: bonferroni method for 6 tests

[1**] "\nMain Effect of TEMPORAL_DO:"**

NOTE: Results may be misleading due to involvement in interactions

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.0187 0.0294 1061 0.638 0.5237

Results are averaged over the levels of: TIME, DOMAIN

[1] "\n=== TEMPORAL_DO × TIME INTERACTION ==="

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TEMPORAL_DO TIME emmean SE df lower.CL upper.CL

 01PAST Past 0.921 0.0234 1599 0.875 0.967

 02FUT Past 0.953 0.0235 1607 0.907 1.000

 01PAST Future 0.836 0.0234 1599 0.790 0.882

 02FUT Future 0.766 0.0235 1607 0.720 0.812

Results are averaged over the levels of: DOMAIN

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nSimple Effects of TIME within each TEMPORAL_DO:"

TEMPORAL_DO = 01PAST:

contrast estimate SE df t.ratio p.value

Past - Future 0.0856 0.0217 1061 3.952 0.0001

TEMPORAL_DO = 02FUT:

contrast estimate SE df t.ratio p.value

Past - Future 0.1876 0.0219 1061 8.583 <.0001

Results are averaged over the levels of: DOMAIN

[1] "\nSimple Effects of TEMPORAL_DO within each TIME:"

TIME = Past:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT -0.0322 0.0331 1603 -0.973 0.3309

TIME = Future:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.0697 0.0331 1603 2.103 0.0356

Results are averaged over the levels of: DOMAIN

[1] "\n=== TIME × DOMAIN INTERACTION ==="

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TIME DOMAIN emmean SE df lower.CL upper.CL

 Past Preferences 0.783 0.0235 5073 0.737 0.829

 Future Preferences 0.644 0.0235 5073 0.598 0.690

 Past Personality 0.962 0.0235 5073 0.916 1.008

 Future Personality 0.866 0.0235 5073 0.820 0.912

 Past Values 0.784 0.0235 5073 0.738 0.830

 Future Values 0.586 0.0235 5073 0.540 0.633

 Past Life 1.220 0.0235 5073 1.174 1.266

 Future Life 1.107 0.0235 5073 1.061 1.153

Results are averaged over the levels of: TEMPORAL_DO

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nSimple Effects of DOMAIN within each TIME:"

TIME = Past:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.179220 0.0272 5913 -6.590 <.0001

 Preferences - Values -0.000848 0.0272 5913 -0.031 1.0000

 Preferences - Life -0.436770 0.0272 5913 -16.059 <.0001

 Personality - Values 0.178371 0.0272 5913 6.558 <.0001

 Personality - Life -0.257550 0.0272 5913 -9.470 <.0001

 Values - Life -0.435921 0.0272 5913 -16.028 <.0001

TIME = Future:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.221615 0.0272 5913 -8.148 <.0001

 Preferences - Values 0.057652 0.0272 5913 2.120 0.2044

 Preferences - Life -0.462575 0.0272 5913 -17.008 <.0001

 Personality - Values 0.279267 0.0272 5913 10.268 <.0001

 Personality - Life -0.240960 0.0272 5913 -8.860 <.0001

 Values - Life -0.520227 0.0272 5913 -19.128 <.0001

Results are averaged over the levels of: TEMPORAL_DO

P value adjustment: bonferroni method for 6 tests

[1] "\nSimple Effects of TIME within each DOMAIN:"

DOMAIN = Preferences:

contrast estimate SE df t.ratio p.value

Past - Future 0.1390 0.0253 3936 5.504 <.0001

DOMAIN = Personality:

contrast estimate SE df t.ratio p.value

Past - Future 0.0966 0.0253 3936 3.826 0.0001

DOMAIN = Values:

contrast estimate SE df t.ratio p.value

Past - Future 0.1975 0.0253 3936 7.820 <.0001

DOMAIN = Life:

contrast estimate SE df t.ratio p.value

Past - Future 0.1132 0.0253 3936 4.482 <.0001

Results are averaged over the levels of: TEMPORAL_DO

[1] "\n=== TEMPORAL_DO × DOMAIN INTERACTION ==="

NOTE: Results may be misleading due to involvement in interactions

[1] "Estimated Marginal Means:"

 TEMPORAL_DO DOMAIN emmean SE df lower.CL upper.CL

 01PAST Preferences 0.700 0.0280 2861 0.645 0.754

 02FUT Preferences 0.728 0.0281 2887 0.673 0.783

 01PAST Personality 0.928 0.0280 2861 0.874 0.983

 02FUT Personality 0.900 0.0281 2887 0.845 0.955

 01PAST Values 0.681 0.0280 2861 0.626 0.736

 02FUT Values 0.689 0.0281 2887 0.634 0.744

 01PAST Life 1.205 0.0280 2861 1.150 1.259

 02FUT Life 1.122 0.0281 2887 1.067 1.177

Results are averaged over the levels of: TIME

Warning: EMMs are biased unless design is perfectly balanced

Confidence level used: 0.95

[1] "\nSimple Effects of DOMAIN within each TEMPORAL_DO:"

TEMPORAL_DO = 01PAST:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.2289 0.0306 3183 -7.481 <.0001

 Preferences - Values 0.0183 0.0306 3183 0.597 1.0000

 Preferences - Life -0.5050 0.0306 3183 -16.504 <.0001

 Personality - Values 0.2472 0.0306 3183 8.078 <.0001

 Personality - Life -0.2761 0.0306 3183 -9.023 <.0001

 Values - Life -0.5233 0.0306 3183 -17.101 <.0001

TEMPORAL_DO = 02FUT:

 contrast estimate SE df t.ratio p.value

 Preferences - Personality -0.1719 0.0309 3183 -5.571 <.0001

 Preferences - Values 0.0385 0.0309 3183 1.248 1.0000

 Preferences - Life -0.3943 0.0309 3183 -12.777 <.0001

 Personality - Values 0.2104 0.0309 3183 6.819 <.0001

 Personality - Life -0.2224 0.0309 3183 -7.206 <.0001

 Values - Life -0.4328 0.0309 3183 -14.025 <.0001

Results are averaged over the levels of: TIME

P value adjustment: bonferroni method for 6 tests

[1] "\nSimple Effects of TEMPORAL_DO within each DOMAIN:"

DOMAIN = Preferences:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT -0.02826 0.0396 2874 -0.713 0.4757

DOMAIN = Personality:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT 0.02874 0.0396 2874 0.725 0.4684

DOMAIN = Values:

 contrast estimate SE df t.ratio p.value

 01PAST - 02FUT -0.00803 0.0396 2874 -0.203 0.8395

DOMAIN = Life:

contrast estimate SE df t.ratio p.value

01PAST - 02FUT 0.08247 0.0396 2874 2.081 0.0375

Results are averaged over the levels of: TIME

[1] "\n=== THREE-WAY INTERACTION ANALYSIS ==="

[1] "Note: Three-way interaction was non-significant (p = 0.511)"

[1] "\n=== COHEN'S D FOR SIGNIFICANT TWO-WAY INTERACTIONS ==="

[1] "\n=== COHEN'S D FOR TEMPORAL_DO × TIME INTERACTION ==="

Significant pairwise comparisons (p < 0.05):

contrast TEMPORAL_DO estimate SE df t.ratio p.value

Past - Future 01PAST 0.08563433 0.02167029 1061 3.952 0.0001

Past - Future 02FUT 0.18757116 0.02185455 1061 8.583 <.0001

Results are averaged over the levels of: DOMAIN

Cohen's d calculated from raw data:

Comparison: Past - Future | 01PAST

n1 = 2144, n2 = 2144

Cohen's d: 0.10639

Effect size interpretation: negligible

p-value: 0.00008

Comparison: Past - Future | 02FUT

n1 = 2108, n2 = 2108

Cohen's d: 0.24237

Effect size interpretation: small

p-value: 0.00000

Significant pairwise comparisons (p < 0.05):

 contrast TIME estimate SE df t.ratio p.value

 01PAST - 02FUT Future 0.06969664 0.03314652 1603.1 2.103 0.0356

Results are averaged over the levels of: DOMAIN

Cohen's d calculated from raw data:

Comparison: 01PAST - 02FUT | Future

  n1 = 2144, n2 = 2108

  Cohen's d: 0.09518

  Effect size interpretation: negligible

  p-value: 0.03565

[1] "\n=== COHEN'S D FOR TIME × DOMAIN INTERACTION ==="

Significant pairwise comparisons (p < 0.05):

contrast DOMAIN estimate SE df t.ratio p.value

Past - Future Preferences 0.13902794 0.02525902 3935.86 5.504 <.0001

Past - Future Personality 0.09663259 0.02525902 3935.86 3.826 0.0001

Past - Future Values 0.19752790 0.02525902 3935.86 7.820 <.0001

Past - Future Life 0.11322255 0.02525902 3935.86 4.482 <.0001

Results are averaged over the levels of: TEMPORAL_DO

Cohen's d calculated from raw data:

Comparison: Past - Future | Preferences

n1 = 1063, n2 = 1063

Cohen's d: 0.21102

Effect size interpretation: small

p-value: 0.00000

Comparison: Past - Future | Personality

n1 = 1063, n2 = 1063

Cohen's d: 0.13666

Effect size interpretation: negligible

p-value: 0.00013

Comparison: Past - Future | Values

n1 = 1063, n2 = 1063

Cohen's d: 0.30496

Effect size interpretation: small

p-value: 0.00000

Comparison: Past - Future | Life

n1 = 1063, n2 = 1063

Cohen's d: 0.11243

Effect size interpretation: negligible

p-value: 0.00001

Significant pairwise comparisons (p < 0.05):

 contrast TIME estimate SE df t.ratio p.value

 Preferences - Personality Past -0.1792195 0.02719739 5912.96 -6.590 <.0001

 Preferences - Life Past -0.4367697 0.02719739 5912.96 -16.059 <.0001

 Personality - Values Past 0.1783713 0.02719739 5912.96 6.558 <.0001

 Personality - Life Past -0.2575501 0.02719739 5912.96 -9.470 <.0001

 Values - Life Past -0.4359214 0.02719739 5912.96 -16.028 <.0001

 Preferences - Personality Future -0.2216149 0.02719739 5912.96 -8.148 <.0001

 Preferences - Life Future -0.4625751 0.02719739 5912.96 -17.008 <.0001

 Personality - Values Future 0.2792666 0.02719739 5912.96 10.268 <.0001

 Personality - Life Future -0.2409602 0.02719739 5912.96 -8.860 <.0001

 Values - Life Future -0.5202268 0.02719739 5912.96 -19.128 <.0001

Results are averaged over the levels of: TEMPORAL_DO

P value adjustment: bonferroni method for 6 tests

Cohen's d calculated from raw data:

Comparison: Preferences - Personality | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.24351

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Preferences - Life | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.48894

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Values | Past

  n1 = 1063, n2 = 1063

  Cohen's d: 0.23863

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Life | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.28411

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | Past

  n1 = 1063, n2 = 1063

  Cohen's d: -0.48278

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Preferences - Personality | Future

  n1 = 1063, n2 = 1063

  Cohen's d: -0.35747

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Preferences - Life | Future

  n1 = 1063, n2 = 1063

  Cohen's d: -0.57958

  Effect size interpretation: medium

  p-value: 0.00000

Comparison: Personality - Values | Future

  n1 = 1063, n2 = 1063

  Cohen's d: 0.47072

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Life | Future

  n1 = 1063, n2 = 1063

  Cohen's d: -0.29322

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | Future

  n1 = 1063, n2 = 1063

  Cohen's d: -0.66911

  Effect size interpretation: medium

  p-value: 0.00000

[1] "\n=== COHEN'S D FOR TEMPORAL_DO × DOMAIN INTERACTION ==="

Significant pairwise comparisons (p < 0.05):

 contrast DOMAIN estimate SE df t.ratio p.value

 01PAST - 02FUT Life 0.08246623 0.03962602 2874.42 2.081 0.0375

Results are averaged over the levels of: TIME

Cohen's d calculated from raw data:

Comparison: 01PAST - 02FUT | Life

  n1 = 1072, n2 = 1054

  Cohen's d: 0.08221

  Effect size interpretation: negligible

  p-value: 0.03751

Significant pairwise comparisons (p < 0.05):

 contrast TEMPORAL_DO estimate SE df t.ratio

 Preferences - Personality 01PAST -0.2289179 0.03060148 3183 -7.481

 Preferences - Life 01PAST -0.5050373 0.03060148 3183 -16.504

 Personality - Values 01PAST 0.2472015 0.03060148 3183 8.078

 Personality - Life 01PAST -0.2761194 0.03060148 3183 -9.023

 Values - Life 01PAST -0.5233209 0.03060148 3183 -17.101

 Preferences - Personality 02FUT -0.1719165 0.03086167 3183 -5.571

 Preferences - Life 02FUT -0.3943074 0.03086167 3183 -12.777

 Personality - Values 02FUT 0.2104364 0.03086167 3183 6.819

 Personality - Life 02FUT -0.2223909 0.03086167 3183 -7.206

 Values - Life 02FUT -0.4328273 0.03086167 3183 -14.025

 p.value

  <.0001

  <.0001

  <.0001

  <.0001

  <.0001

  <.0001

  <.0001

  <.0001

  <.0001

  <.0001

Results are averaged over the levels of: TIME

P value adjustment: bonferroni method for 6 tests

Cohen's d calculated from raw data:

Comparison: Preferences - Personality | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.33645

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Preferences - Life | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.58553

  Effect size interpretation: medium

  p-value: 0.00000

Comparison: Personality - Values | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: 0.36212

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Life | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.31200

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | 01PAST

  n1 = 1072, n2 = 1072

  Cohen's d: -0.60548

  Effect size interpretation: medium

  p-value: 0.00000

Comparison: Preferences - Personality | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: -0.25029

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Preferences - Life | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: -0.47142

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Values | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: 0.31099

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Personality - Life | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: -0.26217

  Effect size interpretation: small

  p-value: 0.00000

Comparison: Values - Life | 02FUT

  n1 = 1054, n2 = 1054

  Cohen's d: -0.52269

  Effect size interpretation: medium

  p-value: 0.00000

[1] "\n=== COHEN'S D FOR THREE-WAY INTERACTION ==="

[1] "The pairwise comparisons show the TIME effects within each TEMPORAL_DO × DOMAIN combination:"

TEMPORAL_DO = 01PAST, DOMAIN = Preferences:

contrast estimate SE df t.ratio p.value

Past - Future 0.11828358 0.03557011 3935.86 3.325 0.0009

TEMPORAL_DO = 02FUT, DOMAIN = Preferences:

contrast estimate SE df t.ratio p.value

Past - Future 0.15977230 0.03587255 3935.86 4.454 <.0001

TEMPORAL_DO = 01PAST, DOMAIN = Personality:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.03880597 0.03557011 3935.86 1.091 0.2754

TEMPORAL_DO = 02FUT, DOMAIN = Personality:

contrast estimate SE df t.ratio p.value

Past - Future 0.15445920 0.03587255 3935.86 4.306 <.0001

TEMPORAL_DO = 01PAST, DOMAIN = Values:

contrast estimate SE df t.ratio p.value

Past - Future 0.13395522 0.03557011 3935.86 3.766 0.0002

TEMPORAL_DO = 02FUT, DOMAIN = Values:

contrast estimate SE df t.ratio p.value

Past - Future 0.26110057 0.03587255 3935.86 7.279 <.0001

TEMPORAL_DO = 01PAST, DOMAIN = Life:

 contrast estimate SE df t.ratio p.value

 Past - Future 0.05149254 0.03557011 3935.86 1.448 0.1478

TEMPORAL_DO = 02FUT, DOMAIN = Life:

contrast estimate SE df t.ratio p.value

Past - Future 0.17495256 0.03587255 3935.86 4.877 <.0001

[1] "\nCohen's d calculations for significant TIME effects within each TEMPORAL_DO × DOMAIN combination:"

TEMPORAL_DO = 01PAST, DOMAIN = Preferences:

  Past vs Future comparison

  n_Past = 536, n_Future = 536

Cohen's d: 0.18239

  Effect size interpretation: negligible

  p-value: 0.00089

  Estimated difference: 0.11828

TEMPORAL_DO = 02FUT, DOMAIN = Preferences:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.23929

  Effect size interpretation: small

  p-value: 0.00001

  Estimated difference: 0.15977

TEMPORAL_DO = 02FUT, DOMAIN = Personality:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.22151

  Effect size interpretation: small

  p-value: 0.00002

  Estimated difference: 0.15446

TEMPORAL_DO = 01PAST, DOMAIN = Values:

  Past vs Future comparison

  n_Past = 536, n_Future = 536

Cohen's d: 0.20530

  Effect size interpretation: small

  p-value: 0.00017

  Estimated difference: 0.13396

TEMPORAL_DO = 02FUT, DOMAIN = Values:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.40909

  Effect size interpretation: small

  p-value: 0.00000

  Estimated difference: 0.26110

TEMPORAL_DO = 02FUT, DOMAIN = Life:

  Past vs Future comparison

  n_Past = 527, n_Future = 527

Cohen's d: 0.18039

  Effect size interpretation: negligible

  p-value: 0.00000

  Estimated difference: 0.17495