CET4作文评分人混合型反馈的效果研究【2025|PDF|Epub|mobi|kindle电子书版本百度云盘下载】

CET4作文评分人混合型反馈的效果研究PDF格式电子书版下载

注意：本站所有压缩包均有解压码： 点击下载压缩包解压工具

Chapter 1 Introduction1

1.1 Background of the study1

1.2 Purpose of the study and research questions2

1.3 Significance of the study3

1.3.1 Theoretical significance3

1.3.2 Methodological significance4

1.3.3 Practical significance4

1.4 A note on terms6

1.4.1 Mock essays6

1.4.2 Rater effects/variability/biases/errors6

1.4.3 Rating accuracy6

1.4.4 Scoring/score validity6

1.4.5 Scoring/rating expertise7

1.4.6 Cognitive strategy7

1.4.7 Meta-cognitive strategy8

1.4.8 Rating session8

1.4.9 Feedback iteration8

1.4.1 0 Counter-balanced design8

1.4.1 1 The correlation coefficient8

1.4.1 2 The mixed feedback8

1.5 The structure of chapters9

Chapter 2 Literature review10

2.1 Introduction10

2.2 Rater variability as a serious threat to score validity in performance assessments10

2.2.1 Models of performance assessment of writing11

2.2.2 Factors that affect rater performance14

2.2.3 Rater variability from the psychometric perspective17

2.2.4 Rater variability from the hermeneutic perspective22

2.2.5 Rater cognition studies23

2.3 Rater training as a routine measure to control rater variability38

2.3.1 Overview of procedures of rater training39

2.3.2 Studies on rater training effectiveness41

2.3.3 Critical issues in rater training43

2.4 Rater feedback as an important part of training45

2.4.1 Studies on rater feedback effectiveness46

2.4.2 Some common problems51

2.5 Methodological considerations52

2.5.1 Content of the feedback52

2.5.2 Delivery of the feedback53

2.6 Summary53

Chapter 3 Method54

3.1 Introduction54

3.2 Research Design55

3.2.1 The mixed methods design of this study55

3.2.2 The quasi-experimental nature of this study56

3.2.3 Context of the study56

3.2.4 Materials62

3.2.5 Participants66

3.2.6 Instruments70

3.2.7 Pilot study72

3.2.8 Procedures78

3.3 Data analysis80

3.3.1 MFRM analysis of ratings80

3.3.2 Analysis of degree of certainty84

3.3.3 Verbal protocol analysis84

3.3.4 The questionnaire of raters'perceptions of mixed feedback86

3.3.5 The questionnaire of raters'evaluation of feedback effectiveness86

3.3.6 Interview with those who are negative with the feedback effectiveness86

3.4 Summary86

Chapter 4 Results88

4.1 Findings for Research Question 1:The effect of the mixed feedback on rater variability89

4.1.1 Findings for RQ1（1）:The effect of the mixed feedback on rater severity89

4.1.2 Findings for RQ1（2）:The effect of the mixed feedback on rater internal consistency97

4.1.3 Findings for RQ1（3）:The effect of the mixed feedback on rater bias101

4.1.4 Findings for RQ1（4）:The effect of the mixed feedback on rater central tendency104

4.1.5 Findings for RQ1（5）:The effect of the mixed feedback on rater severity DRIFT106

4.2 Findings for Research Question 2:The extent to which EG raters can incorporate the mixed feedback into rating behavior when it is provided repeatedly over 3 iterations109

4.2.1 First round results110

4.2.2 Second round results111

4.3 Findings for Research Question 3:The effect of the mixed feedback on raters'degree of certainty for their ratings112

4.3.1 First round results112

4.3.2 Second round results114

4.4 Findings for Research Question 4:The effect of the mixed feedback on raters'deci-sion-making115

4.4.1 Findings for RQ4（1）:The effect of the mixed feedback on raters'decision-making in terms of text features116

4.4.2 Findings for RQ4（2）:The effect of the mixed feedback on raters'decision-making in terms of information processing behaviors129

4.5 Findings for Research Question 5:Raters'perceptions of the mixed feedback139

4.5.1 First round results139

4.5.2 Second round results145

4.6 Summary151

Chapter 5 Discussion153

5.1 Discussion of Research Question 1:What effect does the mixed feedback have on rater variability?153

5.1.1 Methodological considerations153

5.1.2 Interpretation of the results153

5.2 Discussion of Research Question 2:To what extent can EG raters incorporate the mixed feedback into rating behavior when it is provided repeatedly over 3 iterations?158

5.2.1 Methodological considerations158

5.2.2 Interpretation of the results158

5.3 Discussion of Research Question 3:What effect does the mixed feedback have on raters'degree of certainty for their ratings?160

5.3.1 Methodological considerations160

5.3.2 Interpretation of the results160

5.4 Discussion of Research Question 4:What effect does the mixed feedback have on raters'decision-making?162

5.4.1 Methodological considerations162

5.4.2 Interpretation of the results163

5.5 Discussion of Research Question 5:What are raters'perceptions of such feedback?170

5.5.1 Methodological considerations170

5.5.2 Interpretation of the results170

5.6 General discussion:Establish an internal link between findings173

5.6.1 Linking findings of RQ1,RQ3 and RQ4173

5.6.2 Linking findings of RQ1,RQ3,RQ4 and RQ5176

5.7 Summary181

Chapter 6 Conclusions182

6.1 Summary of findings182

6.2 Implications of the study183

6.2.1 Theoretical implications183

6.2.2 Methodological implications184

6.2.3 Practical implications184

6.3 Limitations of the study and direction for future research185

References189

Appendices203