Thomas Quinlan - Academia.edu (original) (raw)
Papers by Thomas Quinlan
![Research paper thumbnail of Evaluating the Construct-Coverage of the e-rater[R] Scoring Engine. Research Report. ETS RR-09-01](https://attachments.academia-assets.com/83615065/thumbnails/1.jpg)
](Educational Testing Service, 2009
ETS Research Report Series, 2009
Journal of Writing Research, 2013
Written Documents in the Workplace, 2007
In the workplace, writing well requires highly efficient skills in processing information, most e... more In the workplace, writing well requires highly efficient skills in processing information, most especially fluent reading comprehension. When writing in the workplace, professionals must develop strategies for accessing and evaluating information, which involves reading for various purposes. Achieving writing goals often requires the writer to read for different purposes. The writer must read his or her own text to evaluate it, in order to revise. Reading plays an important role in generating new content. When composing from sources, professionals must comprehend information from text sources, such as reports and emails. Recalling and recognizing information from sources enables the writer to integrate that information into their own texts. The importance of reading-during-writing holds practical implications. Fluent reading skills afford a host of advantages for accessing and evaluating information. This chapter explores the cognitive processes of writing expertise, focusing especially upon the ability to read critically. Keywords: cognitive process; comprehend information; evaluating information; professionals; reports composing; role of reading; writing expertise
ETS Research Report Series, 2008
ETS Research Report Series, 2011
Reading and Writing, 2009
... The criteria for text quality included the following: (a) the writer's focus on the topi... more ... The criteria for text quality included the following: (a) the writer's focus on the topic; (b) supporting ... The system included an infrared camera housed in a small box located directly underneath the front of ... of 60 frames per second, with an accuracy of 0.51°. Using a font size of 14 ...
Written Communication, 2012
Moment to moment, a writer faces a host of potential problems. How does the writer’s mind coordin... more Moment to moment, a writer faces a host of potential problems. How does the writer’s mind coordinate this problem solving? In the original Hayes and Flower model, the authors posited a distinct process to manage this coordinating—that is, the “monitor.” The monitor became responsible for executive function in writing. In two experiments, the current authors investigated monitor function by examining the coordination of two common writing tasks—editing (i.e., correcting an error) and sentence composing—in the presence or absence of an error and with a low or high memory load for the writer. In the first experiment, participants could approach the editing and composing task in either order. On most trials (88%), they finished the sentence first, and less frequently (12%), they corrected the error first. The error-first approach occurred significantly more often under the low-load condition than the high-load condition. For the second experiment, participants were asked to adopt the le...
Reading and Writing, 2009
Abstract In this study we investigated the role of reading, how writers coordinate editing with o... more Abstract In this study we investigated the role of reading, how writers coordinate editing with other writing processes. In particular, the experiment examines how the cognitive demands of sentence composing and the type of error influence the reading and writing performance. We devised an experimental writing task in which participants corrected an embedded error (orthographic near-neighbors or far-neighbors) and completed a sentence (using 1 or 3 context words)—in either order. Data were collected by logging keystrokes and recording ...
Language Testing, 2010
E-rater® is an automated essay scoring system that uses natural language processing techniques to... more E-rater® is an automated essay scoring system that uses natural language processing techniques to extract features from essays and to model statistically human holistic ratings. Educational Testing Service has investigated the use of e-rater, in conjunction with human ratings, to score one of the two writing tasks on the TOEFL-iBT® writing section. In this article we describe the TOEFL iBT writing section and an e-rater model proposed to provide one of two ratings for the Independent writing task. We discuss how the evidence for a process that uses both human and e-rater scoring is relevant to four components in a validity argument: (a) Evaluation — observations of performance on the writing task are scored to provide evidence of targeted writing skills; (b) Generalization — scores on the writing task provide estimates of expected scores over relevant parallel versions of the task and across raters; (c) Extrapolation — expected scores on the writing task are consistent with other me...
Language Assessment Quarterly, 2013
Journal of Educational Psychology, 2004
... Toward that end, a few short speech exercises were conducted. For example, in one speech exer... more ... Toward that end, a few short speech exercises were conducted. For example, in one speech exercise, children repeated after me the syllables mee, may, mah, moh, moo in a series of ascending and descending notes. When ...
Journal of Educational Computing Research, 2010
We examined whether an automated essay feedback system could improve the writing performance of c... more We examined whether an automated essay feedback system could improve the writing performance of college students. Students in a freshmen composition course received no feedback or varying amounts of formative feedback on their first drafts of three practice essays (none, intermittent, or continuous). The students wrote a first and then a revised final draft of an essay in a writing lab held once per week. After a retention interval of 2 weeks, a test essay was written without the use of feedback to assess transfer of learning. Holistic scores showed no reliable gains, but the transfer test showed that students learned to reduce errors of mechanics, usage, grammar, and style. The benefit was found for continuous but not intermittent feedback.
sites.google.com
Abstract. Peer review activities are almost ideal for supporting writing instruction. However, th... more Abstract. Peer review activities are almost ideal for supporting writing instruction. However, they also have a glaring weakness: quality of peer feedback. An obvious way to increase the quality of peer feedback is to improve students' reviewing skill. For peer review activities, ...
Educational Testing Service, 2009
ETS Research Report Series, 2009
Journal of Writing Research, 2013
Written Documents in the Workplace, 2007
In the workplace, writing well requires highly efficient skills in processing information, most e... more In the workplace, writing well requires highly efficient skills in processing information, most especially fluent reading comprehension. When writing in the workplace, professionals must develop strategies for accessing and evaluating information, which involves reading for various purposes. Achieving writing goals often requires the writer to read for different purposes. The writer must read his or her own text to evaluate it, in order to revise. Reading plays an important role in generating new content. When composing from sources, professionals must comprehend information from text sources, such as reports and emails. Recalling and recognizing information from sources enables the writer to integrate that information into their own texts. The importance of reading-during-writing holds practical implications. Fluent reading skills afford a host of advantages for accessing and evaluating information. This chapter explores the cognitive processes of writing expertise, focusing especially upon the ability to read critically. Keywords: cognitive process; comprehend information; evaluating information; professionals; reports composing; role of reading; writing expertise
ETS Research Report Series, 2008
ETS Research Report Series, 2011
Reading and Writing, 2009
... The criteria for text quality included the following: (a) the writer's focus on the topi... more ... The criteria for text quality included the following: (a) the writer's focus on the topic; (b) supporting ... The system included an infrared camera housed in a small box located directly underneath the front of ... of 60 frames per second, with an accuracy of 0.51°. Using a font size of 14 ...
Written Communication, 2012
Moment to moment, a writer faces a host of potential problems. How does the writer’s mind coordin... more Moment to moment, a writer faces a host of potential problems. How does the writer’s mind coordinate this problem solving? In the original Hayes and Flower model, the authors posited a distinct process to manage this coordinating—that is, the “monitor.” The monitor became responsible for executive function in writing. In two experiments, the current authors investigated monitor function by examining the coordination of two common writing tasks—editing (i.e., correcting an error) and sentence composing—in the presence or absence of an error and with a low or high memory load for the writer. In the first experiment, participants could approach the editing and composing task in either order. On most trials (88%), they finished the sentence first, and less frequently (12%), they corrected the error first. The error-first approach occurred significantly more often under the low-load condition than the high-load condition. For the second experiment, participants were asked to adopt the le...
Reading and Writing, 2009
Abstract In this study we investigated the role of reading, how writers coordinate editing with o... more Abstract In this study we investigated the role of reading, how writers coordinate editing with other writing processes. In particular, the experiment examines how the cognitive demands of sentence composing and the type of error influence the reading and writing performance. We devised an experimental writing task in which participants corrected an embedded error (orthographic near-neighbors or far-neighbors) and completed a sentence (using 1 or 3 context words)—in either order. Data were collected by logging keystrokes and recording ...
Language Testing, 2010
E-rater® is an automated essay scoring system that uses natural language processing techniques to... more E-rater® is an automated essay scoring system that uses natural language processing techniques to extract features from essays and to model statistically human holistic ratings. Educational Testing Service has investigated the use of e-rater, in conjunction with human ratings, to score one of the two writing tasks on the TOEFL-iBT® writing section. In this article we describe the TOEFL iBT writing section and an e-rater model proposed to provide one of two ratings for the Independent writing task. We discuss how the evidence for a process that uses both human and e-rater scoring is relevant to four components in a validity argument: (a) Evaluation — observations of performance on the writing task are scored to provide evidence of targeted writing skills; (b) Generalization — scores on the writing task provide estimates of expected scores over relevant parallel versions of the task and across raters; (c) Extrapolation — expected scores on the writing task are consistent with other me...
Language Assessment Quarterly, 2013
Journal of Educational Psychology, 2004
... Toward that end, a few short speech exercises were conducted. For example, in one speech exer... more ... Toward that end, a few short speech exercises were conducted. For example, in one speech exercise, children repeated after me the syllables mee, may, mah, moh, moo in a series of ascending and descending notes. When ...
Journal of Educational Computing Research, 2010
We examined whether an automated essay feedback system could improve the writing performance of c... more We examined whether an automated essay feedback system could improve the writing performance of college students. Students in a freshmen composition course received no feedback or varying amounts of formative feedback on their first drafts of three practice essays (none, intermittent, or continuous). The students wrote a first and then a revised final draft of an essay in a writing lab held once per week. After a retention interval of 2 weeks, a test essay was written without the use of feedback to assess transfer of learning. Holistic scores showed no reliable gains, but the transfer test showed that students learned to reduce errors of mechanics, usage, grammar, and style. The benefit was found for continuous but not intermittent feedback.
sites.google.com
Abstract. Peer review activities are almost ideal for supporting writing instruction. However, th... more Abstract. Peer review activities are almost ideal for supporting writing instruction. However, they also have a glaring weakness: quality of peer feedback. An obvious way to increase the quality of peer feedback is to improve students' reviewing skill. For peer review activities, ...