Learning Management Systems: Tracking learner development and developing effective evaluative rubrics
(2014-2016, sophia university)
With rapidly available access to technology such as online learning management systems that allows us to track students’ output, we are in a better position than ever to use that information to improve both input tasks and evaluation. This project endeavors to utilize such technology, for which the researcher has considerable inside knowledge and expertise, in order to track students’ learning development and generate highly effective standardized tasks and evaluation rubrics.
The proposed action research project will take place in the academic English writing courses in foundation and access programs at Dublin Institute of Technology as well as the Core courses in the Faculty of Liberal Arts (FLA). Students’ learning development will be tracked over a period of four semesters. For this project, outcomes of all tasks completed by students for courses in English Composition, including additional outside tasks completed through the faculty’s writing center, will be used to generate tracking data using the revolutionary Coursebase software.
Coursebase can track…
Basic activity data
Courses created, lessons created, tasks created, tasks assigned, tasks submitted, messages sent, etc.
Basic results data
Grades, mean, median, high/low, submission rates, question scores, question answers, writing markups, etc.
Basic access data
Logins, page visits, time on platform, time on task, time of day, time of week, device type, location, etc.
Item analysis
Item difficulty, item discrimination, standard deviation, reliability coefficient, distractor analysis, error ratio, etc. on all content including textbooks, assignments, tests, and individual questions.
Correlation analysis
Correlation coefficient between any two or more variables.
Progress analysis
Comprehensive analysis of learning progress using all data above.
Recommendation algorithm
Coursebase’s proprietary recommendation algorithm can analysis, sort and recommend learning content to students based on their individual real-time learning needs.
In terms of generating effective standardized evaluation rubrics, Coursebase software makes important data readily accessible. That data can then be applied to developments in evaluation rubrics currently talking place in Europe, taking advantage of the carefully developed “can do” approach in the application of the Common European Framework (CEFR) (see Schmidt, et al, 2010; Little, 2009).
Return to projects
The proposed action research project will take place in the academic English writing courses in foundation and access programs at Dublin Institute of Technology as well as the Core courses in the Faculty of Liberal Arts (FLA). Students’ learning development will be tracked over a period of four semesters. For this project, outcomes of all tasks completed by students for courses in English Composition, including additional outside tasks completed through the faculty’s writing center, will be used to generate tracking data using the revolutionary Coursebase software.
Coursebase can track…
Basic activity data
Courses created, lessons created, tasks created, tasks assigned, tasks submitted, messages sent, etc.
Basic results data
Grades, mean, median, high/low, submission rates, question scores, question answers, writing markups, etc.
Basic access data
Logins, page visits, time on platform, time on task, time of day, time of week, device type, location, etc.
Item analysis
Item difficulty, item discrimination, standard deviation, reliability coefficient, distractor analysis, error ratio, etc. on all content including textbooks, assignments, tests, and individual questions.
Correlation analysis
Correlation coefficient between any two or more variables.
Progress analysis
Comprehensive analysis of learning progress using all data above.
Recommendation algorithm
Coursebase’s proprietary recommendation algorithm can analysis, sort and recommend learning content to students based on their individual real-time learning needs.
In terms of generating effective standardized evaluation rubrics, Coursebase software makes important data readily accessible. That data can then be applied to developments in evaluation rubrics currently talking place in Europe, taking advantage of the carefully developed “can do” approach in the application of the Common European Framework (CEFR) (see Schmidt, et al, 2010; Little, 2009).
Return to projects