Learning Analytics Dashboards for Professional Training - Challenges and Proposal (original) (raw)
Related papers
Development of the Learning Analytics Dashboard to Support Students' Learning Performance
2015
The Learning Analytics Dashboard (LAD) is an application to show students' online behavior patterns in a virtual learning environment. This supporting tool works by tracking students' log-files, mining massive amounts of data to find meaning, and visualizing the results so they can be comprehended at a glance. This paper reviews previously developed applications to analyze their features. Based on the implications from the review of previous studies as well as a preliminary investigation on the need for such tools, an early version of the LAD was designed and developed. Also, in order to improve the LAD, a usability test incorporating a stimulus recall interview was conducted with 38 college students in two blended learning classes. Evaluation of this tool was performed in an experimental research setting with a control group and additional surveys were conducted asking students' about perceived usefulness, conformity, level of understanding of graphs, and their behavioral changes. The results indicated that this newly developed learning analytics tool did not significantly impact on their learning achievement. However, lessons learned from the usability and pilot tests support that visualized information impacts on students' understanding level; and the overall satisfaction with dashboard plays as a covariant that impacts on both the degree of understanding and students' perceived change of behavior. Taking in the results of the tests and students' openended responses, a scaffolding strategy to help them understand the meaning of the information displayed was included in each sub section of the dashboard. Finally, this paper discusses future directions in regard to improving LAD so that it better supports students' learning performance, which might be helpful for those who develop learning analytics applications for students.
Learning Analytics: Layers, Loops and Processes in a Virtual Learning Infrastructure
Handbook of Learning Analytics
Learning analytics (LA) is a term that refers to the use of digital data for analysis and feedback that generates actionable insights to improve learning. LA feedback can be used in two ways: 1) to improve the personal learning power of individuals and teams in the process of value creation; and 2) to respond more accurately to the learning needs of others. The human online communications; sensors that monitor more; as well as traditional survey data collected from sort of social and technical learning infrastructures that best support processes of improvement, adaptation and change. These challenges are located at the human/data interface and are as important for schools or universities whose purpose is to enhance learning and its outcomes as they are for corporate service or a product. Both depend on the capability of humans within their systems to be able to monitor, own learning journey to achieve a purpose of value. Learning analytics provides formative feedback at can be aggregated for individuals, teams, and whole
The missing link in Learning Analytics
ASCILITE Publications, 2023
Learning Analytics and staff-facing dashboards enable educators to gain insights into student learning, enhancing teaching practices and learning outcomes. Student-facing dashboards (SFDs) can also prove advantageous for students as they empower them to better interpret their results, promote self-reflection with the goal of improving their academic performance. Whilst there is no currently preferred software solution for implementing dashboards. Through the authors' reflections of creating SFDs, using assessment and ePortfolio asset data, this can be achieved with free or readily available tools. This concise paper used initiatives for the author to reflect upon the process creating SFDs. Investigations for opportunities to refine dashboards are also presented.
Learning dashboards An overview and future research opportunities
In this paper, we present work on learning analytics that aims to support learners and teachers through dashboard applications, ranging from small mobile applications to learnscapes on large public displays. Dashboards typically capture and visualize traces of learning activities, in order to promote awareness, reflection, and sense-making, and to enable learners to define goals and track progress toward these goals. Based on an analysis of our own work and a broad range of similar learning dashboards, we identify HCI issues for this exciting research area.
Visualizing Learning Analytics: Designing A Roadmap For Success
2013
Learning analytics tools help online educators visually extract meaningful performance and behavioral patterns from learners’ trace data. While many learning analytics solutions have addressed how educators monitor and provide summative feedback to learners, most are pedagogically neutral, and do not feature or support formative feedback. We explore the research principles underlying the design and implementation of a learning analytics tool rooted in theories of self-regulation, formative feedback and design-based research that address challenges unique to online educators and learners. The tool, itself a source of formative feedback, is intended to improve educator efficacy and the provision of timely feedback, leading to greater learner retention and overall satisfaction.
TaBAT: Design and Experimentation of a Learning Analysis Dashboard for Teachers and Learners
Journal of Information Technology Education-Research, 2021
Aim/Purpose Since the beginning of the COVID-19 pandemic, many countries have adopted online education as an alternative to face-to-face courses. This has increased awareness of the importance of analyzing learning data left by students to improve and evaluate the learning process. This article presents a new tool, named TaBAT, created to work with different LMSs in the form of dashboards accessible online and allowing teachers to monitor the progress of their learners and at the same time allow learners to visualize their learning process. Background TaBAT is designed based on the results of our previous research on factors that can influence the success of online learners, where we proposed and statistically validated a model for assessing the success of online learners called e-LSAM (e-Learner Success Assessment Model). Methodology Two studies are presented in this article. The first one is conducted on a group of students from two classes (each composed of two groups) of a highe...
Learning Analytics: A Way to Monitoring and Improving Students' Learning
2017
This paper focus on the potential contributes of Learning Analytics in the improvement students learning. The analysis of student's data collected from Virtual Learning Environments is important to ascertain student's engagement. This paper presents the analysis of data collected in the ambit of MatActiva project. Data was analysed with Google Analytics, Course Dedication and Moodle Reports. Promising results were obtained.
Development of a dashboard for Learning Analytics in Higher Education
In this paper, we discuss the design, development, and implementation of a Learning Analytics (LA) dashboard in the area of Higher Education (HE). The dashboard meets the demands of the different stakeholders, maximizes the mainstreaming potential and transferability to other contexts, and is developed in the path of Open Source. The research concentrates on developing an appropriate concept to fulfil its objectives and finding a suitable technology stack. Therefore, we determine the capabilities and functionalities of the dashboard for the different stakeholders. This is of significant importance as it identifies which data can be collected, which feedback can be given, and which functionalities are provided. A key approach in the development of the dashboard is the modularity. This leads us to a design with three modules: the data collection, the search and information processing, and the data presentation. Based on these modules, we present the steps of finding a fitting Open Source technology stack for our concept and discuss pros and cons trough out the process .
International Journal of Educational Technology in Higher Education
Higher education institutions are moving to design and implement teacher-facing learning analytics (LA) dashboards with the hope that instructors can extract deep insights about student learning and make informed decisions to improve their teaching. While much attention has been paid to developing teacher-facing dashboards, less is known about how they are designed, implemented and evaluated. This paper presents a systematic literature review of existing studies reporting on teacher-facing LA dashboards. Out of the 1968 articles retrieved from several databases, 50 articles were included in the final analysis. Guided by several frameworks, articles were coded based on the following dimensions: purpose, theoretical grounding, stakeholder involvement, ethics and privacy, design, implementation, and evaluation criteria. The findings show that most dashboards are designed to increase teachers’ awareness but with limited actionable insights to allow intervention. Moreover, while teachers...