Assessing next generation technology enhanced learning
Cloud created by:
27 March 2011
ARV2011 Alpine Rendezvous
Research Strand led by Dr Denise Whitelock.
STELLAR Grand Challenge 2: Orchestrating Learners
Key research questions related to this challenge include:
- What is the role of the teacher/more knowledgeable other in orchestrating learning and how does this relate to collaboration and the knowledge of students?
- What is the role of assessment and evaluation in learning and how can technology play a role?
- From the point of view of the learner what is the relationship between higher-order skills and learning of a particular knowledge domain and what is the role of technology in this respect?
- How can we identify the current learning trajectory or a person? Would it be beneficial to make them aware of trajectory switches?
NATIONAL UNION OF STUDENTS' PRINCIPLES OF EFFECTIVE ASSESSMENT
1. Should be for learning, not simply of learning
2. Should be reliable, valid, fair and consistent
3. Should consist of effective and constructive feedback
4. Should be innovative and have the capacity to inspire and motivate
5. Should measure understanding and application, rather than technique and memory
6. Should be conducted throughout the course, rather than being positioned as a final event
7. Should develop key skills such as peer and reflective assessment
8. Should be central to staff development and teaching strategies, and frequently reviewed
9. Should be of a manageable amount for both tutors and students
10. Should encourage dialogue between students and their tutors and students and their peers
15:59 on 28 March 2011
The Big Challenge of e-assessment:
What we have at moment is wolf in sheeps clothing. We’re being constructivist and collaborative with all these tools, but are we really doing this in practice.
- Evaluation: What counts as evidence?
- Look for guidelines for assessment for elearning
- How openness give challenges to how we demonstrate our credentials when assessing students performance in elearning.
- What can we do with mobiles and assessment
Recognize the wolves!
Wolves as sheep – can we get them to lie down.
16:09 on 28 March 2011
Individuals' responses to assessment.
- Explored reactions to personalised and automated forms of assessment.
- When is it best to deliver feedback?
- Should you emphasise achievement or effort?
What evidence do we require that e-assessment is worth implementing?
- Depends on the purpose of the asessment
- e-assessment would make faculty members rethink their practice
- learners would rethink their learning goals
- Allow them to develop their reflection, their transferable skills
- Could be used to reflect to a group what they have discussed or not discussed.
Measures that can be employed
- Difficult to change learner views and their engagement with and enjoyment of the assessment process
- Allow teachers to move away from marking activities on which their time is not well spent
Unique features of e-assessment, that would not be possible otherwise
- Can measure how consistent feedback is
- Can use student satisafaction surveys to some extent.
- Monitor dropout rate.
- Reduce costs of marking
- Reduce costs of monitoring plagiarism
Apps for e-assessment
- Could include alerts and notifications
- Important to know when learners are ready to receive those
- Traffic-light system alerting teachers of groups of learners to difficulties
- Marking when knowledge is transferred to a new area
- Allow more able others to help with your learning problems
- Facilitate assessment for the learner by making it more convivial
Possible grand challenge for assessment
Development of an evidence-based assessment system for cognitive, affective and psychomotoric learning providing learners with timely feedback at the right moment that leads finally to a society-wide asssessment literacy and a changed perception of assessment.
19:05 on 28 March 2011
Assessment group New Grand Challenge:
Task 1: looking at individuals’ responses to assessment.
Is feedback personal or depersonalised? Human interface versus computer interface to feedback. Pros and cons of both. When is it best to deliver feedback. Nature of it. Emphasise achievement or effort.
Task 2: What counts as evidence? e-assessment would make faculty members rethink their teaching practice. E-assessment would allow learners to practice critical thinking and reflection. Transfer skills would be important. E-assessment could be used as a way to reflect to the group what topics they had discussed or not discussed.
Measures you could employ. Changing learner views and objectives in entering the assessment process. Engagement and enjoyment of that process that is traditionally not enjoyable. Free up lecturer time to shift attention to more important aspects to enriching teaching and learning. Moving away from marking.
Focusing on unique features of assessment that could not be done otherwise. What are the key features?
- Is feedback more consistent than before
- Student satisfaction surveys
- Monitoring drop-out rate
- Reducing costs of marking or reducing costs of monitoring plagiarism and cheating. Capture this or stop it happening with eassessment.
Task 3: Killer app for mobile assessment – alerts and notifications. Important to know when learners ready to receive those alerts and notifications. When they would be most receptive to getting these kinds of signals.
Traffic light system app alerting teachers or other learners to difficulties that learners might be experiencing.
Capture features of understanding or applying knowledge out in the field.
Applications concerned with getting more able others to help you with your learning problems.
Applications to facilitate assessment for the learner by making the process more visible or pleasant – such as audio recording.
The development of an evidence-based assessment system for cognitive, affective, psychomotoric learning providing learners with timely feedback that leads to society-wide assessement literacy and a changed perception of assessment.
19:10 on 28 March 2011