Cloud created by:

Rebecca Ferguson
27 March 2011

ARV2011 Alpine Rendezvous

Research Strand led by Dr Denise Whitelock.

This is one of four workshop strands that relate to

STELLAR Grand Challenge 2: Orchestrating Learners
Key research questions related to this challenge include:

  • What is the role of the teacher/more knowledgeable other in orchestrating learning and how does this relate to collaboration and the knowledge of students?
  • What is the role of assessment and evaluation in learning and how can technology play a role?
  • From the point of view of the learner what is the relationship between higher-order skills and learning of a particular knowledge domain and what is the role of technology in this respect?
  • How can we identify the current learning trajectory or a person? Would it be beneficial to make them aware of trajectory switches?

Extra content

NATIONAL UNION OF STUDENTS' PRINCIPLES OF EFFECTIVE ASSESSMENT

http://www.timeshighereducation.co.uk/story.asp?sectioncode=26&storycode=405152&c=2

1. Should be for learning, not simply of learning

2. Should be reliable, valid, fair and consistent

3. Should consist of effective and constructive feedback

4. Should be innovative and have the capacity to inspire and motivate

5. Should measure understanding and application, rather than technique and memory

6. Should be conducted throughout the course, rather than being positioned as a final event

7. Should develop key skills such as peer and reflective assessment

8. Should be central to staff development and teaching strategies, and frequently reviewed

9. Should be of a manageable amount for both tutors and students

10. Should encourage dialogue between students and their tutors and students and their peers

Rebecca Ferguson
14:59 on 28 March 2011

The Big Challenge of e-assessment:

What we have at moment is wolf in sheeps clothing. We’re being constructivist and collaborative with all these tools, but are we really doing this in practice.

  • Evaluation: What counts as evidence?
  • Look for guidelines for assessment for elearning
  • How openness give challenges to how we demonstrate our credentials when assessing students performance in elearning.
  • What can we do with mobiles and assessment

Recognize the wolves!

Wolves as sheep – can we get them to lie down.

Gill Clough
15:09 on 28 March 2011

Individuals' responses to assessment.

  • Explored reactions to personalised and automated forms of assessment.
  • When is it best to deliver feedback?
  • Should you emphasise achievement or effort?

What evidence do we require that e-assessment is worth implementing?

  • Depends on the purpose of the asessment
  • e-assessment would make faculty members rethink their practice
  • learners would rethink their learning goals
  • Allow them to develop their reflection, their transferable skills
  • Could be used to reflect to a group what they have discussed or not discussed.

Measures that can be employed

  • Difficult to change learner views and their engagement with and enjoyment of the assessment process
  • Allow teachers to move away from marking activities on which their time is not well spent

Unique features of e-assessment, that would not be possible otherwise

  • Can measure how consistent feedback is
  • Can use student satisafaction surveys to some extent.
  • Monitor dropout rate.
  • Reduce costs of marking
  • Reduce costs of monitoring plagiarism

Apps for e-assessment

  • Could include alerts and notifications
  • Important to know when learners are ready to receive those
  • Traffic-light system alerting teachers of groups of learners to difficulties
  • Marking when knowledge is transferred to a new area
  • Allow more able others to help with your learning problems
  • Facilitate assessment for the learner by making it more convivial

Possible grand challenge for assessment

Development of an evidence-based assessment system for cognitive, affective and psychomotoric learning providing learners with timely feedback at the right moment that leads finally to a society-wide asssessment literacy and a changed perception of assessment.

Rebecca Ferguson
18:05 on 28 March 2011

Assessment group New Grand Challenge:

Task 1: looking at individuals’ responses to assessment.

Is feedback personal or depersonalised? Human interface versus computer interface to feedback. Pros and cons of both. When is it best to deliver feedback. Nature of it. Emphasise achievement or effort.

Task 2: What counts as evidence? e-assessment would make faculty members rethink their teaching practice. E-assessment would allow learners to practice critical thinking and reflection. Transfer skills would be important. E-assessment could be used as a way to reflect to the group what topics they had discussed or not discussed.

Measures you could employ. Changing learner views and objectives in entering the assessment process. Engagement and enjoyment of that process that is traditionally not enjoyable. Free up lecturer time to shift attention to more important aspects to enriching teaching and learning. Moving away from marking.

Focusing on unique features of assessment that could not be done otherwise. What are the key features?

  • Is feedback more consistent than before
  • Student satisfaction surveys
  • Monitoring drop-out rate
  • Reducing costs of marking or reducing costs of monitoring plagiarism and cheating. Capture this or stop it happening with eassessment.

Task 3: Killer app for mobile assessment – alerts and notifications. Important to know when learners ready to receive those alerts and notifications. When they would be most receptive to getting these kinds of signals.

Traffic light system app alerting teachers or other learners to difficulties that learners might be experiencing.

Capture features of understanding or applying knowledge out in the field.

Applications concerned with getting more able others to help you with your learning problems.

Applications to facilitate assessment for the learner by making the process more visible or pleasant – such as audio recording.

Grand Challenge

The development of an evidence-based assessment system for cognitive, affective, psychomotoric learning providing learners with timely feedback that leads to society-wide assessement literacy and a changed perception of assessment.

Gill Clough
18:10 on 28 March 2011

Embedded Content

E-Assessment for Learning: challenges and opportunities for models of evaluation and design

E-Assessment for Learning: challenges and opportunities for models of evaluation and design

Accessible Alternative
added by Rebecca Ferguson

Contribute

Contribute to the discussion

Please log in to post a comment. Register here if you haven't signed up yet.