CANCELLED: IET Technology Coffee Morning: Creating a Generalised TEL Evaluation Toolkit

15 December 2010
Jennie Lee Building Main Ambient Lab Ground Floor

Cloudscape created by:

Lynda Davies
30 November 2010

Abstract: For the past year and a half, IET has been involved in the ongoing evaluation of the interdisciplinary technology project, xDelia. xDelia (Xcellence in Decision-making through Enhanced Learning in Immersive Applications), is a three-year pan-European project that uses wearable sensors and serious games to investigate how people’s behavioural habits and emotional states affect their financial decision making. The project combines the research skills and expertise of European partners from different methodological traditions (experimental, economic, field research) who are working together to achieve the project goals. Evaluation of such a diverse and geographically distributed project is complex and in order to facilitate the process, we have developed a custom-made Design and Evaluation framework. This framework provides a working collaborative model that uses participatory evaluation techniques (Namioka and Schuler, 1993, Shulha and Cousins, 1997, Cousins and Whitmore, 1998, Patten et al., 2006) to ensure stakeholder engagement and, most importantly, to ensure that the appropriate inputs go into the evaluation to provide outputs that are both meaningful and useful.

The Design and Evaluation framework operates on the macro-level and is supported by micro-level evaluation toolkits that are tailored to the needs of the object under evaluation. During this Tech Coffee morning, we will demonstrate how we have used the D&E framework to evaluate activities in the xDelia project, and illustrate how it links up to micro-level D&E toolkits, using a micro-level D&E toolkit designed to evaluate serious games (currently still in development). Ultimately, we aim to be able to generalise these D&E frameworks and toolkits so that they can be deployed in other educational technology areas. We would like to invite attendees to suggest ways in which we might be able to use these frameworks to support the evaluation of projects that they are involved in and, if we have time during the session, to try adapting them to their own evaluation contexts.

Cousins, J. B. & Whitmore, E. (1998) Framing participatory evaluation. New Directions for Evaluation, (Vol. 1998, 80), 5-23
Namioka, A. & Schuler, D. (1993) Participatory Design: Principles and Practices, Hillsdale, NJ, Lawrence Erlbaum Associates.
Patten, B., Arnedillo Sanchez, I. & Tangney, B. (2006) Designing collaborative, constructionist and contextual applications for handheld devices. Computers & Education, (Vol. 46, 3), 294-308
Shulha, L. M. & Cousins, J. B. (1997) Evaluation Use: Theory, Research, and Practice Since 1986. American Journal of Evaluation, (Vol. 18, 1), 195-208

Presenter: Dr Gill Clough (IET)

See TCM 2010 Schedule:

See TCM website for past events:


Clouds in this Cloudscape