Evaluation and Outcomes

Hello Colleagues,

Lisa Petrides and I are looking forward to facilitating the break-out group, Evaluation and Outcomes, this Wed. 10am and Thurs. 8:30am, and collaborating with you during this part of the agenda. As many of you may know, our OER initiatives through both OER Commons and our OER research, allow us to explore many aspects around different learning modes and ecologies, across projects, resources, and users for potential impacts and models.

We'd like to build on the flexible nature of this session to involve you in an exercise to create a mapping of the OER ecology, and looking through the lens of evaluations and outcomes, teasing out some major factors, drilling into what studies and evidence currently exist, and identifying what things still need to be measured.

We're looking forward to having you contribute your perspective and will be looking for input on how we can cross-pollinate with the other concurrent sessions.

Amee Godwin
11:06pm 3 March 2009

Hi there,

If OERs also intend to enhance Quality, evaluation is critical.I am very much looking forward to join you in this session.

frances ferreira
1:47am 4 March 2009

Hi there,

If OERs also intend to enhance Quality, evaluation is critical.I am very much looking forward to join you in this session.

frances ferreira
1:47am 4 March 2009

As part of our exercise to tease out things that the OER community is looking to measure, we will use the following prompts to describe your project:

Project Basics

1. What is the title of your project?
2. When was your project started (month/year)?
3. What is the URL/website address to your project?
4. Where is your project based?
5. Why was your project initiated? (What need was it trying to meet?)
6. What key goals have you set for your project?
7. How are you progressing towards those goals and how are you measuring the outcomes? (e.g. specific metrics, creating case studies, etc.)
8. How do you think your project fits into the collective goal for OER? (In other words, what do you see as the "grand idea" for OER and how does your project fit into that idea?)
9. What three keywords best describe your project?

Share your own project basics by answering the above questions.

Amee Godwin
5:17pm 4 March 2009

Clusters!

* Miss Natalie Jeanne

Natalie Lennon
6:25pm 4 March 2009

Where were our biggest clusters?

• mobile technology
• learning outcomes
• "How are the users using?"
• conversion from an informal learning to a formal learning environment
• the changing role of teaching
• teachers seeing themselves as curriculum developers

 Big picture outcomes

• stressing collaboration
  •  
    • Is collaboration necessarily the institution's goal?
    • country-to-country collaboration; not as stressed in the United States, but certainly Europe, Africa
    • beneficial for the demonstration of a resource's effectiveness
• building capacity
• student learning
• peer-to-peer learning
• distinguishing use and reuse 
  •  
    • reuse piece is twofold

* Miss Natalie Jeanne

Natalie Lennon
6:39pm 4 March 2009

1. What is the title of your project? OpenER
2. When was your project started (month/year)? July 2006
3. What is the URL/website address to your project? http://www.opener.ou.nl
4. Where is your project based? Netherlands
5. Why was your project initiated? (What need was it trying to meet?) Increase enrollments in formal Higher education
6. What key goals have you set for your project? 5% of users actually enroll
7. How are you progressing towards those goals and how are you
   measuring the outcomes? (e.g. specific metrics, creating case studies,
   etc.) Surveys and add question in electronic orderform for regular paid courses.
8. How do you think your project fits into the collective goal
   for OER? (In other words, what do you see as the "grand idea" for OER
   and how does your project fit into that idea?) Lower tresholds to education
9. What three keywords best describe your project? Informal learning; Life Long Learning; Selfstudy learning material

Robert Schuwer
7:15pm 4 March 2009

1. What is the title of your project?OLnet
2. When was your project started (month/year)? 03/09
3. What is the URL/website address to your project?http://onlet.org
4. Where is your project based? OpenU UK & CMU
5. Why was your project initiated? (What need was it trying to meet?) Need for evidence and the capacity to generate the evidence.
6. What key goals have you set for your project? Growth of interest. Fellowships. Etc...
7. How are you progressing towards those goals and how are you
   measuring the outcomes? Gathering requirements. Setting up sub-projects. Reflective events.
8. How do you think your project fits into the collective goal
   for OER? (In other words, what do you see as the "grand idea" for OER
   and how does your project fit into that idea?) Understanding the impact and potential - helping the community.
9. What three keywords best describe your project? Research, community, evidence.

Patrick McAndrew
7:17pm 4 March 2009

MITEs evaluation tool:

Another very popular tool we see in higher ed: http://www.qualitymatters.org/   

Another we have looked at the LOAM tool from the UK: http://www.nottingham.ac.uk/nursing/sonet/projects/loam/

Terri Rowenhorst
7:17pm 4 March 2009

1. Project basics for Johns Hopkins OpenCourseWare
2. Initiated Feb 2005
3. ocw.jhsph.edu
4. @ Johns Hopkins Bloomberg School of Public Health
5. Make quality educational content from academic courses available to users
6. Get specified number of courses on OCW
7. We reached the goal of development and have added other edcuational content such as seminar into OCW. However, we would like to collect data on use, users, usability, and usefulness. 
8. We provide one area of quality content into the OER universe.
9. Academic course content, open access

sukon kanchanaraksa
7:23pm 4 March 2009

1. OCW Consortium
2. September, 2005
3. http://ocwconsortium.org
4. Cambridge, MA / global
5. Collaboration among OCW producers
6. Helping OCW producers make their courses more valuable to users
7. We're at the beginning of studying this.  We've been supporting the sharing of best practices, but there's a long way to go.
8. We strive to carry the ethos of openness from our production of content to our collaboration on processes and policy.
9. Collaboration, quality, openness

Terri L. Bays
10:32pm 4 March 2009