Friday, June 20, 2014

Instructional Design Evaluation




  • Chapters in Section III discuss evaluation in instructional design and provide you with three evaluation models: CIPP, Five-Domain, and Kirkpatrick’s Training Evaluation model. Search for at least two other models used for evaluation and summarize these models. Describe how you would use them to evaluate your instruction. 
    The Jerold Kemp instructional design method
  • The Jerold Kemp instructional design method
    The Jerold Kemp instructional design method
    1. Identify instructional problems, and specify goals for designing an instructional program.
    2. Examine learner characteristics that should receive attention during planning.
    3. Identify subject content, and analyze task components related to stated goals and purposes.
    4. State instructional objectives for the learner.
    5. Sequence content within each instructional unit for logical learning.
    6. Design instructional strategies so that each learner can master the objectives.
    7. Plan the instructional message and delivery.
    8. Develop evaluation instruments to assess objectives.
    9. Select resources to support instruction and learning activities. 
source: http://www.instructionaldesigncentral.com/htm/IDC_instructionaldesignmodels.htm 
 
According to the Jarold Kemp instructional design method as listed above, there are nine steps to instructional design.  This one starts out by identifying the problem, this is different than most design evaluations.  This is similar to the educational model of "backwards design" where the designer starts by identifying the goals for the lesson rather than the objectives.

  • Reflect on what other questions that instructional design evaluation should address besides whether the instructional design leads to comparable amounts of learning and learner satisfaction as traditional methods. Should return on investment and management of resources also be considered in evaluations of instructional programs? What other measures should/could be considered?
In most cases, instructional design evaluations compare to other types of design models but I am not sure if that is the best approach.  The evaluation measures if there is comparable amounts of learning and if the student is satisfied with the approach.  Why is it the case where the more they learn the better quality the design?  I find myself, cramming information into my students for the upcoming tests and they do not have a clue as to why and how these concepts are applicable to anything.  They "learned" many things but do not appreciate or have a deep understanding of the concepts.  I believe that another measure that should be considered is the rigor of the learning of the material, but it should also be more that just rigor.  Many curricula are very rigorous but the scaffolding to reach all students is not there.  I realize that this is the job of the instructor but it should also be built into the instructional design for the instructor to utilize.
  • Section IV focuses on human performance, performance support systems, knowledge management systems, and the concept of informal learning. Not all problems in learning and/or performance require an instructional one. Many times a non-instructional approach is a more appropriate solution. Identify a performance problem in your area of work and identify non-instructional solutions that may help solve the problem. Would better performance support systems, knowledge management systems, or opportunities for informal learning solve the problem?
The biggest problem that I have in the classroom is motivation of the students.  While the direct teaching style that is currently used may be much of the problem, I believe it has to do with the students' self-concept in mathematics and the relevance of the coursework for them personally.  Some days I can see the dread in the faces of my students as they enter the door.  I have taken non-instructional approaches to help alleviate their "agony".  Towards the second half of the year, once my consistent classroom management was established, I began relaxing during the lesson and joking around with the students.  While walking around, assisting with individual practice, I would begin to have personal conversations with the students.  This seemed to help somewhat and some students began working harder.  Another thing I did was to show short 5 minute videos as the students entered the classroom.  Sometimes it was relevant to the lesson and sometimes it was just for fun.  So I have tried non-instructional solutions but next year I will continue with what I have done but add instructional solutions as well, such as more student-centered instruction.

6 comments:

  1. Casey,

    I know how you feel!! Sometimes I can tell the information that is being crammed into my students' heads is overload. I hate the turn that testing has had on education. Many times students don't have a clue about why they are learning a specific concept. In the past years I've started activating my students prior knowledge about a certain topic and showing how were going to take what they've already learned and add it to the knew information. My students always give me this "Ohhh, now it makes sense look." I use the sock puppet app on my ipad sometimes in the morning to get my first graders ready for the days' work.

    Great post!! :)

    ReplyDelete
    Replies
    1. Annika,

      I envy you teaching 1st graders. I will make connections sometimes to other concepts and explain why a certain math concept is the way it is expecting some light bulbs or some "ahhhh", but I get blank stares. It is my life's mission to figure out how to get students to see the beauty in mathematics.

      Delete
  2. This comment has been removed by the author.

    ReplyDelete
  3. I also can feel your pain. I will be teaching math for the first time next year and have the same worries. I see that you area a high school teacher. Jason Mood, who is also in this class, teaches high school math. He has some great idea to keep kids motivated in class. He does the flipped classroom and like you shows short clips to reengage the students during class. As an elementary teacher I see the relevance in teaching the kids "Why" they have to learn something and connecting it to their life. I too think that the students are crammed with a lot of information. I do feel that the design helps to increase your students learning. If you have a good plan where the students are engaged then retention is higher. Students remember more when they are actively learning then just sitting back and "listening" to a lecture. Evaluation of that plan needs to be done frequently and reflection on how your teaching can be more effective.

    ReplyDelete
  4. Teaching high school must be difficult. I can see how it would be more difficult to always connect their learning to "real life" because most of the things taught in high school are applicable to professions they might have after they graduate. Perhaps this is how you can help make the learning relevant, though, by helping them discover the types of jobs in which they would use the concept taught. I know this gets my students (albeit elementary aged) excited when we learn about a type of scientist that does or uses the concepts we are learning (like a meteorologist when we're studying about weather, etc.).

    ReplyDelete
  5. Casey,
    The motivation factor is huge – first you’re dealing with kids that usually don’t have a large/long attention span. Secondly you have to find the appropriate material (preferably technological tools are involved because kids love devices) like the short 5 minute videos, which are time-consuming, I’m sure.
    You know recently I read an article, and although it was a business related issue – one can apply it anywhere. It stated that connecting abstract learning to concrete situations was a proven motivational technique, where one applies abstract theories to real-world scenarios. I don’t’ know if that’s something you already do, but if not – then it may be worth your time…? Please know I’m not telling you what to do in your classroom, this is just something I read and wanted to share =)

    ReplyDelete