25705 Views 8 Replies Latest reply: Oct 4, 2010 12:27 PM by Darcy Moody RSS
Catherine Cullen 140 posts since
May 29, 2009
Currently Being Moderated

Jul 6, 2010 8:30 AM

Educators, how do you measure student learning?

We know that measuring student learning is essential to recognizing and responding to teacher effectiveness. (Want to know more about why teacher effectiveness and measuring student learning are so important? Check out the Hope Street Group policy team report on reforming teacher evaluation.)

 

Of course, educators measure student learning in their classrooms every day, using a wide range of assessments and responding immediately to feedback. But not all measures of student learning are reliable and comparable enough to be used for teacher evaluation.

 

So educators, tell us, how do you measure student learning in your classroom? What lessons can be learned from your classroom practice and applied to teacher evaluation policy?

 

Make yourself heard! Reply to this discussion by quickly and easily registering or logging in. You can even use your existing Facebook account.

  • Dina Rock 138 posts since
    Jul 8, 2009

    This is a loaded question and the tricky part (o.k. there are a lot of tricky parts!) is that each classroom and each school are unique in thier own ways.  So, the question starts with a broader question.  What do you want to measure? Is it small, as in a study unit for a specific subject area? Or is it more broad, say, the reading growth of a second grade student.  I believe that measurement first and foremost must be done throughout the year, using multiple assessments, as we discussed in our recommendations.  It is important that you (the classroom teacher) meets regularly with your team members, or others in your school or district to make sure that you are all on the same page regarding the evaluation process.  Each subject area should be looked at separately, and then a discussion needs to take place on what is most important to evaluate.

    And then comes the tough questions.  What type of evaluation/assessment do I use that best fits my goals and objectives?

    I believe personally that the "toolbox" method of evaluation is perfect for me. Meaning, no one assessment is good for every type of evaluation.  There should be a "menu" of multiple assessments in every teacher's classrooms, no matter what grade or subject.  There are so many different types of these being used and many tools/books out there to help decide what is best for you and your classroom.  Testing, of the traditional type is typically overused, and we in education have been known to swing far to the left or far to the right with newfangled ideas on best practices.  We've gone from phonics only, to whole language only to chunking, to etc... you get it...

    I believe in wirtten assessments, crittical thinking projects, use of Bloom's Taxonomy for questioning etc... It is vital we evaluate the whole child in different settings, with multiple measures to see their strengths as well as areas for improvement.  The days of memorizing dates, times and places, is hopefully a distant memory, and instead is replaced with questions that will challenge the student to find the information, the who, why, what, when and how of a problem, a novel, an event in history etc..

    Thoughts?

  • Douglas Clark 92 posts since
    Jul 8, 2009

    This is a great question and gets to the heart of the challenges that we, as teachers, face today. In my district in central Texas, we currently use a system called AIMS web, which is based on the Dieblels program that has been available and widely used for some time. We conduct an initial assessment at the beginning of the year, again in the middle of the year and then a final at the end. For those students who are determined to be in need of specific remediation, we increase the monitoring on a weekly basis. In addition, our district has us conduct periodic benchmarks throughout the year to determine progress and we have a state-wide test at the end of the year called the TAKS test, which is currently in revision and will be called the STARS test. Of course these are in addition to what each individual content teacher, special teacher, dyslexia teacher, speed pathologist and others may provide.


    Wow, on the surface it would appear that we provide multiple assessments that should be effective in determining how our students are doing. However, one major problem is that, regardless of the deficiencies identified, the pressure to keep on track with the curriculum and cover all the elements of the curriculum is so strong that many teachers are reluctant to deviate from the district plan for fear of falling behind with the scope and sequence and not giving the students enough content to be successful with the end of the year TAKS test. Even though we see many of our students who simply do not have the prerequisite skills necessary to move on, the pressure to "cover the material" is so strong that well meaning teachers move on in the lesson plan and fail to stop and remediate as necessary. The end of the year test is THE determination of how each teacher has done during the year. We have great data, but we don't use it in a meaningful way. It's just there. And you can guess how many of those students do at the end of the year when they are forced to take a test that they clearly are not ready to take. If we had a system that "graded" the teacher on how much progress the student made from the beginning of the year to the end, based on the students level of functioning, then this could be a more accurate method of evaluation.


    An additional concern on evaluations based on student progress is the concern for the "Whole Child". As most of you realize, there are so many variables that directly impact on how individual students progress in school that we, as teachers have little to no control over. If we had the opportunity to help create systems that support all those other parts of a child's life, then our participation in that effort might be a reasonable piece to evaluate.. I understand  there is a program in Harlem called the Harlem Children's Zone (www.hcz.org) that has had major success with a "wrap-around" system that looks at all aspects of a child's life. Take a look at this as it seems like a program that could help the rest of the country if it can be brought to scale.


    Any policy that impacts on the evaluation of teachers must include the many variables that effect the outcomes for children. Any reasonable educator would agree that we should be evaluated on the progress of our children. The issue is how to capture the many pieces of the pie so an accurate and fair assessment is obtained that shows how the child has done and provides a roadmap for educators to improve their skills. In addition, this must be done with significant input and support from the teachers. We know what needs to be done---the "system" needs to talk "with us" not "at us".


    I would speak to the issue of salary and evaluations but I will save that for another post as that is a dissertation in itself.

     

    I would love to hear how others handle student assessment and the impact on teacher evaluations. Are you similar to Texas or very different? My guess is we are all fairly close on the big issues, just differences in the details. Let me know!


    Doug

    • Dina Rock 138 posts since
      Jul 8, 2009

      Doug, I completely agree with all of your points and have a question about the Diebels program that you use.  We use it too, but I have a big problem with the way we use it.  The students are given a one page passage and then given a timed amount of time to read it out loud. This is basically to test reading fluency, but in my opinion does not even address "reading" which I believe involves comprehension.  The way they check for comprehension is to ask them to review what they read and based on their answers, they are given a "comprehension" score which can be very skewed.  For example, if a child only reads 20 words in 2 minutes, but then remembers what they read, they are given a high score.  But a child who reads the whole passage and doesn't recall all the details, receives a lower score.  It is much easier to remeber 20 words then 200...

       

      As you see in my response before you, i agree that the whole child is key to learning and not just learning in my opinion but recall and long term memory retrival.  I would love to know more about the Harlem project.  It sounds like a great tool to look at for the teacher evaluation system reform and also for the multiple measures component.

       

  • 20 posts since
    Sep 22, 2010

    Measuring teachers by student growth is problematic.  I agree that each class/subject is unique.  I agree there needs to be standards, but there also needs to be some adjustability to those standards when needed.  Our district now has what I call “Curriculum Cops”, their job is to come by as an “observation” to make sure you are where you are supposed to be on the curriculum guide, map, whatever.  This is supposed to be a good thing… Yep, I am still waiting for the good part.

     

    Students should be measured utilizing a variety of tools.  Just like there are a myriad of learning styles those students should be allowed to demonstrate their skills on a broad base and not be limited to a single measurement.  Give students an opportunity to do multiple demonstrations of skill i.e. written, demonstration of some sort, standardized, etc.  Once students are assessed in this manner the mean, mode, or whatever should be judged accordingly in an equitable/objective manner.

     

    I know personally that I choke on tests of any variety.  So too do many students.

    Measuring teachers by student growth is problematic.  I agree that each class/subject is unique.  I agree there needs to be standards, but there also needs to be some adjustability to those standards when needed.  Our district now has what I call “Curriculum Cops”, their job is to come by as an “observation” to make sure you are where you are supposed to be on the curriculum guide, map, whatever.  This is supposed to be a good thing… Yep, I am still waiting for the good part.

     

    Students should be measured utilizing a variety of tools.  Just like there are a myriad of learning styles those students should be allowed to demonstrate their skills on a broad base and not be limited to a single measurement.  Give students an opportunity to do multiple demonstrations of skill i.e. written, demonstration of some sort, standardized, etc.  Once students are assessed in this manner the mean, mode, or whatever should be judged accordingly in an equitable/objective manner.

     

    I know personally that I choke on tests of any variety.  So too do many students.

    • Dina Rock 138 posts since
      Jul 8, 2009

      Stephen, wow.. i can't believe that they are called Curriculum Cops.. just that name alone would put fear in the classroom.  Let's just say that ..oh.. i don't know, a teacher is fascilitating a great discussion and so in lieu of "staying on "day two paragraph twelve, standard 13""  the teacher chooses to extend the lesson, add a wonderful writing component and maybe dare i say some critical thinking and problem solving to the classroom... it makes me crazy that if that "cop" were to come in, that they couldn't (or wouldn't) necessarily see the value in teaching the whole child.  It makes me frustrated and angry at this system that has been created.  Are we trying to create robots who can spit out information?   I teach fifth and sixth grades and every year teach them about Bloom's Taxonomy.  I want them to understand the levels of thinking and to start thinking in a critical, problem solving, scholarly way.  NOPE, not in the standards.  But it should be.  In this day and age, we need to find all the ways to "reach" our students... tests, poetry, writing, creating, discovering... Does anyone really believe that people like Bill Gates, Albert Einstein etc... could have functioned in today's classroom?  They needed to be in a place where cooperative learning, not teaching to the test was the norm... without their ability to analyze, synthesize and evaluate, they would just be answering questions on a test.. Standard 3.4, 3.5, etc... I am with you Stephen, I choke on tests too.  I am glad you entered the discussion!

      • 20 posts since
        Sep 22, 2010
        Currently Being Moderated
        Sep 29, 2010 9:41 PM (in response to Dina Rock)
        Re: Educators, how do you measure student learning?

         

        Diana, Nope that is not the official name, but it is the name I use.  I have used it in front of several administrators and truly love the expression on their face as they try to explain things away.  What stinks even worse is we have "White board protocols."  That is specific information listed on our white boards including... SPIs (both number and written out), Leading questions, Long term goals, short term goals, ad nauseam.  Things that have no applicability in the classroom except to look good when district observers come by.  They have no relevance in advancing student achievement, the students pay it no attention, and if you ask them about it they will tell you, “What whiteboard?”  One teacher literally had 7 feet of whiteboard space utilized to list what he had to for the 5 classes he taught leaving him approximately 4 feet to utilize for actual classroom work.

         

        Yep, fun stuff.  Maybe the discussions we have here will help somewhere.  That is why I am participating I want to help teachers do what they are supposed to… That would be teach so students have an opportunity to learn.

      • 20 posts since
        Sep 16, 2010
        Currently Being Moderated
        Sep 30, 2010 6:04 PM (in response to Dina Rock)
        Re: Educators, how do you measure student learning?

        Dina,

        EXACTLY! Most of my students are not exposed to problem-solving and critical thinking practice at home, so when we get them in the classrooms, we have to guide them through the process using "think aloud" sessions where the teachers stops and pretends to be a student who is stuck in finding an answer, then demonstrates looking at all the options of "What can I do now to help myself reach a solution?" It may make the lesson digress from the written standard but it's a necessary life skill.

  • Darcy Moody 29 posts since
    Aug 1, 2009

    Hi- Wow!!!  You all bring up such excellent points!  Isn't critical thinking and problem solving where we are supposed to be supporting our students...and aren't we supposed to be teaching to the students and differentiating accordingly?!?  And yet... Curriculum Cops are becoming standard practice...and we are not addressing student learning needs in the process!  I understand the need for accountability and making sure that standards are being covered...but in the methods class I am teaching we just had to add a column to the standard lesson plan they are using and discuss "accommodations and modifications" for students who do not show mastery of the objective...OR those with mastery before the lesson begins.  Differentiating based on formative assessment pre or during a lesson was a foreign concept to these pre-service teachers.  They are being taught to fill their white boards with performance objectives and teach "I do, we do, you do"... and learning at a conceptual level and looking at students three dimensionally is being lost in the process (not to mention all that precious white board space where children used to share their strategies and thinking)! 

     

    I am frustrated when we go so far in protocol and speaking to student achievement that we rob the students of achievement in the process.  I think it is important to get more teacher perspective in the national conversation...it is a complicated issue and experience with teaching and learning is an important piece of this.  Measuring student learning is complicated and sticky, but we do it every day and use that information to inform instruction.  So...I guess I'm curious how we take this practice and add these multiple measures into the process instead of defaulting to using strictly standardized testing because that data is easier to calculate.  In thinking about Catherine's earlier question about how we measure student learning within our classrooms...it sounds like the teachers in this discussion would not use strictly their state standardized test to gauge student learning and inform their planning and instruction.  Hmmmm....

More Like This

  • Retrieving data ...

Bookmarked By (0)