island architects, inc.
The Revisions: Comparison of Past Practices to Current Revised Assessments
Again, the goals of the revisions are as follows:
Revised Assessment Number One: Island Architects, Inc.
This new assessment incorporates many different changes when compared to the original fixed-response assessment. By having students incorporate their topographic mapping skills, they have to apply and build on previous knowledge in order to successfully complete this project. Additionally, it offers kids an opportunity to be creative, a characteristic of multiple choice tests which is missing (unless kids make patterns on their scantron sheets!) It is also asking them to do some writing, albeit just a little, in order to justify the location of certain items on this island. This taps into the core ideas, the "Big Three Geographic Questions", that all my students know from the first day: Where is it? Why is it there? So What?
Revised Assessment Number Two: Your Island's Natural History Essay
The Island's Natural History Essay builds upon the student's successful completion of the topographic map described above. This essay calls upon students to apply what they know about landforms and landform development and climate and the factors that affect climate to a new situation. It also expects them to organize and present information in a logical way (again, another strike against the multiple-choice test!) and synthesize information.
A Look at the Numbers
Because the data from last year's assessments is not available in any meaningful form, the results of this analysis of assessment are more qualitative than quantitative. What is available, however, is a grade distribution, which follows:
n = 97
|
A |
14 |
14.4% |
|
A- |
22 |
22.6% |
|
B+ |
17 |
17.5% |
|
B |
24 |
24.7% |
|
B- |
12 |
12.3% |
|
C+ |
6 |
6.1% |
|
C |
1 |
1% |
|
C- |
1 |
1% |
|
D+ |
0 |
0 |
At first glance, I was struck by how high the grades were. This is a result of a combination of factors: one, that this population of students is one that is high-achieving by their nature. (This is a honors-level course, and many of the students take the AP Human Geography test in the spring.) Second, I use an absolute grading system, where student performance is measured in relation to specified standards, rather than relative to other group members. Rather than having a bell-shaped distribution of scores, there is opportunity for each student, if their work is good enough, to receive an "A." Third, this could reflect grading subjectivity on my part.
Having taught this course for eight years, I have a pretty good feeling that if this assessment had been multiple choice, student grades would have been much higher. As mentioned previously, these students do extremely well when called upon to memorize, since, for this population, this presents very few intellectual challenges. I feel quite strongly that by having students show me what they know through writing and analyzing, I am tapping into their higher-level thinking skills and creating an assignment that is more challenging than the traditional paper-and-pencil multiple choice test.
Plans for the Future/Fitting This into the Body of Knowledge on Assessment
I liked that this project required students to research, analyze and most importantly synthesize a wide variety of geographic information. That the revised assessment tapped into all these great skills is reason enough for me to continue to use this assessment. At the same time, however, there were problems that I think could have been avoided if the assessment design had been different.
Conclusion
When I made my KWL in Phase I of this project, I knew that essays and other alternative assessments were a better way of capturing what students know. But I was looking (in vain!) for some magic alternative! The struggle, as we teachers know, is to create meaningful, challenging assignments that do not consume every waking moment in order to be graded. I think the real lesson that I have learned is that there IS no efficient way to tap into the higher level thinking skills that we want our students to develop. There may not be a way for me to return 97 essays in two weeks or less. Perhaps acceptance of my own limitations and a re-directed focus on what is truly important for students to know and be able to do is what is called for when creating meaningful assessments.