Below is an example of the kind of data that has no useful impact on instruction ever. The data content in the picture below is high but the information content is low. How exactly is this information supposed to help a teacher make sense of what she should do with her students?
Here’s a slightly more useful variation on the same data where it has been organized to potentially be suggest some next steps. However, there’s a critical piece missing in this data – the actual task students did! Without knowing what the questions were that were asked and without knowing what the responses below refer to, this is meaningless information. The only take-away that I have from the information below is that it is unlikely for these multiple-choice questions that students were guessing.
This leads me to believe that one of the issues we have with this data is that it has compressed the information about what students did to such a great degree that it is impossible to use the information meaningfully. All of the rich work students have done and what they have thought about has been compressed into a few numbers and consequently making decisions based on those numbers alone is incredibly difficult.
What can we do differently? One option is to consider hypotheses about why students may have actually chosen those multiple choice responses like the following. Again, the question itself is critical but at least this leads to some potential things to give feedback to students about.
But these suggestions for what students thought about if they chose a response are just hypotheses. They are thought through from an adult’s perspective on the mathematics and these kind of analyses are rarely informed by detailed and thoughtful research into children’s mathematical thinking.
While multiple-choice questions are an inexpensive and relatively time-efficient way to gather evidence of student performance, they make it difficult to really capture the richness of student thinking. What, for example, do you think the student below was thinking about when they worked on this problem?
While it is clear that this sample of student work provides potentially powerful information, the challenge with looking at individual student work is it can be extremely time-consuming and challenging to study a variety of student work and come up with systematic responses to that group of students. We have to somehow combine the richness of information provided by what students actually did with a systematic approach so that we can approach teaching an entire classroom full of students.
One approach we have used in our project to diagnostic assessment is to systematically look at student work and decide what approaches students took and attempt to group their work with other students who appear to have thought similarly. A teacher I know literally uses the desks in his classroom and spreads out all of his student work across the room trying to make sense of the different mathematical ideas students used. Other teachers record their interpretations of the approaches the students used in spreadsheets, like the picture below suggests.
But still, no matter how we organize the information, the question remains, what do we do with it? A further challenge is, how do we use information on what we uncover about student thinking in a more timely fashion rather than after our class is over?
I’m going to suggest some approaches for both of these questions in a follow-up post, but I’d love to know how you respond to student data, both after the fact and during a class.
]]>
Last Saturday, I tried a new instructional activity called Choral Counting. This activity was recommended to me by Magdalene Lampert and comes out of the work she and others have done to support high-quality ambitious teaching.
I’m experimenting with these instructional routines in part because I hope to support teachers in the project I support in using them in their instruction, which I can hardly be expected to do without experiencing them from the inside myself. It’s clear that this activity is much richer mathematically than one might expect from just hearing about it. One finding I have already is that I have to do a much better job of planning how I will use my space when recording the numbers!
The basic idea of choral counting is easy — students count in unison and you write down the numbers as they chant, and then pause students to ask them questions about the numbers. What I learned Saturday is that there is a lot of potential in this activity to bring out rich mathematical ideas for discussion as a group.
I chose to start at sixteen and count by fives. While the counting was going on, I noticed my students paused a bit at 76. So I stopped and asked them why they think they paused. They also paused at 101, which during my lesson planning I had anticipated they would do. They also had different responses at 111 (121 was next, which I expected).
I don’t know why they found 76 more challenging. Maybe because it was the first time they had to use a number in either position higher than 6? 101 is clear – Many students thought “tendy one” and self-corrected before they spoke, which slowed them down. I thought this myself when I first counted through this routine! Many students said 121 instead of 111 and I remember my own son doing something similar when he was learning how to count. I also paused a couple of times to ask students what pattern they noticed and at one point I asked them to predict what the number would be if we counted four more times. One student proved her answer by counting up by fives, another student said it would be twenty more because four times five is twenty.
Here’s the data collected by my assistant teacher (one of the children’s older sister comes to the class and she has happily volunteered to record information for me and to walk around the class generally supporting students).
Once we got to 131, I asked students what would be the next number that starts with 2. Two students came up with different mathematical arguments that the next number would be 201. One student said that the first digit was clearly a 2 and that the next digit must be a zero, because we are counting by fives. The last digit must be a 1 because our pattern always alternates between 1 and 6 and 1 is smaller than 6. The other student said that if we counted 19 fives or 95 higher from 101, that would be 196 which does not start with 2, but that if we counted 20 fives or 100 higher from 101, that would be 201 which must be the next number starting with 2 since we won’t count a number between 196 and 201.
Although the activity went longer than I expected, it was incredibly rich and worth doing.
]]>
Too often we ask teachers to listen for an hour or even two to someone talk nearly non-stop about what they know with perhaps a question thrown in once in a while. Since very few people can talk in an engaging way for this amount of time, it’s no wonder that so many people check out of this kind of experience.
But this experience is even worse because most educators have the background experience to engage in the ideas being discussed almost immediately but lecturing at teachers does not take into account their prior experiences. If someone lectures at teachers for an hour, I assume that they actually do not understand their topic or teaching well enough to think through how someone might engage in the topic more directly (the only exceptions are a keynote or a class size that numbers in the hundreds, very little else is possible without technology).
Yesterday I gave teachers a very brief introduction to one of four potential technology tools they might want to explore, and then I gave them access to the resources they would need to explore the tools. While they did this, I circulated around the room. Once it looked like they had made a decision about which tool they intended to explore more deeply, I asked them to group up with people exploring the same tool.
Then I continued to circulate around the room and made a note who seemed comfortable with the technology, who needed support, and who was vocal and who was not. I checked out who attempted to make things with the tools for themselves and who seemed more content to explore things already created. I used the information I gathered to decide when to pause the various groups’ discussion and work and how to structure the ensuing conversation and what questions might be useful to ask. I used the experiences the teachers were developing from the technology to inform the rest of the session.
I asked teachers to try and fill in a lesson plan template and choose a goal. Most did not, and so I decided to model a potential use of the technology using a Noticing and Wondering protocol. We then discussed what goal this activity might support and what this activity would look like if we tried to use pencil and paper.
At no point did I treat the teachers like they were incapable of figuring out how to use the technology themselves or thinking through for themselves how the technology might support their teaching. I certainly gave them opportunities for feedback on their ideas and offered them support when they seemed to need it, but I treated them as people who think and the ideas they had as being important to surface.
After all, this is all just good teaching, and don’t educators deserve that?
]]>
At the beginning of the year, we made two major shifts in our beginning of unit diagnostic assessments. The first is that we selected tasks which aligned more closely to mathematical ideas that one might consider pre-requisite ideas for the unit. The next is that we developed a more sophisticated protocol for teachers to make sense of the student work.
In prior years, we expected teachers to use a rubric to score the student work and use the scores to make decisions about what to do next. Unfortunately this process has teachers compress the information from the student work into a single number for each student, and then we had to provide a tool to help teachers unpack the score into mathematical understandings and then have them decide on next steps. This means that a huge amount of potentially useful information for making decisions about the student work is lost in the conversion to a number which unnecessarily complicates the decision-making process.
Instead, we developed a protocol and a spreadsheet tool so that teachers could look at the student work and systematically record the strategies the students were using as well as how successfully students used these strategies.
In order to develop the protocol and the spreadsheet tool, I took a sample of student work on the task and grouped it according to different types of mathematical strategies students used for each question on the task. I then decided on language that would communicate those strategies to teachers and created a set of instructions on how to go through the student work and record the strategies systematically.
Given the amount of time this takes, we decided to restrict this to just the beginning of unit assessments and suggested to teachers that instead of looking at every single student’s work, they could select a random sample of 20 to 30 students to look at in depth. We also attempted to make it clear, that while we strongly suggested that teachers try using this tool, this was not a mandated part of our project; instead the mandate is for teachers to give an initial assessment to their students and then systematically make sense of the information provided by the task.
Once we have the spreadsheet tool ready for any given unit, our data researcher uses Autocrat and a custom script a member of the New Vision Cloudlab team wrote to distribute the spreadsheets to teachers and then pre-populate the spreadsheets with their student names.
One theory I have with this work is that an excellent way for teachers to develop their knowledge of how students approach mathematical tasks and consequently understand mathematical ideas, is to systematically look at student work and record and analyze the actual strategies students have used, as represented by their written work.
An interesting finding we have so far is that although not all of our teachers are using the spreadsheet tool, many of them are systematically sorting their student work by different strategies used and making sense of the student work and then deciding on instructional next steps, based directly on the student work itself. This is very likely an idea generated by the use of the tool as we had not witnessed large number of teachers in our project using this protocol until this year.
Our hope is that by the end of this year, we will have tasks and tools available for each of the twenty units we are developing as part of our resource support for teachers.
]]>
In my experience when I first started using technology in my teaching, my planning protocol went something like this:
The advantage of the TTAL protocol is that it puts the goal or focus first and helps prompt someone planning a lesson to think through how each part of their lesson supports their overall goals for students. I also think that although the TTAL protocol was originally developed for use developing lessons with a mathematical focus, it could be fairly easily adapted to be more content-agnostic.
The overall protocol goes something like this:
I recommend reading the entire protocol because there is obviously more nuance to the protocol than what I am describing. For example, the TTAL protocol recommends that you do the activity you are planning for students to do, both how you would do it with your knowledge and experience but also to anticipate how your students would do the task with their different knowledge and experience.
A critical idea to keep in mind when making choices about activities for lessons, including ones that involve technology; what your students think about is what they will remember and what they remember will dictate what they will be able to do.
]]>
I’m going to talk today about my journey from a teacher who tried to correct students’ mistakes to someone who paid attention to student thinking and participated in mathematical reasoning with my students.
When I first started teaching, I monitored students’ behaviour, carefully recording dots when they failed to hand in their homework, dots when they were late, dots when they did not participate, dots when they were absent. I held those dots over my students’ heads like the Sword of Damocles. I was the dot master!
I noticed that my students made predictable mistakes and I modified my lessons to address those mistakes. “Don’t forget to change the sign of the second number.” “x times x is x-squared, not 2x.” “Don’t cancel the x’s!”
However, I was often confused by what they were doing. I became curious about where student mistakes come from. Why is this student writing a +1 there? What does this mean to him? Why are students doing these crazy things??
I began to realize that what students said and what they did was the result of something they were doing that I could not directly observe. I formed a hypothesis: students think. In fact, I realized that students think quite a lot.
I thought my job was to intervene on how they were thinking rather the product of that thinking. I realized that if what students do is a product of their thinking then I need to know what they are thinking not just what they write. I needed to be able to read minds.
Unfortunately, I still thought my job was to fix their thinking as if it were something that had been broken by their experiences. I thought that my students were just thinking wrong things, and therefore all I had to do was correct their thinking.
“A teacher is a mechanic for the mind”, I said to myself, “And in order to repair it, I just need to know how it works.” I wanted to reach into my students’ minds and fix them. I viewed my students as broken and my job was to make them whole again.
I listened to what my students said. I carefully watched what my students did to help me prognosticate their actions. “If I just know enough about how they think,” I thought, “I can help them think better.”
I was judge, I was jury, and I executed based on my understanding of student thinking. I tried students for the crime of thinking differently than I and sentenced them to more explanations of the only truth that mattered, my truth.
This approach has flaws. It has limitations. 10 thoughts per kid. 20 kids a class. Six classes a day. Five days in a week. 34 school weeks in a year. That’s 204 thousand thoughts a year to pay attention to. It was overwhelming.
And you know what? One day I realized that the way the kids thought yesterday wasn’t the same they thought today. What I learned about student thinking was out of date by the time I wanted to use it because, just like me, kids don’t think the same way everyday.
I needed to be able to responded to thinking live in the moment, rather than teaching while blindfolded. I started having mathematical conversations in the moment with my students and listening to them have conversations in order to uncover their thinking and respond now.
I anticipated student thinking instead of student mistakes. Here’s 11 different ways I solved a problem. Guess how many of these ways were actually used by my students? None of them. Human cognition is incredibly complex.
I questioned my beliefs about mathematics and why we teach it. What do I want my students to get out of mathematics class? More importantly, what do my students want to get out of mathematics class?
We are conditioned to think of ideas like this as being right or wrong, correct or incorrect, true or false. Instead, let’s figure out how what this kid has done make sense to her. Let’s remember that that students’ mistakes are the result of thinking.
There are other benefits to making student thinking visible in a classroom. An ongoing mathematically-rich conversation engages all of my students in thinking about mathematics in ways which give them agency and authority.
How do we design mathematics classes where students don’t end up thinking they’ve spent 13 years memorizing arcane rituals? Let’s make mathematics class about learning about thinking rather than about trying to avoid mistakes.
Children are not broken! It is not our job to treat them as things to fix. Children are sense-makers! Our job as educators is to provide experiences so students develop models for understanding the world.
Here are my sons. Let’s work together to build a world that treats them and all other children as sense-makers within it.
]]>
Here are the academic vocabulary words I noticed students would need to understand (in an academic sense) in order to be able to do this task without any support:
table, random, data, scatterplot, selected, relationship, linear, equation, least squares regression, line, interpret, points, variability, estimate, expect, more than, less than, predicted, amount, more, less, residual, difference, calculated, plotted, corresponding, number, set, explain, determine, appropriate, describe, sample, diameter, plot, fit, area
Students might not know some of these words and still be successful task as they can use the other words (including the non-academic vocabulary) in order to make sense of what those words mean. It could also be that through doing this task and talking with other students about it, they can learn some of the words that they did not know.
All of these words are important words for students to know and to be able to use in appropriate contexts if students are going to be able to participate in the wider mathematics community. We cannot strip language, either common or academic, from our mathematics classes and expect students to be successful. As Harold Asturias has reminded me a few times, in order to have complex ideas, we need complex language to describe those ideas.
On the other hand, we can be thoughtful and deliberate in how we introduce new words to describe ideas to students. Specifically we can:
What else can we do to help students use language to make sense of mathematical ideas?
]]>
The very first investigation for grade 3 is on counting out 100 snap blocks. In this task, students are prompted to explain how they are sure they have 100 snap blocks. The goals of the task are to investigate how students understand numbers represented in a visual way and to learn how they communicate mathematical ideas to each other orally as well as in writing.
Before I decided to use the task with students, I decided to try a few different strategies myself to try and anticipate what strategies students might use. Here are a few of them below.
As it turned out, only one of these strategies was actually used by students in the class. I uncovered this, while students were working on this task, by circulating between groups and looking to see what students were actually doing.
One group started with a 5 by 5 square they had already built during the free exploration time, and built out into a 10 by 10 square. As it turns out, I built my 10 by 10 square by snapping together 10 columns of 10 blocks so even this very similar strategy did not exactly match my thinking. This group finished quite quickly and when asked to find another way of proving they had 100 blocks, did not do so. Instead they worked on improving their explanation.
Another group decided to split the task of counting in half, and realized this meant that each of them would be responsible for counting out 50 blocks. However, when they started working, they did not communicate with each other very well on their plan for counting and for the first several minutes they just put blocks together. Upon observing this, I asked them what their plan was, which required them first to communicate about a plan. One of the students decided that 50 blocks could be counted as two rows of 25 blocks, and that 25 blocks could be represented as a 5 by 5 square, and so they each individually created a 5 by 5 by 2 block, and put it together on the height 2 side, forming a 5 by 10 by 2 block.
The final group just started by snapping blocks together as quickly as they could without keeping track of how many blocks they had, but they did attempt at least to keep their blocks in a rectangular prism form. I asked them what their strategy was, and one of them indicated that they were not counting because they planned on counting later once they were pretty sure they had 100 blocks. I then decided to keep asking them how many blocks they had every time I checked in with them. Finally I asked them to stop building and just count how many blocks they had.
At this stage the students had a 5 by 5 by 4 rectangular prism. As the students counted their blocks, I noticed that they had to count the lengths of each side each time, and had to count the number of blocks on each face each time, and did not seem to be subitizing this collection of objects. I also noticed that their strategy for counting all of the blocks was to count the surface area of four sides of the whole block ending up with 20 + 20 + 25 + 25 for 90 blocks total. I wondered why they had chosen only four sides with this strategy instead of a more consistent six sides, so I asked them how many sides the block had. They counted it out by rotating the shape, found the block had six sides, and decided that in fact they must have 20 + 20 + 20 + 20 + 25 + 25 blocks.
At this point, I thought about ending the counting activity and having groups come together, but I decided that because the students did not know each other very well, and because I had not done very much work on constructing community norms around how work is shared, it would not be very productive for this group to come and present their model at this time. Instead, I pointed at one of the corner blocks asked the students how many times this one block was counted with their scheme, and one of the students quickly noticed that it would be counted three times, at which point one of the other students said, “Oh” and decided to count the blocks by “counting the groups of blocks”. He basically counted out one row of 5 by 4 to find out how many blocks were in one row and then counted out the 5 rows of blocks to come up with 20 + 20 + 20 + 20 + 20 = 100 blocks. The first student looked clearly convinced that this meant they had 100 blocks so I decided to continue to be uncertain as to whether the third student in this group was convinced and end the activity.
As the students got together, I decided to sequence their explanations from the group that counted out half of the blocks, the group that counted out the big rectangular prism, and end with the group that counted out a 10 by 10 square. Each group shared their strategies while I prompted them to explain their work more completely.
After the class was over, I took time to write notes to myself on what I noticed during the class, to help me plan the class for the following week. I looked at what the students wrote down as their explanations on paper, and decided that these did not capture enough of the thinking students did to be very useful to me, except that I became acutely aware that all of my students need work constructing coherent explanations.
My goal for this group of students is to develop their capacity to use arguments and evidence to justify the mathematical ideas they uncover with each other to form a community of mathematicians. I want them to be curious about how each other understands the mathematics and to use their shared understanding to extend and build on their individual understanding of the mathematics.
The formative assessment process I used during this lesson could be summarized with the following steps:
The process I’ve described above does not require an exit ticket, it does not require different coloured cups on tables, it does not require daily quizzes. It requires me to plan what thinking I hope and expect to see and to build a model of how students understand the mathematics and to carefully select how I will support students in developing their understanding.
Formative assessment is more of a mindset on using student thinking as the basis for teaching and learning rather than a quick checklist or a list of strategies.
]]>
You can’t control where your students come from, and you can’t control what their parents do, and you can’t control how society views them, and while all of these things are important, you can only pick a part of the problems you see and start working. Every dirty floor that gets cleaned starts with a single sweep of the broom.
Study your teaching.
What do you do that makes an impact? What do you have control over? Where can you make a difference? What are your goals for this group of students you have on this day in this place. Why are these students struggling and yet these ones are not? How do I move my students from here to there, and where is here anyway?
Study your teaching.
It’s up to no one else. You are in control of whether you improve or stay the same. Whether or not you preach personal responsibility for your students, you need to accept it for yourself. Take charge of your learning and make the assumption that you can always get better.
Study your teaching.
You know that no matter what anyone says, teaching is hard work. It just might be the most difficult work ever conceived. Fermat’s Last Theorem was once thought of as one of the most challenging problems in mathematics, but at least it is solved. We still don’t know how to ensure that every kid has the same opportunity to reach their full potential or even if this is a useful way to frame the challenges of teaching. Teaching is the noble profession that enables everyone’s dreams.
Study your teaching.
If you believe that teaching is hard, then why are you trying to do it alone? There is an old African proverb that says if you want to go quickly, go alone, but if you want to go far, go together. The journey to excellent teaching is long and hard and you will need to work with other people to reach it.
Study your teaching.
Educational fads come and go, but you should be curious why this is so? Why is it policy makers are always trying something new? Study for yourself what works and what does not. You must work with your colleagues to incrementally improve what you do, because in a world focused on quick fixes, no one else will.
Study your teaching.
It makes the work continually interesting. Instead of just marching through what you have always done, be curious about what you do and try out new things. The unexamined life is not worth living, but it is more appropriate to say that if you aren’t curious in what you do, you aren’t living at all. Life is too short to treat teaching as just a job. One source of happiness is curiosity.
Study your teaching.
Be systematic. Make no assumptions about what works and what does not. If everyone really understood the ideal path through which people learn, there would be no one like me still studying it. Be careful to examine your own biases and models for understanding the world. What led you to believe in x, and how do you know x is true? And if other people do not believe in x, why not? What is different about what they know and what you know?
Study your teaching.
What does it mean to teach? What are we trying to teach? Do you teach mathematics or do you teach children? Can you be human without attending to other people’s emotions? They say that they will never remember what you say, they will only remember how you made them feel. Is this true, and if so, how are you making your students feel?
I have only three words of advice, but if you heed them, then you have your life’s work ahead of you.
Study your teaching.
]]>
I wrote about a lot of different topics, including formative assessment, social media, language and learning, strategic inquiry, using mathematics, and ways students can understand mathematics. I found myself writing and tweeting quite a bit less about technology and tools this year and quite a bit more about processes.
My most popular posts, as measured by page views, were on effective mathematics teaching, using mathematics to choose my next apartment, 20 things I think every teacher should do, categorizing student work, ineffective feedback and the Khan Academy, the confirmation bias cycle, and what mathematics teachers need to know.
The posts that took me the most time to write were on effective mathematics teaching, ineffective feedback and the Khan Academy, supporting english language learners in math, sharing individualized comments using Autocrat, and what mathematics teachers need to know. From a time-to-write to number-of-views ratio, my post on the confirmation bias cycle is a huge hit. My favourite post from the year is on what mathematics teachers need to know.
My blog has been viewed over 9 million times since I started blogging and has generated 1889 comments. This year’s posts have amassed 275 thousand views and generated 95 comments, both of which make sense given that I have far fewer posts than usual and that most of my page views each year come from older posts.
I’m looking forward to the new year. I have some projects that I have been working on that will be fun to blog about. I’m particularly interested in learning more about how teachers develop as teachers and what potential learning trajectories look like for teacher knowledge.
]]>