Education ∪ Math ∪ Technology

Author: David Wees (page 42 of 97)

Do iPads improve mathematics instruction? Maybe

Student using iPad
(Image source: MindShift blog)

Stephen Downes just shared this study suggesting that students see a 20% improvement in their test scores on their state exam after using an iPad loaded with HMH Fuse.

I am a supporter for using technology in mathematics education, but it’s probably worth examining these results closer. Here are some quotes from the study itself, and my unpacking of what this means for the reliability of this study.

  • Earhart has been a school eager to employ new technology in the classroom…” (p5):

    This suggests a selection bias. Further, it also suggests that this program has been attempted at one school, or that all that has been shared with us are the results from one school. Were there other schools that had an opportunity to pilot this program which have not been shared in this study?

  • Coleman approached his teachers about this opportunity and two teachers, Jackie Davis and Dan Sbur, were ultimately chosen to take part in the study.” (p5) :

    This suggests that the process for choosing the teachers was anything but random. The study makes careful mention that the students were carefully chosen, but underplays how teachers were selected.
     

  • …this meant more work and time required by the teachers…” (p5) “Like any new technology, there was a slight learning curve with adopting a tablet in the classroom. “In the beginning of the year I tried a little bit of everything, trying to find out what was best for my class and for me,” recalls Jackie Davis. Dan Sbur also found that “Over time, it became easier to use and I could use it more in my class as I became comfortable with the device and app.” (p6) :

    The teachers who were chosen (or volunteered?) had to work harder to implement this program. This suggests that at least part of the effect on their test scores could be attributed to the efforts their teachers put in.
     

  • …This meant that students were allowed to take the devices home and “customize them,” adding their own music, videos, and additional apps. This approach also allowed students to have 24/7 access to the HMH Fuse: Algebra I program.” (p5) :

    So now, are we measuring the effectiveness of the program, or the effectiveness of time spent learning math? Students who spend much more time working on math are obviously going to see an increase in their test scores.
     

  • As one would expect, those students who were randomly selected to be part of the HMH Fuse study were very excited – as were their parents. In fact, Coleman quickly found that one benefit of the HMH Fuse: Algebra I app was enabling parents to provide more support to their children: “Parents could watch the videos or review problems with their children to help them if they did not understand.”” (p6) :

    Clearly parental involvement makes a difference in a student’s education, and if this app helps parents be more involved, that’s excellent. If this program wasn’t considered so innovative, and new, would parents be as involved? In other words, if we standardized this program, would parents get excited by it?
     

  • In addition, Mr. Davis found students took the initiative to use HMH Fuse: Algebra I to check their work during class, freeing him up to do more one-on-one work with struggling students in need of individual attention. In this regard, the HMH Fuse app essentially enabled a “flipped classroom” model in which students learned and worked independently at home, and then came to class ready to do problems and practice what they had learned (see Bergmann & Sams, 2011). This “flipped classroom” dynamic gave both Mr. Davis and Mr. Sbur the ability to provide personalized instruction to many students during the normal school day.” (p6) :

    If the HMH Fuse app allows students to work in a more self-directed way, that’s a good thing. If their teachers are changing their pedagogical approaches to suit the affordances of the device, that’s probably a good thing too. So one wonders how much of the learning effect was due to this personalized attention. Did the two teachers in this study also find ways to personalize and give individual attention to their students in their other non-iPad classes?

 

One thing not at all discussed in this study is what they hope to accomplish by improving mathematics instruction. Test scores are one measure we have for mathematical ability, but they are not the only measure. Did this program give students additional time to work on improving their mathematical reasoning and their problem formulating & solving skills? Hopefully the authors of this paper will submit it for formal review so that any of the issues that I’ve addressed can be peer reviewed.

Apple iPad textbooks

So as expected, Apple announced their new textbooks for the iPad. Looking over the specs and what is possible to create with the iPad, it doesn’t look like they’ve offered a complete set of features for their book, but buried in their authoring features is the ability to embed HTML widgets into pages. There are some things I’d like to see improved about their digital textbook, but most schools will find the fact that they can subscribe to multiple textbook publishing companies through the same system pretty attractive.
 

Some flaws I spotted:

  • The textbook does not seem to build in the ability to translate or look up definitions of words.
     
  • No discussion on the adjusting the readability (in terms of word choice and reading level) of the texts.
     
  • No discussion on interacting with other users of the textbook, either through comments, or even sharing anotations. It might be possible to share annotations, but can you share books? Can you deep link to a portion of a textbook to share a thought with someone else?
     
  • The interactivity they have included seems somewhat limited to pseudointeractivity. Being able to manipulate an image and move it around is not as big a deal (in terms of effect on student learning) as they seem to be making it out to be. You may be able to build in games and simulations, but you’ll have to build them yourself as HTML 5 widgets. I’d like to see a textbook which includes the ability to graph data, manipulate it, and run simulations within the text itself.
     
  • The textbooks will be in a proprietary format which can only be created on a Mac. This means that it will be sometime before authoring tools come out for other OS, and then getting your textbook onto the iPad via those authoring tools looks very much like it will have to go through the iTunes store. Good luck trying to get a book that doesn’t meet the somewhat stringent requirements of the iTunes store into the app. I can imagine that courses on human sexuality and gender may find themselves using paper textbooks for some time to come, for example.
     
  • A typical complaint with traditional mathematics textbooks is that the examples given earlier in the textbook are then replicated in the exercises the students do, and the exercise becomes not about doing mathematics, but about recognizing (and memorizing the solution to) problem types. I don’t see any evidence that this will be fixed with the new textbook, especially given the companies with whom they’ve partnered. Maybe because the technology is improved, the pedagogy will improve? I’m not sure…
     
  • One of the comments from the video advertising the new iPad textbooks said that students wouldn’t even have to think about what information they’ve bookmarked or annotated in the textbook. Doesn’t this seem somewhat problematic, given that a purpose of education is to get students to think?

I don’t disagree with digital textbooks per say. For schools that can afford this option, they do have a lot of benefits. I just think we should continue to ask ourselves, how can we improve the textbook? It’s been fundamentally the same for so long, and I don’t see a huge benefit in spending extra money for the reading device for a textbook (aside from reduced weight in students’ backpacks) if we can’t also fix some of the pedagogical problems in traditional textbooks.
 

Update: An important observation for Canadian markets – the Apple digital textbooks are not yet licensed for use in Canada, and the software to manage distribution locally of the textbooks is not yet available here.

Edcamp weekend

I attended Edcamp Delta this past weekend. On the same weekend, Edcamp SD43 occurred in Port Coquitlam. Both Edcamp events had a fair number of people, which is a fairly impressive draw for a Saturday professional learning session that no one is forced to go to.

The sessions were heavily tweeted about. Here is the archive for the Edcamp SD43 hashtag. Here is the archive for the Edcamp Delta hashtag.

Every session felt really useful and/or interesting during the day. I spent the morning talking about technology in the primary grades, and on an educational panel talking about education in British Columbia. In the afternoon, I facilitated a session on "Improving Professional Development" which Brad and I continued during the last session time.

I’m excited to report that Edcamp is flourishing in BC.

5 little monkeys

At Edcamp Delta, Brad shared the following parable with me.

In the parable, researchers supposedly put 5 monkeys together in a cage, and in the cage there were some steps leading to some bananas. Whenever any of the monkeys would start to go up the steps to get a banana however, the hypothetical researchers would spray all of the monkeys in the cage with cold water. Every time any one of the monkeys went to get a banana, the entire group would get sprayed with cold water. After time, the monkeys would self-regulate and would attack any monkey that tried to make a move for the bananas, and the researchers stopped spraying the monkeys with water.

In the next stage of the experiment, they removed one of the original monkeys, and replaced it with a new one. The new monkey, not knowing about the cold water, would eventually decide to make an attempt to get one of the bananas, at which point the other four monkeys would attack the new monkey, preventing it from getting a banana. Over time, the new monkey learned not to make an effort to get a banana, and even though it had not experienced the spraying of cold water, it learned about the aversion to going to get a banana.

Over time, the researchers replaced each of the original monkeys with a new monkey, and each time, the new monkey learned not to attempt to get a banana as the other monkeys would beat it up. In other words, the researchers learned that the monkeys had passed along a cultural adaptation (avoidance of getting bananas) without having the original reason for the adaptation still present.

There was an experiment done with monkeys in the 1960s which is likely from where this parable was derived. Stephenson was able to train monkeys to avoid touching an object with blasts of air, and discovered that these monkeys could transmit this aversion to a ‘naive’ colleague (Stephenson, 1967). So while the parable seems to have never actually been tested, the results from Stephenson’s experiment suggest the parable is believable.

The point of this parable is that we can often repeat patterns as a form of peer pressure without understanding the original reasons for the behaviour. While we have an advantage over monkeys, which is that we can clearly articulate to each successive generation the reasons for a particular action that we take, unfortunately, we often do not share our reasons with the next generation, and only share the rules that we have established.

We see this experimented repeated over and over again in society. For example, suppose that in a subway station a door was locked in the early morning, and another door was unlocked. The first people to arrive at the subway station, not seeing anyone around, will test both doors, and enter through the one that works. Eventually traffiic gets a bit higher, and the door that works is always open because of constant traffic through the door. The other door, which doesn’t work, is assumed to not work since no one seems to be using it. If a custodian came by and unlocked the door, it wouldn’t be used, until someone came and actually went against the grain and tested the other door. We could call this person who tests the other door, even though no one else seems to be using it, an innovator.

Cultural pressure to follow what we’ve always done before, without really understanding the reasons why we follow the actions we do, is quite strong. How many of our structures in schools are done in certain ways even though the restrictions on doing them in other ways no longer exist?

 

References:

Stephenson, G. R. (1967). Cultural acquisition of a specific learned response among rhesus monkeys. In: Starek, D., Schneider, R., and Kuhn, H. J. (eds.), Progress in Primatology, Stuttgart: Fischer, pp. 279-288.

I could use some help

I’ve been invited to do a keynote on the topic of educational technology for the University of Alberta at their Technology Fair for their student teachers and education faculty on February 13th. See http://www.educ.ualberta.ca/technologyfair/ for details on this conference.

I’m working on the keynote, and I could use some feedback. There are aspects of what I’ve written that I’m happy with, and others that I think need improvement. I’m not planning on reading this verbatim, but it will inform how I construct my slides, and speaking notes for the keynote. If anyone can give me some feedback, that would be greatly appreciated.

You can either comment on the keynote directly, or leave me a comment here. Thank you in advance for your assistance.

 

 

Are teachers overpaid?

Two authors of a controversial paper from the Heritage Foundation suggest that teachers are overpaid for their efforts. Here is my response.

The US economy dropped by 15.6% in 2009 for a total loss of $2, 342, 400, 000, 000. The people responsible for this disaster to the economy almost all received million dollar bonuses for their efforts.

From this I can deduce that the relationship between compensation for one’s "work" and what one does, or knows how to do, is not as straight forward as the authors of this paper claim.

All compensation is political. We choose to compensate some people differently than others for historical reasons, for political reasons, and obviously for economic reasons, but to ignore the historical and political aspects of compensation is to make a grave error in one’s research.

Thoughts? Do you think teachers are overpaid?

 

 

Is my son a writer?

This is a list my son created of things he wanted to make sure he got done for the day.

Writing a list

 

Does this make my son a writer? Is it more important that he is attempting to use text to get out his thoughts? Or is it more important that I help him correct the mistakes that he has made to make him a ‘better’ writer?

I’m of the opinion, at least at this stage, that we allow our son to make mistakes without being overly concerned about correcting them. Once he learns how to read, he will naturally learn how to spell better, and he will also learn more of the rules about how we write things down. At this stage grammar, and structure are somewhat unimportant, and just being willing to experiment and make an attempt is of critical importance.

What do you think?

Bicycling with my son


One of the first times my son rode his bicycle.


I went bicycling with my five year old son yesterday with his new bicycle from his Birthday. We haven’t had much of a chance to bicycle recently together, so my son hadn’t actually ridden his bicycle since the summertime. As a result, he had really forgotten a lot about what he learned over the summer about riding bicycles, and was really struggling to even get his bicycle going.

As the minutes wore on, he became more and more frustrated, although I was encouraged by his willingness to fall down and then get right back up over and over again. I did give him some advice and encouragement during this time, but since I knew he was capable of riding his bicycle, I didn’t want to be too helpful.

I realized that he had forgotten what it felt like to ride his bicycle. He was on an unfamiliar bike that was just a wee bit too large for him, and just couldn’t seem to get it together.

So I asked him to pause for a second, and get off his bicycle. I knelt, and we were face to face, and I asked him if he remembered riding his bicycle before. He said he couldn’t and his face fell a bit. I asked him if he remembered riding it down Auntie Juniper’s driveway (which is where he first learned how to ride his bicycle), and his face lit up while he nodded vigorously. I asked him to close his eyes, and imagine himself riding down Auntie Juniper’s driveway. He closed his eyes and I reminded him of how much practice he had put in, how much fun he had during the summer, and how good he had gotten at riding his bicycle. We spent about two minutes remembering together the feeling of the first time he rode a bicycle.

Right after that, he got back on his bicycle and started to ride it. He only fell down one more time while riding his bicycle, and even managed to ride it all the way around the park twice without stopping (he was pretty proud of this accomplishment). He went from unable to get his bicycle going more than a couple of feet to being as capable as he was during the summer after all of his practice.

This incident reminded me of a few things about learning:

  • What you know how to do is tied to your emotions. It is not enough to simply know things, you have to have some feelings attached to those things for them to be useful. When my son lacked confidence, he wasn’t able to ride his bicycle. When he regained his confidence, and remembered the joy he felt riding his bicycle during the summer, all of his knowledge about how to ride a bicycle came back to him.
     
  • Focused and contextualized practice are important in learning. You can’t really get better at riding a bicycle by talking about riding a bicycle, you have to do it. My son spent many hours riding his bicycle in order to become better at it.

    Although I see the obvious value in learning in practicing, I want to re-iterate how important it is that this practice be in a meaningful context. I often see comments on stories about mathematics education, for example, where the people talk about this or that cashier who was unable to make change without a calculator and how this points to an obviously sorry state of mathematics education. The question I want to ask in response to the often repeated story of the cashier is, when did they practice making change? They practiced arithmetic repeatedly in schools, no doubt, but how many schools have students play the part of cashiers and make change for pretend customers? How often is the skill of arithmetic practiced in context?
     

  • Practice should be part of a shared experience, and should have a positive emotion attached to it. If my son had learned how to ride a bicycle on his own, I wouldn’t have been able to help him remember his previous experience. If he had spent his entire time practicing in frustration or in anger during the summer, I doubt he would have remembered how to ride his bicycle yesterday.
     

 

Calculator vs Slide Rule vs Hand calculations

In an excellent post Michael Doyle says the following:

Electronic calculators are abstract, abacuses are not.
Slide rules fall in-between.
Our sense of quantities has become abstract.


Here is my comment back:

It’s not so much that numbers are abstract to students, but our representations of those numbers (the numerals that make up 122) are abstract.

Base 10 is a much more complicated concept than we give credit to in our teaching of it.

How many people are fooled by the numbers thrown out on the news (example: 12 millions dollars over-budget, on a budget of 1.3 trillion)?

The scale on a slide rule is a logarithmic one, and so it breaks the intuitive linear sense of numbers that we are born with. Hence, I don’t think it’s necessarily the case that the scale helps us understand the operations any better. A slide rule is a calculator, it just uses slides instead of buttons, and the operations are just as mystifying to most people.

Similarly the operations on a calculator (or the standard algorithms we teach kids to use on pencil and paper) are just as mystifying. Regardless of which algorithm one uses, one should have an understanding first of what the expected outcome of the algorithm should be, which unfortunately, we spend almost no time teaching in our mathematics curriculums.

It has become more important to do operations quickly and accurately to demonstrate "computational fluency" and error checking, a MUCH more important skill, has fallen by the wayside. Being able to estimate or predict the outcome of an algorithm is not only a far more useful life-skill than accurately calculating it (when one wants accuracy, one should use the correct tool) and further, it requires actual understanding of the process.

I think Michael is right that our sense of quantities is abstract, but I think that this has always been true for most people, regardless of the form of technology we’ve used to do our calculations. It is not so much the calculator that is the problem, but the embedded abstraction in numerals themselves. Unfortunately, we spend much more time teaching kids how to do operations on numbers, and I don’t think we spend enough time teaching about what the numbers themselves mean (or at least on reminding students what they learned in previous years on numbers). For example, in the BC curriculum, the discussion on the relative size of numbers seems to stop in grade 6.

It is too easy to blame kids lack of fluency as adults with numbers on the technology used to do calculations with those numbers. Instead we should ask ourselves, where have we taught them fluency with numbers? How have we helped them learn about the abstraction numbers represent?