Taking a break

Image via Wikipedia

It’s been pretty quiet around here at Casting Out Nines lately. This is mainly due to two things. First, I’m spending five days a week home with my oldest two kids — the youngest joins us on Wednesdays — and keeping the kids active and engaged doesn’t leave much time for blogging. Second, as you all know, I’m starting a new position at Grand Valley State University in the fall and our big move to Michigan takes place in two weeks. We’re totally uprooting in this move, and preparing for it consumes a lot of time and emotional energy.

I’ve decided that, in light of all this, that I might as well declare the blog to be on hiatus for a month or so until we’re settled. There are a couple of posts that might go up soon — one of them being the last entry in the How I make screencasts series — but otherwise let’s just call it summer vacation here at CO9’s, and things will resume in “back to school” mode later. (“Back to school” time always seems to happen too soon, but that’s another story.)

I do want to mention, because it’s hard to keep it in, that there are some major changes coming up for Casting Out Nines that I am very excited about. These have been brewing for almost a year now and are just about ready to go into place. I can’t really go into detail — nor do I have an exact timetable — but suffice to say that the experience you get here at CO9’s will be better than ever, and it’s more than just another change in the visual theme.

Anyway, that’s it from me for now — follow me on Twitter if you just can’t live without my content (ahem) but otherwise, get out there and enjoy your summer!

Helping the community with educational technology

Image via Wikipedia

Many people associated with educational technology are driven by a passion for helping students learn using technology in a classroom setting. But I wonder if many ed tech people — either researchers or rank-and-file teachers who teach with technology — ever consider a slightly different role, voiced here by Seymour Papert:

Many education reforms failed because parents did not understand or could not accept what their children were doing. Remember the New Math? This time there will be many who have not had the personal experience necessary to appreciate fully the multiple ways in which digital media can augment intellectual productivity. The people who do can make a major contribution to the success of the new initiative by helping others in their communities understand the potential. And being helpful will do much more than improve the uses of the computers. The computers could be a catalyst for turning our communities into “learning communities.”

So true. So much of education falls to the immediate family, and yet often there are technological innovations in the classroom which fail to be supported at home for the simple reason that parents and other family members don’t understand the technology. Ed tech people can make a real impact by simply turning their talents toward this issue.

Question for you all in the comments: How? It seems that the ways that ed tech people use to communicate their thoughts are exactly the ones off the radar screen of the people who need the  most help — Twitter, blogs, conference talks, YouTube videos, etc. You would need to get on the level with the parent trying to help their kid in a medium that they, the parents, understand. How is that best done? Newsletters? Phone hotlines? Take-home fact and instruction sheets? Give me some ideas here.

(h/t The Daily Papert)

Thoughts on the culture of an inverted classroom

I’ve just finished up the spring semester, and with it the second iteration of the inverted classroom MATLAB course. With my upcoming move, it may be a while before I teach another course like this (although my experiments with targeted “flipping” went pretty well), so I am taking special care to unwind and document how things went both this year and last.

I asked the students in this year’s class about their impressions of the inverted classroom — how it’s worked for them, what could be improved, and so on.  The responses fell into one of two camps: Students who were unsure of, or resistant to, the inverted classroom approach at first but eventually came to appreciate its use and get a lot out of the approach (that was about 3/4 of the class), and students who maybe still learned a lot in the class but never bought in to the inverted method. No matter what the group, one thing was a common experience for the students: an initial struggle with the method. This was definitely the case last year as well, although I didn’t document it. Most students found closure to that struggle and began to see the point, and even thrived as a result, while some struggled for the whole semester. (Which, again, is not to say they struggled academically; most of the second group of students had A’s and B’s as final grades.)

So I am asking, What is the nature of that struggle? Why does it happen? How can I best lead students through it if I adopt the inverted classroom method? And, maybe most importantly, does this struggle matter? That is, are students better off as problem solvers and lifelong learners for having come to terms with the flipped classroom approach, or is adopting this approach just making students have to jump yet another unnecessary hurdle, and they’d be just as well off with a traditional approach and therefore no struggle?

I think that the nature of the struggle with the inverted classroom is mainly cultural. I am using the anthropologists’ definition of “culture” when I say that — a culture being a system whereby a group of people assign meaning and value to things.

In particular, the way culture places value on the teacher is radically different between the traditional academic culture experienced by students and the culture that is espoused by the inverted classroom. In the traditional classroom, what makes a “good teacher” is typically that teacher’s ability to lecture in a clear way and give assessments that gauge basic knowledge of the lecture. In other words, the teacher’s value hinges on his or her ability to talk.

In the inverted classroom, by contrast, what makes a “good teacher” is his or her ability to create good materials and then coach the students on the fly as they breeze through some things and get inexplicably hung up on others. In other words, the teacher’s value hinges on his or her ability to listen.

Many students who are in that other 25% who never buy into the inverted classroom think that teachers using this approach are not “real” teachers at all. As one student put it, when they pay a teacher their salary, they expect the teacher to actually teach. What is meant by “teaching” here is an all-important question. Well, on the reverse side, if there were such a thing as a group of students who had only experienced the inverted classroom their entire lives and then entered into a traditional classroom, those students would think they are experiencing the worst teacher in the history of academia. The guy never shuts up! He only talks, talks, talks! We have to fight to get a word in edgewise, we get only brief chances to work on things when he is there, and we’re always booted unceremoniously out of the lecture hall (we used to call them “classrooms”) and left to fend for ourselves on all this difficult homework!

I’m convinced that bridging this cultural gap is what takes up most of the time and effort in an inverted classroom — forget about screencasts!

The “golden moment”

We’re in final exams week right now, and last night students in the MATLAB course took their exam. It included some essay questions asking for their favorite elements of the course and things that might be improved in the course. I loved what one of my students had to say about the assignment in the course he found to be the most interesting, so I’ve gotten permission from him to share it. The lab problem he’s referring to was to write a MATLAB program to implement the bisection method for polynomials.

It is really hard to decide which project I found most interesting; there are quite a few of them. If I had to choose just one though, I would probably have to say the lab set for April 6. I was having a really hard time getting the program to work, I spent a while tweaking it this way and that way. But when you’re making a program that does not work yet, there is this sort of golden moment, a moment when you realize what the missing piece is. I remember that moment on my April 6 lab set. After I realized what it was, I could not type it in fast enough I was so excited just to watch the program work. After hitting the play button, that .3 seconds it takes for MATLAB to process the program felt like forever. I actually was devastated that I got an error, and thought I had done it all wrong once again, but then I remembered I had entered the error command so it would display an error. I actually started laughing out loud in the lab, quite obnoxiously actually.

Yes!  As somebody once said, true learning consists in the debugging process. And that’s where the fun in learning happens to lie, too. Let’s give students as many shots as possible to experience this process themselves.

Understanding “understanding”

This past Saturday, I was grading a batch of tests that weren’t looking so great at the time, and I tweeted:

I do ask these two questions a lot in my classes, and despite what I tweeted, I will probably continue to do so. Sometimes when I do this, I get questions, and sometimes only silence. When it’s silence, I am often skeptical, but I am willing to let students have their end of the responsibility of seeking help when they need it and handling the consequences if they don’t.

But in many cases, such as with this particular test, the absence of questions leads to unresolved issues with learning, which compound themselves when a new topic is connected to the old one, compounded further when the next topic is reached, and so on. Unresolved questions are like an invasive species entering an ecosystem. Pretty soon, it becomes impossible even to ask or answer questions about the material in any meaningful way because the entire “ecosystem” of a student’s conceptual framework for a subject is infected with unresolved questions.

Asking if students understand something or if they have questions is, I am realizing, a poor way to combat this invasion. It’s not the students’ fault — though persistence in asking questions is a virtue more students could benefit from. The problem is that students, and teachers too, don’t really know what it means to “understand” something. We tend to base it on emotions — “I understand the Chain Rule” comes to mean “I have a feeling of understanding when I look at the Chain Rule” — rather than on objective measures. This explains the common student refrain of “It made sense when you did it in class, but when I tried it I didn’t know where to start“. Of course not! When you see an expert do a calculation, it feels good, but that feeling does not impart any kind of neural pathway towards your being able to do the same thing.

So what I mean by my tweet is that instead of asking “Do you understand?” or “Do you have any questions?” I am going to try in the future to give students something to do that will let me gauge their real understanding of a topic in an objective way. This could be a clicker question that hits at a main concept, or a quick and simple problem asking them to perform a calculation (or both). If a student can do the task correctly, they’re good for now on the material. If not, then they aren’t, and there is a question. Don’t leave it up to students to self-identify, and don’t leave it up to me to read students’ minds. Let the students do something simple, something appropriate for the moment, and see what the data say instead.

This may have the wonderful side effect of teaching some metacognition as well — to train students how to tell when they do or do not know something.

Targeting the inverted classroom approach

Image via Wikipedia

A while back I wondered out loud whether it was possible to implement the inverted or “flipped” classroom in a targeted way. Can you invert the classroom for some portions of a course and keep it “normal” for others? Or does inverting the classroom have to be all-or-nothing if it is to work at all? After reading the comments on that piece, I began to think that the targeted approach could work if you handled it right. So I gave it a shot in my linear algebra class (that is coming to a close this week).

The grades in the class come primarily from in-class assessments and take-home assessments. The former are like regular tests and the latter are more like take-home tests with limited collaboration. We had online homework through WeBWorK but otherwise I assigned practice exercises from the book but didn’t take them up. The mix of timed and untimed assessments worked well enough, but the lack of collected homework was not giving us good results. I think the students tended to see the take-home assessments as being the homework, and the WeBWorK and practice problems were just something to look at.

What seemed true to me was that, in order for a targeted inverted classroom approach to work, it has to be packaged differently and carry the weight of significant credit or points in the class. I’ve tried this approach before in other classes but just giving students reading or videos to watch and telling them we’d be doing activities in class rather than a lecture — even assigning  minor credit value to the in-class activity — and you can guess what happened: nobody watched the videos or read the material. The inverted approach didn’t seem different enough to the students to warrant any change in their behaviors toward the class.

So in the linear algebra class, I looked ahead at the course schedule and saw there were at least three points in the class where we were dealing with material that seemed very well-suited to an inverted approach: determinants, eigenvalues and eigenvectors, and inner products. These work well because they start very algorithmically but lead to fairly deep conceptual ideas once the algorithms are over. The out-of-class portions of the inverted approach, where the ball is in the students’ court, can focus on getting the algorithm figured out and getting a taste of the bigger ideas; then the in-class portion can focus on the big ideas. This seems to put the different pieces of the material in the right context — algorithmic stuff in the hands of students, where it plays to their strengths (doing calculations) and conceptual stuff neither in a lecture nor in isolated homework experiences but rather in collaborative work guided by the professor.

To solve the problem of making this approach seem different enough to students, I just stole a page from the sciences and called them “workshops“. In preparation for these three workshops, students needed to watch some videos or read portions of their textbooks and then work through several guided practice exercises to help them meet some baseline competencies they will need before the class meeting. Then, in the class meeting, there would be a five-point quiz taken using clickers over the basic competencies, followed by a set of in-class problems that were done in pairs. A rough draft of work on each of the in-class problems was required at the end of the class meeting, and students were given a couple of days to finish off the final drafts outside of class. The whole package — guided practice, quiz, rough draft, and final draft — counted as a fairly large in-class assessment.

Of course this is precisely what I did every week in the MATLAB course. The only difference is that this is the only way we did things in the MATLAB course. In linear algebra this accounted for three days of class total.

Here are the materials for the workshops we did. The “overview” for each contains a synopsis of the workshop, a list of videos and reading to be done before class, and the guided practice exercises.

• Determinants: Here’s the overview and here are the in-class problems.
• Eigenvalues and eigenvectors: Overview, in-class problems.
• Inner products: Overview, in-class problems.

The results were really positive. Students really enjoyed doing things this way — it’s way more engaging than a lecture and there is a lot more support than just turning the students out of class to do homework on their own. As you can see, many of the guided practice exercises were just exercises from the textbook — the things I had assigned before but not taken up, only to have them not done at all. Performance on the in-class and take-home assessments went up significantly after introducing workshops.

Additionally, we have three mastery exams that students have to pass with 100% during the course — one on row-reduction, another on matrix operations, and another on determinants. Although determinants form the newest and in some ways the most complex material of these exams, right now that exam has the highest passing rate of the three, and I credit a lot of that to the workshop experience.

So I think the answer to the question “Can the inverted classroom be done in a targeted way?” is YES, provided that:

• The inverted approach is used in distinct graded assignments that are made to look and feel very distinct from other elements of the course.
• Teachers make the expectations for out-of-class student work clear by giving an unambiguous list of competencies prior to the out-of-class work.
• Quality video or reading material is found and used, and not too much of it is assigned. Here, the importance of choosing a textbook — if you must do so — is very important. You have to be able to trust that students can read their books for comprehension on their own outside of class. If not, don’t get the book. I used David Lay’s excellent textbook, plus a mix of Khan Academy videos and my own screencasts.
• Guided practice exercises are selected so that students experience early success when grappling with the material out of class. Again, textbook selection should be made along those lines.
• In-class problems are interesting, tied directly to the competency lists and the guided practice, and are doable within a reasonable time frame.

These would serve as guidelines for any inverted classroom approach, but they are especially important for making sure that student learning is as great or greater than the traditional approach — and again, the idea of distinctness seems to be the key for doing this in a targeted way.

What are your suggestions or experiences about using the inverted or “flipped” classroom in a targeted way like this?

Speaking of the inverted classroom

On Wednesday, I gave a talk at Indiana University – Purdue Universty – Indianapolis (IUPUI, for short) to the teaching seminar for math graduate students on the inverted classroom. It was sort of a generalization of the talk I gave on the inverted linear algebra classroom back at the Joint Mathematics Meetings in January. Carl Cowen was in attendance at that talk and invited me to make the 20-minute drive from my house to IUPUI to do something like it, and I was happy to oblige.

Since putting the talk up on Slideshare yesterday morning, it’s gotten over 200 views, 2 favorites, a handful of retweets/Facebook likes, and is currently being highlighted on Slideshare’s Education page. So I thought I would share it here as well. Enjoy and ask questions!

Five questions I haven’t been able to answer yet about the inverted classroom

Between the Salman Khan TED talk I posted yesterday and several talks I saw at the ICTCM a couple of weeks ago, it seems like the inverted classroom idea is picking up some steam. I’m eager myself to do more with it. But I have to admit there are at least five questions that I have about this method, the answers to which I haven’t figured out yet.

1. How do you get students on board with this idea who are convinced that if the teacher isn’t lecturing, the teacher isn’t teaching? For that matter, how do you get ANYBODY on board who are similarly convinced?

Because not all students are convinced the inverted classroom approach is a good idea or that it even makes sense. Like I said before, the single biggest point of resistance to the inverted classroom in my experience is that vocal group of students who think that no lecture = no teaching. You have to convince that group that what’s important is what (and whether) they are learning, as opposed to my choices for instructional modes, but how?

2. Which is better: To make your own videos for the course, or to use another person’s videos even if they are of a better technical or pedagogical quality? (Or can the two be effectively mixed?)

There’s actually a bigger question behind this, and it’s the one people always ask when I talk about the inverted classroom: How much time is this going to take me? On the one hand, I can use Khan Academy or iTunesU stuff just off the rack and save myself a ton of time. On the other hand, I run the risk of appearing lazy to my students (maybe that really would be being lazy) or not connecting with them, or using pre-made materials that don’t suit my audience. I spend 6-12 hours a week just on the MATLAB class’ screencasts and would love (LOVE) to have a suitable off-the-shelf resource to use instead. But how would students respond, both emotionally and pedagogically?

3. Can the inverted classroom be employed in a class on a targeted basis — that is, for one or a handful of topics — or does it really only work on an all-or-nothing basis where the entire course is inverted?

I’ve tried the former approach, to teach least-squares solution methods in linear algebra and to do precalculus review in calculus. In the linear algebra class it was successful; in calculus it was a massive flop. On some level I’m beginning to think that you have to go all in with the inverted classroom or students will not feel the accountability for getting the out-of-class work done. At the very least, it seems that the inverted portions of the class have to be very distinct from the others — with their own grading structure and so on. But I don’t know.

4. Does the inverted classroom model fit in situations where you have multiple sections of the same course running simultaneously?

For example, if a university has 10 sections of calculus running in the Fall, is it feasible — or smart — for one instructor to run her class inverted while the other nine don’t? Would it need to be, again, an all-or-nothing situation where either everybody inverts or nobody does, in order to really work? I could definitely see me teaching one or two sections of calculus in the inverted mode, with a colleague teaching two other sections in traditional mode, and students who fall under the heading described in question #1 would wonder how they managed to sign up for such a cockamamie way of “teaching” the subject, and demand a transfer or something. When there’s only one section, or one prof teaching all sections of a class, this doesn’t come up. But that’s a relatively small portion of the full-time equivalent student population in a math department.

5. At what point does an inverted classroom course become a hybrid course?

This matters for some instructors who teach in institutions where hybrid, fully online, and traditional courses have different fee structures, office hours expectations, and so on. This question raises ugly institutional assumptions about student learning in general. For example, I had a Twitter exchange recently with a community college prof whose institution mandates that a certain percentage of the content must be “delivered” in the classroom before it becomes a “hybrid” course. So, the purpose of the classroom is to deliver content? What happens if the students don’t “get” the content in class? Has the content been “delivered”? That’s a very 1950’s-era understanding of what education is supposedly about. But it’s also the reality of the workplaces of a lot of people interested in this idea, so you have to think about it.

Got any ideas on these questions?

Salman Khan on the inverted classroom

Salman Khan, of the Khan Academy, sounds off on the potential of pre-recorded video lectures to change education in the video below. He calls it “flipping” the classroom, but around here we call it the inverted classroom.

I like especially that Salman made the point that the main effect of inverting the classroom is to humanize it. Rather than delivering a one-size-fits-all lecture, the lecture is put where it will be of the most use to the greatest number of students — namely, online and outside of class — leaving the teacher free to focus on individual students during class. This was the point I made in this article — that the purpose of technology ought to be to enhance rather than replace human relationships.

I hope somewhere that he, or somebody, spends a bit more time discussing exactly how the teachers in the one school district he mentions in the talk actually implemented the inverted classroom, and what kinds of issues they ran up against. Ironically, the greatest resistance I get with the inverted classroom is from students themselves, namely a small but vocal group who believe that this sort of thing isn’t “real teaching”. I wonder if the K-12 teachers who use this model encounter that, or if it’s just a phenomenon among college-aged students.

Discussion thread: Student responsibilities

I’d be interested in hearing your thoughts on the following statement about responsibilities in college:

In college, it’s the student’s responsibility to initiate requests for help on assignments, and it’s the instructor’s responsibility to respond to those requests in a helpful and timely way.

Do you think this statement is true or false? If false, could you modify it so that it’s true?