# Tag Archives: Linear algebra

## Targeting the inverted classroom approach

Image via Wikipedia

A while back I wondered out loud whether it was possible to implement the inverted or “flipped” classroom in a targeted way. Can you invert the classroom for some portions of a course and keep it “normal” for others? Or does inverting the classroom have to be all-or-nothing if it is to work at all? After reading the comments on that piece, I began to think that the targeted approach could work if you handled it right. So I gave it a shot in my linear algebra class (that is coming to a close this week).

The grades in the class come primarily from in-class assessments and take-home assessments. The former are like regular tests and the latter are more like take-home tests with limited collaboration. We had online homework through WeBWorK but otherwise I assigned practice exercises from the book but didn’t take them up. The mix of timed and untimed assessments worked well enough, but the lack of collected homework was not giving us good results. I think the students tended to see the take-home assessments as being the homework, and the WeBWorK and practice problems were just something to look at.

What seemed true to me was that, in order for a targeted inverted classroom approach to work, it has to be packaged differently and carry the weight of significant credit or points in the class. I’ve tried this approach before in other classes but just giving students reading or videos to watch and telling them we’d be doing activities in class rather than a lecture — even assigning  minor credit value to the in-class activity — and you can guess what happened: nobody watched the videos or read the material. The inverted approach didn’t seem different enough to the students to warrant any change in their behaviors toward the class.

So in the linear algebra class, I looked ahead at the course schedule and saw there were at least three points in the class where we were dealing with material that seemed very well-suited to an inverted approach: determinants, eigenvalues and eigenvectors, and inner products. These work well because they start very algorithmically but lead to fairly deep conceptual ideas once the algorithms are over. The out-of-class portions of the inverted approach, where the ball is in the students’ court, can focus on getting the algorithm figured out and getting a taste of the bigger ideas; then the in-class portion can focus on the big ideas. This seems to put the different pieces of the material in the right context — algorithmic stuff in the hands of students, where it plays to their strengths (doing calculations) and conceptual stuff neither in a lecture nor in isolated homework experiences but rather in collaborative work guided by the professor.

To solve the problem of making this approach seem different enough to students, I just stole a page from the sciences and called them “workshops“. In preparation for these three workshops, students needed to watch some videos or read portions of their textbooks and then work through several guided practice exercises to help them meet some baseline competencies they will need before the class meeting. Then, in the class meeting, there would be a five-point quiz taken using clickers over the basic competencies, followed by a set of in-class problems that were done in pairs. A rough draft of work on each of the in-class problems was required at the end of the class meeting, and students were given a couple of days to finish off the final drafts outside of class. The whole package — guided practice, quiz, rough draft, and final draft — counted as a fairly large in-class assessment.

Of course this is precisely what I did every week in the MATLAB course. The only difference is that this is the only way we did things in the MATLAB course. In linear algebra this accounted for three days of class total.

Here are the materials for the workshops we did. The “overview” for each contains a synopsis of the workshop, a list of videos and reading to be done before class, and the guided practice exercises.

The results were really positive. Students really enjoyed doing things this way — it’s way more engaging than a lecture and there is a lot more support than just turning the students out of class to do homework on their own. As you can see, many of the guided practice exercises were just exercises from the textbook — the things I had assigned before but not taken up, only to have them not done at all. Performance on the in-class and take-home assessments went up significantly after introducing workshops.
Additionally, we have three mastery exams that students have to pass with 100% during the course — one on row-reduction, another on matrix operations, and another on determinants. Although determinants form the newest and in some ways the most complex material of these exams, right now that exam has the highest passing rate of the three, and I credit a lot of that to the workshop experience.
So I think the answer to the question “Can the inverted classroom be done in a targeted way?” is YES, provided that:
• The inverted approach is used in distinct graded assignments that are made to look and feel very distinct from other elements of the course.
• Teachers make the expectations for out-of-class student work clear by giving an unambiguous list of competencies prior to the out-of-class work.
• Quality video or reading material is found and used, and not too much of it is assigned. Here, the importance of choosing a textbook — if you must do so — is very important. You have to be able to trust that students can read their books for comprehension on their own outside of class. If not, don’t get the book. I used David Lay’s excellent textbook, plus a mix of Khan Academy videos and my own screencasts.
• Guided practice exercises are selected so that students experience early success when grappling with the material out of class. Again, textbook selection should be made along those lines.
• In-class problems are interesting, tied directly to the competency lists and the guided practice, and are doable within a reasonable time frame.
These would serve as guidelines for any inverted classroom approach, but they are especially important for making sure that student learning is as great or greater than the traditional approach — and again, the idea of distinctness seems to be the key for doing this in a targeted way.
What are your suggestions or experiences about using the inverted or “flipped” classroom in a targeted way like this?

Filed under Clickers, Inverted classroom, Linear algebra, MATLAB, Screencasts

## Speaking of the inverted classroom

On Wednesday, I gave a talk at Indiana University – Purdue Universty – Indianapolis (IUPUI, for short) to the teaching seminar for math graduate students on the inverted classroom. It was sort of a generalization of the talk I gave on the inverted linear algebra classroom back at the Joint Mathematics Meetings in January. Carl Cowen was in attendance at that talk and invited me to make the 20-minute drive from my house to IUPUI to do something like it, and I was happy to oblige.

Since putting the talk up on Slideshare yesterday morning, it’s gotten over 200 views, 2 favorites, a handful of retweets/Facebook likes, and is currently being highlighted on Slideshare’s Education page. So I thought I would share it here as well. Enjoy and ask questions!

## Five questions I haven’t been able to answer yet about the inverted classroom

Between the Salman Khan TED talk I posted yesterday and several talks I saw at the ICTCM a couple of weeks ago, it seems like the inverted classroom idea is picking up some steam. I’m eager myself to do more with it. But I have to admit there are at least five questions that I have about this method, the answers to which I haven’t figured out yet.

1. How do you get students on board with this idea who are convinced that if the teacher isn’t lecturing, the teacher isn’t teaching? For that matter, how do you get ANYBODY on board who are similarly convinced?

Because not all students are convinced the inverted classroom approach is a good idea or that it even makes sense. Like I said before, the single biggest point of resistance to the inverted classroom in my experience is that vocal group of students who think that no lecture = no teaching. You have to convince that group that what’s important is what (and whether) they are learning, as opposed to my choices for instructional modes, but how?

2. Which is better: To make your own videos for the course, or to use another person’s videos even if they are of a better technical or pedagogical quality? (Or can the two be effectively mixed?)

There’s actually a bigger question behind this, and it’s the one people always ask when I talk about the inverted classroom: How much time is this going to take me? On the one hand, I can use Khan Academy or iTunesU stuff just off the rack and save myself a ton of time. On the other hand, I run the risk of appearing lazy to my students (maybe that really would be being lazy) or not connecting with them, or using pre-made materials that don’t suit my audience. I spend 6-12 hours a week just on the MATLAB class’ screencasts and would love (LOVE) to have a suitable off-the-shelf resource to use instead. But how would students respond, both emotionally and pedagogically?

3. Can the inverted classroom be employed in a class on a targeted basis — that is, for one or a handful of topics — or does it really only work on an all-or-nothing basis where the entire course is inverted?

I’ve tried the former approach, to teach least-squares solution methods in linear algebra and to do precalculus review in calculus. In the linear algebra class it was successful; in calculus it was a massive flop. On some level I’m beginning to think that you have to go all in with the inverted classroom or students will not feel the accountability for getting the out-of-class work done. At the very least, it seems that the inverted portions of the class have to be very distinct from the others — with their own grading structure and so on. But I don’t know.

4. Does the inverted classroom model fit in situations where you have multiple sections of the same course running simultaneously?

For example, if a university has 10 sections of calculus running in the Fall, is it feasible — or smart — for one instructor to run her class inverted while the other nine don’t? Would it need to be, again, an all-or-nothing situation where either everybody inverts or nobody does, in order to really work? I could definitely see me teaching one or two sections of calculus in the inverted mode, with a colleague teaching two other sections in traditional mode, and students who fall under the heading described in question #1 would wonder how they managed to sign up for such a cockamamie way of “teaching” the subject, and demand a transfer or something. When there’s only one section, or one prof teaching all sections of a class, this doesn’t come up. But that’s a relatively small portion of the full-time equivalent student population in a math department.

5. At what point does an inverted classroom course become a hybrid course?

This matters for some instructors who teach in institutions where hybrid, fully online, and traditional courses have different fee structures, office hours expectations, and so on. This question raises ugly institutional assumptions about student learning in general. For example, I had a Twitter exchange recently with a community college prof whose institution mandates that a certain percentage of the content must be “delivered” in the classroom before it becomes a “hybrid” course. So, the purpose of the classroom is to deliver content? What happens if the students don’t “get” the content in class? Has the content been “delivered”? That’s a very 1950’s-era understanding of what education is supposedly about. But it’s also the reality of the workplaces of a lot of people interested in this idea, so you have to think about it.

Got any ideas on these questions?

Filed under Education, Inverted classroom, Life in academia, Teaching

## How the inverted classroom saves students time

Our semester is into its third full week, and most of my time (as you know from checking my Twitter or Facebook feed) is being spent, it seems, on making screencasts for the MATLAB class. I feel like I’ve learned a great deal from a year’s worth of reflection on the first run of the class last spring, and it’s showing in the materials I’m producing and the work the students are giving back.

The whole idea of the inverted classroom has gotten a lot of attention in between the current version of the course and the inaugural run — the time period I think of as the “MATLAB offseason” — through my blogging, conference talks, and everyday conversations at my work. One of my associate deans, off of whom I’ve bounced a number of ideas about this course, related a conversation he recently had with someone about what I’m doing.

Associate Dean: So, Talbert is using this thing called the inverted classroom.

Other person: What’s that all about?

AD: He puts the lectures all online, and instead of lecturing in class he has them do group assignments on various kinds of problems.

OP: Doesn’t that double the amount of time students have to spend on the class?

I’ve never encountered that exact reaction before, although I did mention once that the biggest negative comment from students last year in the MATLAB course was that it took too much time relative to the credit load (1 credit). I liked how my associate dean put the answer:

AD: Well… think about it this way. You are still doing both lecture and “homework”. But which part of that are going to need the most amount of help on?

OP: OK, now I get it.

Exactly. Students are going to need a lot more guidance on the difficult task of assimilating information than they will need on the relatively easy — incredibly easy, in fact — task of receiving a transmission of information. Both phases of the game need to take place in some form, but assimilation is harder, and the probability of sinking massive amounts of time into work that goes nowhere is a lot higher, than in transmission.

I’ve seen some great examples of where the inverted classroom method has actually saved students possibly hours of fruitless labor in the last two weeks.

Today, for instance, we were doing a lab problem set on command line plotting. In one of the tasks, students are asked to produce a 1×2 subplot illustrating the behavior of a two-parameter family of functions. One team was stuck because their M-file wouldn’t execute properly even though their code looked correct. The problem: They used a dash (-) in the title, which causes MATLAB to think that the stuff preceding the dash is a variable name, which wasn’t in the workspace. It’s an innocent error but not one that students with just two weeks of MATLAB under their belts could easily debug themselves. Had they run into this problem outside of class, who knows how much time would have been wasted getting nowhere? But inside class, it was solved in the amount of time it took for them to raise their hands and for me to come over and look.

Another example from today: A team had entered this code:

x = linspace(0,10);
y = 100 - exp(-2*x);
axis([0 15 90 105])
plot(x,y)


They had entered the code without line 3 already but didn’t like the look of the plot, so they added the axis command to try and change the viewing window. But nothing changed. Why? To the trained eye, it’s simple — you have to have something plotted first before you can change the axis. So just reverse lines 3 and 4. But to the untrained eye, again, who knows how much time would be lost in trying to figure this out? Instead I was able to instruct them directly on this, at the conceptual level (How is MATLAB thinking its way through your code?) and they got it. (It wasn’t just me telling them, “You need to switch lines 3 and 4.”)

So above and beyond being more instructionally effective, I’m realizing — and I hope students are too — that the inverted classroom makes student time a lot more efficient, and there’s a much higher success-to-effort ratio than in the traditional mode of teaching.

## An M-file to generate easy-to-row-reduce matrices

In my Linear Algebra class we use a lot of MATLAB — including on our timed tests and all throughout our class meetings. I want to stress to students that using professional-grade technological tools is an essential part of learning a subject whose real-life applications closely involve the use of those tools. However, there are a few essential calculations in linear algebra, the understanding of which benefits from doing by hand. One of those calculations is row-reduction. Nobody does this by hand; but doing it by hand is useful for understanding elementary row operations and for getting a feel for the numerical processes that are going on under the hood. And it helps with understanding later concepts, notably that of the LU factorization of a matrix.

I have students take a mastery exam where they have to reduce a 3×5 or 4×6 matrix to reduced echelon form by hand. They are not allowed any technology on that exam. I’ve learned that making up good matrices for this exam is surprisingly tricky. My first attempt at writing the exam resulted in a nice-looking matrix whose reduced echelon form had mind-bendingly big fractions in it. I want the exam to be about row reduction and not fraction arithmetic, so I  sat down this morning and wrote this MATLAB function called easyRR.m which automatically spits out $m \times n$ random integer matrices whose row-reduction process might involve fractions but which aren’t horrendous:

%% Function to create an mxn matrix that is easy to row-reduce by hand.
% Basic idea: Construct this matrix by building an LU factorization for it
% where both L and U have small integer values.
% R. Talbert, Feb 15, 2011

function A = easyRR(m,n)

%% Create the L in the LU factorization. This matrix encodes the elementary
%% row operations needed to get A to echelon form.

L = randi([-10, 10], [m,m]);

% Replace diagonal elements with 1's:
for i=1:m
L(i,i) = 1;
end

% Zero out all entries above the diagonal:
L = tril(L);

%% Now create the U in the LU factorization, using smaller integers so that
%% the back substitution phase isn't too bad.

% This creates an mxn random integer matrix and zeros out all entries below
% the diagonal.
U = triu(randi([-5,5], [m,n]));

%% The easy-to-reduce matrix is the product of L and U.
A = L*U;



Here’s a screenshot:

The fractions involved here have denominators no larger than 25, which is way more doable for students than what I had been having them work with (sorry, guys).

And, if you happen to have the Symbolic Toolbox for MATLAB, you can add the line latex(sym(A)) to the end and the function will spit out the $\LaTeX$ code for that matrix, for easy copy/paste into the exam.

Anyway, I thought this was useful and so I’m giving it away!

Filed under LaTeX, Linear algebra, Math, MATLAB, Teaching

## How it all works in the MATLAB course

Image via Wikipedia

I’ve put up a few posts and several comments about the inverted classroom this week. A lot of that is because the second iteration of the MATLAB course is coming around at the beginning of February (we have a January term, so spring classes start a little late for us) and that’s done entirely in “inverted” mode. There were a lot of comments in this post about the inverted classroom, and based on some of those comments as well as some questions I got at my Joint Meetings talk on this subject, I thought I’d say a little about how, exactly, this instructional method gets implemented on a day-to-day basis in the MATLAB course.

The MATLAB course meets once a week (Wednesdays) for 75 minutes. This sets up a once-per-week workflow that repeats itself every Wednesday. Here’s how it will go:

1. On Thursday evenings, students are assigned one or more video lectures to watch in advance of the next week’s meeting on Wednesday. The videos are posted to the internet, so students can pause, rewind, and stop/restart at will, and most videos will be posted to YouTube for easy viewing on a mobile device such as a smartphone. Along with the videos will be given a list of actions students will be expected to perform with MATLAB before coming to class and a series of Guided Practice exercises to work through what they see in the videos. Students are expected to start early so that they can ask questions throughout the week as they come up.
2. The Guided Practice exercises are turned in on Wednesday morning prior to the class meeting so that I can read through them quickly for any widespread issues that arise. It’s a light implementation of just-in-time teaching. (By the way: Read the page at that link. That describes something close to the inverted classroom idea.)
3. In the first few minutes of the class meeting on Wednesdays, students take a short quiz designed to assess their completion of the tasks from the Guided Practice. Quizzes are open-MATLAB so they can check their work as they work. The quizzes are taken electronically so that grading is instantaneous (or near-instantaneous, anyway). The quizzes provide individual accountability on the basic competencies for the week.
4. After the quiz, a brief question-and-answer session takes place in which I discuss any issues arising from the Guided Practice or Quiz, and students can ask brief questions as well. However: There is no lecture and no “re-teaching” during this time. The focus is on clearing up issues from student work. If a student asks, “Can you go over how to do ____?” and the blank contains some general topic (like “plotting” or “if-then statements”) I will generally say “no” because the student has had ample opportunities to ask those kinds of questions during the week. Well, rather than just saying “no” I will try to get at what the student’s real question is. “Can you go over plotting?” usually hides a small, good, targeted question on a single specific topic that can be cleared up in no time. Those questions are fine.
5. The remaining time in class (about 60 minutes) is spent by students working in teams on authentic, problem-centered activities highlighting important ideas to be addressed in the course that week.
6. Students turn in a partial draft of their in-class activity at the end of the Wednesday meeting and then turn in a completed draft by 11:00 PM on the following day (Thursday). At this point the cycle repeats itself with a new list of videos, learning objectives, and Guided Practice exercises.

This cycle is a bit different than what I started with last year, when I first ran the course. The in-class problem sets were supposed to be completely done by the end of class; that turned out to be ridiculously unrealistic. I let students turn in the finished products after 48 hours, which was nice for them except that some teams wouldn’t get far on anything during the meetings, intending to do it all outside of class, which then led to having to finish the week’s lab on top of the next week’s out-of-class assignments. To keep traffic moving better, I’m insisting this year that students turn in a reasonably complete rough draft by the end of the hour (I’ll have a rubric for that later) and then the whole thing before Thursday is done; at which point they should have no leftover work competing with the outside viewing and practice.

Also, the names have changed. Last year it was “homework”; this year it’s “guided practice” to emphasize that the exercises are intended to provide, well, guidance and practice. Last year it was “labs”; this year it’s “in-class problem sets” because there are significant differences between these problem sets and actual labs that science classes use. Last year it was videos; this year it’s “lectures”, to emphasize that it’s not the case that there is no lecturing taking place. Words mean a lot.

I estimate that students will spend no more than 1 hour  a week watching video lectures; between 1 and 2 hours a week working through the guided practice; and maybe 1 hour a week in a combination of reviewing old work, coming to office hours, reading and contributing to online discussions, and other class-related tasks. That’s about 3 hours a week, which is pretty typical for a 1-credit class that meets 75 minutes a week, and it’s even better when you consider the inverted model specifically relegates the least cognitively complex tasks to outside of class.

The number-one student complaint I heard last year was that, far from occupying 3 or fewer hours a week of time, it was taking 6, 8, 10 or even more hours a week to complete the out-of-class tasks. That concerns me greatly. Every now and then in any class you’ll have to spend more than the usual “3 hours of work for each hour in class” conversion formula. But if students are spending more than that much on a regular basis, I would want to see what they are doing. There’s no way what I am assigning will take that long, no matter what your background competency or comfort level or what-have-you are, unless there is some serious inefficiency happening in how the work is being done. That concern is manageable if addressed.

Filed under Education, Inverted classroom, MATLAB, Teaching

## The inverted classroom and student self-image

Image via Wikipedia

This week I’ve been immersed in the inverted classroom idea. First, I gave this talk about an inverted linear algebra classroom at the Joint Meetings in New Orleans and had a number of really good conversations afterwards about it. Then, this really nice writeup of an interview I gave for MIT News came out, highlighting the relationship between my MATLAB course and the MIT OpenCourseware Project. And this week, I’ve been planning out the second iteration of that MATLAB course that’s starting in a few weeks, hopefully with the benefit of a year’s worth of experience and reflection on using the inverted classroom to teach technical computing to novices.

One thing that I didn’t talk much about at the Joint Meetings or in the MIT interview was perhaps the most prominent thing about using the inverted classroom model on a day-to-day basis: how students react to it and change as a result of it. I was actually quite surprised that nobody at my Joint Meetings talk asked me a question about this, because honestly, the inverted classroom sounds great on paper, but when you start to imagine the average college student walking in on the first day of class and having this method of instruction described to him, it becomes clear that a significant amount of work is going to have to be done in order to get students — who are already resistant to any change from their accustomed modes of instruction — on board with the plan.

Students do tend to resist the inverted classroom at first. Some forms of resistance are more benign than others. On the benign end of the spectrum there are students with little experience with the course material or its prerequisites who get bogged down on the basic podcast viewing (which takes the place of in-class lectures in this model) or the accompanying guided practice, and instead of actively seeking a resolution to their question will wait for the instructor to clear it up — in class. On the other end is the student who simply doesn’t believe I’m serious when I say there won’t be any lecturing, who then doesn’t do the work, assuming I’ll bail him out somehow — in class. But in the inverted model, students are held responsible for acquiring basic competencies before class so that the hard stuff — what we refer to as assimilation — is the primary focus of the class time.

I break this distinction down for students, but not everybody buys into it. Those who don’t will have to undergo a learning process that usually looks like shock — shock that I won’t reteach them the material they were supposed to have viewed and worked on, while the lab assignment based on that material is going on. This can get very ugly in ways I probably don’t need to describe. Let’s just say that you had better not use the inverted classroom model if you aren’t prepared to put out a constant P.R. effort to convince students of the positive benefits of the model and constantly to assuage student concerns.

I’ve often wondered why students sometimes react so negatively to the inverted classroom model. I’ve come to believe it’s the result of a invasive, false belief that can arise in students about their ability to learn things independently of others — namely, that they simply cannot do so. I have had students tell me this to my face — “I can’t learn [insert topic] unless you lecture to me about it in class first.” Clearly this is not true. Toddlers learn their native language without formal instruction, just by assimilating (there’s that word again) the language going on naturally in their background. We all learn things every day without sitting in a classroom; we may seek out training data first through printed instructions, worked-out examples, YouTube videos, etc., but it’s almost never in a classroom setting. Learning new things on our own initiative and without formal instruction in a classroom setting is as natural to humans as breathing. Indeed you could say that it’s the capacity to learn in this way that makes us human. But somehow many students think otherwise.

Where does this belief come from? I think that it comes from its own instance of assimilation, namely the assimilation of a culture of programmed classroom instruction that takes place from roughly the first grade through the twelfth grade in this country. Students have so few experiences where they pursue and construct their own knowledge that they simply come to believe that they are incapable of doing so. And this belief is propagated most rapidly in mathematics. I’ve been reading in Seymour Papert‘s book Mindstorms: Children, Computers, and Powerful Ideas, and this quote hits this issue right on the head:

Difficulty with school math is often the first step of an invasive intellectual process that leads us all to define ourselves as bundles of aptitudes and ineptitudes, as being “mathematical” or “not mathematical”, “artistic” or “not artistic”, “musical” or “not musical”, “profound” or “superficial”, “intelligent” or “dumb”. Thus deficiency becomes identity and learning is transformed from the early child’s free exploration of the world to a chore beset by insecurities and self-imposed restrictions.

That last sentence (emphasis added) sums it up, doesn’t it? Deficiency becomes identity. Eventually, if a student is robbed of experiences of self-motivated learning, the student eventually adopts a self-image in which she is incapable of self-motivated learning. It is a false self-image that is ultimately dehumanizing.

Which is why I put such stock in the inverted classroom model. I think this method of teaching, along with other learner-centered modes of instruction like problem-based learning, is on the front lines in reversing students’ negative ways of thinking about how they learn. Students may (will?) chafe at the inversion at first. But in the MATLAB course at least, something really cool happened at the end of the semester. I made up a slideshow for students called “Five myths about how you think you learn that CMP 150 has busted”. Among the myths were “I can’t learn unless a professor lectures to me” and “I can’t learn on my own initiative”, and I gave concrete examples of work that the students had done in the class that contradicted these messages. In the end I showed them that through this inverted classroom process they had taken majors strides toward being confident, independent, skill learners and problem-solvers rather than just people who can play the classroom game well. And even the most skeptical students were nodding in agreement. And I think that makes it all worthwhile for everyone.