T.P.R.S. Results

Some Notes on Level 1 Results (Fall 2017)

Meaningful discussion of language teaching is kind of like language learning itself: you need a thing to discuss. Language acquisition starts with stuff: language to be processed.  Language teaching discussion starts with student results.  This semester I have two English 9s, Social Justice 12 and intro Spanish, so I have too little time to “curate” results regularly.  Feb 2017 I have both more 1s and time so I will publish more results then.

Bott…ehhhmm, as they say in Ireland, here are two interesting recent story writes.  30 min, no notes or dictionaries, paper-and-pen only.  These students have had about 50 hrs of input.  Instruction is almost pure C.I.: no metacognition, grammar practice, talking practice, writing practice, K/W/A activities, peer group work, bla bla.  Just a lot of input.

This is the fourth story they have written.  Word target was 400.  Most kids are below average this year.  This is possibly because I am doing mostly Slavic-style “untargeted” input, where we have much less repetition of specific vocabulary targets in the short term.

First, here is Angela’s story.  Ang is Filipina and still has a bit of an accent.  She has been in Canada for two years, and reads a lot.  She is also a Duolingo user.  She tells me she is putting in about four hours/week.  Check it:

img_0111

There is a bunch of stuff I havn’t used in there.  She is generally getting it right in terms of meaning but there are still grammatical holes.  I’m including this because, yes, Duolingo– which frankly bores the crap out of me– does deliver decent C.I.  Krashen noted in a paper that Duolingo works about as well as traditional college Spanish instruction, if the user can manage to stay interested, which most do not.  Angela says she likes the new story feature on Duolingo.

Next, we have Nisha.  She is Punjabi, and has had zero previous Spanish. Lotsa words, a good story, but some obvious issues (eg noun gender).  What is tough for the Punjabi kids (in writing) is that adjective and noun endings in Spanish– -a indicates feminine– indicate masculine in Punjabi (e.g. bacha = boy, bachi = girl, bache = kids) so we get confusion. Also in Punjabi (as nearly as I can tell) there is a lot less verb conjugation (or maybe I just can’t hear it when I ask them about it). Nisha is not a Duolingo user.  Her only Spanish is at school.

But anyway, props to Nisha for doing so well after only 50 hours.

 

Advertisements

To plan, or not to plan?

How do we know what a student can really do with an additional language, in, say, writing?  Suppose we wanted to be deadly boring for our students.  Hmmm, how about, we make them write about their daily routine, that should put both students and teacher nicely to sleep.

If we are a traditional teacher, we want to know what they have learned: what they can consciously do with language.  We could give them a writing prompt–describe your daily routine– time to plan/look at vocab/check out Google translate/”reflect on our learning”/plan out our metacognitive strategies/whatever, then give them a bunch of time to write, and then mark it.

If we are C.I. teachers, we want to see what students have acquired— what they can do without any planning, immediately. So we give them the same topic, zero prep time, a bit of time to write, then mark.

A teacher recently shared two writing samples from Spanish 1.  One sample is from a CI-taught kid in his class, the other from a kid taught by his grammarian colleague.

EXAMPLE A.  This is from the textbook/grammar teacher’s top student

  • the teacher spent three weeks doing a “unit” on reflexive verbs
  • the teacher’s students had just finished their “reflexive verb unit”
  • they had time to “prepare” their writing
  • they had 20 min. to write
  • about 120 words
  • quality: excellent, with minor errors

GT refl par.

EXAMPLE B. from one of the C.I. teacher’s middle-of-the-road students

  • the C.I. teacher spent about one week doing a story involving this vocab
  • the story using this vocabulary was asked one month prior to this being written
  • zero planning time
  • 10 min. writing time
  • 104 words
  • Quality: excellent, with very minor errors

CI reflexive write
What I noticed:

  • The CI student’s output is twice the speed of the traditionally-taught kid
  • the CI kid does as well as the grammar kid with no planning time and half the writing time
  • The CI kid has “been away” from the vocab for three weeks and uses it as well as the kid who just finished a “unit” on it
  • The CI kid spent one week with this vocab while the grammar kid spent three weeks

Anyway…faster writing with zero prep time and less instructional time: C.I. is looking a lot better than the text.

Stories 1 Textbook 0

We are three weeks into Spanish 1. I have 30 students: 29 total beginners, and one kid, Marc, who has taken Spanish 1 and 2 at another school with a traditional teacher (where he got a high B both years). Marc is a solid student who pays attention in class. 

Another beginner, Mariam, arrived one week late because of holidays, and she has never taken Spanish. 

Here are their first story writes. They had 20 min (no notes or dictionaries) to rewrite our story with new names, places and details. 

Who would you expect to do better– the kid who’s taken Spanish for two years, or the kid who’s taken it for 11 days?  Check it: 

This is Marc’s story. He’s taken two years of Spanish

Now, here is Mariam’s. She has had eleven days of Spanish. 

Now let us be clear: not all the 1s wrote this much or well. Some wrote 30 words (goal is 100 for the story) with awful grammar. I’ll post stats when I have everything entered.  But it is interesting that a beginner can do this well after 11 days. 

Level Two Spanish Results: First Picture Description

Spanish 2 has been running for three weeks.  We have read a couple of easy novels, and have done one story cycle: el restaurante, which included reading, storyasking, Movietalk (Mr Bean videos RULE!) and Picturetalk.

Today’s first writing assessment: describe this photo.

  
Here are four writing samples.  The kids had 5 minutes, no notes or dictionaries.

First, Janelle, the top student. Amazing how she mixes past and present appropriately.

 

Next, we can compare two Level Two students who are not top performers. Hassan went to another school last year, where he had traditional grammar-and-textbook-based teaching.  This is garbled and nonsensical.  Hasan has some learning challenges and struggles in other classes.

Next, Abbas, who like Hassan has some challenges and struggles with school.  This is not awesome…but we understand, and he has built in a bit of a backstory.  Abbas had only TPRS in Level One.

Based on results, C.I. clearly helps the challenged kids more than does a traditional text.

   
Finally, Amneet.  This is not very good writing.  What is interesting here is that Amneet is probably the best speaker in the class.  I have found this kind of thing typical:  while most of the kids can undertsand everything (the scores for reading and listening quizzes are all between 80-100%), production skills vary dramatically from kid to kid and medium to medium.  Writers are not necessarily speakers, and vice-versa.

Amneet arrived late in Spanish 2, has missed a bunch of classes, but did well last year (over 80%) so I am expecting her written output will pick up.

 

T.P.R.S. or…whatever? More Evidence for the Effectiveness of Comprehensible Input

I have documented TPRS kids’ success in the past (see this) but today we are in for a different kind of treat: we are going to look first at what top students can do with traditional methods (forced output, grammar practice, word lists, memorisation, etc) and then with comprehensible input.

Today, totally by accident, I found my old Spanish 2 binder from when I was a traditional methods teacher using the ¡Juntos Dos! program.  One of my old Level 2 final projects was to create a children’s book.  The kids generally used themselves as characters.   This story was written by Nuvjit S.

Nuvjit was a keen language learner in high school, and has since then acquired Japanese. She was the top student in Spanish in her year.   For this project, the kids got editing help from me, they could use dictionaries, etc. Here is Nuvjit’s children’s book. This was the best project of its kind that I got that year.  So take a look at what I was able to get done with traditional methods.  This is second year Spanish.


  
  
  

Now, let’s take a look at what a kid taught with only comprehensible input methods can do.

This is Neha D.’s story. She is one of the top five or six students from this year.  This was done today, in 50 minutes, with no notes or dictionary.  First draft.  No editing.  Neha is Nuvjit, ten years later, with  Spanish teaching based on what we know the brain needs to acquire language: tons of compelling comprehensible input, in aural and written form.

Neha has never seen a grammar worksheet, a verb conjugation table or an explanation of how the pretérito  differs from the imperfecto.  She has never had her work corrected, and she has never “reflected on her learning,” or fiddled with a portfolio.  She probably can’t even tell you what a verb is and she has never heard the word “conjugate.”

This is first year Spanish.


  
  
  
  
  

So…it’s pretty obvious which method works better…for me, and for these students.  Your mileage may vary.

Now let me also be clear here:  I was a pretty bad communicative teacher.  I didn’t get good results (well, I couldn’t get my kids to have awesome results).  There were– and are– loads of people better than me in that tradition.  So I am pretty sure that any number of people could have gotten better results.  I’m also at best a slowly-improving T.P.R.S. practitioner, and there are loads of people who get better results than me.

This however is also my post’s silver lining:  if I was a bad “communicative” teacher and I’m a marginal (but improving) T.P.R.S. practitioner, my kids are getting more out of the class with T.P.R.S.

At bottom, I don’t attribute Neha’s success to me being smart or a good teacher, or to how funny I am– err, try to be– etc.  Neha and her classmates’ success ultimately stems from T.P.R.S., Movietalk, etc, allowing us to remain comprehensibly in the target language for huuuuuge amounts of time.

Spanish Results: Adriana Ramírez’s Level 1 Spanish #showumine

My colleague Adriana Ramírez (@veganadri) has published some beginner results.  Here are three of her kids’ writing samples from early October 2015.  This is semi-sheltered grammar (no past tense yet) from classic TPRS: storyasking and reading, with some MovieTalk. They had 30 mintes to write these.  Also note that these kids

  • do not “practice” writing
  • do not “practice” or “study” grammar
  • are not forced into any kind of “communicative output” or “communicative pair” activities
  • do not use notes or dictionaries when doing writing assessments.

These are very good results.  Check it!

Ramirez 2015 Sept 1 Ramirez 2015 Sept 2

What results does T.P.R.S. get? Amazing ones…and here’s the proof.

Do T.P.R.S., Movietalk, Look and Discuss, and other comprehensible input methods work?

Yes.  And not only do they work, they work much better than anything else out there.

What began as a friendly Twitter challenge– beat my beginner kids’ output using old-school methods or textbook, and I’ll take you crafty beer-drinking, hashtag #showumine– now has a bunch of T.P.R.S. teachers showing what their kids can do.

The rules are simple: show what your kids can do in writing (or speech) without dictionaries, rehearsal, Internet, notes or advance warning, with limited time and no preparation.  In other words, show what’s wired in, i.e. acquired, and not “learned.”

The proof, as they say, is in the pudding.  So, without any further ado, here are results.  This entry, constantly updated, provides links to various teachers’ kids’ written and oral output.

We need more French samples, and all other languages are welcome.  Know something that needs adding?  Lemme know and I’ll add it.

SPANISH  

Eric Herman‘s oral assessment of beginners is here.  Eric notes that “these are unfamiliar tasks and functions, but I challenge non-c.i. teachers to give the same test and get the same results.”

Chris Stolz has Spring semester 2015 beginner writing samples from 7 weeks in8 weeks in, stories from 8 weeks in and 11 weeks in.  This post compares two top students– one taught with legacy methods, one with C.I.

Grant Boulanger has 8th graders doing oral output here.  Here is one of Grant’s beginners– using three verb tenses and other so-called “advanced” grammar– to retell a story.  Grant also showcases his 8th graders (Level 1 Spanish) doing an impromptu story retell here.

Mike Coxon‘s kids are recorded here.

Mike Peto has some writing samples here.

Crsytal Barragan here shows first-day-back-to-school writing samples. Here, the student who was taught with T.P.R.S. writes rings around the student from the legacy-methods class.

Adriana Ramírez’ Level 1 Spanish results are here.

Jim Tripp has some Level 2 examples (with discussion) here.

Darcy Pippins’ AP results are here.  

LATIN

Magister Lance Piantaggini shows what beginner kids can do in Latin.

CHINESE

Terry Waltz‘s site has writing samples plus oral stuff.  Her kids can throw down with charactersCheck it.

Hai Yun Lu has a level 1 Mandarin student storytelling here.

GERMAN

Brigitte Kahn‘s kids do 5-min speedwrites here.

FRENCH

Bess Hayles shows first day back from vacation writing samples here.

A traditionalist and Kim A. (comprehensible input) here have writing samples.  The reader can decide if the Level 2 (traditional) or Level 1 (C.I.) Kim A vs Traditojnalist exemplars.

Beginner results after 11 weeks: 5-min Speedwrites. #showumine

Here are my beginner speedwrite  results after 11 weeks of T.P.R.S.  No notes, dictionaries or Internet.  Their task was in 5 min describe yourself. This is their 5th 5-min write so their curving bonus is now down to 20. Their score will be wordcount/100 plus grammar score /3 (x33) averaged together.  The small #is grammar and the big # is wordcount.  If a kid got 52 words, their wordcount mark is 72.

Note: this is fully unsheltered grammar, and the kids are in a split 1 and 2 class.

Roshini:  
She’s got some past/present tense confusion. Also a few other issues. This is actually not as good as her last one from three weeks ago.mmark will be about 70%. 

Next, Marya:

This is basically perfect. Nice work. Mark will be about 89%

Minali:

She has the plural son and gustan problem but otherwise this is really good. Mark will be between 85 and 90.

Manisha is already at 100 basically perfect words– nice. Mark will be 100%

Manvir (gr 10) also writes nicely but much more slowly than Manisha (gr 12). She makes a few mistakes but nothing crazy. Mark around 90%


Finally, Eric.  This kid has an IEP and started class two weeks late.  He has spelling problems etc etc (in English), has some kind of “processing problem,” is supposed to write using a computer (but declined one today), is supposed to get extra time, and was dutifully failed out of French in gr 8.

Now, this is not awesome…for a kid with no challenges. For a kid with Eric’s challenges, it’s frikkin’ amazing.  Three weeks ago he wrote 6 words. His oral language is also booting up and he can now say sentences.  This will get him about 60%

So. I’ll mark stories in a day or two.  The beginners– who are getting fully unsheltered grammar from Day 1– are doing well.
The challenge stands: beat my results using grammar teaching, and an evening of drinking is on me. Ladies and gentlemen, start your engines…and if you want to share results,  use the Twitter hashtage #showumine

Whaddaya got, grammarians?

My Twitter challenge from a month ago stands: if you can use grammar and output-focused methods, and get better results than me with true beginners, an evening of beer (or wine) tasting is on me.

(Before we discuss results, let’s discuss what really matters: 🍻…Vancouver now has a bunch of crafty breweries. My favorite is Brassneck, who do not bottle, and who have only two beers (and I.P.A. and a northwest pale ale– this very close to Sierra Nevada Pale Ale, the gold standard for this style) which are always on tap. The other eight or so rotating taps are brewmaster Conrad Gmoser “unleashed” and you never see the same beers twice.  You may find cherry sours, Belgian Trippels, saisons, pilseners, Gmoser’s legendary 11% espresso stout… But Brassneck is not alone: there are a bunch of other great places too and though we are neither Denver nor Portland there is good beer to be had.  My colleague Leanda read this and said “what about 🍷?” so fair enough a wine-guzz–, er I mean, tasting evening is also ip for grabs)

ANYWAY…so far nobody has stepped up for their free beer evening.  Hello, grammarians.  Whaddaya got? “Communicative” teachers– you out there?  American Adminz who think talking, self-reflection, writing, grammar practice and “essential questions” matter– you feelin’ me?

Now allow me to explain the somewhat sarcastic tone here.  There are a bunch of teachers in the U.S. whose idio– err I mean, Administratorz, sorry, are totally unaware of how language acquisition works. These Adminz watch competent c.i. practitioners and then say stupid things like

  • “I want to see more communicative pair activities”
  • “the students aren’t talking enough”
  • “there is too much teacher talk”
  • “TPRS does not teach grammar”
  • “I do not see essential questions on the board”
  • “I do not see students reflecting on their learning”
  • “While stories I am sure are fun, the kids will also need grammar practice.”

The only thing worse than an admin who knows nothing about language acquisition is an admin who points to bad practices and wants to see more of them.  Uninformed Adminz are often two-year-olds: they want to see some shiny, commonsensical obvious “stuff” being “done” by kids “right now” as “evidence” of ________.  Uninformed Adminz love seeing communicative pair activities– “look! The kids are talking!”– and they looooove things with edubabbble– “look! E-learning! Portfolios! Self-assessment! Rigor!”– and they do not like classrooms with kids who appear to be, well, thinking and absorbing.

So these idi– err I mean, educational leaders, make life hard for c.i. practitioners, and point at bad practices for what c.i. people “should” be doing (and generally do not look at the results of c.i. instruction). Anyway, this is a challenge.  My kids do NONE of the following

  • Self assessment
  • Grammar worksheets
  • Speaking Spanish (unless they want to)
  • Communicative pair activities
  • Internet/dictionary word searches
  • Revision of writing
  • Goal setting
  • Portfolios
  • anything online

Challenge: use all the things I don’t, and get better results than me.

Here’s what my beginner kids are doing at 8 weeks of Spanish.  These are examples of story writes (a.k.a. relaxed writes). They have 40 minutes to write a story which is a variation on the most recent story we asked (and read extended versions of) in class.  They are not allowed to use notes, dictionaries, Internet, etc.  What you see here is from memory.

Manisha missed the first week of class and misses about a day a week cos of stress issues.  The grammar mistakes are absolutely minor. Here is page 1. 

Roshini also did amazingly well: 324 words.  Note the French error! Ha! She mixes up dio and dijo.

Manvir also did well. 282 words. She has a few errors– minor spelling and adj agreement. I’ll post her whole thing.

Here’s Manvir’s 2nd page

and here is her conclusion

Standard disclaimer: I am neither smart, hardworking nor good at languages. If I can get these results, anyone can get these results!

And if you think these are good…you should see what Adriana Ramírez’ kids can do.  Ella es mi profesora diosa. 

Results: Beginner Speedwrites Week 8 (Spring 2015)

Today was our fourth story test.  The class had a speedwrite assignment: in five minutes, describe this picture in as many words as possible. Note: we are unsheltered (i.e. we use all necessary grammar and do not restrict ourselves to any one verb tense, mood, etc).  Also we are a split class: beginners, 2s and three native speakers.

This picture works well: we just did the “Cambio de Pelo” story and the kids know words for hair, eyes, colours, dog, cat, guitar.

 

So here are what the beginners did.

First, Marya.  Note spelling mistake– “guitare”– this kid had French last year and it shows.  Also note tense & person confusion.  I have started doing ¿qué hiciste anoche?  PQA at the start of every class and the beginners are mixing these up.  My theory is that if it’s not also in structured writing (i.e. story form) they mix it up more.

Manvir has some problems with verbs. She is missing hay and es which may have to do with not enough present-tense PQA and/or reading.  Also adjective agreement errors.  The thing is entirely comprehensible, but the errors at times make you go huh?

  Minali’s was interesting. It hit me that the beginners have problems with the definite article!  I had assumed, my God, this goes without saying…but…most of our kids being L1 Punjabi or Hindi (which do not have articles) perhaps I can’t assume that English crossover grammar will kick in.  Again here hay and es and está are missing.  Also note jugar guitar a classic French/English cognate mistake, one that comes from the conscious mind.

Manisha’s is basically perfect but she did not write in 3rd person.

Roshini’s is also perfect basically and very high wordcount.  But she did not write in present– I am wondering if these guys actually can consciously think about verb tenses. Also note classic on-the-way error: Saturn gustaba instead of A Saturn le gustaba.  She hasn’t added the a and le because these are of low importance: the beginner language brain is focusing on gustaba, which has all the essential info. Interesting also how she used plural adjective form azules for pelo.

Wordcounts are lower than last time. This is (I think) because when we do story-related PQA, all of the answers are in first person, so it’s easy to describe yourself.  We simply do a whole lot less talk in 3rd person present.

What did I learn? 

  • Do MUCH more present tense PQA (or ask actors about each other)
  • do pop-ups for everything including articles!
  • put more present-tense commentary in written versions of unsheltered stories, OR do way more Picturetalk  (look and discuss) in present tense.
  • the kids don’t make mistakes unless I don’t provide enough input