Archive for the ‘Academic Performance Index’ Category

Educational Earthquakes

Wednesday, October 27th, 2010

Last week we had another all-state earthquake drill.  Even Gavin Newsom, mayor of San Francisco, was under the desk at a school in the East Bay.  California is not kidding.  No hurricanes, no tornadoes, but schools are prepared for the unknown earthquake.

My 4th graders weren’t even born when the last major quake hit the bay area, October 21, 1989, but I remember it well.  I was waiting on my bike at the corner of the major intersection, on my way home from math tutoring.  I put my feet on the ground as the road started rumbling.  The guy next to me got out of his car, saying ‘That was a big one’ as an old lady fell to the ground.  After all the shocks stopped I was riding down the hill street, and another girl helped me stomp out a small fire that was burning in the dry grass.

This year’s earthquakes don’t heave the ground; instead financial choices and school choices are thrown around.  Especially with the elections coming up, day after day I read about the latest reform plan for some school, dependent on fiscal policy in the state.

In Monday’s New York Times, the article was about the New Jersey governor doing all he can to dump the teachers union.  Free marketers hate the unions, and I’m not sure how long this discussion about free market competition improving the quality of schools will continue.  What will happen in the meantime to low-performing schools whose students can’t wait for free markets to come up with, revise, and implement reform to make a unique, perfect school?  Some say good competitive schools are already providing a choice, but how many are actually receiving API of 900 like my traditional public school?  Right now, the score is the guide.

I know our school does well because the majority of parents are involved in the classroom and raise funds.  That’s how all the teachers, in spite of a severe budget crisis in the school district, managed to be retained for this year.

In my master’s classes I’ve reviewed the best language practices to show results.  For example, students need the skills to decode new vocabulary, infer, ask questions to analyze characters, predict.

Have you heard of ’silly bands’– thin rubber bands made in different shapes like a rabbit, a genie, a high-heel?  I used them in my master’s class to show how one uses those skills to figure out anything, even the form of a silly band.  I’ll tell you, those silly bands are one of the earthquakes in our school.  Right now they are causing an uproar in the lower grades and in my class, if I see one out, it goes in my drawer.

Still, I have students that read so well that during the language arts bloc each student has chosen a book and conferences with me at which time I give a mini-lesson about a skill not yet mastered.  Very different from other teachers in my master’s class who use an all class model to teach language arts.

At staff development at our school yesterday afternoon, another earthquake shook our vision of  teaching math.  Students are being asked to look at word problems and decode new vocabulary, infer, ask questions to analyze the operation, predict.  See what I mean about skills that will help a student do anything?

As long as the students learn to read for meaning and like books, including math books.  That is the goal for life, correct?

How Many Americans Think Public Schools Are ‘In Crisis’?

Wednesday, September 22nd, 2010

We received our Academic Performance Index (API) results Monday, September 13, and pumped our fists since our school, middle-of-the-road as far as our district goes, reached a score of 908.

Almost any school reaching 800 or above is considered fine and dandy, but according to No Child Left Behind (NCLB) benchmarks a couple of the schools in my district, though showing an API of 900 or higher, are considered ‘program improvement’ schools.  That’s right. A disaggregated group did not reach the Annual Yearly Progress (AYP) state goal of 56.8% in English/Language arts, 58% in Math.

The glitches in federal guidelines and state benchmarks, long warned about, are beginning to show up.  Of course, the school district immediately began to examine scores of the students who stayed at ‘basic’ or below, i.e. not good enough, and as we already knew, it was the special services students who didn’t make the grade.  Those small number of students are spread through the grades and so there aren’t enough to label my school ‘program improvement,’ especially since the younger students managed to make a good enough score.

Loud wailing about the weaknesses of the NCLB inspired exams and benchmarks set in 2002 continue all over the country.

But 67% of Americans think the public schools are ‘in crisis’?  As usual, statistics and polls must be read with caution–including Time magazine who paid for the poll.  What does the question mean?  No one in my school district, parents or educators, would say we’re in crisis as far as learning success.  Budget yes, learning, no.

I read, however, in The San Francisco Chronicle an opinion article that STAR tests aren’t secure, that is, old test examples can be modeled and even correct answers handed out, though I don’t know what evidence indicates that illegal activity.  Not at my school.

In my Masters classes, however, we have discussed tests like California’s STAR testing which will have to change now that the legislature and state Department of Education have agreed to Common Core Standards.

About time!  Special services students as well as high-achieving students might do better if the way to account for successful learning changed.  Right now a multiple-choice exam once a year is the easiest to score, disaggregate, and analyze.  Perhaps the experts should look at some other ways to find out if students, from high-achievers, special service students and all the diverse groups in between, are learning to read and do math well enough to think through to the meaning.

In an article by Susan Engel, director of the teaching program at Williams College, I was reminded of using and analyzing reading samples which is the reason I want to get funds for iPod-Touch tools.  In fact, that type of reading sample has been used in many schools to analyze reading and English Language Development.

Ms. Engel also suggests that we don’t need to obsessively follow each and every student every year to see how a particular school is doing.  Using that instrument to punish teachers is not going to improve a school.  I know this blog has enumerated a number of models that would keep public schools strong without being dependent on tests only.

Right now, of course, I’m just happy that this year my students are willing to learn without having to coax them every step of the way.

*For more see Susan Engel, The New York Times “Scientifically Tested Tests” September 20, 2010.

*See Time Magazine’s print article abridgement of the poll done by ABT SRBI, August 17-19, 2010.

Who is Being Tested?

Wednesday, September 15th, 2010

The single word ‘test’ sets off certainty and abuse.  Toss in the word ‘evaluation,’ especially ‘teacher evaluation’ and the argument becomes furious.

analyzing 8-week tests

analyzing 8-week tests

For example, based on the once a year test, California schools received their Annual Yearly Progress scores mid-August and on September 13 Academic Performance Index scores, statistically calculated mainly from the test assessment.  Some schools were grinning and some were down so far it looked like up.

At the same time California legislative bill SB1381 is ready to be signed by the governor which over time will change the test results for schools because Kindergarten students must be 5 years old by September 1 rather than December 1 (with possible waivers, of course).  This change introduced over three years is guaranteed to revise the test scores for even the most low-performing third graders in the next few years.  The older the student, the more likely he or she is to understand how to perform.

Why the fury?

Read any newspaper, education magazine, or online journal to read a long list of reasons one test is an unreliable measure of a student or teacher.  Here are three often named: scores can bounce for a student from one year to the next; short tests every 8 weeks or so assesses what students are learning and provides opportunity to revise teaching; the tests used for AYP and API do not “measure the social skills that are crucial to early learning.” See Daniel Leonhardt’s article “Stand and Deliver” in The New York Times Magazine, September 5, 2010.

The Congressional Edujobs bill with money being sent to states will allay some anxiety during this year as more teachers are not worried about their positions and thus not so vehement about tests-whichever exams are used.

In addition, Race to the Top guidelines and funds for states is a good thing overall.  At least a set of proposals has been generated and states are now addressing the education problems that in the past have been enumerated until one’s eyes glaze over.  No district is asked to choose one over another way to save low-performing public schools.  The models that eventually show the most improvement in student achievement will likely combine several of the many models available.

One sure thing, however, is the chance to revise each state’s testing program.  Keeping in mind the long list of problems with the current tests, it seems valuable to devise a system for the state that will assess the achievement success of students and provide support for learners from the analysis of reliable assessments.  It may be that lots of short assessments (like old-fashioned spelling tests or brief math operations weekly assessments) will turn out to be the most useful.

Anxiety is using one exam a year to label students as well as use that score to evaluate teachers.  A few teachers unhelpful to students may be identified.  However, if the school does not receive the resources to improve, what good is it to castigate a particular school, its teachers and students?

Here is where small grants like those saluted in the current issue of the California Teachers Association magazine California Educator are important as well as financially well-liked in a state with a continuing budget crisis.  Teachers can develop a program that suits their own school’s difficulties, then apply and receive a grant to implement the plan.  Of course, concerns arise like does the small plan allow replication, does it become an institution for the school, does the entire school support the plan.

The struggle is faced in California as well as states all over the country: teachers must be accountable, the latest term for being responsible in elementary school for the success of 20-30 students a year.

A system of testing, if it doesn’t assess what teachers are being asked to do, is going to be seen as an obstacle, something to defend against, so that it takes up a lot of thinking time that one would hope was being used for instruction.

What It Takes

Wednesday, November 25th, 2009

With hoopla about grants for Race To the Top, in an effort to turn around high schools in dire need of help; gung-ho proposals about grants for elementary schools; and constant brouhaha over teacher’s union opposition to change, it’s just plain great to see an article about a school that has actually succeeded.

Not only succeeded, it’s in a low-income pocket of my neighborhood on the San Francisco peninsula, known for high-flying salaries and mega-homes and students who expect to go to Stanford, UC Berkeley, or an Ivy League university.  Leroy Anderson Elementary reached the goal of every elementary school with “at risk” students-an Academic Performance Index (API) 800+.

Reading the article “Learning to Teach to Bridge the Achievement Gap” by Phil Yost, New York Times, November 20, 2009, the qualities of a successful school filled the page.  The article covered highly-qualified teachers willing to pursue the achievement goal, dedicated administrators, curriculum changes shown to improve the capabilities of low-performing students, known successful teaching techniques, regular consistent assessment and analysis, and parent inclusion.

Why can’t all elementary schools with low test scores do what Anderson Elementary did, even in California, the land of no money for schools?

Certain requirements are only inferred in Yost’s article which must be present or developed in the effort to close the achievement gap in a school.

First and foremost, a cadre of teachers, who know the goal and stand by it, must agree to stay at the school.  They understand the difficulties to overcome and will not back away or obstruct.  The teachers are expected to be leaders, listened to by the administrators and asked to research and help organize the curriculum changes that will be needed.

Second, the school needs administrators who are determined to see the change through.  They must be partners with the teaching staff in developing and/or preparing for the reading/language arts and math models.  They must not give up when students don’t improve right away.  They must hold off district personnel who want to try the next big thing.  They must be relentless in the consistency of the program, but watch constantly to improve what isn’t effective.

Third, in spite of what one reads about improvement possible even when the funding picture is bleak, it helps to have a district office on the side of the school.  To turn around a school, it’s good to be a small school in a small district, easier for district personnel to keep in mind the issues the school faces.  (Moreland School District has 5 elementary schools and 1 middle school with about 4000 students total.)

When parents at the school need a program, as at Anderson, to learn English and parenting skills to support their children, the district must have helped find the money.  When teachers say they will tutor students after school, the district will find the money.  When the school principal wants professional development time set aside to analyze test data that drives the curriculum, the district doesn’t put her off, but finds the money.

Finally, when Charles Weis, Santa Clara County Superintendent of Schools (where Anderson Elementary is found), makes general statements about knowing which schools need help and how to help them, it’s not good enough.  If he’s on the side of school reform in low-performing, “at risk” schools, is he working with the district superintendents, the teacher’s unions, and school boards to set a time table for change and not back down?

Jonathan Alter in “Teddy’s Rightful Heir” Newsweek, November 9, 2009, suggests that is happening at the federal Department of Education.  “He (President Obama) and Arne Duncan are showing some Chicago muscle….”

Do what it takes.

Learning Math in the USA

Wednesday, October 21st, 2009

How can we be doing so badly?  The richest country in the world and our kids can’t get a decent math test score on the National Assessment of Educational Progress (NAEP).

hands-on math in textbook

hands-on math in textbook

That, at least, is the judgment based on data from the 2009 Nation’s Report Card released Wednesday, October 14, 2009, and noted in many national newspapers.  The San Francisco Chronicle, “State’s math scores near bottom” by Jill Tucker, says, “California consistently has ranked among the lowest-scoring states”–third from the bottom after this year’s testing sample, only Alabama and Mississippi with lower scores.

On the other hand, except for once every two years when the Nation’s Report Card test scores hit the newspaper, only a few people in the education world know the test was given.  When teaching, I never knew a school or teacher who had given the test.  I’d never seen an example of the test.

It’s a bet that only math gurus at the State Department of Education know fourth grade math proficiency has grown from a scale score 208 in 1992 when the test was first given in California to 232 this year, compared to USA national average 239.  The bad news is two years ago fourth graders had almost the same paltry score-230–out of a possible 500 scale score (a statistical tool to compare data from all 50 states).

The final insult is only 35% of California fourth graders learned enough of the federal math standards to achieve scale scores considered proficient or advanced.

How can that be when the level of proficiency or better on the California Standards Test (CST) used as a growth benchmark for the California Academic Performance Index (API) and the national Annual Yearly Progress (AYP) report has shown considerable improvement?

How? Why?

After much clicking through data on the National Center for Education Statistics’ unfriendly website, the following was disgorged about California NAEP math scores:

1) 7400 of 6 million California students were tested

2) 310 schools agreed to give the test in Fresno School District, San Diego Unified, and Los Angeles Unified

3) where the largest groups of English Language Learners (ELL) in the state reside.

No wonder the scores are weak (ELL average scale score 211).  Every California school district already knows that the achievement gap in the state is most disparate for students who speak little English.

Seems like, as teachers say all the time, too many exams.  Teachers in-the-know are busy looking at in-school assessments, using on-site data to make teaching decisions for improvement in state standards math instruction.

Nevertheless, newspaper articles and various reports about NAEP student failure point to four problems.

1) Every state has different math standards, some too easy, some too broadly defined, none matching the federal standards.

2) State assessments are too easy or don’t assess the most important math standards.

3) State proficiency benchmarks are too low.

4) Teacher preparation, credentialing, and professional development aren’t good enough, often blamed on teacher’s union policies.

What to do?

Most teachers will say, get on with it, create common standards, assessments, and benchmarks between states for math education.  Another well-kept secret, 48 states have agreed to do so.  An example is the New England Common Assessment Program.

Most important by far, states need to step up and fork over the money to “turn around” low performing schools which all those achievement gap ELL students attend.  Various studies have documented a small number of excellent schools for “turn around” models.*

Once attendance is secured, high standards made clear, parents involved, teachers well-supported, the curriculum may begin to stress critical thinking skills, the way to pass any test with flying colors, no matter who gives the exam.

*The school community wants to talk about this dilemma?  Take Care!, showing ways for the school community’s adults to resolve problems successfully,  may help.  See the website for this blog.