Tuesday, July 29, 2014

Student Enrollment in Idaho Schools, Part 1

Which Idaho school district with over 100 students has seen the largest percentage increase in enrollment since the dawn of the 21st century?

Meridian (or, by their new name, West Ada)? – Well, Meridian is first in numerical growth (over 11,000), but fifth in percentage growth. The state’s largest district has grown by 45% since 2001.

Nampa? – Nampa is now the state’s third largest district, with over 15,000 students, but is 8th in rate of growth, at 28%.

The fastest growing district in Idaho is the Vallivue District outside of Caldwell. Vallivue had 3888 students in 2001, and now has enrollment of 7565, according to State Department of Education enrollment statistics. That’s a rate of growth since 2001 of 95%.

Fastest Growing Districts

School districts of over 100 students that have grown by 20% (with enrollment growth) since ’01 are:
  1. Vallivue (3677) – 95%
  2. Kuna (1961) – 62%
  3. Middleton (1348) – 59%
  4. Bonneville (3581) – 47%
  5. Meridian (11237) – 45%
  6. Madison (1176) – 29%
  7. Jefferson County (1141) – 29%
  8. Nampa (3272) – 28%
  9. Teton (335) – 25%
  10. Twin Falls (1696) – 25%
  11. Kimberly (320) – 24%
  12. Post Falls (1070) – 23%
  13. Sugar-Salem (277) – 23%
  14. Dietrich (41) – 21%
Note that much of the student population growth is in three areas of the state: the Treasure Valley (Meridian, Nampa, Kuna, Middleton, Caldwell), the Idaho Falls area (Madison, Jefferson County, Sugar-Salem, Bonneville, Teton), and the Magic Valley (Twin Falls, Kimberly, Dietrich).

Fastest Shrinking Districts

On the flip side, as of the 2013 – 14 school year, 29 school districts of over 100 students have lost more than 20% of their 2001 enrollment. The ten that have lost the highest percentage of enrollment are:
  1. Culdesac – 58% (213 to 92)
  2. Kootenai - 39.6% (288 to 174) 
  3. South Lemhi – 38.8% (129 to 79)
  4. Bruneau-Grandview – 37.6% (526 to 328) 
  5. Nez Perce 37.2% (207 to 130) 
  6. Mullan 36.7% (158 to 100) 
  7. Council 34.8% (333 to 217) 
  8. Cambridge 34.2% (193 to 127) 
  9. Mackay 31.8% (258 to 176) 
  10. Salmon 31.2% (1143 to 786) 
Note that these are all small (with the exception of Salmon), relatively isolated school districts, where the loss of such large percentages of student enrollment certainly has a detrimental effect upon operations.

The median Idaho district size in 2000-01 was 942. In 2013-14 the median size was 798. Eight of the 29 districts which lost more than 20% of their enrollment were larger than the statewide median in 2001:
  1. Emmett (-20%) (2981 to 2382)
  2. Payette (-20%) (1932 to 1582)
  3. Priest River (-21.7%) (1515 to 1187)
  4. Bear Lake (-28.5%) (1501 to 1073)
  5. Orofino (-27.8%) (1419 to 1025)
  6. Oneida County (-26%) (1153 to 853)
  7. Salmon (-31.2%) (1143 to 786)
  8. Soda Springs (-20.3%) (1060 to 845)
Of the 29 districts that lost more than 20% of their enrollment, 18 have opted for a 4-day school week, while 11 have remained with the traditional 5-day student week.

Trends Among Idaho's Largest Districts
To give you an idea of changing enrollment patterns among “large” Idaho districts, here are the ten with the largest student populations, in 2001 and 2013:

2001
  1. Boise – 26442
  2. Meridian – 25223
  3. Pocatello – 12210
  4. Nampa – 11772
  5. Idaho Falls – 10648
  6. Coeur d’Alene – 9083
  7. Bonneville – 7568
  8. Twin Falls – 6869
  9. Caldwell – 5665
  10. Cassia County - 5119
2013
  1. Meridian – 36510 (+44.7%)
  2. Boise – 25978 (-1.8%)
  3. Nampa – 15044 (+27.8%)
  4. Pocatello – 12565 (+2.9%)
  5. Bonneville – 11149 (+47.3%)
  6. Coeur d’Alene – 10284 (+13.2%)
  7. Idaho Falls – 10263 (-3.6%)
  8. Twin Falls – 8565 (+24.7%)
  9. Vallivue – 7565 (+94.6%)
  10. Caldwell – 6277 (+10.8%)

Note: The Boise District had lost about 6% of its enrollment
(about 1500 students) between 2001 and 2007 during the “move to the suburbs”; since then, the district has grown by about 1000 students.

Idaho’s student population grew by 18% between 2001 and 2013, from just over 246,000 students to just over 289,000. Idaho’s districts grew by just 10% during that period, from 245,000 to 270,000. Why the difference? In the next post, data about the growth of charter schools in the state of Idaho.

SAT Math - Rigor and Scores of 700 and Above

In the 2013 administration of the SAT, a score of 700 or above in math ranked in the 93rd percentile nationwide. In Idaho, 247 students, or about 1.5% of the 16921 juniors who took the math subtest, scored a 700 or better on the School Day administration of the SAT. Scoring a 700 is rare, to say the least – most students scoring at this level have their choice of elite schools (of course, they also have high gpa’s, are involved in campus leadership activities, etc).

As has been pointed out in previous posts, a large percentage of Idaho’s student enrollment is concentrated in a few large districts. Over 50% of Idaho’s students go to school in the ten largest districts, and over a quarter of Idaho students attend in the three largest districts, Meridian, Boise, and Nampa.



The vast majority of SAT math scores of 700 and above were also in large districts, but the distribution pattern was very different.


Note that Boise had over a third of the state’s SAT math scores of 700 or better with 9% of the students. Meridian had 15% of the scores with 13% of the students, Coeur d’Alene 10% with 4%, Idaho Falls 6% with 4%, and so on.

In Coeur d’Alene, the two comprehensive high schools (Lake City and Coeur d’Alene) had 9 of the 25 students who scored 700 or better. Sixteen (16) of the students were from Coeur d’Alene Charter Academy. Interestingly, the class of 2014 at CDA Charter had 105 students in the 7th grade, but when the class took the SAT in 11th grade, only 76 remained, a 30% loss among the student population. CDA Charter students are clearly a special group which achieves at a high level.

Sixteen (16) of the 71 students (23%) at CDA Charter who took the SAT during the School Day administration scored 700 or above in math, by far the highest percentage in the state. The total group of 71 students’ average score was 628. Timberline High had 15 of 352 students (4%) score 700 or better in math, with an average of 503.

However, since CDA Charter has a select population, and Timberline High is a comprehensive high school, a better comparison would be a specialized group in the Boise District. For example, the Treasure Valley Math and Science Center uses teacher recommendations, test scores, and an application process to select students who want an accelerated math and science program, and provides a rigorous curriculum, as does CDA Charter. TVMSC is a half-day program offered at a center on the campus of Riverglen Junior High in Boise.

Thirty-three (33) class of 2014 students who were enrolled at TVMSC as 10th, 11th, and or 12th graders took the SAT as 11th graders. Twenty-one (21) of those students (64%) score 700 or better on the SAT math subtest. The total group of 33 students averaged 698 on SAT math.

Students who scored 700 or better were obviously very skilled in math and in problem-solving. However, this level of performance also requires a certain level of content knowledge in mathematics. Of the 88 Boise District students who scored 700 or above in 2013, 87 took Advanced Placement Calculus AB and/or BC as part of their high school math programs. This means that these students were enrolled in AP Calculus AB or Accelerated Math Analysis (or in a few cases AP Calculus BC) as juniors. The lone student who did not take Calculus took AP Statistics as a senior, and was enrolled in Accelerated Math Analysis as a junior.

Of course, a number of students who took Calculus did not score 700 or above in math on the SAT. So enrollment in these courses does not guarantee the highest scores. However, taking advanced math does appear to be a prerequisite for scoring at the highest levels in SAT math.

Thursday, July 17, 2014

Goodbye, Old ISAT... what were the results?

In spring 2014-15, the state of Idaho will officially move from the NCLB-era Idaho Standards Achievement Tests (called herein the “old ISAT”), to the Smarter Balanced Assessments (also to be dubbed the “ISAT”).

Beginning in spring 2007, a new vendor, Data Recognition Corporation, was selected to administer the old ISAT, and a new test was delivered to Idaho students. That first year, 79.9% of Idaho students in grades 3-8 and 10 received a mark of “proficient” or “advanced” on the test. In math, the percentage was 75.8%. In 2012-13, in the final statewide administration of the old ISAT, the percentages were 89.1% in Reading and 80.9% in Math. So, then, the improvement in proficient/advanced percentages over the six years of old ISAT administration was 9.2% in Reading and 5.1% Math.

However, this comparison of proficiency rates conceals something much more important that was happening in Idaho’s public schools. If we examine just the percentages of advanced students in each year, we can see that important shift.



In old ISAT Reading, only a third of Idaho's 3-8 and 10 students scored in the “Advanced” category in 2007. By 2012, half of Idaho’s kids had reached that performance level. And, though the ISAT “advanced” level is not quite so high as that of the SAT, it’s clear that many more Idaho students reached a higher level of rigor in the time of the ISAT. In fact, almost 30,000 more Idaho students were “advanced” in 2012 than were in 2007.


In Math, though the growth was somewhat less than that made in Reading, it was still impressive. Again, only a third of Idaho students were advanced in 2007. By 2012, 45% were in that category. That’s an improvement of more than 17,000advanced students from 2007 to 2012.

The measurement criteria used under the NCLB law, which labeled schools “failing” if they did not meet “Adequate Yearly Progress” with as few as 34 students among their total populations, obscured the tremendous gains made by Idaho schools and districts during the administration of the old ISAT. Those gains were truly impressive.

Monday, June 9, 2014

Century Scholars - From Here They Can (and DO) Go Everywhere

For the past nine years, the Boise District has honored top students at Boise high schools with the Century Scholars award. These students, who have the highest weighted grade point averages (gpa) at their respective high schools, receive a medal and a certificate and are asked to choose teachers who have had a significant impact on their lives. These “distinguished educators” are honored along with the students. The ceremony typically takes place in April of each year and is sponsored by the Rotary Clubs of Boise.

It’s interesting to look at the characteristics of these top students in the Boise District. What follows is an analysis of the 2012-13 class of Century Scholars. This post focuses on the students from the four traditional Boise high schools.

Grades and Advanced Coursework

The eighty-four (84) students (representing the top 5% of the class of 2013) sported an average weighted gpa of 4.27. The Boise District gives credit for Advanced Placement coursework on a 5-point scale, while credit for all other classes is on a 4-point scale. The Scholars took an average of 10 Advanced Placement courses. Two students took 18 AP classes, 1 took 17, and 3 took 16. 40 of the students took Calculus AB and BC, and another 32 took Calculus AB as their capstone math course.

College Entrance Examinations and Activities

The average ACT composite score from this group was 31 (the ACT is scored on a 36 point scale) which was at the 97th percentile on the ACT scoring scale. There were three perfect ACT scores from this group, and 22 Scholars scored 33 or higher, at the 99th percentile nationwide.

On the SAT Critical Reading subtest, the average score was 645, or about the 90thpercentile nationwide. There were 5 perfect Critical Reading scores from the Scholars. In math, the average of 687 is at about the 92nd percentile, and there were 6 perfect math scores. The writing average was at 639, at the 89thpercentile. The average composite score for Century Scholars was 1971, or about the 92nd percentile. The maximum composite score on the SAT is 2400. Twelve scholars scored above 2220, at the 99th percentile.

Century Scholars participated in all sorts of school activities and classes outside of Advanced Placement – from leadership to varsity athletics, chamber and jazz orchestra to ceramics, from debate to journalism, taking full advantage of the offerings of an elite public school system.



College Destinations

In terms of post-secondary choices, Class of 2013 Century Scholars enrolled in college in 21 states and the District of Columbia. Some stayed close to home – 17 (20%) stayed in Idaho; 7 at BSU, 3 each at the University of Idaho, the College of Idaho, and Idaho State University, and one at BYU-Idaho .

The majority of Scholars chose the northwest and the western United States for their pursuits – 5 attended in Oregon, 5 in Washington, 5 in Montana, 2 in Colorado, 11 in California, 6 in Utah, and 4 in Arizona. Others traveled across the country – 2 to the District of Columbia, 4 to Massachusetts, 2 to Maine, 4 to New York, and 2 to Pennsylvania, while two left the mainland for Hawaii.

A number of students are attending the most elite schools in the country. Georgetown, the University of Chicago, Brown, Harvard, MIT, Tufts, Duke, Columbia, Penn, Cornell, Carnegie Mellon, Santa Clara, and Stanford are among the destinations of 2013 Century Scholars.

Other Scholars are enrolled at some of the most prestigious liberal arts colleges in the U.S. – Grinnell (IA), Bowdoin and Colby (ME), Carleton (MN), Oberlin (OH), Lewis and Clark, Reed and Pacific (OR), and Whitman (WA) are included.

In 2013, two Scholars received appointments at military academies, one to The United States Military Academy at West Point, and the other at the United States Air Force Academy in Colorado Springs.

Wherever our Century Scholars choose to enroll, they bring an excellent academic record and a well-rounded background to their college and university experiences. They are truly an impressive group.

Tuesday, June 3, 2014

What the Star Rating System Tells Us, Part 2

The Star Rating System provides a limited portrayal of the quality of a school, mostly because it relies only on growth and achievement in standardized test scores (elementary and junior high), or on those measures and college-ready courses and test scores (high schools). However, given its limitations, the system does provide comparative achievement and growth information about schools across the state.

As indicated in part 1 of this post, elementary and junior high Star Ratings will likely see some revision of growth/achievement weighting by the Star Rating Committee, but will retain the same basic structure.

However, the high school ratings are problematic, in that they tell us little about the achievement outcomes of schools across the state, and instead rely too heavily on growth. Chester Finn, Jr. made an argument for using achievement as the primary measure in rating high schools.

So, if we could adjust the weighting for high schools, could we more accurately reflect outcomes and preparation for post-secondary? Yes, if we used a formula something like this:
  • Achievement – 45%
  • Growth – 20%
  • Graduation Rate – 10%
  • Advanced Opportunities – 25%
In this proposal, fully 70% of the points in the rating system would be earned through college-readiness achievement and course-taking patterns. The effect? High schools with the most students taking Dual Credit or Advanced Placement coursework and showing evidence of college readiness on the SAT or the SBAC would have the highest ratings. For example, using growth points, high school graduation, and advanced opportunities from the old system and reweighting them with 2013 SAT performance, the highest ranked schools would be:



Note that every high school received the maximum possible points for high school graduation and for advanced opportunities. Idaho's high school graduation rate is among the best in the nation, so that makes some sense. But the bar for advanced opportunities is set at a very low level. In fact, only 25% of juniors in the high school had to take an advanced opportunity course (AP, Dual Credit, Tech-Prep, International Baccalaureate), as long as 90% of the students enrolled received a grade of "C" or better, for the high school to receive the maximum number of points.

Comparing to the chart we used in Part 1, we see that the proposed weighting system better reflects achievement outcomes in Idaho high schools.



So what happens to high schools that rated 5 stars on the 2013 Star System, but had lower preparation indicators on the SAT?



Even though the Star system is an imperfect measure of school quality, this proposal provides for consumers a better indicator of college and career readiness among Idaho high schools.

Monday, June 2, 2014

Teacher Evaluations and Standardized Test Scores

The Idaho Department of Education recently released its newest application for a waiver from provisions of the No Child Left Behind law for public comment. The waiver application includes a timeline for the implementation of a statewide teacher evaluation system (pages 290-299).

Idaho’s proposed teacher evaluation system is based upon a controversial plan from the state of New Mexico, which recently provided teachers with their evaluation rankings, sparking some reaction from teachers across the state. 50% of a teacher’s rating in the New Mexico system is based on student growth and achievement on the New Mexico Standards-Based Assessment (to be replaced by PARCC assessment in 2015) and/or other assessments (such as end of course and reading assessments), 25% on teacher observations, and 25% on multiple measures, such as teacher attendance, preparation and planning, and professionalism. Teacher evaluation ratings were not made public in New Mexico in 2014. In Idaho’s waiver application, the first statewide teacher evaluation ratings would occur in Summer 2015.

Idaho’s system currently calls for 33% of the evaluation to be based on achievement and growth on standardized tests, though legislation in 2012 that increased the percentage to 50% was rendered null and void by the overturn of Propositions 1, 2, and 3, and House Bill 557, held in committee in 2014, would have increased the percentage to 50% over a period of years, comporting with the new NCLB waiver application.

The Technical Advisory Committee (TAC), a subcommittee of the Tiered Licensure Committee reviewing Idaho’s licensure requirements as part of the planning for Idaho’s Career Ladder, recommended last week that the SBAC (or another statewide assessment) be a mandatory part of teacher evaluation at applicable grades (the SBAC is currently planned for administration in Idaho in grades 3-11 in spring 2015).

These test-based teacher effectiveness measures are called Value Added Measures (VAM) and purportedly measure individual teacher contribution to student achievement by comparing the expected growth of the individual student against the actual individual student growth while in the teachers' classroom (source: New Mexico Department of Education).

However, two recent studies from reputable statistical organizations question the relationship of student growth on standardized test measures to teacher quality.

First, the American Statistical Association produced a statement regarding Value Added measures and teacher evaluation, making these points:

  • VAMs are generally based on standardized test scores, and do not directly measure potential teacher contributions toward other student outcomes.
  • VAMs typically measure correlation, not causation: Effects – positive or negative - attributed to a teacher may actually be caused by other factors that are not captured in the model.
  • VAMs should be viewed within the context of quality improvement, which distinguishes aspects of quality that can be attributed to the system from those that can be attributed to individual teachers, teacher preparation programs, or schools. Most VAM studies find that teachers account for about 1% to 14% of the variability in test scores, and that the majority of opportunities for quality improvement are found in the system-level conditions. Ranking teachers by their VAM scores can have unintended consequences that reduce quality.
Here is an article from Valerie Strauss of the Washington Post detailing the ASA findings.

In early May, Morgan Polikoff of USC and Andrew Porter of the University of Pennsylvania published another study, "Instructional Alignment as a Measure of Teacher Quality” in the peer-reviewed journal Educational Evaluation and Policy Analysis. Using results of the Gates Foundation Measures In Effectiveness of Teaching study, they found “no association between value-added results and other widely-accepted measures of teaching quality.” (see article in Education Week).

The seeming disconnect between the work of the Technical Advisory Committee and the research on value-added measures and teacher evaluation hearkens back to the introduction of Proposition 2, Pay for Performance, in 2011. Research showing the ineffectiveness of Pay for Performance implementation in other states was plentiful, as is the emerging research on use of value-added measurement for teacher evaluation. The first distribution of funds highlighted the same inequities that an evaluation system based on standardized test scores will show.

The work of teachers with their students during the school year can easily be taken into account at the local level in evaluations done by principals with teachers without using standardized test scores and value-added measurement. Progress of orchestra students on musical pieces, Pre-Algebra students on a statistics unit, U.S. History students in understanding the causes of the Civil War – all should be handled at the local level through judicious use of content-specific assessment data, observations of instruction, and analysis of classroom management and preparation, as well as other variables from effective teaching frameworks such as the Charlotte Danielson model.

College Majors of Boise District Graduates

Data about everything from fees to college grad rates are available at an excellent website hosted by the National Center for Educational Statistics and called the College Navigator.

Colleges and universities report their data based on "first-time full-time" enrollees, which means that students in a particular high school class who enter college as full-time students for the first time in the semester after graduation are tracked. The NCES provides four and six-year college grad rates for every college that takes federal funds.

We've used the same statistical calculations to track Boise District students for the past six years, and we now have complete six-year data for the 2007 Boise District high school graduating class. It's interesting that the highest percentage of Boise District college grads major in Science, Technology, Engineering, and Mathematics.