{"id":4802,"date":"2012-02-16T14:02:43","date_gmt":"2012-02-16T19:02:43","guid":{"rendered":"http:\/\/stateimpact.npr.org\/florida\/?p=4802"},"modified":"2012-04-09T13:59:17","modified_gmt":"2012-04-09T17:59:17","slug":"inside-the-mathematical-equation-for-teacher-merit-pay","status":"publish","type":"post","link":"https:\/\/stateimpact.npr.org\/florida\/2012\/02\/16\/inside-the-mathematical-equation-for-teacher-merit-pay\/","title":{"rendered":"Inside the Mathematical Equation for Teacher Merit Pay"},"content":{"rendered":"<p><em>Miami Herald reporter <a href=\"http:\/\/stateimpact.npr.org\/florida\/2012\/02\/17\/why-poverty-is-not-included-in-the-mathematical-equation-for-teacher-merit-pay\/\">Laura Isensee<\/a> contributed to this report. Read her story on Florida&#8217;s merit pay formula <a href=\"http:\/\/www.miamiherald.com\/2011\/11\/05\/2488961\/complex-new-teacher-evaluations.html\">here.\u00a0<\/a><\/em><\/p>\n<p>School has always been about grading students. But now 24 states\u00a0<a href=\"http:\/\/stateimpact.npr.org\/florida\/tag\/senate-bill-736\/\">are starting to grade teachers<\/a>.<\/p>\n<p>Florida is using a mathematical formula to calculate how well teachers are doing their jobs. The grade it spits out will help determine how much a teacher gets paid and whether that teacher can keep his or her job.<\/p>\n<p>But the formula is so complex even an advanced calculus teacher and former college math major can\u2019t understand how it works.<\/p>\n<div id=\"attachment_5002\"  class=\"wp-caption module image right\" style=\"max-width: 620px;\"><a class=\"fancybox\" title=\"Advanced calculus high school teacher, Orlando Sarduy, writes out the formula that will grade and help determine the pay of Florida teachers. Even for a college math major like him, the formula is too confusing to understand. He calls it a &quot;mathematical experiment.&quot;\" href=\"http:\/\/stateimpact.npr.org\/florida\/files\/2012\/02\/formula-crop.56.jpg\" rel=\"\"><img decoding=\"async\" loading=\"lazy\" class=\"size-large wp-image-5002\" title=\"formula crop.56\" src=\"http:\/\/stateimpact.npr.org\/florida\/files\/2012\/02\/formula-crop.56-620x359.jpg\" alt=\"\" width=\"620\" height=\"359\" srcset=\"https:\/\/stateimpact.npr.org\/florida\/files\/2012\/02\/formula-crop.56-620x359.jpg 620w, https:\/\/stateimpact.npr.org\/florida\/files\/2012\/02\/formula-crop.56-300x174.jpg 300w, https:\/\/stateimpact.npr.org\/florida\/files\/2012\/02\/formula-crop.56-220x127.jpg 220w, https:\/\/stateimpact.npr.org\/florida\/files\/2012\/02\/formula-crop.56.jpg 658w\" sizes=\"(max-width: 620px) 100vw, 620px\" \/><\/a><p class=\"wp-media-credit\">CHARLES TRAINOR JR. \/ Miami Herald<\/p><p class=\"wp-caption-text\">Advanced calculus high school teacher, Orlando Sarduy, writes out the formula that will grade and help determine the pay of Florida teachers. Even for a college math major like him, the formula is too confusing to understand. He calls it a &quot;mathematical experiment.&quot;<\/p><\/div>\n<p>Coral Reef High School teacher\u00a0Orlando Sarduy says just reading the formula is difficult for him.<\/p>\n<p>StateImpact Florida and the <em>Miami Herald<\/em> partnered up to deconstruct the equation and\u00a0try to figure out what&#8217;s going on here. We asked statisticians and policymakers how the formula works. The answer we got: No lay person, teacher or reporter can understand it. So just trust us.<\/p>\n\n<p>\u201cI would really\u00a0challenge\u00a0any sort of decision maker to look at [the formula] and explain it,\u201d Sarduy said. \u201cI understand just the basics, but this is really the technical nitty-gritty of what\u2019s going on, and to me it looks the same as it would to a lay person, like \u2018what&#8217;s going on here?\u201d\u00a0<!--more--><\/p>\n<p><strong>How The Formula Works\u00a0<\/strong><\/p>\n<p><strong><\/strong>The formula is designed to predict how students will score on the state&#8217;s standardized exam\u2014the FCAT. And then it adjusts teachers&#8217; pay depending on how well their students measure up against that predicted score.<\/p>\n<p>The formula takes into account school and student characteristics that Florida officials say predict how well a student is going to do in school.<\/p>\n<div class=\"module pull-quote right\">\n<p>&#8220;I would really\u00a0challenge\u00a0any sort of decision maker to look at [the formula] and explain it.\u201d<\/p>\n<h6>&#8211; Orlando Sarduy, advanced calculus teacher<\/h6>\n<\/div>\n<p>Those officials decided there are only 10 factors that matter. They chose things like the number of students in a classroom, whether English is a student\u2019s first language,\u00a0attendance rates and disability status.<\/p>\n<p>The statisticians created a formula that gives each of the 10 factors a certain weight.<\/p>\n<p>That\u2019s<a href=\"http:\/\/www.miamiherald.com\/2011\/11\/05\/2488961\/complex-new-teacher-evaluations.html\"> how the statisticians and policymakers who created the formula explained it <\/a>to <em>Miami Herald<\/em> education writer Laura Isensee.<\/p>\n<p>For example: If a student misses 5 days of school, the statisticians determine what the effect of missing 5 days of school will have on that student\u2019s standardized test score.<\/p>\n<p>The statisticians do this for each factor and every student. In the end, the formula predicts what a student\u2019s test score should be given all these factors.<\/p>\n<p>\u201cAnd that prediction will be the grading stick for the teacher,\u201d Isensee said. \u201cIf the student gets higher than the predicted score, the state thinks they must have a good teacher. If a student scores below the predicted score, then the teacher could be in trouble.\u201d<\/p>\n<p>The state has <a href=\"http:\/\/www.fldoe.org\/committees\/sg.asp\">a list of all the different weights for all the factors<\/a>.<\/p>\n<p>But Isensee said, \u201cThe weights are all over the place, even for kids who seem to be in the same situation.\u201d <div class=\"related-content alignleft\"><h4 class=\"related-header\">Related<\/h4><div class=\"links\"><h5>Posts<\/h5><ul><li class=\"link\"><a href=\"http:\/\/stateimpact.npr.org\/florida\/2012\/02\/17\/why-poverty-is-not-included-in-the-mathematical-equation-for-teacher-merit-pay\/#more-5016\">Why Poverty Is Not Included in the Mathematical Equation for Teacher Merit Pay<\/a><\/li><li class=\"link\"><a href=\"http:\/\/stateimpact.npr.org\/florida\/2011\/08\/03\/can-schools-depend-on-teacher-evaluations\/\">Can Schools Depend on Teacher Evaluations?<\/a><\/li><li class=\"link\"><a href=\"http:\/\/stateimpact.npr.org\/florida\/2011\/08\/15\/merit-pay-could-mean-big-rewards-for-florida-teachers\/\">Merit Pay Could Mean Big Rewards for Florida Teachers<\/a><\/li><\/ul><\/div><div class=\"topics\"><h5>Topics<\/h5><p class=\"topic\"><img class=\"alignleft\" src=\"http:\/\/stateimpact.npr.org\/florida\/files\/2011\/07\/Floridateachers1-550x403-60x60.jpg\" height=\"60\" width=\"60\" \/><a href=\"http:\/\/stateimpact.npr.org\/florida\/topic\/merit-pay\/\">Does Performance-Based Pay Have Any\u00a0Merit?<\/a><\/p><\/div><\/div><\/p>\n<p>Here&#8217;s an example. Warning, difficult math ahead.<\/p>\n<p>The weight for an English language learner in reading class is\u00a0-7.3 if you&#8217;re in sixth grade, but it +12.9 if you&#8217;re in tenth grade.<\/p>\n<p>Isensee says the formula requires a lot of trust.<\/p>\n<p>\u201cI tried to understand why the impact is so different for everyone and the statisticians basically told me, \u2018Don&#8217;t worry about it, that&#8217;s the formula&#8217;s job. The formula knows how much weight to give everything.&#8217;<\/p>\n<p>\u201cThe teachers have to trust that the policy makers chose the right factors, and the policymakers have to trust that the statisticians came up with an accurate formula.&#8221;<\/p>\n<p>Kathy Hebda is with the Florida Department of Education. She says the formula Florida created is a state of the art model.<\/p>\n<p>&#8220;We have contracted with leading national experts,&#8221; Hebda said. &#8220;We have <a href=\"http:\/\/www.fldoe.org\/committees\/sg.asp\">a statewide committee that is steering the process<\/a> and making recommendations to the commissioner about the model, that\u2019s made up primarily of teacher. That kind of input and guidance is extremely important to make sure that the model works properly.<\/p>\n<p>\u201cWe\u2019re very confident in the process and the approach we\u2019ve taken,&#8221; Hebda said.<\/p>\n<p>Teachers like Sarduy are skeptical. He questions why Florida only chose 10 factors to begin with.\u00a0He says there could be hundreds of factors that impact how well a student does in school.<\/p>\n<p>&#8220;[The formula is] only as good as the variables that you\u2019re actually looking out for as well as the test that you\u2019re using to measure,&#8221; Sarduy said. &#8220;At the backbone of this is still an exam that\u2019s made up.\u00a0If the exam is invalid, the whole equation is invalid.&#8221;<\/p>\n<p>The most influential factor in the equation is the\u00a0score a student gets on the FCAT exam. It&#8217;s the factor with the most predictive value.<\/p>\n<p><strong>What Happens If You Don\u2019t Teach an FCAT Subject?<\/strong><\/p>\n<p>In Florida about 60% of teachers do not teach a subject that is tested by the FCAT, like\u00a0physical education teachers, health and history teachers, or chemistry and advanced calculus teachers.<\/p>\n<div class=\"module pull-quote right\">\n<p>&#8220;Health teachers, advanced calculus teachers &#8211; their pay will be based on how well kids read.\u201d<\/p>\n<h6>&#8211; Laura Isensee, Miami Herald education writer<\/h6>\n<\/div>\n<p>Insensee says until the state comes up with a test for every subject in every grade, teachers who don&#8217;t teach an FCAT subject are going to be graded on the whole school&#8217;s reading score.<\/p>\n<p>\u201cSo heath teachers, advanced calculus teachers, their pay will be based on how well kids read,\u201d said Isensee.<\/p>\n<p>That has teachers like Sarduy pretty frustrated.<\/p>\n<p>&#8220;It&#8217;s infuriating,\u201d Sarduy said. \u201cI have nothing to do with whatever that end result is.&#8221;<\/p>\n<p>But the state does give teachers another chance to show off their teaching skills. Hebda says the grade the formula gives teachers is only half of the whole teacher evaluation process.<\/p>\n<p>\u201cThe law is very clear that that\u2019s 50% of an evaluation. The other piece of that is equally important, which is instructional practice,&#8221; Hebda said.<\/p>\n<p>&#8220;What is the teacher actively doing in the class? What are the students actively doing in the class? And then what are the student outcomes? Those are the things that all go into making that final evaluation result.&#8221;<\/p>\n<p>So principals and other educators will still do their own evaluation of teachers by sitting in their classroom and reviewing lesson plans.<\/p>\n<p>But some teachers still feel like too much of the end result is out of their control.<\/p>\n<p><strong>The State Says Poverty Doesn\u2019t Matter<\/strong><\/p>\n<p>Study after study we hear that poverty is the number one indicator of how well students do in school. But Florida policymakers made it against the law to include any socioeconomic status as a factor in the formula.<\/p>\n<p>There\u2019s no factor for poverty, homelessness, immigration status, race or ethnicity.<\/p>\n<p>The state says the formula does not need to include a student&#8217;s socioeconomic status\u00a0as its own factor in the formula because its already baked into the equation. Teachers would only be graded on how well they help poor students improve from the year before when they were also poor.<\/p>\n<p>The rationale is that all kids, regardless of whether they&#8217;re homeless or poor, can improve at the same rate as kids from wealthy areas, if they have a good teacher.<\/p>\n<p>&#8220;I like the fact that its attempting to isolate just the teacher&#8217;s [role],&#8221; Sarduy said. &#8220;But you have to realize, that&#8217;s me on the line. I&#8217;m now part of a statewide experiment.&#8221;<\/p>\n<p>UPDATE: Here&#8217;s the formula in its entirety.<\/p>\n<div class=\"embed-documentcloud\" style=\"text-align: center;\"><div class=\"DC-embed DC-embed-document DV-container\"> <div style=\"position:relative;padding-bottom:129.4444444444444%;height:0;overflow:hidden;max-width:100%;\"> <iframe src=\"\/\/www.documentcloud.org\/documents\/296824-florida-teacher-evaluation-formula.html?embed=true&amp;responsive=false&amp;sidebar=false\" title=\"Florida Teacher Evaluation Formula (Hosted by DocumentCloud)\" sandbox=\"allow-scripts allow-same-origin allow-popups allow-forms\" frameborder=\"0\" style=\"position:absolute;top:0;left:0;width:100%;height:100%;border:1px solid #aaa;border-bottom:0;box-sizing:border-box;\"><\/iframe> <\/div> <\/div><\/div>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Miami Herald reporter Laura Isensee contributed to this report. Read her story on Florida&#8217;s merit pay formula here.\u00a0 School has always been about grading students. But now 24 states\u00a0are starting to grade teachers. Florida is using a mathematical formula to calculate how well teachers are doing their jobs. The grade it spits out will help [&hellip;]<\/p>\n","protected":false},"author":32,"featured_media":4803,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[17],"tags":[1019,1007,1058],"acf":[],"_links":{"self":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/posts\/4802"}],"collection":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/comments?post=4802"}],"version-history":[{"count":0,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/posts\/4802\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/media\/4803"}],"wp:attachment":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/media?parent=4802"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/categories?post=4802"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/tags?post=4802"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}