{"id":18744,"date":"2013-05-28T13:07:30","date_gmt":"2013-05-28T17:07:30","guid":{"rendered":"http:\/\/stateimpact.npr.org\/florida\/?p=18744"},"modified":"2013-05-28T13:07:31","modified_gmt":"2013-05-28T17:07:31","slug":"why-fcat-scores-should-be-compared-to-more-than-one-yardstick","status":"publish","type":"post","link":"https:\/\/stateimpact.npr.org\/florida\/2013\/05\/28\/why-fcat-scores-should-be-compared-to-more-than-one-yardstick\/","title":{"rendered":"Why FCAT Scores Should Be Compared To More Than One Yardstick"},"content":{"rendered":"<div id=\"attachment_18745\"  class=\"wp-caption module image right\" style=\"max-width: 225px;\"><a href=\"http:\/\/stateimpact.npr.org\/florida\/2013\/05\/28\/why-fcat-scores-should-be-compared-to-more-than-one-yardstick\/img_1066\/\" rel=\"attachment wp-att-18745\"><img decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-18745\" title=\"IMG_1066\" src=\"http:\/\/stateimpact.npr.org\/florida\/files\/2013\/05\/5-28-PassingPlace-225x300.jpg\" alt=\"\" width=\"225\" height=\"300\" srcset=\"https:\/\/stateimpact.npr.org\/florida\/files\/2013\/05\/5-28-PassingPlace-225x300.jpg 225w, https:\/\/stateimpact.npr.org\/florida\/files\/2013\/05\/5-28-PassingPlace.jpg 375w\" sizes=\"(max-width: 225px) 100vw, 225px\" \/><\/a><p class=\"wp-media-credit\">Madeline_Mundt \/ Flickr<\/p><p class=\"wp-caption-text\">Researcher Matthew Di Carlo takes a second look at just how much improvement there was on Florida Comprehensive Assessment Test writing scores this year.<\/p><\/div>\n<p>The headlines last week announced that a <a href=\"http:\/\/stateimpact.npr.org\/florida\/2013\/05\/24\/fcat-writing-scores-show-improvement\/\">higher percentage of Florida students met expectations<\/a> on the state writing exam. But Matthew Di Carlo at the Shanker Blog says <a href=\"http:\/\/shankerblog.org\/?p=8390\">Florida parents and educators should look a little deeper into the results.<\/a><\/p>\n<p>Di Carlo explains how the points establishing the state&#8217;s 1 to 6 scale &#8212; known as cut scores &#8212; can provide a false impression of progress.<\/p>\n<p>For instance, Di Carlo notes that the percentage of fourth graders scoring 3.5 or above on the test increased by nine percentage points. The <a href=\"http:\/\/www.fldoe.org\/news\/2013\/2013_05_24-2.asp\">Florida Department of Education loved those results<\/a>.<\/p>\n<p>But the average fourth grade score improved only slightly. The percentage of fourth graders scoring 3.0 or better, the expectation prior to last year, improved by just two percentage points.<\/p>\n<p><!--more--><\/p>\n<p>Here&#8217;s Di Carlo:<\/p>\n<blockquote><p>In other words, the \u201csignificant gains\u201d touted by the FLDOE are heavily concentrated in a single grade, and, more importantly, they basically disappear if one uses the previous benchmark of 3.0 instead of the current 3.5.<\/p>\n<p>This illustrates a very important point about changes in these kinds of cutpoint-based rates, including proficiency rates, one that we\u2019ve\u00a0<a href=\"http:\/\/shankerblog.org\/?p=7814\">discussed here many times<\/a>\u00a0before:\u00a0<em>Trends in rates depend a great deal on where you set the cut score, and where students are \u201clocated\u201d vis-\u00e0-vis that threshold<\/em>.<\/p>\n<p>If you use the 3.5 threshold, there was a moderate increase. But the rate using the 3.0 cut score, which was considered \u201cpassing\u201d prior to 2012, was basically flat. It\u2019s the same exact data, but with a different line comes a rather different conclusion.<\/p><\/blockquote>\n<p>In Florida&#8217;s defense, Di Carlo notes that the state does release the scores so that he an others can dig into the data. Some places, such as the District of Columbia, do not release the scores.<\/p>\n<p><a href=\"http:\/\/shankerblog.org\/?p=8390\">Read Di Carlo&#8217;s full post here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The headlines last week announced that a higher percentage of Florida students met expectations on the state writing exam. But Matthew Di Carlo at the Shanker Blog says Florida parents and educators should look a little deeper into the results. Di Carlo explains how the points establishing the state&#8217;s 1 to 6 scale &#8212; known [&hellip;]<\/p>\n","protected":false},"author":31,"featured_media":18745,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[15],"tags":[1035,1019,426,1039],"acf":[],"_links":{"self":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/posts\/18744"}],"collection":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/comments?post=18744"}],"version-history":[{"count":1,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/posts\/18744\/revisions"}],"predecessor-version":[{"id":18748,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/posts\/18744\/revisions\/18748"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/media\/18745"}],"wp:attachment":[{"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/media?parent=18744"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/categories?post=18744"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stateimpact.npr.org\/florida\/wp-json\/wp\/v2\/tags?post=18744"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}