WASHINGTON–U.S. Senator Bill Cassidy, M.D. (R-LA), member of the Senate Health, Education, Labor, and Pensions (HELP) Committee, today expressed serious concerns to the U.S. Department of Education regarding the academic integrity of the National Center on Improving Literacy’s (NCIL) report, “Screening for Dyslexia.” The NCIL’s report was a product of a $1.5 million grant funded through the Department of Education.
Cassidy worked in the Senate HELP Committee to establish the National Center on Improving Literacy (NCIL) in the 2015 passage of the Every Student Succeeds Act (ESSA). One of the primary charges of NCIL was to conduct a thorough review of the literature available and provide assistance on how to improve identification of dyslexia at an early age. However, the NCIL report relies heavily on outdated or inaccurate references and fails to provide evidence-based recommendations for schools screening young children for dyslexia.
“If one were to look past the significant issue of inaccurately referencing key ‘facts’ to support NCIL’s argument, which on its own presents serious questions regarding the legitimacy of the paper’s scholarship, one would find that NCIL’s suggestions and recommendations to improve efforts to effectively screen for dyslexia are sloppy and misguided, at best,” Dr. Cassidy said in the letter. “At worst, the paper’s scholarship is ideologically skewed in an effort to advance a specific agenda to help struggling readers read, rather than the stated purpose of the paper, which is to provide evidence-based recommendations when screening young children for dyslexia.”
Dr. Cassidy is an active advocate on behalf of Americans with dyslexia, describing how his family has overcome dyslexia and how others can too. He also passed legislation included in the First Step Act providing dyslexia screening in prisons to reduce recidivism by helping more inmates learn to read.
The full text of the letter is below:
Dear Secretary DeVos:
The ability to read, comprehend what is read, and write well are crucial learning abilities for educational achievement and lifelong success. Young students, who are unable to read in the same manner as their peers, struggle to catch up to their peers later on in school and must exert extra focus and attention to read at the same level as their peers.[1] This unexpected difficulty to read can present adverse long term effects in many forms, including career outcomes[2] and the potential for legal trouble later on in life.[3] Of the students who are unable to read in the same manner as their peers, it is understood that a significant percentage have dyslexia, which is known to affect 1-in-5 Americans (20 percent).[4]
Understanding that 1-in-5 Americans are affected by dyslexia, I worked with my colleagues on the Senate Health, Education, Labor, and Pensions (HELP) Committee to establish the National Center on Improving Literacy (NCIL) in the 2015 passage of the Every Student Succeeds Act (ESSA).[5]One of the primary charges of NCIL was to conduct a thorough review of the literature available and provide assistance on how to improve identification of dyslexia at an early age. In doing so, NCIL was to identify or develop professional development recommendations for schools to better understand dyslexia, identify evidence-based screeners, implement evidence-based instruction, and disseminate the findings to States and local school districts.[6]
Unfortunately, as the primary author of the provision that authorizes funding for the center and as the father of a child with dyslexia, I find the most recent evidence of NCIL’s work deeply troubling. NCIL’s recent paper “Screening for Dyslexia,”[7] published on March 2, 2019, painted a picture of dyslexia that is foreign to my family’s lived experience. Furthermore, it lacks the serious scholarship that a $1.5 million center[8] should produce on behalf of taxpayers and the millions of families in the United States with loved ones who struggle to read because of dyslexia.
Perhaps the most objectionable aspect of the paper is the number of outdated references, references that are omitted in the reference list, and references entirely missing from the paper. If one were to look past the significant issue of inaccurately referencing key ‘facts’ to support NCIL’s argument, which on its own presents serious questions regarding the legitimacy of the paper’s scholarship, one would find that NCIL’s suggestions and recommendations to improve efforts to effectively screen for dyslexia are sloppy and misguided, at best. At worst, the paper’s scholarship is ideologically skewed in an effort to advance a specific agenda to help struggling readers read, rather than the stated purpose of the paper, which is to provide evidence-based recommendations when screening young children for dyslexia.
In an academic setting, the existence of just one or two improper citations or references is enough to invalidate and cripple an entire argument or study. The reason for this is clear: the ability to hold the argument or study up to rigorous testing depends on the validity and application of the information presented in the paper, assuming that the information presented is traceable, reliable, and presented in good faith. If one is unable to trace down the underlying point cited or referenced, the reader will have no way of knowing if the statement in the paper is based on fact, whether it is an opinion expressed by a reputable author, or if it is entirely fabricated and falsely attributed for the purpose of advancing a special interest.
In the case of NCIL’s “Screening for Dyslexia” paper, it takes the reader only a handful of pages to find examples of egregious errors. In discussing the prevalence of dyslexia, it references an outdated statistic by Sally Shaywitz, M.D., claiming that 5-17 percent of children have dyslexia.[9]The paper failed to use the most up-to-date statistic from the same Dr. Shaywitz, which shows that 1 in 5 children, or 20 percent, have dyslexia.[10] While there are varying degrees of dyslexia found in children and adults, it is widely understood that far more than 5-17 percent of children have dyslexia.
Another example on the same page of the paper (6) that demonstrates the failure of NCIL to use up-to-date information is the International Dyslexia Association’s (IDA) definition of dyslexia, which is more than 15 years old. While some states do use the IDA definition, the First Step Act, which was signed into law in December 2018, includes a federal definition for dyslexia and an evidence-based way to screen for dyslexia. The First Step Act definition for dyslexia and the required approach to screening are as follows:
Dyslexia Definition:
Dyslexia means an unexpected difficulty in reading for an individual who has the intelligence to be a much better reader, most commonly caused by a difficulty in the phonological processing (the appreciation of the individual sounds of spoken language), which affects the ability of an individual to speak, read, and spell.[11]
Dyslexia Screening Program:
Dyslexia Screening Program is a screening program for dyslexia that is:
(A) evidence-based (as defined in section 8101(21) of the Elementary and Secondary Education Act of 1965 (20 U.S.C. 7801(21))) with proven psychometrics for validity;
(B) efficient and low-cost; and
(C) readily available.”[12]
Understanding the unexpected nature of dyslexia and the absence of an effect dyslexia has on an individual’s intelligence is critical to understanding what dyslexia is and is not. Additionally, employing an evidence-based, cost-effective, and readily-available screening mechanism is critical to ensure a screener’s large-scale effectiveness and feasibility.
The IDA definition for dyslexia states that “difficulties [with dyslexia] typically result from a deficit in the phonological component of language that is often unexpected in relation to other cognitive abilities and the provision of effective classroom instruction.” While the IDA definition recognizes the phonologic and unexpected nature of dyslexia (underlined), it implicitly blames teachers and classroom instruction as the reason why some individuals are dyslexic (bolded). Defining dyslexia in this way is harmful and neglects the fact that individuals with dyslexia are born with the difficulty. Dyslexic individuals have an inherently harder time than their non-dyslexic peers when learning to read and write well, and speak foreign languages.
If using outdated statistics, definitions, and neglecting to mention existing federal definitions and screening requirements for dyslexia is not enough to convince one of the lack of serious scholarship on the authors’ part, then page 7 of the paper makes it abundantly clear that the authors did not put in the effort necessary to publish a reputable document. On page 7, six separate references are listed that do not appear on the paper’s reference list. Those sentences and the corresponding references are listed below:
- Students may be at risk for not attaining full literacy skills for a variety of reasons. For example, students may be at risk because they are English learners who are struggling to learn literacy skills in two languages simultaneously (Gersten, 1996).
- Of course, single-cause explanations rarely capture the complexity behind a student’s struggle to develop strong literacy skills (Maughan & Carroll, 2006; Snowling, 2012).[13]
- Multiple risk factors may be interacting with each other to make literacy problems more pronounced than they might be if only one risk factor was present (Muter & Snowling, 2009).
- This includes providing intervention to students with (yet) undiagnosed literacy-related disabilities, including dyslexia, as well as those students who are experiencing literacy-related difficulties for other underlying reasons (Shaywitz, 2014).
- Whether the literacy-related difficulty is caused by dyslexia or a disability other than dyslexia, another factor (e.g. low oral language skills), or a combination of factors, early and intense intervention to address the difficulties is the best way to prevent early problems from becoming more severe over time (Connor, et al., 2014).
If one did not read the rest of the paper, they might look at these clear omissions and think that the authors accidently left references for page 7 off the reference list. That would be a mistake. The trend of omitting references continues throughout the paper. My tabulation shows that the following references and the corresponding pages were omitted from NCIL’s reference list.
As a gastroenterologist, if I published an academic paper that was funded by the Department of Health and Human Services on the best ways to screen for colon cancer but failed to properly reference 31 of my sources, would you feel comfortable distributing that document to physicians nationwide as a guide to “better screening?” I certainly hope not.
Thus is the problem with NCIL’s “Screening for Dyslexia.” It is abundantly clear that the authors of the paper never sought any form of peer review. If it was reviewed by their peers, any of the 31 missing references would have been flagged. A proper peer review not only would have revealed the absence of listed references, it would have invoked significant scrutiny on NCIL’s numerous assertions without any form of citation or reference.
For example, on page 8, one page after which six references were cited but not listed in the reference list, not a single assertion is cited and listed in the reference list. This is despite the fact that the authors went on a 479-word tangent on the neuroscience behind early screening for dyslexia. Early screening and intervention is critical for dyslexic students and there is good research available regarding the neuroscience of dyslexia;[14] however, the lack of any such reference to the research available raises the question of whether the information is presented as fact or simply the opinion of a few individuals.
Instead of focusing on screening for dyslexia as the title implied, the paper is about screening for struggling readers and multi-tiered systems of support (MTSS), which is most often implemented in schools through Response to Intervention (RtI). The paper paints a very favorable review of MTSS—and RtI by extension—despite the 2015 study by the National Center for Education Evaluation and Regional Assistance titled “Evaluation of Response to Intervention Practices for Elementary School Reading.” The study, which was commissioned through the Department of Education, demonstrated the weaknesses and shortcomings of RtI, going as far as to say, “for those students just below the school-determined eligibility cut point in Grade 1, assignment to receive reading interventions did not improve reading outcomes; it produced negative impacts.”[15]
Finally, pages 17 and 18 of the paper discuss how dyslexia screening assessments should be implemented from kindergarten through the beginning of high school. The entire paragraph, starting with “Dyslexia screening assessments” and ending with the five bullet points on page 18, is opinion masquerading as fact. There is no evidence to support the assertions made by the authors. To the degree that sources are cited in the section, they are nowhere to be found in the reference list. If screening is conducted with an evidence-based screener, a student only needs to be screened for dyslexia once because dyslexic students are born with dyslexia—it is not acquired over time. The paper also neglects to mention the availability of affordable, evidence-based screeners that schools can use to help identify dyslexic students. If schools were to use a screener to help better identify students, they would save significant resources that are currently spent on RtI and other offerings of MTSS. Not only will the use of an effective screener save school districts precious time and resources as they try to identify students with dyslexia, an effectively employed screener and the necessary follow up testing can then ensure dyslexic students get the evidence-based instruction they deserve and need at an earlier date than would otherwise be provided.
It is clear to me that NCIL does not have the expertise or interest in properly identifying or screening for dyslexia, as is demonstrated by the significant lack of quality, peer-reviewed scholarship. Should the current grant recipients at the University of Oregon apply for another grant through the Comprehensive Centers Program, I strongly recommend that the Department of Education go in a different direction.
Thank you for considering the many concerns I laid out for you with NCIL’s “Screening for Dyslexia” paper. If I can be of further assistance to you or your staff, please do not hesitate to let me know.
Sincerely,
###