2025 Meta-Analysis Executive Summary

AID 1843060 · View on Simbli

Agenda Item

b. Division of Student Services ~ Waterford Supplemental Instructional Resource (Not to exceed $130,000) ~ Updated 8.7.2025

Summary: Presented by: Dr. Norman C. Sauce III, Chief of Student Services, Division of Student Services
Request: It is requested that the Board of Education approve the purchase of the Waterford Platform - Instructional Supplemental Resource in the amount not to exceed $130,000 from the Bright From the Start Pre-K4 Grant and the Pre-K3 General Operating Budget.
Why: Due to the proposed deployment of the Waterford Platform - Instructional Supplemental Resource across all Pre-K4 classrooms throughout the district, the total cost in the amount not to exceed $130,000 from the Bright From the Start Pre-K4 Grant and the
Pre-K3 General Operating Budget. The Waterford supplemental instructional platform is a diagnostic adaptive program for Pre-K scholars that has a strategic focus on the development of early literacy and early numeracy skills while being aligned to the Georgia Early Learning Developmental Standards, (GELDS). The programs’ systematic and explicit approach to learning that supports the gradual release model with target support for remediation and/or acceleration is aligned to each student’s learning pathway that’s highlighted by research based instructional practices. The skills that are developed in partnership with the instructional experience within the classroom setting with the utilization of the Waterford platform helps to enhance the development of early literacy, early numeracy, and foundation of school skills within our Pre-K (3&4) scholars.
Details: The DeKalb County School District, as a local educational agency (LEA) receiving Bright From the Start - (Pre-K4) grant funds, has an obligation to continue to enhance the instructional offering of our young scholars in the areas of early literacy and early numeracy. Services from the preferred vendor will support explicit instruction being delivered as an added value to our young scholar’s instructional experience within their classroom and home settings.

The DeKalb County School District currently serves over 2800 Pre-K (3&4) students within (25) Pre-K3 classes and (128) Pre-K4 classes. Having access to the Waterford Platform - Instructional Supplemental Resource will be an added value to their instructional experience within the early learning arena.

During the 2024-2025 school year, the Waterford platform was piloted across all our Pre-K3 expansion sites and Pre-K4 classes that are designated at the same schools. There was a total of 550 students utilizing the platform within the various Pre-K (3&4) expansion and piloted classrooms. Effective communication with our families is essential with ensuring that the Waterford platform is accessible and utilized at home during the school year to support our students’ instructional journey. The utilization of the platform within their classroom settings is an added value to the instructional offering that they receive form their teachers and paraprofessionals. In accordance with Board Policy DJE, Board approval is being requested for the Waterford - supplemental instructional resource to be deployed across the district within all Pre-K (3&4) classrooms.

Waterford Platform - Pre-K3 Achievement Data
The scores listed below represent the achievement data for the content areas of literacy and numeracy Pre-K3 scholars during the 2024-2025 SY.




Waterford Platform - Pre-K4 Achievement Data
The scores listed below represent the achievement data for the content areas of literacy and numeracy Pre-K4 scholars during the 2024-2025 SY.




According to DJE, Board approval is being requested for the Waterford Platform - Instructional Supplemental Resource and Professional Learning services.
Financial impact: The financial impact to the general funds for Pre-K3 students who will utilize the Waterford platform during the 2025-2025 school year will not exceed the amount of 20,000. The financial impact to the Bright From the Start funds for Pre-K4 students who will utilize the Waterford platform during the 2025-2026 school year will not exceed the amount of $110,000.

Department of Early Learning and Pre-K3 Programs Charge Code:
560.0000.434000.17821.7481.1540.6014.094.2025
Department of Early Learning and Pre-K4 Programs Charge Code:
560.2300.553200.17821.7481.1540.8010.094.2026
560.2210.511600.17821.7640.1540.8010.094.2026
Contact: Dr. Norman C. Sauce III, Chief of Student Services, Division of Student Services
Dr. Zack Phillips, Executive Director of Early Learning and Pre-K Programs, Division of Student Services, 678-676-2048
Effective: Upon Board Approval
Status: Approved by the Office of Legal Affairs
The Efficacy of Waterford’s Programs:
A Meta-Analysis of a Decade of Research

Executive Summary
The Big Picture
Early learning lays the foundation for
lifelong success. A decade of research shows
Waterford programs work!

Key takeaways of this report:
⦁ Waterford programs help children make
  learning gains beyond what they would have
  achieved in a year.
⦁ On average, students advance a full year or
  more beyond expected growth.1
⦁ Results span demographics including children
  from the most under-resourced communities.




                                    Meta-Analysis Executive Summary 1
The Proof is in the Numbers
To find out if Waterford programs help children in PreK through 2nd grade
learn critical skills, we conducted a meta-analysis—a study combining data
from multiple studies to draw a single conclusion.




        Data Included in the Meta-Analysis




          38             Published, peer-reviewed studies




    10                   9                 13                      6
  ESSA Tier 1         ESSA Tier 2         ESSA Tier 3          ESSA Tier 4
   Studies             Studies             Studies               Studies




     More than   48,000                       Data from the last
     Waterford learners in
     PreK through 2nd grade                        10 years

                                                 Meta-Analysis Executive Summary 2
The Results?
Waterford Makes a Strong Impact on
PreK through 2nd Grade Learning

Research shows Waterford’s reading and math programs help children
learn foundational reading and math skills. Waterford works:

 ⦁ For children in PreK through 2nd grade
 ⦁ Across demographics:
     °   Race and ethnicity
     °   Children experiencing poverty
     °   Multilingual learners
     °   Children receiving special education services
 ⦁ No matter where children use the program: at home or school

Children using Waterford programs make significant learning gains. On average,
students advance a full year or more beyond expected growth—and those gains
continue to benefit them in the long term.


                       Average Effect Size for Waterford’s Programs
                             for Grades PreK through Second
         0.6

         0.5
                 .51                                    .49
         0.4                                 .45                     .46
                                                                                 .44                        .42
                                .39
         0.3                                                                                    .34
                                                                                                                       0.25
                                                                                                                      Benchmark
         0.2

         0.1

         0.0
                PreK        Kindergarten    First      Second      Overall       Pre-K      Kindergarten Overall
                 13,421          9,628       11,970      11,170      46,189       2,781          731        3,512
                students       students    students    students     students    students      students    students
               21 studies     13 studies   9 studies   4 studies   35 studies   7 studies     2 studies   9 studies



                                                             Grade
                                                       Reading          Math


    Effect size is used to measure the magnitude of student growth. According to the
    National Institute for Direct Instruction (NIFDI), effect sizes over 0.25 are considered
    educationally important, providing a meaningful indication of student progress.


                                                                                     Meta-Analysis Executive Summary 3
Effective Across Demographics
Across various demographics and backgrounds, children develop their skills
with Waterford. Waterford works for children spanning race and ethnicity; those
experiencing poverty; multilingual learners; and children receiving special education
services.

Black/African American, Latino/a, and multilingual learners saw the most significant
outcomes in reading, making learning gains beyond what is typical in an academic year.


                                                   Race and Ethnicity
                     Race/Ethnicity
                         7 Studies                 Among the racial and ethnic groups in our studies,
               0.7
                                                   Waterford is a proven solution for growing children’s
               0.6
                        .68                        literacy skills. The effects of using Waterford were larger
               0.5                        .55
                                                   than what is considered educationally significant.
                                  .51
 Effect Size




               0.4
                                                   Black/African American students saw the most
               0.3
                                                   significant outcomes in reading, fostering learning gains
               0.2
                                                   beyond what they would have achieved in a year.
               0.1

               0.0                                 For Latino/a students, the impact of using Waterford
                       Black/ Latino/a White/
                       African   7,726 Caucasian   well exceeded the benchmark for meaningful
                      American
                                         3,320
                        7,093
                               students
                                        students
                                                   growth in reading, and that was also the case for
                      students
                                                   White/Caucasian students.
                              Reading
                                                   These positive results for historically underserved
                                                   populations highlight the program’s potential to bridge
                                                   achievement gaps.

                                                   → For more information in the white paper full text, see
                                                     page 9.




                                                                            Meta-Analysis Executive Summary 4
                                                                     Children Experiencing Poverty
              Experiencing Poverty
                                 7 Studies                           For children experiencing poverty, Waterford improves
                0.5                                                  educational outcomes, helping students achieve
 Effect Size




                0.4                                                  reading gains beyond what they would have achieved
                                                  .38                in half a year. These strong results are demonstrated
                0.3               .33
                0.2                                                  across seven studies, with nearly 2,500 students.
                0.1
                                                                     → For more information in the white paper full text,
                0.0
                                  Yes             No                   see page 9.
                                  2,495           3,111
                                 students       students


                                    Reading



                                                                      Multilingual Learners
              Multilingual Learner
                                 4 Studies                            On average, multilingual learners using Waterford
                0.7                                                   advanced more than a full year beyond expected
                0.6                                                   growth—results that show how the program
                0.5               .56                                 can help underserved students make significant
 Effect Size




                0.4                               .44                 literacy gains.
                0.3
                                                                      → For more information in the white paper full text,
                0.2

                0.1
                                                                        see page 9.
                0.0
                                  Yes             No
                                   889           6,079
                                 students       students


                                    Reading




               Special Education Status
                                                                      Children Receiving Special
              0.9
                                                                      Education Services
              0.8

              0.7
                       .81                                            Results show students receiving special education
              0.6
                                                .69
                                                                      services saw large improvements in both reading
              0.5
                                   .50                     .49
                                                                      and math and advanced more than a full year
Effect Size




              0.4
                                                                      beyond expected growth when using Waterford.
              0.3

              0.2
                                                                      → For more information in the white paper full text,
              0.1

              0.0                                                       see page 9.
                       Yes          No          Yes         No
                        519        3,548        306        1,258
                      students    students    students    students


                          Reading            Math
                          4 Studies          3 Studies




                                                                                             Meta-Analysis Executive Summary 5
Effective Wherever Children Use
the Program
Children succeed in learning critical skills with Waterford whether they
use the program at home or school, and no matter who is leading their
learning--a parent, caregiver, or teacher. This flexibility can help level
the playing field to meet children where they are with high-quality
instructional materials.

→ For more information in the white paper full text, see page 12.




             Average Effect Size for Waterford’s Programs
                      by Implementation Model
                 0.6

                 0.5
                                                                     .48
   Effect Size




                 0.4      .45            .45
                 0.3
                                                          .38
                                                                                    0.25
                                                                                   Benchmark
                 0.2

                 0.1

                 0.0
                       Home-based Place-based         Home-based Place-based
                          14,281         31,908           2,226       1,609
                         students       students        students    students
                        21 studies     14 studies       6 studies   3 studies


                                     Location of Programs Use
                                            Reading     Math




                                                                            Meta-Analysis Executive Summary 6
More Evidence That Waterford Works
Third-party Assessment Data Proves
Waterford’s Effectiveness
Analysis of outcomes from students using Waterford, as measured
by third-party assessments, reveals two key findings: 1) on average,
children who used Waterford outperformed those who did not, and 2)
these results are consistent across all assessments.

→ For more information in the white paper full text, see page 10.




                     Average Effect Size for Waterford’s Programs
                                    by Assessment
       0.7
                            .68
       0.6

       0.5
               .52
       0.4                                                      .44
                                                                                                      .41
                                         .38         .38
       0.3                                                                   .34          .32                    0.25
       0.2                                                                                 .27                  Benchmark


       0.1

       0.0
             Brigance     Bader       NWEA MAP     KTEA-3       DRA        Acadience     STAR       KTEA-3
                3,844       2,723        3,085       1,832       3,769        5,059        770        2,102
              students    students     students    students    students     students    students    students
             12 studies   8 studies    5 studies   4 studies   3 studies    3 studies   2 studies   5 studies


                                                     Assessment
                                                    Reading          Math




                                                                                  Meta-Analysis Executive Summary 7
Our Programs Meet the
Highest Standards Set by the
U.S. Department of Education
The studies demonstrate Waterford’s effectiveness using stringent
standards. Among the most widely used standards for educational
research is the four-tiered Every Student Succeeds Act (ESSA) system
defined by the U.S. Department of Education.

ESSA aims to improve student outcomes by setting standards for
“evidence-based” interventions, making it easier for school systems
to choose programs that work. These studies are well designed, show
positive learning outcomes, and, for tier 1 and 2 studies, include at least
350 students in two locations.

Students using Waterford far exceed the educationally important
benchmark across all ESSA tiers, demonstrating success across a body
of rigorous research.

→ For more information in the white paper full text, see page 11.



                       Average Effect Size for Waterford’s
                            Programs by ESSA Tier
                 0.6

                 0.5                  .54          .52
                                                                                       .49
   Effect Size




                 0.4
                                                               .41         .41
                 0.3
                         .30                                                                       0.25
                                                                                                  Benchmark
                 0.2

                 0.1

                 0.0
                        Tier 1       Tier 2      Tier 3       Tier 4      Tier 1      Tier 2
                          5,897       7,480       20,573      12,239       2,102       1,609
                        students    students     students    students    students    students
                       10 studies   9 studies   13 studies   6 studies   5 studies   3 studies


                                                   ESSA Tier
                                                Reading            Math




                                                                                           Meta-Analysis Executive Summary 8
Waterford Makes a Lasting Impact
                                                   When conducting research, one of the
          Average Effect Size for                  biggest questions is: Do learning gains hold
          Waterford’s Program for                  up over time?
           Longitudinal Results
                 9 Studies                         Data from 9 studies including over 33,000
                  0.4                              students using Waterford’s reading
                                                   curriculum shows the answer is yes!
    Effect Size




                  0.3
                                        0.25
                  0.2       .25        Benchmark
                                                   This is further evidence that Waterford can
                  0.1
                                                   close early learning gaps for students across
                  0.0
                        Longitudinal
                                                   various backgrounds, putting them on a
                           33,387                  path for long-term academic success.
                           students


                          Reading




                                             Ready to improve literacy
                                             in your community?
                                             Let’s discuss how we can work
                                             together to make an impact.
                  By partnering with Waterford, you’re not just investing in a program;
                  you’re investing in your community’s future. We believe in the power of
                  collaboration, and we’re ready to work with you to create an educational
                  experience that gives every child the best chance to succeed. Let’s make
                  a difference together.




1
     An effect size of around 0.4 is commonly used as a benchmark for a year of academic growth, based on
John Hattie’s research in Visible Learning for Teachers. However, this value can vary depending on factors
such as subject, grade level, assessment type, and educational context. Therefore, while 0.4 serves as a
general guideline, interpreting effect size requires careful consideration of specific educational settings
and assessment methods.

                                                                        Meta-Analysis Executive Summary 9
Waterford.org is a national early education nonprofit
that provides research-backed PreK through 2nd grade
reading, math, and science programs that children can
use wherever they learn.

Our tailored programs help children reach critical
milestones by third grade, laying the foundation for
future success for every child.




                                       Meta-Analysis Executive Summary 10