DCSD GA Computer Evaluation Services Level Data Proposal.docx (2)

AID 1620615 · View on Simbli

Agenda Item

a. RFP# 24-568 Level Data LLC (Not to exceed $247,887)

Summary: Presented by: Dr. Markisha Mitchell, Chief Accountability & Continuous Improvement, Division of Accountability & Continuous Improvement,
Request: It is requested that the Board of Education approve the award and contract for computer program evaluation services to Level Data LLC in an amount not to exceed $247,887.
Why: Level Data is the leading provider in Education Return on Investment (eROI) analysis. Its suite of software applications capture academic strategy, strategic alignment tools, resources, programs and associated cost to conduct eROI analysis. Level Data’s computer program evaluation process helps school districts answer questions like:

What resources do we have and what is the impact student learning?
Are students using the resources to the appropriate degree for optimal success?
Which resources are giving us the greatest return on investment?
How much did we spend on each resource? Are we engaging in effective spending and/or duplication of resources?


Level Data’s work with school districts illuminates core requirements for Education Return on Investment (eROI) to work in a practical educational setting allowing districts to measure the educational effectiveness and impact of district and school programs. To accomplish this, they will provide correlations to properly analyze the impact of programs.

The platform will combine and correlate disparate data sets out of multiple internal systems across a school district (expenditures, student information system data, student achievement data, program data). Additionally, strategic alignment (objective, goal, measurement, and target audience) will be captured for each item under analysis. Level Data’s experts have determined a successful implementation approach consisting of a combination of return on investment software, data analysis, and onsite/virtual meetings.

The AIM return on investment platform triangulates data from financials, student demographics, and student achievement, as well as usage/participation data when applicable, to calculate the eROI of each instructional program under analysis. Level Data’s technology securely and seamlessly integrates data and provides integration through a concierge data service, minimizing the workload on district technology staff. Level Data’s team of experts guide school districts through this process to ensure a successful evaluation of programs that lends to greater efficiency and improvements in student achievement.
Details: RFP 24-568 was competitively solicited through the Purchasing Department. It was posted to the DCSD IonWave website and the Georgia Procurement Registry on November 16, 2023. Electronic notification was sent to 56 vendors from the DCSD Vendor Bid List, 1605 vendors through the state of GA Procurement Registry and 385 vendors through IonWave. Three proposals were reviewed and deemed responsive to the requirements of the solicitation. The three responsive proposals were evaluated by the selection committee.
Financial impact: The purchase amount not to exceed $247,887 will be paid using ESSER funds

448.2210.530000.30521.7030.4190.8010.030.2022
Contact: Dr. Markisha Mitchell, Chief Accountability & Continuous Improvement, Division of Accountability & Continuous Improvement, 678.676.0300
Effective: March 2024-July 2024
DCSD GA Computer Evaluation Services RFP




Table of Contents
RFP 24- 568 Computer Program Evaluation Services                                      3
Addenda                                                                              26
Audited Company Financial Statements/Company Annual Reports for 2021 and 2022        27
Business License                                                                     28
Certificate of Insurance                                                             30
Attachment A – Cost Proposal Form/Fee Schedule                                       31
Attachment B – Non-Collusion                                                         32
Attachment C - Conflict of Interest                                                  33
Attachment D – Critical Paragraphs                                                   34
Attachment E – Offeror’s Client Reference Form                                       35
Attachment F – Statement of Confidentiality and Non-Disclosure                       37
Attachment G – Suspension and Debarment Certification                                38
Attachment H – Immigration & Security Certification                                  39
Attachment I – Sample Service Agreement                                              44
Attachment J– Signature Page                                                         63
Company Profile                                                                      64
    About Level Data                                                                 64
    Company Principals                                                               64
    Primary Contacts                                                                 65
    Organizational Structure                                                         65
    Personnel Assigned to this Project                                               66
        Project Personnel Biographical Summaries                                     66
    Current and Past Experience on Similar Projects                                  73
    Compliance Information                                                           75
    Litigation Information                                                           75
Project Scope of Work                                                                76
    Introduction to Level Data                                                       76
    Level Data’s Evaluation Approach                                                 76
        Strategic Resource Alignment                                                 77
        AIM: Education Return on Investment (eROI) Platform                          78
        Key Functionality                                                            78
        Scope of Services                                                            80
        Implementation & Onboarding Process                                          85

                                                                                1 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



            Level Data Training & Customer Support Model                             94
Brochures, Catalogs, Manuals, Websites, Literature, and other marketing media       105
Added Value                                                                         108
    Additional Key Features                                                         110




                                                                                2 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




RFP 24- 568 Computer Program Evaluation Services




                                                   3 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 4 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 5 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 6 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 7 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 8 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 9 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 10 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 11 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 12 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 13 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 14 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 15 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 16 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 17 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 18 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 19 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 20 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 21 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 22 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 23 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 24 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 25 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Addenda




                                                 26 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Audited Company Financial Statements/Company Annual
Reports for 2021 and 2022

   1. Level Data was purchased by Boston Ventures Home Page - Boston Ventures in August of 2022. We
      have provided the relevant tax returns which are those from the purchase date forward. Tax returns
      prior to August of 2022 do not provide accurate information about the current financial stability of
      Level Data. We have provided a P&L for Level Data pre-acquisition for the 2021 fiscal year.
   2. Level Data is not publicly traded.
   3. Not applicable.
   4. There are no criminal or civil proceedings involving Level Data.
   5. Level Data has not filed a petition in bankruptcy or taken any actions with respect to insolvency or
      any other relief from creditors.
   6. Level Data has not been the subject of any order, judgment, or decree and have not been enjoined
      from engaging in any type of business practice.
   7. We are not including the financial documents in this proposal document. Financial documents of
      privately held companies are Private and Confidential and both documents are watermarked with
      that designation. The PW to the 2022 financial data is 07579cpa




                                                                                                  27 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Business License




                                                 28 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 29 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Certificate of Insurance




                                                 30 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment A – Cost Proposal Form/Fee Schedule




                                                 31 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment B – Non-Collusion




                                                 32 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment C - Conflict of Interest




                                                 33 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment D – Critical Paragraphs




                                                 34 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment E – Offeror’s Client Reference Form




                                                 35 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 36 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment F – Statement of Confidentiality and
Non-Disclosure




                                                  37 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment G – Suspension and Debarment Certification




                                                        38 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment H – Immigration & Security Certification




                                                      39 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 40 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 41 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 42 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 43 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment I – Sample Service Agreement




                                                 44 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 45 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 46 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 47 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 48 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 49 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 50 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 51 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 52 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 53 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 54 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 55 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 56 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 57 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 58 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 59 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 60 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 61 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 62 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Attachment J– Signature Page




                                                 63 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Company Profile
About Level Data

Level Data, LLC, North America’s leading K-12 student data validation and return on investment software
provider, serves more than 7 million in student population. The company was established on June 19, 2007
and has been doing business under the Level Data name for the past 16 years. Level Data is a Delaware
Limited Liability Corporation - S Corp. Please refer to the included business license for confirmation of
company formation.

The company’s corporate headquarters is located at 6850 Stadium Drive, Kalamazoo, MI 49009, with
company branches located in both Huntsville, Alabama and Franklin, Tennessee.

Most districts struggle with data quality which influences learning and funding. At Level Data, our mission is
to provide simple solutions that deliver data districts can trust so they can lead with confidence and focus on
what really matters. Level Data maintains data providing services surrounding data analytics, reporting, and
return on investment, for more than 1,700 school districts directly in the U.S and Canada, along with eleven
State Departments of Education across the U.S. and all associated districts in those states.

While the privately-owned company is considered small in relation to larger corporations in the industry,
Level Data has 125 employees. As for company principals, Gary Fortier serves as Chief Executive Officer and
Matthew Wellner serves as Chief Financial Officer.

Level Data has a strong financial standing, as evidenced in the shared financial statements. Level Data is
majority owned by BV Investments. Financial backing from BV Investments provides significant financial
strength for the company. “BV partners with entrepreneurs and families to invest in sound businesses and
provide them with significant strategic, operating, and analytical assistance.”


Company Principals
 Name                        Title

 Gary Fortier                Chief Executive Officer

 Matthew Wellner             Chief Finance Officer




                                                                                                      64 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Primary Contacts
 Name                        Title                       Phone/Fax               Email Address

 Adam Pearson                Chief Customer Officer      866-511-3282            apearson@leveldata.com

 Nicole Pezent               Director of Strategic &     866-511-3282            npezent@leveldata.com
                             State Account
                             Management



Organizational Structure
The following is an organizational chart illustrating the company’s structure.




                                                                                                 65 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Personnel Assigned to this Project
The following is a list of management-level employee(s) the firm intends to assign to the project. Experience
and certifications can be found in the bios attached below.

 Name             Title               Role/Responsibilities for Project

 Adam Pearson     Chief Customer          ●   Initiate onboarding and initial implementation
                  Officer                 ●   Manage customer success team to ensure a timely delivery
                                              of project scope
                                          ●   Enhance overall customer experience

 Marty Reed       Chief Product           ●   Manage project flow for AIM product implementation and
                  Officer                     other technical needs relating to program evaluation

 Nicole Pezent    Director of             ●   Manage customer success team to ensure a timely delivery
                  Strategic & State           of project scope
                  Account                 ●   Provide theory and approach for product evaluation
                                          ●   Lead project alignment to school improvement
                  Management




Project Personnel Biographical Summaries




                                                                                                     66 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 67 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 68 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 69 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 70 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 71 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 72 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Current and Past Experience on Similar Projects

Level Data has a proven track record of success with over seven years in public K-12 Return on Investment
evaluations, having worked with districts across the southeast in Georgia, Tennessee, Mississippi, Alabama,
Louisiana, South Carolina, and in Illinois. ​Many of these districts share similar demographic and
socio-economic traits as DeKalb County School District, making Level Data a well qualified partner to deliver
the requested project for computer program evaluations.

Level Data currently serves school districts ranging from 300 students to over 100,000 students with a recent
partnership with The School District of Lee County in Florida. Districts have historically struggled to measure
education return on investment internally due to the complex nature of correlating expenditures to student
outcomes. School systems have benefited from Level Data’s methodology by reevaluating implementation
plans related to instructional software, eliminating duplicative purchases coupled with decision analysis
resolution exercises to yield the better performing software remains for student outcomes, better
organizational alignment of district staff, implementation of processes, and the development and tracking of
Key Performance Indicators.

Level Data has the capacity to deliver the requested project to evaluate computer programs for DeKalb
County School District from both a human resource and product standpoint. Company leadership, as defined
in the included company organizational chart, oversees a team of data specialists, developers, programmers,
implementation, customer success team, and trainers. This team will work in partnership with the DeKalb
County School District team to provide a turnkey solution through project scoping, data integration, setup,
software training, and support. Your implementation team has over 55 years of education data experience.
With knowledge and understanding of both return on investment, student data, and student achievement,
the DeKalb County School District will benefit from the knowledge and support of the partnership with Level
Data.

Level Data is committed to supporting the vision and mission of school districts in each implementation and
strives to work with district leadership to carry out their theory for continuous improvement as part of the
overall return on investment process. As it relates to this project, DeKalb County School District will be
assigned a customer success team for the project, as well as other lead trainers as defined by the training in
the agreement. Level Data trainers provide an insurmountable level of experience in school improvement and
achievement work combined with student data knowledge, bringing best practices of Education Return on
Investment to partnering districts.

Additionally, program experience in conducting technical and data analysis in education, business, software
development, and finance is represented collectively through successfully supporting over 200 school districts

                                                                                                      73 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



implement and sustain continuous improvement in raising effectiveness while eliminating waste. This
experience differentiates Level Data from one time program evaluation methods, as the company is equipped
to provide innovative solutions to enhance and optimize the delivery and consumption of the data analysis
findings, eliminating many of the roadblocks that may be present in a more manual delivery method. Level
Data’s data analytic tools have consistently proven to identify ineffective spending as well as unmanaged
spending resulting from lack of use. The savings and identification of ineffective spending attributed to similar
analyses is well over $145 million and/or increasing student achievement through appropriate alignment of
resources.

Level Data has experience evaluating various educational computer programs being utilized currently in
districts in the United States. Some of these include but are definitely not limited to BrainPOP, Brainchild,
Curriculum Associates - iReady, Curriculum Advantage, NWEA MAP, Renaissance, ENA, BirdBrain Technologies,
Renaissance, OdysseyWare, Edgenuity, Edmentum, Cengage Learning, Project Lead The Way, John Baylor
Prep, ACT Online Prep, USA Test Prep, Study Island, Imagine Learning, Scantron, IXL, BrainPOP, Professional
Development organizations, etc. Additionally, Level Data has experience with non-instructional administrative
computer platforms and services that support the overall education mission of school districts, both from an
ROI and process perspective.

While identifying computer programs being used in DeKalb County School District and accessing the needed
data to perform a program evaluation may be a challenge for some approaches, Level Data’s expertise in
capturing data from these and other computer programs make the company fully equipped to provide this
service to DeKalb County School District.

Examples of similar work are highlighted in our reference districts below:

    ●   Desoto County Schools partners with Level Data on an ongoing basis to identify any ineffective
        spending as well as optimize funds around instructional needs. As the largest and one of the highest
        achieving school districts in Mississippi, it is necessary that they continue to raise the bar for students
        to maintain a high caliber of education for families and communities in Desoto County. Level Data has
        supported that goal by helping to maximize return on investment & instruction. Level Data has
        helped Desoto County Schools identify, inventory, and evaluate resources aligned to instructional
        priorities across the district. Level Data has also been instrumental in helping align return on
        instruction at the classroom level to ensure resource implementations are helping meet the needs of
        our students down to specific classroom and subgroups.

    ●   Cherokee County School District has partnered with Level Data to measure and raise return on
        investment & instruction. Level Data’s software solution has helped accomplish this goal by
        measuring return on investment, determining effectiveness of education programs, as well as return

                                                                                                         74 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



        on classroom instruction. As the end of relief funding approaches, Level Data is helping Cherokee
        County identify resources with a high return on investment and provide guidance on resources that
        can be strategically abandoned. Level Data has also been instrumental in helping align return on
        instruction at the classroom level to ensure classroom grades reflect performance on summative
        assessments. Cherokee County leaders have shared that they wished they had embarked on this
        continuous improvement work long ago but are happy to be currently going through the process with
        the Level Data team.


Compliance Information

Level Data is registered to do business in the State of Georgia and has provided a copy of our business
registration as requested. Individual employee licenses are not required for this contract.

Litigation Information

The company has had no litigation filed against us in the last 5 years.

The company has never failed to complete a contract or contracts or have defaulted or been declared in
default on any contract.

We have had no contracts terminated with or without cause.




                                                                                                     75 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Project Scope of Work

Introduction to Level Data

Level Data is the leading provider in Education Return on Investment (eROI) analysis. Its suite of software
applications capture academic strategy, strategically align tools, resources, personnel, programs, and
associated costs to conduct eROI analysis. In collaboration with state and district administrators, a suite of
proprietary applications was created to deliver ongoing insights into the educational efficacy of resources,
pinpointing exactly where corrective actions will increase the educational return and eliminate ineffective
spending.

Level Data’s commitment to DeKalb County School District is to help administrators uncover valuable insights
into the efficacy of targeted computer products and programs to positively impact student achievement. To
accomplish this, Level Data’s AIM return on investment platform will capture, manage, and evaluate the
effectiveness of selected computer programs and resources in relation to student outcomes.

Level Data’s computer program evaluation process helps school district administrators answer questions such
as:

    ●   What all do we have to impact student learning? (including district, department specific, school level
        tools/resources)
    ●   Are students using the resources to the appropriate degree for optimal success?
    ●   Which resources are giving us the greatest return on investment?
    ●   How much did we spend on each resource? Do we have ineffective spending or duplication of
        resources?


Level Data’s Evaluation Approach

Level Data’s work with school districts illuminates core requirements for Education Return on Investment
(eROI) to work in a practical educational setting allowing districts to measure the educational effectiveness
and impact of district and school programs. Education Return on Investment (eROI) and Usage Return on
Investment (uROI) analysis requires student level correlations and strategic alignment to be accurate and
relevant. To accomplish this, it is necessary to have a tool to provide these correlations to properly analyze
the impact of programs. The platform must combine and correlate disparate data sets out of multiple internal
systems across a school district (expenditures, student information system data, student achievement data,
program data). Additionally, strategic alignment (objective, goal, measurement, and target audience) must be
captured for each item under analysis, as this data typically is not readily available in a school district.

                                                                                                        76 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Strategic alignment provides the necessary context to accurately evaluate the efficacy of educational activities
based on the desired intent and outcomes.

Level Data’s experts have determined a successful implementation approach consisting of a combination of
return on investment software, data analysis, and onsite/virtual meetings. The AIM return on investment
platform triangulates data from financials, student demographics, and student achievement, as well as
usage/participation data when applicable, to calculate the eROI of each instructional program under analysis.
Level Data’s technology securely and seamlessly integrates data and provides integration through a concierge
data service, minimizing the workload on district technology staff. Level Data’s team of experts guide school
districts through this process to ensure a successful evaluation of programs that lends to greater efficiency
and improvements in student achievement.

Strategic Resource Alignment

Level Data’s proprietary Education Strategic Planning (ESP) module captures the strategic alignment of
instructional programs, products, personnel, resources, initiatives and strategies targeting student
achievement. The module also captures the intent, goals, and usage expectations of the resource/program.
The ESP application:



                                                                 ● Captures the objective of the
                                                            strategy
                                                                 ● Captures appropriate performance
                                                            measure, metric, and goal
                                                                 ● Captures the strategic alignment of tools
                                                            and resources
                                                                 ● Captures the usage/fidelity expectations
                                                            of each tool and resource


                                                             Strategic resource alignment provides the
                                                             foundation of the Education Return on Investment
process. Unless the aforementioned components are documented, eROI analysis loses context and meaning
for stakeholders who are responsible for managing and improving eROI. The ESP module allows district and
school level stakeholders to automate the correlation of educational programs with student outcomes, taking
the evaluation workload off of district staff and minimizing the need to gather or create data to complete the
evaluation.

Level Data’s approach to identifying the instructional programs begins with a district Accounts Payable file. By
gaining access to all instructional expenditures that have been purchased by DeKalb County School District,

                                                                                                      77 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Level Data eases the workload and need for DeKalb County School District staff to compile surveys, lists or
other means to determine which computer programs the district has in place. This also allows for capturing of
any district level, school level, or departmental purchases. The district will have the opportunity to add any
additional findings to this list; however, the bulk of the identification process is completed with this step.



AIM: Education Return on
Investment (eROI) Platform
Level Data’s proprietary AIM application
correlates financial, academic data (formative,
summative, progress monitoring), student
demographic data, and course/class roster
information all in one single location to
execute Education Return on Investment
analysis. AIM has the capacity to evaluate
computer programs, personnel, tools and
resources in the context of strategically
aligned student outcomes and utilization
parameters as defined by key education
stakeholders. Administrators access visual
insights to understand the relationship between educational activities, the budget, and ways to optimize
instruction to improve student educational growth.

Key Functionality
 Correlation Reporting Engine    AIM correlates the alignment of products, programs, personnel, and
                                 resources down to the student level (versus the school cost center).
                                 This allows AIM to conduct extensive Usage Return on Investment
                                 (uROI) and eROI analysis and present findings with drill downs by state,
                                 district, school, by grade level, by teacher, by class section, and by
                                 student. Without student level correlation, uROI and eROI analysis
                                 would be incomplete, inaccurate, and difficult to pinpoint exactly where
                                 corrective actions need to be implemented to improve student
                                 outcomes.

 Multi-Variate Analysis Tools    AIM is a multivariate platform. The platform is capable of capturing,
                                 layering, and evaluating multiple data points in isolation or in
                                 conjunction to analyze variables and influencers on student outcomes.



                                                                                                    78 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



 Disparate Expenditures        Level Data will gather all financials associated with the performance
                               evaluation. AIM disaggregates each expenditure to a per student
                               expenditure and also groups expenditures in order to provide “whole
                               cost” analysis for projects with stated objectives.

 Strategic Resource            Level Data’s AIM platform captures, aligns, and correlates student
 Alignment- Impact Area &      achievement activities into impact areas and strategic objectives. Each
 Objective Analysis            area correlates associated costs, measurements, and three forms of ROI
                               analysis. District administrators can easily view across the district down
                               to the individual school level the strategic alignment of these activities
                               and the educational impact or down to the student level. The analysis
                               may be filtered down by a variety of factors including but not limited to
                               course/class section, grade level, funding source, etc, and quickly
                               unearths misalignments between spending and strategic objectives.

 Resource Impact Report        AIM allows administrators to view the impact of resources identified on
                               the strategic resource alignment module. The report includes the
                               allocated cost, % of students meeting the fidelity threshold, ineffective
                               spend and overall education impact. Education impact is evaluated on
                               students meeting fidelity/receiving exposure versus those that are not.
                               From the resource impact report, district or school administrators can
                               document recommended actions for continuous improvement plans, as
                               well as for evidence for the use of federal funds.

 Dynamic Student Level         AIM allows administrators to dynamically correlate independent or
 Correlations                  multiple variables down to the student level. Each correlation may be
                               modified in real time for dynamic analysis, review, and refinement.

 Academic, Financial, and      Following the execution of a MOA (Memorandum of Agreement), Level
 Student Information           Data will obtain data access to gather student academic data,
 Onboarding                    associated with curriculum, and student information system data
                               through direct integration or secure upload. A Level Data representative
                               will work directly with a designated DeKalb County School District
                               representative to obtain relevant education financial expenditures.
                               Academic
                                    ● AIM allows the inclusion of state accountability, formative, and
                                        progress monitoring data as performance measures
                               Financial
                                    ● AIM allows the inclusion of financial data either input directly
                                        into the system or ingested from financial accounts payable
                                        files
                               Student Information:



                                                                                                   79 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



                                     ●   AIM ingests student demographic data to help administrators
                                         identify insights by particular subgroups of interest
                                     ●   AIM ingests student course and roster information to let
                                         administrators analyze eROI insights by
                                         school/teacher/grade/section/subgroup

 Dynamic Context Tagging         AIM allows the creation of custom tags for expenditures, students, and
                                 measurements. These tags may be applied dynamically for use in eROI
                                 analysis.

 Longitudinal Data               AIM allows districts to look at different variables across multiple years
 Correlations                    to determine the longitudinal impact of the variables. This provides
                                 administrators the ability to review the impact of numerous variables
                                 regardless when they were implemented and/or expected eROI
                                 timeframe.

 Dynamic eROI Analysis           The AIM software platform generates eROI analysis from the collected
 Calculations by Benchmark,      data sets including financials, student achievement, and participation to
 Growth Goal, & Learning         calculate the eROI of the instructional tool being deployed. The AIM
 Gains                           platform allows dynamic correlations between the strategic alignment
                                 of resources and the eROI calculations based on the information
                                 captured within the ESP module. The eROI may be calculated by
                                 benchmark (proficiency), growth goal, and learning gains. Goals may be
                                 specific to schools/grade levels allowing schools to measure against
                                 continuous improvement targets.

 Evaluate eROI by grade level,   Student level correlations allow AIM to conduct extensive uROI and
 school, teacher, subgroup,      eROI analysis to present findings with drill downs by district, by school,
 student, vendor, resource, or   by grade level, by teacher, by subgroup, by class section, by
 strategy                        vendor/resource/strategy and by student.




Scope of Services
    ●   Identify strengths and weaknesses in purchased computer applications.

Level Data’s SaaS approach provides an objective evaluation highlighting strengths and weaknesses in
educational computer applications. Level Data evaluates the effectiveness of the selected computer programs
in the context of student outcomes. Existing district performance measures such as summative, benchmark,
and formative assessments will be identified as key performance indicators to measure the academic efficacy
of the programs, eliminating the need to create new measurements or implement additional assessments.


                                                                                                      80 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Performance measures will be aligned with accountability, providing evidence-based data to guide future
decisions on both instructional offerings as well as budget optimization.

Level Data’s insights are analyzed across schools, grade levels, classrooms, and subgroups, providing an easy
method to determine exactly where programs are or aren’t being successful for students. By evaluating each
resource down to these granular levels based on student performance, district administrators gain an
understanding of each program’s curriculum alignment by subject area and grade span to understand each
program’s strengths and weaknesses as it relates to the impact on student achievement.

    ●   Identify successful programs and resources, and areas needing improvement.

The success of programs and resources hinges on the proper use and implementation of those resources
alongside classroom instruction. Level Data’s reports not only highlight gaps in alignment in relation to
academic accountability, but also identify areas needing improvement, such as the fidelity of implementation
of the selected resources across campuses and classrooms.

The usage ROI (uROI) highlighted in Level Data’s ROI resource report provides administrators with a clear
understanding of where and how each program is being implemented, providing breakdowns by grade level,
campus and down to each classroom to help determine areas needing improvement in relation to
implementation fidelity. Level Data’s uROI reports show exactly which classrooms are or are not implementing
programs to fidelity and how that is contributing to student success. Not only will this help the DeKalb County
team evaluate their programs but it also provides an ongoing method for managing and monitoring
expectations with staff which is essential for continuous improvement.

    ●   Identify resources that are and are not being allocated efficiently.

Because Level Data’s AIM platform correlates instructional spending on programs to student outcomes, it
highlights resource allocation efficiency. Level Data’s approach ingests instructional spending from the
accounts payable file as part of the program evaluation process, delivering insights on allocated cost per
program, underutilized spend, as well as education return on investment (eROI) measures.

Data insights from the ROI resource report guide administrators on where allocations can be optimized,
adjusted, or repositioned to ensure increased efficiency and to maximize every dollar being spent on
instructional resources. Level Data’s ROI resource report highlights whether the issue may be program
effectiveness or if the issue is lack of fidelity with the intended plan of implementation.

An instructional evaluation alone may be too narrow, as programs may be duplicated or ineffective in relation
to the associated costs that have been allocated to programs. Level Data’s evaluation approach captures
resource spending and identifies students in need through the return or instruction reporting, providing a
holistic view to resource efficiency.



                                                                                                     81 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



    ●   Generate valuable data that can be used to identify evidence-based best practices.

Level Data’s evaluation process helps guide instructional decisions with supporting evidence to ensure
success for the students of DeKalb County School District. Level Data’s insights provide the analysis from both
an instructional and financial lens, allowing for more meaningful cross-departmental collaboration and
decision making on resource allocation. Districts can be confident in their ability to make these decisions as
the data is provided as an objective measure of success.

By combining financial and instructional data, the administrative team will have evidence to show exactly
where programs are or aren’t working for the actual students being served by DeKalb County School District,
allowing for more meaningful cross-departmental collaboration and decision making on resource allocation.
When determining which programs to sustain or discontinue, districts can be confident in their ability to
make these decisions in the strategic abandonment process with accurate, comprehensive information..

To accomplish this, Level Data’s Impact Analysis Reporting feature allows districts to see the ROI of each
curriculum expenditure in isolation or in aggregate by strategic objective. ROI is expressed in three primary
ways: Categories are Distribution, Effect Size, and eROI. Each category shows the impact in a percentage
format but will also provide the user the ability to drill down to the raw student data. The Distribution section
shows which students were exposed to the variable(s) and breaks down which students responded positively
or negatively to the variable(s). This analysis allows administrators to drill down to the individual student level
to identify areas for improvement. The Effect size analysis shows to what degree the students responded to
the variables (Did the student grow, stay the same, or decline?). This analysis displays the effect size and
average scores across the entire student population in addition to the population of students that gained,
declined, or stayed the same. The ROI section shows the total amount spent on the variable(s) under analysis
return or loss based on the impact on student achievement.

    ●   Offer recommendations that will inform future program development and implementation.

Level Data will provide actionable data insights to inform future program decisions and implementation needs
to help guide district and school administrators to more successful implementations of instructional
programs. Data insights will be delivered in multiple formats, including through the ROI reports within the
platform and also presented during eROI summary data meetings with identified members of the DeKalb
County School System team.

During ROI data summary meetings, Level Data’s data analysts present back findings from the analysis to help
ensure that district leaders are equipped with evidence-based best practices to carry out next steps for future
program development and implementation. Presentations may include recommendations on areas where
program implementation can be improved, redirected, or expanded into other areas based on how well the
program implementation is contributing to student success.



                                                                                                         82 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Level Data’s SaaS approach provides an ongoing evaluation of educational resources through the return on
investment process, which provides additional benefits over a one-time program evaluation. Once strengths
and weaknesses are identified in purchased computer applications, it is imperative that the impact of student
success continues to be measured each year. In order to ensure equitable access and implementation,
districts should measure usage and fidelity of implementation down to the classroom level on an ongoing
basis, which can be very challenging without the proper tool to measure the data for multiple educational
programs. Level Data’s AIM platform provides the means to accomplish an ongoing measurement with
current students. As demographics and learning abilities change, districts must continue to analyze impact
and effectiveness for current students.

    ●   Ensure compliance with education laws and regulations, reducing legal risks for the school district.

Level Data’s expertise in data security protocols equips the project management team to support the creation
and guidance of Memorandum of Agreement/Data Governance policies for DeKalb County School District.
This will help standardize data sharing processes with third party vendors and providers to ensure
responsibility and compliance with education laws and regulations.

    ●   Reveal disparities in program outcomes among different student populations, helping districts
        address issues of equity and fairness.

Level Data supports the vision of DeKalb County School District to ensure student success, leading to higher
education, work, and life-long learning. Level Data’s AIM return on investment platform will help district
leaders ensure students are receiving equitable access and benefiting from effective instructional resources,
while revealing disparities for specific subpopulations to help enforce greater levels of equitable services for
ALL students within the district.

Level Data’s AIM platform provides districts the option for customized cohorts and subgroups, allowing any
program to be evaluated for student subpopulations including but not limited to Special Education, English
Language Learners, MTSS groups (tiered groups), free/reduced lunch, etc. By allowing a multi-layer approach
to evaluations, districts can gain insights that help inform best practices for equity across all student
populations.

    ●   Identify areas where programs can be improved, refined, or expanded to better serve the needs of
        students, teachers, and the community.

Level Data’s AIM platform identifies which resources are working for student success. Reports not only
highlight strengths or gaps in alignment in relation to academic accountability, but also identify areas needing
improvement such as the fidelity of implementation of resources across campuses and classrooms.

This data will guide next steps for continuous improvement on whether computer programs should be
continued in the current state, expanded to more students, or discontinued altogether. In addition, this data
highlights areas where implementation plans may need refining, or if there is simply a need to reset staff
                                                                                                     83 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



expectations as part of the continuous improvement process. Level Data’s process highlights valuable data
and best practices for successful implementations of the most effective programs ensuring that the needs of
students are being met in the classrooms.

Teachers will also benefit from this data as the DeKalb County team will be able to help teachers understand
what is most impactful for students and eliminate the need for teachers to choose from hundreds of different
resources. Upon completion of this process, teachers will have the most effective tools in their instructional
toolkit to better support their students. Furthermore, stakeholders and community members will be assured
that DeKalb County School District practices fiscal responsibility and puts community and tax-payer funds into
resources that are most effective for students.

    ●   Help ensure that taxpayer funds are being used effectively by providing an objective assessment of
        how well programs are meeting their intended goals.

Level Data’s AIM platform helps school districts maximize their resources including funding and time spent on
the implementation of programs throughout the district. To accomplish this, Level Data’s AIM platform
disaggregates each expenditure to a per student expenditure and also groups expenditures in order to
provide “whole cost” analysis for projects with stated objectives. The AIM platform highlights the amount of
and exactly where ineffective spending exists from an eROI and uROI perspective, providing administrators
with actionable information to impact district budgets and finances. Elimination of ineffective spending drives
student outcomes as these funds are recycled back into higher yielding resources.

By completing an eROI analysis with Level Data, DeKalb County School District can ensure taxpayer dollars are
being spent effectively to maximize resources for student success. Level Data’s eROI analysis provides district
leaders the opportunity to maximize ineffective or duplicate resources as it relates to instructional spending.
Education Return on Investment (eROI) data provides evidence for the use of various funding sources to
include but not limited to ESSA requirements for federal funds, relief funds, or district funding.
Fiscal accountability is critical as districts prepare for the end of relief funds. As the reduction in funds
approaches, Level Data’s insights will help guide decisions on what to sustain or strategically abandon,
empowering district leaders to maximize every dollar spent. Stakeholders from staff, parents, board members,
and community members will rest easy knowing that district leadership is actively pursuing fiscal
responsibility and greater efficiency with district funds.

    ●   Provide facilitation, consultation and materials that engage the Accountability and Continuous
        Improvement department in each phase of the process. On a weekly basis at a minimum.

To ensure a successful evaluation process, Level Data provides implementation support through both project
management and customer success. Project management will ensure the project milestones are met, while
the customer success team will guide the overall success through use of the findings through best practices
and support. At a minimum, Level Data agrees to provide weekly facilitation, consultation and materials to


                                                                                                     84 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



the Accountability and Continuous Improvement department throughout each phase of the process. A full
description of the implementation & onboarding process and training & support plan can be found below.

Our project management plan includes the following: organizational alignment, feasibility, contingency plans,
constraints, detailed work schedule, milestones, risk management, communication, deliverables, human and
material resource requirements, and approval. The constraints within our plan are identified in three ways;
non-issue, issue, critical issue. Using these identifiers, we will deploy our contingencies to overcome any
obstacles that may arise during the project.

Implementation & Onboarding Process

The Level Data implementation process begins with the execution of a Memorandum of Agreement between
Level Data and the partnering school district to ensure proper protocols are executed to maintain the
confidentiality of DeKalb County School District student data. A detailed Memorandum of Agreement
outlining procedures taken by Level Data to maintain data security can be found below. Additionally, more
documentation surrounding security protocols can be found in Level Data’s Privacy Pledge or Privacy Policy.
Level Data is also willing to execute the DeKalb County School District’s data governance policy if preferred.




                                                                                                     85 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 86 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 87 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 88 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 89 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 90 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 91 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 92 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Once the Memorandum of Agreement is executed, the Level Data implementation customer success team
will schedule a kickoff meeting. The Level Data customer success team will work with appropriate district
personnel to set up the onboarding process, outline goals and objectives, and establish communication
protocols with key stakeholders.

Level Data’s technology securely and seamlessly integrates data and provides integration through a concierge
data service, minimizing the workload on district technology staff. Onboarding begins with identification of
required data sets including student information, resource/program data, accounts payable and student
achievement data. Please see below for descriptions of onboarding process and the data collection process:

    ●   Student Information System Onboarding

Following the execution of a MOA, DeKalb County School District will provide Level Data with the appropriate
secure and trackable data access points to DeKalb County School District student information system data for
integration. Level Data will identify the best format for data transfer via integration, secure file upload, or
through administrative access as needed. Upon receipt of access, Level Data staff will import student
information system data into AIM. AIM ingests student demographic data to help administrators identify
insights by particular subgroups of interest. AIM ingests student course and roster information to let
administrators analyze eROI insights by school/teacher/grade/section.

    ●   Accounts Payable Onboarding

The financial onboarding process is executed with accounts payable data export provided by DeKalb County
School District. A Level Data representative will work directly with a designated DeKalb County School District
representative to obtain financial expenditure files which will then be imported by Level Data staff for the
correlation process to begin. AIM allows the inclusion of financial data either input directly into the system or
ingested from financial accounts payable files.

    ●   Student Achievement/Academic Performance Measure Onboarding

Following the execution of a MOA, DeKalb County School District will provide Level Data with appropriate
secure and trackable data access to begin the process of gathering student academic data, associated with
district performance measures and assessments, as well as curriculum and instructional resources. Level Data
sets up data integration for these tools through automatic upload, third party integration, and/or with
provided administrative access accounts as needed. AIM allows the inclusion of state accountability,
formative, and progress monitoring data. Level Data staff will import student achievement data into AIM.

Upon receipt of the above mentioned data access, Level Data staff will set up the AIM site and import data for
DeKalb County School District.




                                                                                                       93 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Level Data Training & Customer Support Model
Level Data provides a combination of both virtual/in person training opportunities based on district needs as
part of the scope of the project. Following the onboarding of data, initial setup/training is scheduled with the
district point of contact to ensure understanding of the capabilities of the platform, proper alignment for eROI
initiatives and resources, and navigation of the platform.

In addition, ongoing customer success support will be provided to DeKalb County School District as part of the
evaluation process. Weekly touchpoints will be made with the Accountability and Continuous Improvement
department. Delivery will include but is not limited to weekly calls, meetings, online support, and summary
emails. The weekly touchpoints will update progress of implementation, highlight any roadblocks, and
provide next steps and status updates with the Accountability and Continuous Improvement department.

Level Data will provide the Accountability & Continuous Improvement department with appropriate
documentation, modules, and training resources, as well as support through in-person training as designed
within the agreement, as well as online support to include video tutorials, live video sessions for additional
support as needed, and documentation. Level Data also sets up saved reports within the AIM platform and
shares them to appropriate AIM users, as another method of reducing workload of the DeKalb County School
District and providing needed data to support data driven decision making.

Training Components are described below:


    ●   Strategic Impact Area and Objectives Scoping Meeting

        The Level Data onboarding process begins with a project scoping meeting to determine a clearly
        defined plan of timeline, expectations, and roles for a successful implementation. The scoping
        meeting with district personnel includes an overview of the solutions and values provided to the
        DeKalb County School District team, as well as the alignment process for identification of district
        strategic impact areas on which the district seeks to focus spending and improvement efforts. During
        this process, the alignment of student achievement activities into impact areas and strategic
        objectives is set up within the AIM platform. Each area correlates associated costs, measurements,
        and three forms of eROI analysis.

    ●   AIM Functional Training

        Functional software training is provided as part of the implementation to ensure understanding of
        platform capabilities and user navigation of the platform. Functional training is scheduled with the
        district point of contact to ensure understanding of the capabilities of the platform, proper alignment
        for eROI initiatives and resources, and navigation of the platform.

    ●   Software Support

                                                                                                      94 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



       Ongoing software support will be provided to DeKalb County School District as part of the annual
       software license. Support includes phone, email, and online support for DeKalb County School
       District staff. Not only will Level Data provide appropriate documentation, modules, etc. with training
       resources, as well as support through in person training as designed within the agreement, as well as
       online support to include video tutorials, live virtual sessions as needed, and other documentation.
       Level Data also creates various saved reports within the platform and shares them to appropriate
       AIM users, as another method of reducing workload of the DeKalb County School District and
       providing needed data to support data driven decision making.

   ●   Strategic Resource Alignment

       Strategic alignment (objective, goal, measurement, and target audience) must be captured for each
       item under analysis as this data typically is not readily available in a school district. Resources are
       strategically aligned through the Strategic Resource Alignment process and module. Expenditures on
       district resources such as products, programs, services, and positions are aligned to intended users,
       expectations for usage fidelity, and appropriate performance measures. The AIM platform provides
       dynamic correlations of the alignments as a result of the plan captured within the ESP module.

   ●   eROI Evaluation

       AIM evaluates tools and resources in the context of strategically aligned student outcomes and
       utilization parameters as defined by key education stakeholders. For the instructional analysis Level
       Data will utilize the AIM software platform to conduct eROI analysis from the data sets collected. The
       AIM platform triangulates data from financials, student achievement, and participation to calculate
       the eROI of each instructional tool being deployed. This data is then compared across the Level Data
       database, as well as with data from within DeKalb County School District to determine the
       effectiveness of each resource. This platform will measure desired resources based on access being
       provided to applicable data.

   ●   eROI Professional Learning Updates

       Level Data recommends the option for professional learning updates to support the implementation
       of the AIM platform. Suggested mid year and end of year updates support the eROI data
       implementation through eROI executive data summaries. These summaries are provided through
       professional learning sessions with district and school administrators and can be delivered virtually or
       onsite. Suggested attendees are district administrators and school administrators as determined by
       the district. Administrators access visual insights to understand the relationship between educational
       activities, the budget, and ways to optimize instruction to improve student educational growth. Level
       Data provides best practices, recommendations, and insights based on the eROI data analysis to
       allow optimal understanding of how to utilize the eROI data.


                                                                                                     95 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



In addition to the designated customer success team, the following individuals serve as primary project
contacts and may be reached in case of emergency or for services needed after hours, holidays, or weekends
if needed. Please contact (269) 488-2040 or send an email to helpdesk@leveldata.com or reach one of the
contacts below.



 Contact                 Title                      Emergency             Email
                                                    Support Phone

 Marty Reed              Chief Product Officer      (269) 488-2040        mreed@leveldata.com

 Adam Pearson            Chief Customer Officer     (269) 488-2040        apearson@leveldata.com

 Nicole Pezent           Director of Strategic &    (269) 488-2040        npezent@leveldata.com
                         State Account
                         Management




    ●   Develop a timeline for planning and execution of the Computer Program Evaluation Services
        process.

The following is a suggested timeline for planning & execution of the computer program evaluation services
process, followed by a description of each project deliverable. Timeline will be revisited following the bid
award date and agreed upon by both parties.



                        Deliverable                                    Suggested Timeframe
 Pre-Implementation Meeting, Initial Data Gathering & Setup                  January 2024
 Level Data AIM Education Return on Investment Platform                     January 2024-
 Reporting Access                                                              June 2024
 Kickoff Meeting                                                             January 2024
 Onboarding/Data Gathering                                           Late January/ February 2024
 Weekly Touchpoint                                                              Ongoing
 Level Data AIM Functional Training                                         February 2024
 eROI Executive Summary Data Meetings                                     End of school year




                                                                                                    96 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



    ●   Level Data AIM Education Return on Investment Platform Reporting Access: Access provided to AIM
        platform capable of capturing and managing the Return on Investment for instructional resources.

    ●   Data Gathering: Remote data gathering assistance, integration and uploads of datasets. Data is
        automatically imported into AIM by Level Data. All data is uploaded, integrated and accessed through
        secure and compliant portals.

    ●   Kickoff Meeting: Scoping of project with timeline creation, overview of process and implementation,
        calendar planning, strategic alignment of objectives and goals, how to get the most from your
        Academic Resource Management System.

    ●   Weekly Touchpoint: Weekly touchpoints will be made with the Accountability and Continuous
        Improvement department. Delivery will include but is not limited to weekly calls, meeting, and
        summary emails. Weekly touchpoint will update progress of implementation, highlight any
        roadblocks, and provide next steps and status updates with the project’s point of contact from
        Accountability and Continuous Improvement department to ensure success.

    ●   Level Data AIM Functional Training: Hands-on, platform navigation, functional training. Onsite
        sessions limited to 15 participants per session. * Training must be scheduled in one day increments.

    ●   eROI Executive Summary Data Meetings: Periodic executive summary meetings with cabinet and/or
        participants to be determined by the client to discuss eROI data insights, ensure continued progress
        in implementation, and share best practices for improvement. Sessions to be scoped as part of
        agreement.


Sample documents for tracking project scope and training manual can be found below.

    ●   A sample project scoping document is attached below for tracking major timeline events and next
        steps from kickoff meeting, as well as major milestones for the project.




                                                                                                    97 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 98 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 99 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 100 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 101 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 102 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 103 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



The following manual provides a linked one page document for each AIM report to showcase what the data
will show and how it can be accessed. This is one of the training documents and support opportunities that
Level Data customers receive to ensure they are successful in accessing the AIM platform and program
evaluation data.

                          Level Data Report Manual- Linked Resources

                       eROI Growth Report - This report shows overall student growth and
                         learning loss by assessment type.


                       eROI Proficiency - This report shows which students are above or below
                         the proficiency line on an assessment.


                       eROI Resource Report - Tracks instructional expenditures against
                         performance measures and usage expectations to identify if utilization
                         drives outcomes.

                       ACE (Assessment Correlation Engine) Report - This report correlates
                         student grades and benchmark mastery in order to identify grade
                         inflation & deflation.

                       Return on Assessment Report - This report measures how aligned the
                          benchmark/formative assessments are with the state assessment.




                                                                                                 104 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Brochures, Catalogs, Manuals, Websites, Literature, and other
marketing media




                                                         105 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




                                                 106 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



Company Website: https://www.leveldata.com/return-on-investment




                                                                  107 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP




Added Value

Level Data provides additional values specific to the company’s delivery approach and technical expertise that
differentiates our ROI solution from other providers. Based on our previous experience and expertise, Level
Data finds the combination of these values provide the greatest impact on raising the return on investment &
instruction.

Level Data understands that the teaching and learning process is made up of a combination of many different
components including the classroom teacher, digital resources, school programs & initiatives, professional
development, etc. With this in mind, Level Data provides a comprehensive solution that also highlights return
on instruction, empowering districts to align the return on investment & instruction process alongside their
current continuous improvement process to ensure all ROI work focuses on raising student outcomes.

    ●   Opportunity for ongoing return on investment measurement with longitudinal capability

Level Data’s comprehensive solution provides a robust, ongoing method of evaluating implementation fidelity
and effectiveness of educational computer programs, allowing districts to continue to ensure their resources
are maximized and positively impacting students on a longitudinal basis. This is an important consideration
when selecting a provider to deliver the computer program evaluation, as the district will continue to have a
need of monitoring what’s working for students of the DeKalb County School System each year.

Furthermore, selecting an evaluation platform over a one-time consultative evaluation provides additional
values not only during the initial project, but also provides the opportunity for ongoing benefits to DeKalb
County School District, should the district wish to include within their ongoing continuous improvement
process each year. Districts using the Level Data platform have the ability for multiple ROI checkpoints
throughout the year following their assessment schedule, providing at a minimum, a mid and end of year
data analysis to address current needs and adapt action plans to reflect student needs.

    ●   Ability to measure other resources & initiatives in addition to computer applications

In addition to digital education resources, districts are also investing time and funding into school programs &
initiatives, professional development, and other supports. Thus, a return on investment analysis must also
include the ability to capture and measure resources aside from just digital programs. Level Data’s AIM
platform also provides an opportunity for evaluation of other resources outside of digital/computer based
programming.

Other types of resources may include but are not limited to initiatives such as professional development,
summer learning, after school programs, college entry preparation programs, as well as academic positions
such as tutors/interventionists, or instructional coaches. With a growing need to show evidence on the use of
federal funding, it is important to also measure these tools as well. In the event DeKalb County School District

                                                                                                     108 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



would like to measure additional resource types following the initial project scope delivery, the opportunity
would provide greater insights on optimizing return on investment in those additional areas.

    ●   Offers additional Return on Instruction reporting to guide planning/measure student success

Level Data’s AIM platform also provides Return on Instruction reporting. While this was not requested in the
project scope, this is a valuable component that would become part of the evaluation process for DeKalb
County School District. AIM’s return on instruction reports highlight instructional strengths/weaknesses to
help guide instructional, resource allocation, and professional development needs. Additional key features
and reports can be found at the end of the Added Values section.

    ●   Removes perception based data and replaces it with actual objective evidence based on your
        district’s performance measures

While some approaches lack substance and are merely based on perceptual data/surveys that capture
responses from staff regrading if they used programs and how they feel about the implementation, Level Data
provides a more objective, true correlation to the usage data from the program source and to student
performance data for measurement and evaluation of resources. Level Data measures the effectiveness of
educational resources specific to your instruction and to your Tier I process.

    ●   Provides data for the evidence for federal funding purchases

Districts use Level Data’s ROI resource reports to show evidence for ESSA on the use of federal funding. This
data shows evidence on the impact a resource had in relation to student outcomes. As federal grants require
this evidence, this helps alleviate the workload involved for staff in pulling data from multiple sources to
provide this evidence for title and other federal funds.

    ●   Provides supporting documentation and evidence for accreditation & monitoring process

Districts must show evidence of a program evaluation process during their accreditation process, as well as
for evaluations during monitoring. Without a thorough process, many districts struggle to capture or locate
this data when it is time to go through the accreditation or monitoring process. Level Data’s approach
provides the tools needed to capture, manage, and evaluate resources and expenditures each year, providing
documentation to support both processes. Districts find it helpful as it not only shows the evidence, but also
documents that there is an ongoing process in place to help satisfy these requirements.

    ●   Supports increased accountability with team by ability to manage implementation down to school
        levels

Program evaluations can be very insightful in providing districts with information on current levels of
implementation and the effectiveness of those implementations. Level Data’s approach takes that a step
further because of the ability it provides to administrators to manage implementations and track

                                                                                                    109 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



usage/participation down to the individual school, grade level, classroom and student. Data analysis at this
level supports district and school administrators with actionable insights to help raise the accountability and
execution of the implementations for resources that are impacting student outcomes in a positive way. This
helps leaders reinforce expectations and ensure that all students are receiving equitable access to the most
effective tools and resources.



Additional Key Features

    ●   Net Growth & Learning Loss Analysis

AIM provides administrators a net growth and
learning loss report to assess academic return from
the district, school, grade, teacher, and class section
levels. The report includes net growth analysis,
percent of learning loss, and degree of learning loss.
The report measures growth and learning loss at any
two points in time, with ability to look year over
year, or at different points throughout the year. This
report drills down to the student level and can be
viewed with any summative, benchmark or
formative assessment.




    ●   Proficiency Analysis

AIM provides administrators a proficiency analysis for
any assessment from the district, school, grade,
teacher, and class section levels. The report includes
% of proficient students, % above proficiency line, %
below for non proficient students. The report drills
down to the student level.




                                                                                                      110 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST
DCSD GA Computer Evaluation Services RFP



    ●   Return on Assessment Analysis

AIM allows administrators to view the return of
their formative/benchmark assessment platforms.
The analysis identifies how correlated the
formative/benchmark assessments are at
predicting proficiency on state accountability tests.




    ●   Return on Classroom Instruction
        Analysis

AIM allows administrators to view the return
of their grading practices. Grading practices
are evaluated to determine how well they
reflect standards mastery. AIM provides
comparisons between classroom report card
grades and summative assessments for
accountability. The report identifies grade
inflation and deflation metrics and can be
drilled down from the district, school/grade,
teacher, class section, and student levels.




                                                        111 | Page
DCSD GA RFP 24-568 Proposal
Submit on https://dekalbschoolsga.ionwave.net/
Due Date 12-19-2023 2:00 PM EST