Search

Fidelity & Evaluation

Overview

Because data-based decision making is an important pillar of MTSS, an efficient system for evaluating data is integral to inform choices.

Definition: Fidelity is the degree of exactness with which something is implemented or conducted; and 

Fidelity happens across multiple points within NDMTSS framework; system, process, and multi-tier instruction.

An example of a question fidelity can address:

Did you do what you said you would?

Measuring fidelity means gathering data to check that supports are provided to students as intended. At an individual program or intervention level, some measures of fidelity can include program specificity, quality of delivery, exposure/duration, and student engagement.  

When a practice or program is implemented as intended by the researchers or developers, this is referred to as fidelity of implementation. Other commonly used terms include treatment integrity, procedural fidelity, intervention integrity, procedural reliability, and procedural adherence. Generally, to implement a practice or program with fidelity, an individual should:

  • Be adequately trained
  • Adhere to the instructional procedures of the practice or program (e.g., follow the script, implement among groups of the correct size)
  • Implement the practice or program as frequently as recommended (e.g., daily, three times per week)
  • Implement the practice or program for the recommended amount of time (e.g., one semester, one academic year)
  • Skillfully implement the instructional procedures

*Adapted from IRIS Center

More broadly, fidelity is monitored for the implementation of:

  • The MTSS system as a whole
  • Instruction
  • Interventions
  • Administration of assessments
  • Analysis of assessment data

Evaluation is a systematic and ongoing process of collecting, analyzing, and using information to answer questions about the effectiveness, efficiency, and quality of educational programs, policies, and practices.  Evaluation occurs frequently and helps to determine the effectiveness of the system, process, or multi-tier instruction.

Why It’s Essential

Kids can’t benefit from ineffective practices done well nor can they benefit from effective practices done poorly. We need both.

Some of the benefits of assessment within MTSS are:

  • Fidelity
    Fidelity monitoring is crucial to ensure the effectiveness of a Multi-Tier System of Supports (MTSS) in schools, including core instruction, interventions, and assessments. 

    Lack of implementation fidelity might result in a practice or program being less effective, less efficient, or producing less predictable responses. When programs implemented with fidelity are compared to programs not implemented with fidelity, the difference in effectiveness is profound.
  • Evaluation
  • Improves teaching and learning by providing feedback to educators and students on their strengths and areas of need; helping them identify areas for improvement; and informing curriculum development, instructional design, and professional development.
  • Promotes accountability and quality assurance by providing evidence of the achievement of learning outcomes, the alignment of standards and assessments, and the quality of the educational services and resources. Evaluation also supports accreditation, certification, and recognition of educational institutions and programs.
  • Informs decision-making and policy development by providing information to stakeholders (such as administrators, policymakers, funders, and parents) on the needs, preferences, and satisfaction of the educational community. Evaluation supports planning, budgeting, resource allocation, and policy formulation/implementation.

Looking for more resources?

go to resources now

North Dakota’s Multi-Tier System of Supports (NDMTSS) is a framework to provide all students with the best opportunities to succeed academically, socially, emotionally, and behaviorally in school. NDMTSS focuses on providing high-quality instruction and interventions matched to student need, monitoring progress frequently to make decisions about changes in instruction or goals. Data is used to allocate resources to improve student learning and support staff implementation of effective practices.

Copyright 2024 North Dakota’s Multi-Tier System of Supports
Facebook X-twitter Rss
  • News
  • Contact Us