PME 802 - Program Evaluation Design (Steps 1 & 2)


Program Evaluation Design - Beyond the Bell

Step 1

General Overview:

I will be evaluating the Beyond the Bell Tutoring Program.  This program is run by the YMCA with the goal of "break[ing] the cycle of poverty by closing the achievement gap experienced by low-income children. This program takes a holistic approach to the well-being of every child." (YMCA SWO).  It runs throughout the school year from September to June and supports elementary aged students in grades 1-6 with homework assistance, individual learning needs, social skills, health and wellness, and other fun and creative activities.  Students attend for approximately two hours after school, 2 or 3 days a week.  There is no cost to families as it is funded by a number of community sponsors such as the school board, community foundations, individual donors, and the Ontario Trillium Foundation.

The program currently runs at four locations in my area.  Two schools are in the public school board, one site is in the catholic school board, and one location is at Bkejwanong Kinomaagewgamig (the elementary school at Bkejwanong First Nation).  One of the public school sites is my school, A.A. Wright Public School.  At my school students attend either Monday/Wednesday or Tuesday/Thursday with Friday being set aside for special guests, presentations, walking trips, and other special activities.  There are typically about 15 students enrolled in each cohort.  I have had many students from my class participate in the Beyond the Bell program.

Focus:

The focus of the program is to improve academic achievement for at risk students.  "YMCA staff leaders are positive role models helping each student to improve literacy and numeracy skills, build social skills, develop self-confidence and experience new opportunities. The program provides children with the tools and support they need to help close the achievement gap and develop a stronger and more successful future." (YMCA SWO).

Size of Staff:

The size of the staff varies from location to location depending on the size of the program and number of students involved.  There is roughly a 1:5 ratio of staff to students.  At my school there is typically a supervisor and two other staff members which makes a 3:15 ratio of staff to students. 

Goals:

The goal of the Beyond the Bell program is to close the achievement gap for lower socioeconomic students.  Their slogan is "Ensuring No Child Falls Through The Gap".  This is done through a focus on four key program areas: 

    • Realizing academic achievement
    • Improving health and wellness
    • Exploring culture and creativity
    • Developing social skills
As mentioned in the "Focus" section the goal is to provide students with positive role models who can help improve literacy and numeracy skills, build social skills, develop self-confidence, and experience new opportunities.

Community Demographics:

Beyond the Bell programs target lower income families and students.  Sites are strategically situated at schools in lower socio-economic areas with a student population to support the program.  The town where I work was once a vibrant industrial area with many factories offering well paid positions to undereducated individuals.  However, in the 1990s (and exacerbated by the recession of the early 2000s) much of this industry either shut down or left town leaving the area economically depressed.  My school, A.A. Wright Public School, has just under 200 students and is the largest public elementary school in town.  It serves many low socio-economic families in the area.  On the average year (this past school year was a bit different with Covid) the program has about 30 participants.

Step 2

Purpose of Evaluation:

The purpose of this evaluation is to see if Beyond the Bell is actually effective in its goal of closing the achievement gap for lower socioeconomic students.  I am planning to use the impact evaluation approach as it can be used during and after the program has run.  I feel this will be most beneficial for collecting meaningful data and answering my guiding questions.

Specific Evaluation Questions to Guide Evaluation Design: 

    1. Does the program adequately address the complexities of low income students?

    2.  Does the program support the potential unique needs of Indigenous students?

    3.  Does the program address and support the individual needs (academic, behavioural, special needs, etc.) of each student?

    4  Does the program adhere to and follow the Ontario curriculum when designing lessons, supports, and special activities?

    5.  Does the program track and gauge improvements of students?  How is this done?

    6.  How does the program collect and analyze data for internal purposes (program development and improvement) and external purposes (continued funding and program promotion/advertisement)?

Sources

YMCA SWO. "Beyond the Bell." (2020).  Available: https://www.ymcaswo.ca/beyond-bell.

Comments

Post a Comment

Popular posts from this blog

PME 802 - Module 2B (Steps 3 & 4)

Image
Step 3 - Program Theory The program theory for this evaluation follows the "if/then" format outlined and recommended by Wilder Research.  Dr. Sharpe noted that "A program theory consists of a set of statements that describe a particular program, why, how and, under what conditions the program effects occur, predict the outcomes of the program, and specify the requirements necessary to bring about the desired program effects." (Sharpe, 72).   Furthermore, Wilder Research reminded me that "clarity and plain language are essential" since "a clear program theory help[s] others see the sense of your program." (Wilder Research, 1).  "Appendix B: Program Theory Development" in the Wilder Research article is also quite helpful for organizing my thinking and ensuring all the necessary activities, results, and evidence are included.  Keeping all of this in mind my program theory for Beyond the Bell is as follows: If children attend the Beyond the...
Read more

PME 802 - Module 3B (Steps 5, 6, & 7)

Step 5 - Data Collection & Analysis Methods The data collection for this evaluation is a combination of qualitative and quantitative approaches.  A variety of data collection methods is most beneficial because "different methods reveal different aspects of the program." (Taylor-Powell & Steel, 6).   Furthermore, the CDC writes that "e mploying multiple methods (sometimes called “triangulation”) helps increase the accuracy of the measurement and the certainty of your conclusions when the various methods yield similar results." (CDC.gov).   Literacy & Numeracy Checklist:  " Checklists are used to encourage or verify that a number of specific lines of inquiry, steps, or actions are being taken, or have been taken, by a researcher." (Given, 2008).  One of the Beyond the Bell program goals is to increase literacy and numeracy skills.  An important element would be ensuring the skills taught in the program align with the Ontario curriculum s...
Read more