04.12.2023 Views

2022 – 2023 Program Evaluation

Results of NC State University's annual evaluation of Muddy Sneakers Outdoor Classroom programs, led by researcher Kathryn Stevenson.

Results of NC State University's annual evaluation of Muddy Sneakers Outdoor Classroom programs, led by researcher Kathryn Stevenson.

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

<strong>2022</strong> - <strong>2023</strong><br />

<strong>Program</strong> <strong>Evaluation</strong><br />

Compiled from the <strong>2023</strong> report by<br />

Lead Researcher, Kathryn Stevenson


CONTENTS<br />

What we measured and why<br />

Summary of what we found<br />

What this means for schools<br />

Detailed results<br />

About the sample<br />

About the Muddy Sneakers experience<br />

Connection to nature and local spaces<br />

Science Learning<br />

Social Emotional Learning<br />

Supporting Teachers<br />

Variations across student groups<br />

2<br />

3<br />

3<br />

4<br />

4<br />

5<br />

6<br />

8<br />

9<br />

11<br />

12<br />

1


What we measured and why<br />

Nature exposure in many forms can support<br />

the learner and create a context that boosts<br />

learning outcomes related to academics,<br />

personal development and stewardship<br />

(Kuo et al., 2019). These outcomes align<br />

closely with the Muddy Sneakers Outdoor<br />

Classroom mission and program design.<br />

Muddy Sneakers programs focus on nature<br />

exposure with the aim of supporting science<br />

learning, as well as the social-emotional<br />

support of students and connection to local<br />

natural landscapes. Our student evaluation<br />

is distributed to teachers twice a year and to<br />

students once at the end of our program.<br />

Outcomes Evaluated in This Report Include:<br />

connection to nature<br />

science learning<br />

social-emotional<br />

learning<br />

teacher support<br />

The Equigenic Effect<br />

Did you know that, on average, students achieve similar outcomes in nature-based vs.<br />

classroom-based learning environments and, in some instances, further support students who<br />

often struggle in a traditional classroom? We have found this in the past with Muddy Sneakers <strong>–</strong><br />

the program seemed to support student attention and behavior, but especially for students with<br />

Individual Education Plans (IEPs) (Szczytko et al., 2018).<br />

2


Summary of what we found<br />

Student Outcomes<br />

Students reported significant positive gains<br />

in each outcome of interest:<br />

SCIENCE LEARNING<br />

enthusiasm about the program<br />

memorable experiences tied to science<br />

standards<br />

CONNECTION TO NATURE<br />

going somewhere new<br />

wanting to return to sites visited<br />

SOCIAL-EMOTIONAL LEARNING<br />

meeting new classmates<br />

learning social skills<br />

trying new things<br />

feeling safe and having fun<br />

feeling calmer and healthier<br />

feeling focused and learning better<br />

being more likely to attend school<br />

Teacher Outcomes<br />

Teachers were similarly enthusiastic about<br />

the program and instructors and felt the<br />

program did a good job supporting their<br />

teaching of science standards.<br />

Teachers reported that Muddy Sneakers:<br />

helped make students excited to come<br />

to school<br />

supported those who struggle in the<br />

classroom<br />

built critical thinking skills<br />

supported emotional well-being and<br />

peer relationships<br />

They said Muddy Sneakers helped them:<br />

teach science more effectively<br />

connect with students<br />

explore outdoor spaces<br />

What this means for schools<br />

Muddy Sneakers directly supports standards-aligned science learning while supporting critical<br />

thinking and social-emotional learning. Also a direct impact of our mission and approach to<br />

learning, Muddy Sneakers supports a connection to nature, including exposing and building<br />

appreciation for local natural areas within their communities.<br />

Both teachers and students enjoy the program, and evaluation results suggest they benefit from<br />

it. With additional support in the classroom, schools may experience increased teacher<br />

retention rates and reduced burnout. Students and teachers reported gains in social-emotional<br />

learning, including peer-to-peer relationships and connecting with their teachers, which may<br />

improve student behavior and classroom performance.<br />

3


Results<br />

<strong>2022</strong> <strong>–</strong> <strong>2023</strong> Muddy Sneakers Fast Facts<br />

49<br />

schools<br />

294<br />

field expeditions<br />

3,074<br />

students<br />

98<br />

virtual programs<br />

137<br />

teachers<br />

87,414<br />

contact hours<br />

Responses from 41 schools are included in these results:<br />

DISTRICT<br />

STUDENT<br />

RESPONSES<br />

TEACHER<br />

RESPONSES<br />

Asheville City 47 0<br />

Buncombe County 71 2<br />

Guilford County 10 1<br />

Haywood County 104 5<br />

Henderson County 246 3<br />

Jackson County 24 1<br />

Madison County 0 0<br />

Montgomery County 0 0<br />

Orange County 12 1<br />

Polk County 139 3<br />

Rowan County 408 10<br />

Rutherford County 9 1<br />

Transylvania County 95 3<br />

Wake County 0 0<br />

Watauga County 41 2<br />

Winston-Salem Forsyth County 169 5<br />

TOTALS 1375 37<br />

Self-reported gender<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Boys<br />

Girls<br />

No Answer<br />

Non-Binary<br />

Self-reported race<br />

Asian<br />

Black/African American<br />

Hispanic<br />

Mixed Race<br />

Native American<br />

White<br />

No Answer<br />

4


About the Muddy Sneakers Experience<br />

Overall, students enjoyed the Muddy<br />

Sneakers experience and felt it positively<br />

changed them.<br />

Students most frequently mentioned<br />

valuing learning and having fun with<br />

Muddy Sneakers.<br />

Similarly, teachers were happy with the<br />

program.<br />

75%<br />

of teachers reported an<br />

“excellent” rating for<br />

safety, learning and fun.<br />

89%<br />

of students agreed that<br />

they enjoyed their time<br />

with Muddy Sneakers<br />

Which parts of the partnership did you use with students<br />

this year?<br />

In-Person Expeditions<br />

Skype a Sneaker Virtual Sessions<br />

EOG Test Prep<br />

Classroom Curriculum Materials<br />

Instructor Visits for School Events<br />

On-Call Support<br />

0% 20% 40% 60% 80% 100%<br />

5


Connection to nature and local spaces<br />

Connection to Nature<br />

Overall, Muddy Sneakers is taking students<br />

to new places, while also helping students<br />

see familiar natural areas in new ways,<br />

and/or making them want to return again.<br />

Students discussed the value they learned<br />

to place in nature and protecting nature.<br />

This supports the quantitative results and<br />

demonstrates that Muddy Sneakers<br />

provides opportunities for students to<br />

connect with nature, especially their local<br />

environments.<br />

I wonder how nature works...<br />

30%<br />

20%<br />

10%<br />

0%<br />

Every Day<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

Once a Week<br />

Once a Month<br />

Never<br />

AFTER MUDDY SNEAKERS<br />

71%<br />

of students reported a<br />

connection to nature,<br />

reflecting an overall increase<br />

An Increased Sense of Wonder and Inquiry<br />

AFTER MUDDY SNEAKERS<br />

67%<br />

of students wondered<br />

how nature works at<br />

least once a week<br />

THIS INCLUDES<br />

32%<br />

who wondered how<br />

nature works daily<br />

6


Rather spend time on technology than outside<br />

Before Muddy Sneakers, nearly 30% of<br />

students would always rather spend time on<br />

technology than outside. After Muddy<br />

Sneakers, that number shrunk to around<br />

20%<br />

Student quote about their favorite part:<br />

“Making me go outside a bit more<br />

instead of being stuck inside doing<br />

random things, Muddy Sneakers really<br />

shows that there’s more fun to be had<br />

than on a phone!”<br />

60%<br />

40%<br />

20%<br />

0%<br />

Always<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

Sometimes<br />

Rarely<br />

Never<br />

While students were still interested in<br />

spending time on technology, they<br />

reported wanting to do so less often after<br />

Muddy Sneakers in comparison to before.<br />

How many times did Muddy Sneakers take you to<br />

someplace new?<br />

Every time<br />

About half the time<br />

Once<br />

Never, but I saw new parts of places I had visited before<br />

Never<br />

0%<br />

10%<br />

20%<br />

30%<br />

40%<br />

50%<br />

81%<br />

of students said Muddy<br />

Sneakers took them<br />

someplace new at least half of<br />

the time<br />

THIS INCLUDES<br />

39%<br />

of students who are<br />

exposed to a new place<br />

every time<br />

7


Science Learning<br />

Students showed gains in understanding of science appreciation as well as confidence in<br />

science.<br />

Science Confidence<br />

Science Affinity<br />

70%<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

70%<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

60%<br />

60%<br />

50%<br />

50%<br />

40%<br />

40%<br />

30%<br />

30%<br />

20%<br />

20%<br />

10%<br />

10%<br />

0%<br />

0%<br />

Teachers and students also felt Muddy Sneakers supported science learning and achievement.<br />

Many [students] wrote that they valued learning about nature and science, or detailed specific<br />

concepts, ideas, or practices they learned that were memorable or valuable.<br />

82%<br />

of students agreed, “Muddy<br />

Sneakers made me<br />

understand science better.”<br />

Some students mentioned that learning<br />

science with Muddy Sneakers helped<br />

prepare them for the EOGs.<br />

97%<br />

of teachers also report Muddy<br />

Sneakers supports students’<br />

understanding of science<br />

85% of teachers think Muddy Sneakers<br />

supports higher science test scores; 45%<br />

think it may support non-science test scores.<br />

8


Social and Emotional Learning<br />

Critical Thinking<br />

Students reported gains in critical thinking<br />

skills, including being open to new ideas<br />

and seeking out multiple sources of<br />

information.<br />

80%<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

60%<br />

40%<br />

20%<br />

0%<br />

Students reported that Muddy Sneakers made them...<br />

feel more calm<br />

want to share what we learned with my family and friends<br />

more likely to come to school<br />

feel healthier<br />

focus and learn better<br />

talk to classmates I usually don't talk to at school<br />

Yes<br />

No<br />

0% 20% 40% 60% 80%<br />

Some students mentioned that the most important thing about Muddy Sneakers was that they<br />

felt safe, learned how to be safe or were more confident in an outdoor environment.<br />

9


Teachers Agreed with Students and Added that Muddy<br />

Sneakers...<br />

76%<br />

helps students improve their<br />

emotional wellbeing.<br />

84%<br />

supports students who often struggle in the<br />

classroom.<br />

82%<br />

increases classroom participation and<br />

engagement.<br />

87%<br />

helps students build relationships with peers<br />

they may not connect with in the classroom.<br />

89%<br />

builds critical thinking skills.<br />

58%<br />

helps students be more calm & patient. 82%<br />

makes students more excited to come to<br />

school.<br />

74%<br />

helps students focus and learn<br />

better in the classroom.<br />

10


Supporting Teachers<br />

As Muddy Sneakers is a partnership with schools, we asked about the degree to which this<br />

partnership benefited teachers. Teachers reported many positive outcomes, including teaching<br />

science more effectively, connecting with students, feeling supportive, and wanting to explore<br />

more places outside in their personal time.<br />

Teachers indicated that Muddy Sneakers made them...<br />

Disagree Neutral Agree<br />

Strongly Agree<br />

Teach science more effectively<br />

Connect with my students<br />

Personally explore outdoor spaces<br />

Feel supported as a teacher<br />

Teach more effectively overall<br />

Connect with my coworkers<br />

Feel calmer and more relaxed<br />

Manage student behavior<br />

0% 20% 40% 60% 80% 100%<br />

Overall, Muddy Sneakers fosters the idea that learning takes place<br />

all the time in all areas. I love it when they say, “I learned so much”<br />

about a topic they’ve already been taught. Muddy Sneakers is the<br />

extension of what they’ve been taught and very importantly offers<br />

more examples of real life application and connections.<br />

11


Variations across student groups<br />

Our industry as a whole is seeking ways to create more accessible and equitable programs. In<br />

the absence of access to school or adult-supplied information, students were asked to write-in a<br />

self-reported gender and race. A significant percentage of students did not supply an answer (or<br />

gave a nonsensical answer) for gender.<br />

Connection to Nature<br />

Differential changes in connection to nature<br />

were modest across genders and, to a lesser<br />

degree, race. Note that change was similar<br />

across these demographics, but for several<br />

cases, there were differences in entry (and<br />

associated exit) points. These likely point to<br />

influences beyond Muddy Sneakers’ control<br />

but highlight opportunities for future care<br />

and potential programmatic focus.<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

Boys Girls Other<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

Asian<br />

Black/African American<br />

Hispanic<br />

Mixed Race<br />

Native American<br />

White<br />

No Answer<br />

0% 20% 40% 60% 80% 100%<br />

Science Learning<br />

Like connection to nature, the changes in science confidence were similar across the board, but<br />

the entry points differed with gender. In terms of race, trends were similar across races, with<br />

none of the differences seen as significant.<br />

12


Science Confidence<br />

Encouraging trends show the biggest gains<br />

among those students who enter with the<br />

least amount of science confidence,<br />

echoing growing evidence for an equigenic<br />

effect of nature-based programming (Faber<br />

Taylor et al., <strong>2022</strong>).<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

Boys Girls Other<br />

Asian<br />

Black/African American<br />

Hispanic<br />

Mixed Race<br />

Native American<br />

White<br />

No Answer<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

0% 20% 40% 60% 80%<br />

Science Affinity<br />

Variations across science affinity were also<br />

similar across race and gender, with no<br />

significant differences present when<br />

comparing pre- or post-responses across<br />

these groups of students.<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

Boys Girls Other<br />

Asian<br />

Black/African American<br />

Hispanic<br />

Mixed Race<br />

Native American<br />

White<br />

No Answer<br />

Before Muddy Sneakers<br />

A er Muddy Sneakers<br />

0% 20% 40% 60% 80%<br />

13


OUR MISSION<br />

The mission of Muddy Sneakers is to awaken in children a deeply<br />

felt connection with the natural world — one that inspires curiosity,<br />

stimulates learning, and brings new life to classroom performance.<br />

Muddy Sneakers, Inc. is a nonprofit, tax-exempt charitable organization (tax identification number 26-0338084)<br />

under Section 501(c)(3) of the Internal Revenue Code. Donations are tax-deductible as allowed by law.


828-862-5560<br />

info@muddysneakers.org<br />

PO Box 146, Brevard, NC 28712<br />

www.muddysneakers.org

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!