First 5 Santa Cruz County 2010-11 Annual Evaluation Report
First 5 Santa Cruz County 2010-11 Annual Evaluation Report
First 5 Santa Cruz County 2010-11 Annual Evaluation Report
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
FIRST 5 SANTA CRUZ COUNTY<br />
ANNUAL EVALUATION REPORT<br />
July 1, <strong>2010</strong> - June 30, 20<strong>11</strong><br />
October 20<strong>11</strong><br />
OUR MISSION:<br />
OUR VISION:<br />
All <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Children<br />
enter school ready to achieve<br />
to their greatest potential.<br />
To help children succeed in school and in life,<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> invests in health, early<br />
learning, and family support to promote optimal<br />
development of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children.
Acknowledgements<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> would like to acknowledge Applied Survey Research (ASR) for their support<br />
and assistance with the evaluation and this report. <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> also thanks Nicole<br />
Young, of Optimal Solutions Consulting, for the close collaboration in crafting the procedures<br />
necessary to successfully evaluate the Triple P program.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> would also like to thank the staff and participants of the funded partner<br />
agencies whose commitment to data collection has facilitated the gathering of the robust data<br />
included in this report.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Applied Survey Research Optimal Solutions Consulting<br />
Susan True<br />
Stephanie Bluford<br />
Vicki Boriack<br />
Angela Cline<br />
Barbara Dana<br />
Irene Freiberg<br />
Holly Maclure<br />
Alicia Zenteno<br />
Susan Brutschy<br />
Lisa Colvig‐Amir<br />
Javier Salcedo<br />
Kim Carpenter<br />
Beth Jaworski<br />
Kathryn Branscomb<br />
Laurie Jacobs<br />
Melissa Mollard<br />
Te Guerra<br />
Nicole M. Young
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT TABLE OF CONTENTS<br />
Table of Contents<br />
Executive Summary ........................................................................ 1<br />
Overall Well‐Being of Children in the <strong>County</strong> ............................................................................ 4<br />
A Profile of <strong>First</strong> 5 Participants ................................................................................................. 5<br />
Healthy Children ...................................................................................................................... 7<br />
Strong Families ........................................................................................................................ 9<br />
Children Learning and Ready for School ................................................................................. <strong>11</strong><br />
Service Integration & Community Strengthening .................................................................... 13<br />
Summary ............................................................................................................................... 14<br />
Part 1: Strategic Framework Results ............................................ 17<br />
Overview of the Strategic Framework .................................................................................... 19<br />
Overall Well-Being of Children in the <strong>County</strong> ................................................................... 21<br />
A Profile of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Youngest Children ................................................................ 21<br />
<strong>County</strong>‐Wide Trends in Indicators of Child and Family Well‐Being .......................................... 22<br />
Profile of Participants ......................................................................................................... 29<br />
Number of Children and Families Served ................................................................................ 29<br />
Increase Services into Communities with the Highest Needs .................................................. 31<br />
Healthy Children ................................................................................................................ 37<br />
Increase Insurance Coverage .................................................................................................. 37<br />
Increase Use of Medical/Dental Homes .................................................................................. 41<br />
Increase Use of Preventive Health Services ............................................................................ 42<br />
Strong Families .................................................................................................................. 45<br />
Decrease Child Abuse and Neglect ......................................................................................... 45<br />
Improve Parent and Caregiver Practices that Support Children’s Social and Emotional<br />
Development ......................................................................................................................... 48<br />
Children Learning and Ready for School ........................................................................... 55<br />
Improve School Readiness Outcomes ..................................................................................... 55<br />
Increase Use of Quality Early Child Care Practices ................................................................... 56<br />
Increase Early Literacy Skills of Children ................................................................................. 64<br />
Increase Use of Kindergarten Transition Practices .................................................................. 66<br />
FIRST 5 SANTA CRUZ COUNTY<br />
i
TABLE OF CONTENTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Service Integration & Community Strengthening ................................................................ 69<br />
<strong>First</strong> 5 Service Integration ...................................................................................................... 69<br />
<strong>First</strong> 5 Fiscal Status and Sustainability .................................................................................... 71<br />
Community Strengthening ..................................................................................................... 74<br />
Part 2: Partner Profiles ................................................................ 77<br />
Healthy Kids Initiative ............................................................................................................ 80<br />
Families Together .................................................................................................................. 85<br />
Triple P – Positive Parenting Program .................................................................................... 91<br />
Side‐by‐Side ......................................................................................................................... 129<br />
La Manzana Community Resources ...................................................................................... 132<br />
Mountain Community Resources ......................................................................................... 139<br />
Early Literacy Foundations (ELF) ........................................................................................... 141<br />
Raising A Reader .................................................................................................................. 153<br />
Starlight Infant/Toddler Program ......................................................................................... 155<br />
School Readiness � Steps to Success .................................................................................... 158<br />
Child Snapshot ...................................................................................................................................... 158<br />
Literacy Continuing Education Workshops ........................................................................................... 161<br />
Migrant Education – Summer Pre‐K Academy ..................................................................................... 163<br />
Migrant Education School Readiness Program .................................................................................... 165<br />
Pajaro Valley Unified School District (PVUSD) Parent Conference ....................................................... 168<br />
Transition to School Workshops ........................................................................................................... 169<br />
Appendices ................................................................................ 171<br />
Appendix I: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Framework .................................................. 173<br />
Appendix II: Measurement Tools ......................................................................................... 175<br />
ii FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT TABLE OF FIGURES<br />
Table of Figures<br />
Figure 1: Number of <strong>County</strong> Children ages 0‐5 .......................................................................................................... 21<br />
Figure 2: Ethnicity of <strong>County</strong> Children ages 0‐5 (20<strong>11</strong>) ............................................................................................ 21<br />
Figure 3: English Language Proficiency of <strong>County</strong> Kindergarteners (<strong>2010</strong>) ............................................................... 21<br />
Figure 4: Unemployment Rate ................................................................................................................................... 22<br />
Figure 5: <strong>County</strong> Enrollment in CalWORKS ................................................................................................................ 23<br />
Figure 6: <strong>County</strong> Enrollment in Public Assistance Nutritional Programs .................................................................... 23<br />
Figure 7: <strong>County</strong> Enrollment in Medi‐Cal ................................................................................................................... 24<br />
Figure 8: <strong>County</strong> Enrollment in Healthy Families ....................................................................................................... 24<br />
Figure 9: <strong>County</strong> Enrollment in Healthy Kids .............................................................................................................. 24<br />
Figure 10: Percentage of Mothers in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Receiving Prenatal Care in the <strong>First</strong> Trimester, by Age ....... 25<br />
Figure <strong>11</strong>: Percentage of Mothers in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Receiving Prenatal Care in the <strong>First</strong> Trimester, by<br />
Payment Method ........................................................................................................................................ 25<br />
Figure 12: Percentage of Births to Teen Mothers (Ages 19 and under) ....................................................................... 26<br />
Figure 13: Teen Birth Rate (per 1,000, Ages 15‐19) ..................................................................................................... 26<br />
Figure 14: Percentage of Births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Paid by Medi‐Cal ...................................................................... 27<br />
Figure 15: Percentage of Children in Preschool Programs and Kindergarten Who Have Individualized Education<br />
or Family Service Plans (IEP/IFSP) ............................................................................................................... 28<br />
Figure 16: Total Unduplicated Children and Parents Served, by Goal Area and Age ................................................... 29<br />
Figure 17: Percentage of Children 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Served by <strong>First</strong> 5 ............................................................ 30<br />
Figure 18: Demographics of Children Participating in <strong>First</strong> 5 Programs, by Year ......................................................... 31<br />
Figure 19: <strong>Annual</strong> Family Income of Parents Participating in <strong>First</strong> 5 Programs, <strong>2010</strong>‐<strong>11</strong>............................................. 32<br />
Figure 20: Percentage of <strong>First</strong> 5 Families with Income below Poverty and Self‐Sufficiency Thresholds, by Year ........ 32<br />
Figure 21: Levels of Children’s Vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, by ZIP code .......................................................... 33<br />
Figure 22: Distribution of Children Who Received Services (<strong>2010</strong>‐<strong>11</strong>), by ZIP Code .................................................... 34<br />
Figure 23: Number of Children Who Received Services, by ZIP Code .......................................................................... 34<br />
Figure 24: Early Childhood Educators Served by <strong>First</strong> 5, by Type ................................................................................. 35<br />
Figure 25: Percentage of Children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Estimated to be Insured ........................................ 37<br />
Figure 26: Children (Ages 0‐5) Newly Enrolled by HCOC in Healthy Kids, Healthy Families and Medi‐Cal<br />
insurance plans ........................................................................................................................................... 38<br />
Figure 27: Number of Children (Ages 0‐5) in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Re‐Enrolled in Publicly‐Funded Health<br />
Insurance Programs, by Year ....................................................................................................................... 39<br />
Figure 28: Newborn Enrollment Project Statistics, <strong>2010</strong>‐<strong>11</strong> ........................................................................................ 40<br />
Figure 29: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids (Ages 2‐6) Who Had Access to a<br />
Primary Care Practitioner ............................................................................................................................ 41<br />
Figure 30: Percentage of Parents <strong>Report</strong>ing their Children Utilized Health Care Prior to Renewal in an<br />
Insurance Program ...................................................................................................................................... 41<br />
Figure 31: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids Who Had a Dental Visit in the<br />
Past Year ..................................................................................................................................................... 42<br />
Figure 32: Percentage of Children (Ages 3‐6) in the <strong>County</strong> Enrolled in Healthy Kids Who Received a<br />
Well‐Child Visit ............................................................................................................................................ 42<br />
Figure 33: Visits to Emergency Department in the Past Year, per 1,000 Member Year (Ages 1‐9) ............................. 43<br />
Figure 34: Number of Emergency Department Visits (Infants Less Than One Year Old).............................................. 43<br />
Figure 35: Rate of Substantiated Allegations of Child Maltreatment in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and California<br />
(per 1,000) ................................................................................................................................................... 45<br />
Figure 36: Change in Families Together Participant’s Risk Levels Over Time, 2007 ‐ 20<strong>11</strong> ......................................... 46<br />
FIRST 5 SANTA CRUZ COUNTY<br />
iii
TABLE OF FIGURES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Figure 37: Number of Families Together Families who had Substantated Allegations of Abuse within 6 Months<br />
after Completing the Program .................................................................................................................... 47<br />
Figure 38: Participants with a Substantiated Allegation of Child Maltreatment Occurring Up to 6 Months after<br />
Program Entry ............................................................................................................................................. 48<br />
Figure 39: The 17 Core Parenting Skills Promoted by Triple P ..................................................................................... 49<br />
Figure 40: Parents’ Use of Positive Discipline Styles .................................................................................................... 51<br />
Figure 41: Level of Parental Problems with Child Behavior ......................................................................................... 52<br />
Figure 42: Levels of Parenting Difficulty Six Months After Triple P Services ................................................................ 53<br />
Figure 43: Percentage of 3 rd Grade Students in the <strong>County</strong> At / Above Grade Level In English/Language Arts .......... 55<br />
Figure 44: Number of Early Childhood Educators Who Have Completed SEEDS trainings .......................................... 58<br />
Figure 45: Number of SEEDS Trained Early Childhood Educators in Licensed Programs, by type of classroom<br />
(2007‐20<strong>11</strong>) ................................................................................................................................................. 59<br />
Figure 46: Primary Language of SEEDS Trained Early Childhood Educators in Licensed Programs (2007‐20<strong>11</strong>) ......... 59<br />
Figure 47: Educational Attainment of SEEDS Trained Early Childhood Educators in Licensed Programs<br />
(2007‐20<strong>11</strong>) ................................................................................................................................................. 59<br />
Figure 48: Number of Children Participating in Raising A Reader ................................................................................ 60<br />
Figure 49: Classroom Support for Language and Literacy (<strong>2010</strong>‐20<strong>11</strong>) ...................................................................... 61<br />
Figure 50: Key Language and Literacy Questions (2007‐20<strong>11</strong>).................................................................................... 62<br />
Figure 51: Average FCCERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) .................... 63<br />
Figure 52: Average ITERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) ...................... 63<br />
Figure 53: Percentage of Children Scoring “At” or “Above” the Target Level in Three Pre‐Literacy Skill Areas, by<br />
Primary Language, <strong>2010</strong>‐20<strong>11</strong>..................................................................................................................... 64<br />
Figure 54: Percentage of Children Meeting Targets for Later Reading Success, by Primary Language ........................ 65<br />
Figure 55: Changes in Students’ Letter Sound Recognition Skills After Participation in Migrant Education Pre‐<br />
School Programs ......................................................................................................................................... 66<br />
Figure 56: Number of Child Snapshot Forms Collected from Participating Preschool Programs ................................. 67<br />
Figure 57: Students’ Average School Readiness Levels Across the Basic Building Blocks of Readiness ....................... 67<br />
Figure 58: Students’ Top Five Readiness Strengths & Challenges ................................................................................ 68<br />
Figure 59: Number of Children Receiving Services from Multiple <strong>First</strong> 5 Partners ...................................................... 69<br />
Figure 60: Percentage of Children Receiving Services from Multiple <strong>First</strong> 5 Partners ................................................. 69<br />
Figure 61: Average Cost per Client, by Goal Area and Partner (<strong>2010</strong>‐20<strong>11</strong>) ................................................................ 71<br />
Figure 62: Balance Sheet, Fiscal Year <strong>2010</strong>‐20<strong>11</strong> ......................................................................................................... 72<br />
Figure 63: Amount of Leveraged Investments By Type ................................................................................................ 73<br />
Figure 64: Total Amount of <strong>First</strong> 5 and Leveraged Investments, <strong>2010</strong>‐<strong>11</strong> ................................................................... 73<br />
Figure 65: Number of 2‐1‐1 Callers and Needs, <strong>2010</strong>‐<strong>11</strong> ............................................................................................. 74<br />
Figure 66: Types of 2‐1‐1 Callers’ Needs ...................................................................................................................... 74<br />
Figure 67: Types of 2‐1‐1 Referrals to Agencies ........................................................................................................... 75<br />
Figure 68: HCOC Child Health Insurance Enrollment, Renewal, and Utilization Percentages ...................................... 82<br />
Figure 69: Newborn Enrollment Project Statistics, <strong>2010</strong>‐<strong>11</strong> ........................................................................................ 83<br />
Figure 70: Number of Emergency Department Visits (Infants Less Than One Year Old).............................................. 84<br />
Figure 71: Case Flow Diagram (<strong>2010</strong>‐<strong>11</strong>) ..................................................................................................................... 87<br />
Figure 72: Percentage of Families Together Participants Who Showed Decreased Risk of Child Maltreatment ......... 88<br />
Figure 73: Change in Families Together Participant’s Risk Levels Over Time, 2007 ‐ 20<strong>11</strong> ......................................... 88<br />
Figure 74: Percentage of Families Together Participants Who Do Not Have a Substantiated Allegation of<br />
Maltreatment Within 6 Months After Case Closure ................................................................................... 89<br />
Figure 75: Parents’ Satisfaction with Various Aspects of the Triple P Program ........................................................... 90<br />
Figure 76: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>‐<strong>11</strong>) ....................................................... 100<br />
Figure 77: How Participants <strong>First</strong> Heard about Triple P (<strong>2010</strong>‐<strong>11</strong>) ............................................................................. 100<br />
Figure 78: Percentage of Parents Participating with Another Adult (<strong>2010</strong>‐<strong>11</strong>) .......................................................... 101<br />
iv FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT TABLE OF FIGURES<br />
Figure 79: Ages of Children Chosen as the “Index” Child* (<strong>2010</strong>‐<strong>11</strong>) ........................................................................ 101<br />
Figure 80: Percentage of Parents Who Needed Assistance to Complete the Assessments (<strong>2010</strong>‐<strong>11</strong>) ...................... 101<br />
Figure 81: Parents’ Use of Positive Discipline Styles .................................................................................................. 104<br />
Figure 82: Level of Parent Confidence ....................................................................................................................... 107<br />
Figure 83: Levels of Conflict Over Parenting .............................................................................................................. 109<br />
Figure 84: Feelings of Support in Their Role as a Parent ............................................................................................ <strong>11</strong>1<br />
Figure 85: Level of Parents’ Satisfaction with Their Relationship .............................................................................. <strong>11</strong>3<br />
Figure 86: Level of Parents’ Emotional Difficulties ..................................................................................................... <strong>11</strong>5<br />
Figure 87: Level of Parental Problems with Child Behavior ....................................................................................... <strong>11</strong>8<br />
Figure 88: Participants with a Substantiated Allegation of Child Maltreatment Occurring Up to 6 Months after<br />
Program Entry ........................................................................................................................................... 120<br />
Figure 89: Parents’ Satisfaction with the Triple P Program: Levels 3 (Multi‐session), and Levels 4 and 5 ................. 121<br />
Figure 90: Parents’Satisfaction with the Triple P Seminars/Workshops .................................................................... 122<br />
Figure 91: Levels of Parenting Difficulty Six Months After Triple P Services .............................................................. 124<br />
Figure 92: Parenting Difficulty Six Months After Triple P Services: Frequency of Each Response Option ................ 124<br />
Figure 93: Number of Practitioners Trained and Accredited with Triple P (2009‐<strong>11</strong>) ................................................ 125<br />
Figure 94: Summary of Parent Consultation Skills Checklist Ratings (<strong>2010</strong>‐<strong>11</strong>) ......................................................... 126<br />
Figure 95: Summary of Training <strong>Evaluation</strong> Survey Ratings (<strong>2010</strong>‐<strong>11</strong>) ...................................................................... 127<br />
Figure 96: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>‐<strong>11</strong>) ....................................................... 132<br />
Figure 97: Parents’ Use of Positive Discipline Styles: Overall ..................................................................................... 134<br />
Figure 98: Level of Parental Problems with Child Behavior ....................................................................................... 136<br />
Figure 99: Parents’ Satisfaction with Various Aspects of the Triple P Program ......................................................... 137<br />
Figure 100: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>‐<strong>11</strong>) ....................................................... 139<br />
Figure 101: Number of Early Childhood Educators Who Have Completed SEEDS trainings (2007‐20<strong>11</strong>) .................... 144<br />
Figure 102: Number of SEEDS Trained Early Childhood Educators in Licensed Programs, by type of classroom<br />
(2007‐20<strong>11</strong>) ............................................................................................................................................... 144<br />
Figure 103: Primary Language of SEEDS Trained Early Childhood Educators in Licensed Programs (2007‐20<strong>11</strong>) ....... 144<br />
Figure 104: Educational Attainment of SEEDS Trained Early Childhood Educators in Licensed Programs<br />
(2007‐20<strong>11</strong>) ............................................................................................................................................... 145<br />
Figure 105: Classroom Support for Language and Literacy, <strong>2010</strong>‐20<strong>11</strong> ....................................................................... 146<br />
Figure 106: Key Language and Literacy Questions (2007‐20<strong>11</strong>).................................................................................. 147<br />
Figure 107: Average FCCERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) .................. 147<br />
Figure 108: Average ITERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) .................... 148<br />
Figure 109: Percentage of All Children Scoring “At” or “Above” the Target Level in Three Pre‐Literacy Skill<br />
Areas, <strong>2010</strong>‐20<strong>11</strong> ...................................................................................................................................... 149<br />
Figure <strong>11</strong>0: Percentage of Children Scoring “At” or “Above” the Target Level in Three Pre‐Literacy Skill Areas,<br />
by Primary Language, <strong>2010</strong>‐20<strong>11</strong> .............................................................................................................. 150<br />
Figure <strong>11</strong>1: Percentage of Children Meeting Targets for Later Reading Success, by Primary Language ...................... 150<br />
Figure <strong>11</strong>2: Percentage of Children at Each Target Level in Three Pre‐Literacy Skill Areas, by Primary<br />
Language, <strong>2010</strong>‐20<strong>11</strong> ................................................................................................................................ 151<br />
Figure <strong>11</strong>3: Changes in How Frequently Parents Read With Their Child, <strong>2010</strong>‐20<strong>11</strong> .................................................. 154<br />
Figure <strong>11</strong>4: Percentage of Children Who Made Developmental Changes in Key Social and Pre‐Literacy<br />
Measures ................................................................................................................................................... 157<br />
Figure <strong>11</strong>5: Number of Child Snapshot Forms Collected from Participating Preschool Programs ............................... 159<br />
Figure <strong>11</strong>6: Students’ Average School Readiness Levels Across the Basic Building Blocks of Readiness ..................... 159<br />
Figure <strong>11</strong>7: Students’ Top Five Readiness Strengths .................................................................................................... 160<br />
Figure <strong>11</strong>8: Students’ Top Five Readiness Challenges .................................................................................................. 160<br />
Figure <strong>11</strong>9: Percentage of Participants Who Responded “Very Much” to Workshop Survey Questions ..................... 162<br />
Figure 120: Summer Pre‐K Academy Letter Sound Identification Results, 20<strong>11</strong> ......................................................... 164<br />
FIRST 5 SANTA CRUZ COUNTY<br />
v
TABLE OF FIGURES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Figure 121: Percentage of Summer Pre‐K Academy Students who Increased Their Letter Sound Recognition By<br />
At Least 5 Letter Sounds ........................................................................................................................... 164<br />
Figure 122: Average Increase in the Number of Letter Sounds Recognized by Summer Pre‐K Academy Students ..... 164<br />
Figure 123: MESRP Letter Sound Identification Results, 20<strong>11</strong> ..................................................................................... 166<br />
Figure 124: MESRP Students’ Average Scores on the Brigance Preschool Screen‐II Assessment ................................ 166<br />
Figure 125: MESRP Students’ Average Scores on the Peabody Picture Vocabulary Test ............................................. 167<br />
vi FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
EXECUTIVE SUMMARY<br />
FIRST 5 SANTA CRUZ COUNTY<br />
1
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
2 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
EXECUTIVE SUMMARY<br />
The Importance of Investing in Young Children<br />
A growing body of scientific evidence points to the economic and societal impacts of wise<br />
investments in the early years. The Harvard Center for the Developing Child states:<br />
A vital and productive society with a prosperous and sustainable future is<br />
built on a foundation of healthy child development. Health in the<br />
earliest years lays the groundwork for a lifetime of vitality. 1<br />
Experiences during the first few years of life – good and bad –<br />
literally shape the architecture of the developing brain. Stable,<br />
positive relationships with adults and growth‐promoting<br />
experiences are keys to the development of the architecture that<br />
forms the foundation for all future learning, behavior, and health.<br />
When we invest wisely in children and families, the next generation<br />
will pay that back through a lifetime of productivity and responsible<br />
citizenship. 2<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is dedicated to giving children the<br />
opportunities they need to reach their full potential.<br />
Overview of this <strong>Report</strong><br />
The Strategic Plan for 2009‐2012 articulates community goals<br />
and results in three goal areas: Healthy Children, Strong Families,<br />
and Children Learning and Ready for School, and also addresses<br />
improved services for young children and their families.<br />
1 http://developingchild.harvard.edu/library/<br />
2 http://developingchild.harvard.edu/initiatives/council/<br />
FIRST 5 SANTA CRUZ COUNTY<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong>’s Vision:<br />
All <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
children enter school<br />
ready to achieve to their<br />
greatest potential.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong>’s Mission:<br />
To help children succeed in<br />
school and in life, <strong>First</strong> 5<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> invests in<br />
health, early learning, and<br />
family support to promote<br />
optimal development of<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children.<br />
This annual report summarizes<br />
findings of the <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
evaluation from July 1, <strong>2010</strong> to June 30, 20<strong>11</strong>. The Healthy Kids<br />
Initiative, Differential Response Initiative, and Early Literacy<br />
Foundations Initiative are multi‐year investments and,<br />
therefore, some information presented reflects multiple years<br />
of data.<br />
3
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Overall Well-Being of Children in the <strong>County</strong><br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> invests in health, early learning and family support to promote the well‐<br />
being of children. To help guide its investments and partnerships, <strong>First</strong> 5 monitors county‐wide<br />
trends that affect child well‐being. The year <strong>2010</strong>‐20<strong>11</strong> marked the second year of the current three<br />
year strategic plan, and the following data reflect the current status of the <strong>County</strong>:<br />
� <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has a growing and diverse population of young children. In 20<strong>11</strong>, there<br />
were 21,258 children ages 0‐5, the majority of whom were either Hispanic (57%), or White<br />
(37%). This diversity continues into kindergarten, where in <strong>2010</strong><br />
almost 49% of children had a primary language other<br />
than English.<br />
� Unemployment has grown dramatically and still varies greatly<br />
across the county. Over the past three years, the <strong>County</strong>’s<br />
unemployment rates reflected the broader economic recession.<br />
Using annual averages, the unemployment rate for the county<br />
jumped dramatically from 7% in 2008 to <strong>11</strong>% in 2009, but<br />
appears to have reached a plateau by 20<strong>11</strong> at almost 13%. Within<br />
the <strong>County</strong>, the percent of unemployed residents differed greatly<br />
by area; the August 20<strong>11</strong> unemployment rate ranged from 4% in<br />
Aptos to 22% in Watsonville.<br />
“Children have been<br />
among those hardest<br />
hit by the [economic]<br />
crisis.”<br />
- Lynch, Rene. “Children are<br />
hidden victims of the economic<br />
crisis, report says.” Los Angeles<br />
Times, 17 August 20<strong>11</strong>.<br />
<br />
Image: africa/FreeDigitalPhotos.net<br />
� There was rising enrollment in public assistance programs. Between 2008 and <strong>2010</strong>, the<br />
total number of <strong>County</strong> residents participating in CalWORKS increased 8%. In addition, more<br />
residents have been utilizing publicly‐funded health insurance programs. Between 2007 and<br />
20<strong>11</strong>, there were enrollment increases in Medi‐Cal (10%), and Healthy Families (28%).<br />
Enrollment in Healthy Kids has shown a slight decrease in the last four years, due to<br />
the waiting list for children ages 6‐18.<br />
� Enrollment in public assistance nutritional programs has<br />
increased. In the last few years, there has been an increase in the<br />
number of residents participating in CalFresh (Food Stamps), the<br />
National School Lunch Program, and Women, Infants, & Children<br />
Program (WIC).<br />
� Not enough mothers are receiving prenatal care in the first trimester.<br />
The percentage of mothers who received prenatal care in their first trimester is high – 83% —<br />
but not high enough, especially for teen moms. The Healthy People initiative recently<br />
lowered its target rate for first trimester prenatal care from 90% (<strong>2010</strong> Objective) to 78%<br />
(2020 Objective), with the result that, on average, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is achieving this<br />
4 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
objective. However, younger mothers tended to fall below this target rate (ages 24 and<br />
younger).<br />
Additionally, there were differences in receipt of early prenatal care based upon the<br />
mother’s source of payment for the care. Only 76% of mothers with Medi‐Cal began receiving<br />
prenatal care during the first trimester, compared to 92% of mothers with private insurance.<br />
� The percentage of births to teen mothers in the <strong>County</strong> is slowly decreasing. In <strong>2010</strong>, there<br />
were 258 births to teen mothers, representing 8.1% of all births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, and a<br />
teen birth rate of 30 per 1,000 (ages 15‐19). Over the past five years there has been a slight<br />
decrease in both births to teen mothers and the teen birth rate, except for 2009 when there<br />
was a small increase in both measurements. Taken together, the two measures indicate a<br />
slowly decreasing proportion of teens in the county who are becoming mothers.<br />
� Over half of the births by women in the <strong>County</strong> were paid for by Medi‐Cal. In <strong>2010</strong>, 55% of<br />
births, across all age groups, were paid for by Medi‐Cal. Medi‐Cal was utilized by over 84% of<br />
the births to women under the age of 25.<br />
� Young children are receiving services for their special needs. In participating preschools,<br />
approximately 6% of children have had an Individualized Education Plan (IEP) or an<br />
Individualized Family Service Plan (IFSP) developed for them, and 6% of kindergarteners are<br />
receiving special education services.<br />
A Profile of <strong>First</strong> 5 Participants<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> reaches children who can make great gains<br />
with early and smart investments.<br />
<strong>First</strong> 5’s goal is to serve the most vulnerable children ages 0‐5 and their families in <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong>, including very low‐income families, English language learners, and families who live in<br />
higher risk zones of the county.<br />
� <strong>First</strong> 5‐supported programs are wide‐reaching: In<br />
<strong>2010</strong>‐<strong>11</strong>, <strong>First</strong> 5 partners served 9,292 children<br />
(unduplicated), representing over two‐fifths of all<br />
children these ages (44%) in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>.<br />
� <strong>First</strong> 5 serves a high number of dual language<br />
learners: Of the children served by <strong>First</strong> 5, 85% were<br />
Latino, and 71% of participants spoke Spanish as their<br />
primary language. Of all Latino children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 62% participated in<br />
services funded by <strong>First</strong> 5.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
5
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
� <strong>First</strong> 5 is reaching an increasingly low income population. Almost 89% of the families served<br />
by <strong>First</strong> 5 earned less than the Federal Poverty Level, based on data for a family of five (the<br />
typical family size served by <strong>First</strong> 5). This also represents an increase from 78% since 2007‐08.<br />
� <strong>First</strong> 5 is serving children in the highest risk zones of the county. Of the children served who<br />
had known ZIP codes, most (92%) lived in the areas of the county that rank highest on a<br />
cumulative index of risk factors that included measures of linguistic isolation, family income,<br />
birth statistics, parental education attainment, child maltreatment and family violence. These<br />
areas include Watsonville, Freedom, Live Oak, and some areas in the city of <strong>Santa</strong> <strong>Cruz</strong>.<br />
<strong>First</strong> 5 strengthens systems by enhancing the capacity of service<br />
providers<br />
In addition to supporting direct services to children and families, <strong>First</strong> 5 aims to boost the capacity of<br />
local systems in order to extend the reach of critical early education, family support, and health<br />
services to a larger number of children and families. Systems enhancements help ensure better<br />
services for years to come. Examples of <strong>First</strong> 5’s capacity‐building work in <strong>2010</strong>‐20<strong>11</strong> include:<br />
� Skill development and coaching for early childhood educators. Training of approximately<br />
125 early childhood educators to deliver the SEEDS of Early Literacy research‐based<br />
strategies in their classrooms or homes;<br />
� Improved parent and caregiver practices that<br />
support children’s social and emotional<br />
development. Training of 86 parent education<br />
practitioners to deliver the Triple P curriculum, an<br />
evidence‐based curriculum shown to increase<br />
parental efficacy, parent‐child interaction, child<br />
behaviors and to reduce rates of child<br />
maltreatment;<br />
� Support for children’s transition to kindergarten.<br />
Training of teachers in 42 preschools to prepare Child Snapshots, a transcript of parent<br />
information and child skills that is delivered to children’s elementary schools. The Snapshots<br />
are intended to stimulate information sharing, dialogue and coordination between early<br />
education providers and elementary schools; and<br />
� Distribution of information to community service providers. Training of health, social<br />
services, and early education providers through workshops, brown bag lunches, and other<br />
trainings to better integrate services and improve customer service.<br />
6 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
Healthy Children<br />
Though coverage rates are high in the county – approximately 93% – there are still children who do<br />
not have health insurance. For the past several years, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has invested in<br />
strategies to help ensure that all children have access to care.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> insures children<br />
� <strong>First</strong> 5 helps uninsured children enroll in health plans: In 2004, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
helped create a new children’s health initiative called Healthy Kids. Healthy Kids has Certified<br />
Application Assisters who provide outreach and assistance to income‐eligible families to help<br />
them apply for public health insurance, and to renew their coverage annually. Because Medi‐<br />
Cal and Healthy Families cannot cover all of the uninsured, <strong>First</strong> 5 also funds the premiums<br />
for Healthy Kids members.<br />
� Children are getting enrolled in public health insurance plans. Since the start of the Healthy<br />
Kids Initiative (June 1, 2004‐June 30, 20<strong>11</strong>), there were 1,134 new enrollments of children<br />
ages 0‐5 in the local Healthy Kids program, 3,371 children in Healthy Families,<br />
and 2,983 children in Medi‐Cal, for a total of 7,488 new enrollments of<br />
Since 2004, 7,488 children<br />
ages 0‐5 have been enrolled<br />
children ages 0‐5.<br />
in public health insurance.<br />
� Children are renewing and using their health insurance. In<br />
order to ensure continuity of care, it’s important that parents keep<br />
In <strong>2010</strong>‐<strong>11</strong>, 71% of all<br />
mothers with Medi‐Cal<br />
births had their new babies<br />
their children enrolled in health insurance plans. During the <strong>2010</strong>‐<strong>11</strong><br />
funding cycle, the Certified Application Assisters helped ensure that<br />
enrolled in Medi‐Cal. 92% of children ages 0‐5 renewed their membership in public health<br />
insurance. Of the renewal applications that were accepted,<br />
approximately 53% were in Healthy Families, 32% were in Medi‐Cal, and 14%<br />
were in Healthy Kids. Almost 97% of children renewing in public health insurance utilized<br />
care prior to renewal.<br />
� <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s newborns are getting connected to medical<br />
care. Baby Gateway—the Newborn Enrollment Project—has now<br />
been launched in three local hospitals. While this program has been<br />
active, 70% of all mothers this year received a newborn visit while<br />
in the hospital. Baby Gateway also assisted 74% of all mothers<br />
with Medi‐Cal births to complete a Medi‐Cal application for their<br />
new babies. With this assistance, 71% of all mothers with Medi‐<br />
Cal births had their new babies enrolled in Medi‐Cal, and 72%<br />
were assigned a primary care provider for their child.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
7
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children get a medical home, preventive<br />
care, and dental care<br />
� Children have a medical home. Nearly all children (95%) ages 2‐6 who were enrolled in<br />
Healthy Kids had access to a primary care practitioner, according to the <strong>2010</strong>‐<strong>11</strong> HEDIS<br />
measures. 3 The majority of children (ages 3‐6) in Healthy Kids also had a well‐child visit<br />
(83%).<br />
� Fewer children are using the emergency<br />
department (ED). Ideally, children and their<br />
families who have insurance and who have a<br />
medical home will be more likely to access their<br />
provider for routine preventive care, and less<br />
likely to use the emergency department (ED) for<br />
non‐urgent medical care.<br />
o The rate of ED use for children using Healthy<br />
Kids insurance was increasing up through 2008, but has shown a decrease since 2009.<br />
o The services provided by the Newborn Enrollment Project may also have had an effect on<br />
the use of the ED for children less than one year old. ED visits at Watsonville Community<br />
Hospital were at a high of 632 in the 2nd quarter of 2009. Baby Gateway was launched at<br />
that hospital in August 2009, and after that the number of ED visits has dropped steadily<br />
to a low of 424 at the beginning of 20<strong>11</strong>.<br />
� Children are getting dental care. Of children ages 4‐6 enrolled in Healthy Kids in <strong>2010</strong>, the<br />
majority (89%) had a dental visit in the past year. This percentage has been slowly increasing<br />
since 2006 (69%). A smaller percentage of younger children (ages 2‐3) are getting dental<br />
visits, although this too has been increasing between 2006 (49%) and <strong>2010</strong> (69%).<br />
3 HEDIS (Healthcare Effectiveness Data and Information Set) is a set of standardized performance measures used by the Health Care Quality<br />
Measurement (HCQM) annual report to track the quality of care that children enrolled in Healthy Kids are receiving in <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong>. HEDIS results are analyzed for the calendar year; therefore, <strong>2010</strong> results are for the time period January 1 ‐ December 31, <strong>2010</strong>.<br />
8 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
Strong Families<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> historically has had higher rates of child abuse and neglect than any other Bay<br />
Area county. 4 Fortunately, the rates of child maltreatment are decreasing and in <strong>2010</strong> the county<br />
rate (7.6 per 1,000) dropped lower than the state‐wide rate (8.7 per 1,000) for the first time in<br />
reporting history.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps strengthen parent‐child relationships<br />
and reduce risk for child abuse and neglect<br />
Through two innovative programs, <strong>First</strong> 5 and its partners are helping to decrease the risk and<br />
incidence of child abuse and neglect.<br />
� In partnership with the county’s Human Services Department‐Family and Children’s Services<br />
and <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center, <strong>First</strong> 5 supports a program<br />
called Families Together. Families Together is <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s<br />
differential response program, a strategy used to intervene early<br />
At‐risk parents have improved<br />
with families in which there has been an allegation of abuse.<br />
parenting styles and reduced<br />
This home visiting program includes comprehensive intake<br />
risk of maltreatment.<br />
and risk assessment, development of a tailored case plan,<br />
parent support and education, child development activities,<br />
The percentage of Families<br />
and periodic assessments. Results of the program have been Together participants assessed<br />
as being at high risk or very high<br />
very encouraging:<br />
risk of child maltreatment<br />
dropped from 62% to 13%.<br />
o Reduction of risk. Parents/primary caregivers receiving<br />
services from Families Together had their levels of risk assessed<br />
while they were in the program. Pre and post risk assessments for<br />
several years combined indicated that families reduced their level of risk for future<br />
maltreatment.<br />
o Reduced rates of child maltreatment. Of the 82 participating families who had their cases<br />
closed in 20<strong>11</strong>, 96% had no substantiated allegations of maltreatment in the 6 month<br />
period following case closure.<br />
� <strong>First</strong> 5 continued the implementation of the Positive Parenting Program, or Triple P. The<br />
program consists of five levels of intervention, from broad‐based, universal efforts in the<br />
community to more intensive, focused efforts with individual parents. The Triple P model is<br />
an evidence‐based program shown in numerous randomized studies to increase parental<br />
4 Center for Social Services Research, School of Welfare, U.C. Berkeley. Child Welfare Dynamic <strong>Report</strong> System, A California Department of<br />
Social Services / University of California at Berkeley collaboration. Accessed online at http://cssr.berkeley.edu/ucb_childwelfare.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
9
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
confidence and efficacy, positive parent‐child interactions and child behaviors, and to reduce<br />
rates of child maltreatment. Highlights of this program include:<br />
o Evidence‐based parenting support is available. <strong>First</strong> 5 has implemented all five levels of<br />
Triple P in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, from the launch of a media campaign to intensive and<br />
focused individual services. In <strong>2010</strong>‐<strong>11</strong>, approximately 893 parents with 1,518 children<br />
participated in the program.<br />
o Parents are engaged and seek more opportunities. Of parents who participated in the<br />
seminars and workshops, 21% requested follow‐up services, suggesting that these brief<br />
services may be an effective way of getting parents engaged in the program and gives<br />
them an opportunity to participate in further services.<br />
o Parenting skills and knowledge are improving along several domains. Parents who<br />
participated in levels 3 and 4 of the Triple P program completed assessments that<br />
measured their levels of parenting skills and knowledge along several domains. Results<br />
showed significant improvements in all domains, including:<br />
Increased use of positive discipline styles � Improved levels of confidence in<br />
parenting � Reduced levels of conflict over parenting � Increased support in<br />
their role as a parent � Increased levels of satisfaction with their relationship �<br />
Decreased levels of emotional difficulties � Improvements in child behavior<br />
There was also evidence that parents who had more serious parenting issues made the<br />
most meaningful changes in their family lives.<br />
o Satisfaction with services. Parents have rated the quality of<br />
services very high, noting that they had received the help they wanted,<br />
Parents are more<br />
confident in their<br />
parenting skills, are<br />
were dealing more effectively with problems in their family, and would<br />
come back to the program if they needed to seek help again.<br />
helping to improve their<br />
o Continued use of the skills they learned. On average,<br />
children’s behavior, and<br />
are building positive<br />
relationships with their<br />
families.<br />
parents felt that the seminars answered their questions, and that they<br />
would continue to use the strategies they learned. Additional survey<br />
results indicate that six months after their Triple P services, parents felt<br />
highly effective in dealing with their children’s behavior, and reported<br />
improved child behavior overall.<br />
o Lowered rates of child maltreatment. Among families who have experienced child abuse<br />
or neglect, results suggest that Triple P is associated with lower rates of new<br />
substantiated child maltreatment allegations. Six months after beginning a Triple P<br />
program, only 1% of parents had a new substantiated maltreatment allegation, compared<br />
to 5% of parents in a comparison parenting program.<br />
10 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
Children Learning and Ready for School<br />
One of the most powerful indicators of later success is a child’s reading proficiency at the end of 3<br />
“The seeds of literacy are<br />
planted before children<br />
enter school.<br />
Important literacy skills do<br />
not develop spontaneously,<br />
instruction shapes them.”<br />
- Snow, Burns, & Griffin, 1998<br />
rd<br />
grade, 5 and data show that <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children are struggling with their reading skills. For<br />
example, only 40% of 3 rd grade students in the <strong>County</strong> scored proficient or better on the<br />
standardized California English Language Arts test (STAR) in <strong>2010</strong>, as compared to<br />
46% statewide. The good news is that there has been a gradual increase in<br />
the past five years in the percentage of county students who are scoring at<br />
or above grade level (from 34% in 2007 to 40% in 20<strong>11</strong>), and county<br />
areas of historically low performance have shown particularly great<br />
improvements in scores.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is helping to improve children’s school<br />
performance by encouraging families to read together, providing language<br />
and literacy skill development for early childhood educators, encouraging<br />
child assessments and differentiated instruction, and working to help children<br />
smoothly transition into kindergarten.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> builds early literacy foundations by<br />
training early childhood educators to enhance language rich<br />
practices in the classroom<br />
� Early childhood educators are getting trained in literacy activities. Since January 2007,<br />
<strong>First</strong> 5 has invested in early literacy training for 356 early childhood educators through the<br />
SEEDS of Early Literacy courses at Cabrillo College.<br />
356 early child educators<br />
are now promoting strong<br />
language and literacy<br />
foundations for children.<br />
Over 7,000 children are<br />
developing the skills to<br />
become successful readers.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
� The SEEDS curriculum is being used throughout <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
child care programs and preschools. Since the founding of the Early<br />
Literacy Foundations Initiative in 2006‐07, 201 SEEDS‐trained teachers and<br />
coaches are working in state‐ and federally‐subsidized classrooms, there<br />
are 155 licensed family child care providers, teachers, and coaches in<br />
private and non‐profit centers/homes, and 155 Family, Friend or Neighbor<br />
(FFN) informal child care providers.<br />
� Classrooms and home‐based settings of SEEDS‐trained early educators<br />
are being transformed into literacy‐rich environments. SEEDS‐trained early childhood<br />
educators are working to ensure their children are on target for kindergarten by using<br />
evidence‐based early literacy strategies, receiving on‐site coaching, and integrating materials<br />
into their learning environments. Assessment results are showing that SEEDS‐coached<br />
5 United States Department of Education, Promoting Educational Excellence for all Americans, Questions and Answers on No Child Left<br />
Behind, retrieved from http://www.ed.gov/nclb/methods/reading/reading.html, 2004.<br />
<strong>11</strong>
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
teachers are improving the quality of support they provide in their classrooms for children’s<br />
development of early literacy:<br />
o In preschool classrooms teaching children ages 3‐5, results from the Early Language and<br />
Literacy Classroom Observation tool (<strong>2010</strong>‐<strong>11</strong>) show that the percentage of classrooms<br />
that provided high quality support for early literacy increased from 16% at pre‐assessment<br />
to 92% at post‐assessment.<br />
o In home‐based settings, results from multiple years of the Family Child Care<br />
Environmental Rating Scale (2009‐<strong>11</strong>) indicated that family child care providers made<br />
improvements in their interactions with children, their use of books with children, and in<br />
helping children understand and use language.<br />
o In infant/ toddler classrooms, results from multiple years of the Infant Toddler<br />
Environmental Rating Scale (2009‐<strong>11</strong>) revealed that teachers made improvements in the<br />
way they interacted with children, used books with children, and helped children<br />
understand and use language.<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps children build the foundation for<br />
later reading success<br />
� Parents are getting involved in their children’s reading. SEEDS<br />
classrooms also implemented Raising A Reader, a weekly rotating<br />
book bag program for families, to boost shared reading practices<br />
and impact children’s early literacy skills. Over 5,000 children<br />
participated in the program during <strong>2010</strong>‐20<strong>11</strong>.<br />
� Children are developing skills in key areas of reading success.<br />
Many preschool classrooms throughout the county are taught by<br />
teachers who have received SEEDS training funded by <strong>First</strong> 5.<br />
Results show that children benefit when teachers enhance their<br />
skills to promote early literacy.<br />
o When they used child assessment data to tailor their instruction with children, children in<br />
these SEEDS‐trained classrooms increased their skills on 3 key predictors of later reading<br />
success (picture naming, rhyming, and alliteration).<br />
o A higher percentage of Spanish‐speaking children scored “below” or “near” target levels in<br />
their initial assessments when compared to English‐speaking children, but by the last<br />
assessment, they had reached or exceeded the levels attained by English‐speaking<br />
children, particularly in rhyming and alliteration, in both languages.<br />
� Children are learning letter sounds. In <strong>2010</strong>‐<strong>11</strong>, 90% of children in two pre‐kindergarten<br />
educational programs provided by Migrant Education increased their letter sound<br />
recognition by at least five letter sounds. On average, children recognized only 1 letter sound<br />
before the program and 18 letter sounds after the program.<br />
12 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps children successfully transition to<br />
kindergarten<br />
<strong>First</strong> 5 is investing in activities that help children successfully transition to kindergarten. Some ways<br />
to do this are to encourage parents to visit the new school with their child, to meet the new<br />
kindergarten teacher, and to attend parent orientations. The following highlights <strong>First</strong> 5’s work to<br />
support successful transitions to kindergarten:<br />
� <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is working with parents and early childhood educators to create<br />
an information “bridge” for children as they transition to kindergarten. Since 2006, parents<br />
and early childhood educators have filled out Child Snapshot forms about children before<br />
they enter kindergarten. Each Snapshot includes key parent information about their child, as<br />
well as the preschool teacher’s assessment of the child’s school readiness skills. These forms<br />
help schools understand their incoming kindergarteners to thereby build balanced<br />
classrooms, attend to individual child and family needs, and to create greater articulation<br />
between preschool and kindergarten.<br />
o This spring, teachers and parents at 42 preschools completed individual Child Snapshot<br />
forms for 976 children, which were then collected and distributed to the kindergarten<br />
teachers at each child’s school of attendance.<br />
o Average readiness scores indicated that children who attended these preschools will be<br />
entering kindergarten with high levels of proficiency across all domains of readiness.<br />
� Parents are receiving kindergarten transition information.<br />
o In February 20<strong>11</strong>, <strong>First</strong> 5 co‐sponsored the Pajaro Valley<br />
Unified School District’s Parent Conference. Over 300 families<br />
participated in workshops promoting transition to<br />
kindergarten practices, healthy child development, and<br />
positive discipline.<br />
o Approximately 267 parents participated in Transition to<br />
School Workshops where they learned about kindergarten<br />
registration requirements, choices of language programs,<br />
how to support their child in school, and ways to ensure that<br />
their child’s entry into school is a pleasant and smooth transition.<br />
Service Integration & Community Strengthening<br />
<strong>First</strong> 5 efforts are sustainable<br />
� Partners maximize <strong>First</strong> 5 investments by leveraging these funds to draw down other matching<br />
funds. In <strong>2010</strong>‐<strong>11</strong>, <strong>First</strong> 5 partners leveraged $3,762,964, more than the entire <strong>First</strong> 5 <strong>Santa</strong><br />
<strong>Cruz</strong> <strong>County</strong> annual program investment of 3,662,823.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
13
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Summary<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is serving 44% of children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, and they are<br />
serving the most vulnerable children, including those in families that are experiencing severe<br />
poverty and are living in areas of the county with the highest risk factors.<br />
<strong>First</strong> 5 and its partners are achieving results in helping these very vulnerable children and families:<br />
� In the Healthy Children goal area, data show that children are insured and using preventative<br />
health care:<br />
o Since 2004, 7,488 children ages 0‐5 have been enrolled in public health insurance.<br />
o In <strong>2010</strong>, 95% of children (ages 2‐6) in Healthy Kids had a medical home, 83% of children<br />
(ages 3‐6) had a well‐child visit in the last year, and 89% of children (ages 4‐6) had a dental<br />
visit.<br />
o In <strong>2010</strong>‐<strong>11</strong>, Baby Gateway assisted 74% of all mothers with Medi‐Cal births to complete a<br />
Medi‐Cal application for their new babies. With this assistance, 71% of all mothers with<br />
Medi‐Cal births had their new babies enrolled in Medi‐Cal, and 72% were assigned a<br />
primary care provider for their child.<br />
� In the Strong Families goal area, families are becoming more healthy and resilient, and it<br />
benefits their children:<br />
o Families who are at risk for child abuse and neglect are being helped to reduce that risk.<br />
o 96% of families who received services from the Families Together program had no<br />
substantiated allegations of maltreatment in the six months after their cases closed.<br />
o <strong>First</strong> 5 has implemented all five levels of Triple P in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, from the launch of<br />
a media campaign to intensive and focused individual services. Brief services may be an<br />
effective way of getting parents engaged in the program and provide an opportunity to<br />
participate in further services.<br />
o Parents participating in the Triple P parenting program significantly increased their<br />
confidence in parenting, used more positive discipline styles, felt more supported, and<br />
improved their relationships with their families.<br />
o Parents who had more serious parenting issues made the most meaningful changes in<br />
their family lives.<br />
o Up to six months after completing the program, Triple P parents continue to report fewer<br />
behavioral problems with their children, and are continuing to use the skills they learned.<br />
o Among families who have experienced child abuse or neglect, results suggest that Triple P<br />
is associated with lower rates of new substantiated child maltreatment allegations.<br />
14 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />
� In the Children Learning and Ready for School goal area, data show that <strong>First</strong> 5 is successfully<br />
building teacher skills to improve children’s later school success:<br />
o The SEEDS of Early Literacy approach is transforming the early education system in the<br />
county. In <strong>2010</strong>‐<strong>11</strong>, the percentage of SEEDS‐trained preschool classrooms assessed as<br />
providing high quality literacy support for children increased from 16% to 92%. Similarly, a<br />
multiple year analysis showed that SEEDS‐trained family child care providers increased<br />
their abilities to help children use books, and understand and use language, and SEEDS‐<br />
trained Infant/Toddler teachers showed improvements in these same dimensions.<br />
o Children in SEEDS‐trained classrooms are increasing their skills in three predictors of later<br />
reading success (picture naming, rhyming and alliteration). Further analyses showed that a<br />
higher percentage of Spanish‐speaking children scored “below” or “near” target levels in<br />
their initial assessments when compared to English‐speaking children, but by the last<br />
assessment, they had reached or exceeded the levels attained by English‐speaking<br />
children, particularly in rhyming and alliteration, in both languages.<br />
o Child Snapshots are helping the kindergarten teachers of 976 children understand their<br />
strengths, as well as areas in which they can be supported for success in school.<br />
� <strong>First</strong> 5 partners are maximizing <strong>First</strong> 5 funding by leveraging their funds to bring in an<br />
additional 3.7 million dollars, and in fact, the amount leveraged exceeds <strong>First</strong> 5’s total<br />
funding for <strong>2010</strong>‐<strong>11</strong> by over $100,000. Because of <strong>First</strong> 5’s funding and this kind of additional<br />
support, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children will continue to get the help they need to become<br />
healthy, strong, and ready for school.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
15
EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
16 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
PART 1:<br />
STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
17
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
18 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Overview of the Strategic Framework<br />
In the <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Plan for 2009‐2012, the Commission articulated a strategic<br />
framework that included community goals and desired program results. In each of the three goal<br />
areas (Healthy Children, Strong Families, and Children Learning and Ready for School), specific<br />
results were chosen to receive Commission investment between 2009 and 2012. A detailed version<br />
of this framework is included in Appendix I, and an overview is as follows:<br />
Increase<br />
Insurance<br />
Coverage<br />
Increase Medical/Dental<br />
Homes<br />
Decrease Child<br />
Abuse &<br />
Neglect<br />
FIRST 5 SANTA CRUZ COUNTY<br />
Healthy Children<br />
Increase Number of<br />
Children Reaching<br />
Developmental<br />
Milestones<br />
Strong Families<br />
Decrease<br />
Childhood<br />
Obesity<br />
Increase use of<br />
Preventative Health Care<br />
Increase Participation in<br />
Quality Structured<br />
Activities<br />
Improve Parent & Caregiver<br />
Practices that Support Social<br />
and Emotional Development<br />
Improve Pre‐Literacy<br />
Skills<br />
Preview of the Strategic Framework Section of this <strong>Report</strong><br />
Increase Parental<br />
Involvement in<br />
Children’s Learning &<br />
Development<br />
Children Learning<br />
and Ready for<br />
School<br />
Increase Use of<br />
Quality Child<br />
Care Practices<br />
Increase Use of Kindergarten<br />
Transition Practices<br />
The Strategic Framework is also the framework for the evaluation. Thus, the Strategic Framework<br />
section of this report reviews the progress that has been made between July 1, <strong>2010</strong> and June 30,<br />
20<strong>11</strong> toward achieving the specific results in each of the three goal areas. Multiple years of data are<br />
often shown for initiatives for which there have been multiple years of investment. To contextualize<br />
these outcome data, this section begins with a review of county‐wide trends as well as a profile of<br />
<strong>First</strong> 5’s participants, and concludes with a section regarding <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s efforts to<br />
support service integration and community strengthening.<br />
19
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
20 FIRST 5 SANTA CRUZ COUNTY
OVERALL WELL-BEING OF CHILDREN<br />
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
IN THE COUNTY<br />
Overall Well‐Being of Children in the <strong>County</strong><br />
A Profile of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Youngest Children<br />
FIRST 5 SANTA CRUZ COUNTY<br />
COUNTY TRENDS<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has a growing and diverse population of young children. In 20<strong>11</strong>, there were<br />
21,258 children ages 0‐5, the majority of whom were either Hispanic (57%), or White (37%). This<br />
diversity continues into kindergarten, where in <strong>2010</strong> almost 49% of children had a primary language<br />
other than English.<br />
Figure 1: Number of <strong>County</strong> Children ages 0-5<br />
Figure 2: Ethnicity of <strong>County</strong> Children<br />
ages 0-5 (20<strong>11</strong>)<br />
3.5%<br />
1.1%<br />
22,000<br />
18,000<br />
14,000<br />
10,000<br />
57.3%<br />
1.4%<br />
18,216 18,382 18,678 18,971 19,209<br />
21,258<br />
2006 2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />
36.7%<br />
White<br />
Hispanic<br />
Asian/Pacific Islander<br />
Other<br />
Multirace<br />
Figure 3: English Language Proficiency of<br />
<strong>County</strong> Kindergarteners (<strong>2010</strong>)<br />
47.0%<br />
51.5%<br />
Source: (Population and Ethnicity) State of California, Department of Finance, Race/Ethnic Population with Age and Sex Detail, 2000–2050. Sacramento,<br />
CA, 20<strong>11</strong>. (English Language Proficiency) California Department of Education, Special Education Division, 2009‐10.<br />
English Language Proficiency definitions:<br />
� English Learners (EL) are those students for whom there is a report of a primary language other than English on the state‐approved Home<br />
Language Survey and who, on the basis of the state approved oral language (grades K‐12) assessment procedures and including literacy (grades 3‐<br />
12 only), have been determined to lack the clearly defined English language skills of listening comprehension, speaking, reading, and writing<br />
necessary to succeed in the school's regular instructional programs.<br />
� Fluent‐English‐Proficient (FEP) students are those whose primary language is other than English and who have met the district criteria for<br />
determining proficiency in English (i.e., those students who were identified as FEP on initial identification and students redesignated from Limited‐<br />
English‐Proficient (LEP) or English learner (EL) to FEP).<br />
N: (Population and Ethnicity) N=21,258; (English Language Proficiency) N=3,267.<br />
1.5%<br />
English as Primary<br />
Language<br />
Fluent‐English‐<br />
Proficient (FEP)<br />
English Learners (EL)<br />
21
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
COUNTY TRENDS<br />
<strong>County</strong>-Wide Trends in Indicators of Child and Family Well-Being<br />
Indicator: Trends in employment and public assistance<br />
The local economy affects all aspects of community well‐being, and one barometer of how a<br />
community is faring is its trends in employment and associated demand for public assistance.<br />
As reflected in the following unemployment data for the county, state, and nation, <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong> has been impacted by the current economic climate. During the recession, the market<br />
contracted and became less able to absorb the workforce, which has resulted in increased<br />
unemployment.<br />
� Between 2006 and 20<strong>11</strong>, the <strong>County</strong> unemployment rate increased from 5.7% to 12.7%.<br />
� Within the <strong>County</strong>, the percent of unemployed residents differed greatly by area; the August<br />
20<strong>11</strong> unemployment rate ranged from 4% in Aptos to 22% in Watsonville.<br />
Figure 4: Unemployment Rate<br />
24%<br />
20%<br />
16%<br />
12%<br />
8%<br />
4%<br />
0%<br />
4.9%<br />
5.7%<br />
4.6%<br />
5.9%<br />
4.6%<br />
7.3%<br />
5.4% 7.2%<br />
5.8%<br />
<strong>11</strong>.4%<br />
<strong>11</strong>.3%<br />
9.3%<br />
22.4%<br />
12.8% 12.7%<br />
12.4%<br />
12.0%<br />
Source: U.S. Department of Labor, Bureau of Labor Statistics, 20<strong>11</strong>.<br />
* Data for 2006‐<strong>2010</strong> reflect the average monthly unemployment rate for each year. Data for 20<strong>11</strong> reflect the average monthly rate through August<br />
(the most current month available at the time of this report).<br />
22 FIRST 5 SANTA CRUZ COUNTY<br />
9.6%<br />
9.0%<br />
4.2%<br />
2006 2007 2008 2009 <strong>2010</strong> 20<strong>11</strong>*<br />
Watsonville, CA<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
California<br />
United States<br />
Aptos, CA
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
COUNTY TRENDS<br />
Unemployment has caused an increase in enrollment in public assistance programs. Between 2008<br />
and <strong>2010</strong>, the total number of <strong>County</strong> residents participating in CalWORKS increased by 8.1%, with a<br />
small decrease within the last year.<br />
Figure 5: <strong>County</strong> Enrollment in CalWORKS<br />
5,000<br />
4,500<br />
4,000<br />
3,500<br />
3,000<br />
2,500<br />
4,582 4,589 4,512<br />
4,951 4,877<br />
2006 2007 2008 2009 <strong>2010</strong><br />
Source: State of California Employment Development Department, Labor Market Information Division, Planning Information Packets, 20<strong>11</strong>.<br />
In tough economic times, food security can become a challenge for families. In <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, in<br />
20<strong>11</strong> over 19,000 people were receiving Food Stamp benefits, which was a 70% increase from 2007.<br />
The number of people receiving food stamps was equivalent to about 7% of all people in the<br />
county, 6 though in <strong>2010</strong> California Food Policy Advocates estimated that 14% of the county<br />
population was income‐eligible. 7 In <strong>2010</strong>, over 19,000 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children were participating<br />
in the National School Lunch Program, or almost 50% of the county’s students. Enrollment in WIC<br />
increased slightly from 9,310 (in 2009) to 9,571 (in <strong>2010</strong>).<br />
Figure 6: <strong>County</strong> Enrollment in Public Assistance Nutritional Programs<br />
PROGRAM 2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />
CalFresh (Food Stamp Program) <strong>11</strong>,367 12,509 14,372 17,629 19,291<br />
National School Lunch Program (Free and<br />
reduced price lunch ) 16,494 16,665 17,666 19,228<br />
not yet<br />
available<br />
not yet<br />
Women, Infants, & Children Program (WIC) - - 9,310 9,571 available<br />
Sources: (CalFresh data) California Department of Social Services, Food Stamp Program Participation and Benefit Issuance <strong>Report</strong>, 20<strong>11</strong>; (National<br />
School Lunch Program) California Department of Education, Educational Demographics Unit, <strong>2010</strong>; (WIC) 2009 data=California Food Policy Advocates,<br />
<strong>2010</strong> <strong>County</strong> Nutrition and Food Insecurity Profiles; <strong>2010</strong> data=State of California Department of Health Services, Certified Participants (Receiving F1s),<br />
Caseload, and Unissued Food Instrument Ratios for All Agencies by Month, 20<strong>11</strong>.<br />
Notes: Based on the recommendation of the <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong> Human Services Department, the methodology for calculating the CalFresh<br />
enrollment was changed to be consistent with their reporting procedures. Results are now based on a July‐June fiscal year (e.g., 2006‐07 data are<br />
reported in 2007), and reflect the average monthly total for each fiscal year. National School Lunch Program results are also based on a July‐June<br />
fiscal year.<br />
6 State of California, Department of Finance, Population Projections for California and Its Counties 2000‐2050, Sacramento, California, 20<strong>11</strong>.<br />
7 California Food Policy Advocates, <strong>2010</strong> <strong>County</strong> Nutrition and Food Insecurity Profiles, <strong>2010</strong>.<br />
23
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
COUNTY TRENDS<br />
It is also important that families have access to health care. The following figures present enrollment<br />
trends in publicly‐funded health insurance programs.<br />
Figure 7: <strong>County</strong> Enrollment in Medi-Cal<br />
44,000<br />
40,000<br />
36,000<br />
32,000<br />
28,000<br />
24,000<br />
20,000<br />
37,804<br />
39,380<br />
40,790 41,996 41,629<br />
Source: State of California, Department of Health Care Services, Research and Analytic Studies Section, Number of Beneficiaries by <strong>County</strong>, 20<strong>11</strong>.<br />
Note: 2007‐20<strong>11</strong> data are reported for July of each year.<br />
Figure 8: <strong>County</strong> Enrollment in Healthy Families<br />
7,000<br />
6,000<br />
5,000<br />
4,000<br />
3,000<br />
2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />
5,387<br />
5,856<br />
6,446<br />
6,577<br />
Source: Managed Risk Medical Insurance Board, HFP Montly Enrollment <strong>Report</strong>s, 20<strong>11</strong>.<br />
Note: Results are as of June of each year.<br />
Figure 9: <strong>County</strong> Enrollment in Healthy Kids<br />
2,500<br />
2,000<br />
1,500<br />
1,000<br />
500<br />
0<br />
Source: Healthy Kids of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Biannual <strong>Evaluation</strong>, 2009‐20<strong>11</strong>.<br />
Note: Enrollment is the number of children as of June of each year.<br />
24 FIRST 5 SANTA CRUZ COUNTY<br />
6,871<br />
2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />
17<br />
1,909<br />
258<br />
1,518<br />
363<br />
1,313<br />
265 195 170<br />
June 2009 June <strong>2010</strong> June 20<strong>11</strong><br />
Waiting list (ages 6‐18)<br />
Ages 6‐18<br />
Ages 0‐5
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Indicator: Percentage of mothers in the <strong>County</strong> receiving prenatal care in the first<br />
trimester<br />
Prenatal Care in the <strong>County</strong><br />
FIRST 5 SANTA CRUZ COUNTY<br />
COUNTY TRENDS<br />
In <strong>2010</strong>, most women in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> received prenatal care during the first trimester of their<br />
pregnancies (83%). The Healthy People initiative recently lowered its target rate for first trimester<br />
prenatal care from 90% (<strong>2010</strong> Objective) to 78% (2020 Objective), with the result that, on average,<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is achieving this objective. However, younger mothers tended to fall below this<br />
target rate (ages 24 and younger). Additionally, there were differences in receipt of early prenatal<br />
care based upon the mother’s source of payment for the care. Only 76% of mothers with Medi‐Cal<br />
began receiving prenatal care during the first trimester, compared to 92% of mothers with private<br />
insurance.<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Figure 10: Percentage of Mothers in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Receiving Prenatal Care in the<br />
<strong>First</strong> Trimester, by Age<br />
81%<br />
83%<br />
59%<br />
63%<br />
72% 75% 75%<br />
69%<br />
84%<br />
86% 87% 87%<br />
Source: <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>.<br />
Note: The data from the report were considered provisional.<br />
2009 N: Overall=3,290,
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
COUNTY TRENDS<br />
Indicator: Percentage of births in the <strong>County</strong> to teen mothers<br />
In <strong>2010</strong>, there were 258 births to teen mothers, representing 8.1% of all births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>,<br />
and a teen birth rate of 30 per 1,000 (ages 15‐19). Over the past five years there has been a slight<br />
decrease in both births to teen mothers and the teen birth rate, except for 2009 when there was a<br />
small increase in both measurements. Taken together, the two measures indicate a slowly<br />
decreasing proportion of teens in the county who are becoming mothers.<br />
Figure 12: Percentage of Births to Teen Mothers (Ages 19 and under)<br />
<strong>11</strong>%<br />
10%<br />
9%<br />
8%<br />
7%<br />
9.5% 9.5% 9.5%<br />
8.7%<br />
8.5%<br />
8.6%<br />
Source: (<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>) <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>;<br />
California data for <strong>2010</strong> are not yet available.<br />
Figure 13: Teen Birth Rate (per 1,000, Ages 15-19)<br />
38<br />
36<br />
34<br />
32<br />
30<br />
28<br />
Source: (<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>) <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>, State<br />
of California, Department of Finance, Race/Ethnic Population with Age and Sex Detail, 2000–2050. Sacramento, CA, <strong>2010</strong>; California data for <strong>2010</strong> are<br />
not yet available.<br />
26 FIRST 5 SANTA CRUZ COUNTY<br />
9.7%<br />
9.2%<br />
8.1%<br />
2006 2007 2008 2009 <strong>2010</strong><br />
37.8<br />
37.1<br />
36.4 36.4<br />
35.2<br />
33.3<br />
35.5<br />
32.1<br />
30.0<br />
2006 2007 2008 2009 <strong>2010</strong><br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
California<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
California
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Indicator: Percentage of births in the <strong>County</strong> with Medi‐Cal insurance coverage<br />
In <strong>2010</strong>, across all age groups, 55% of births were paid for by Medi‐Cal. However, Medi‐Cal was<br />
utilized by almost 84% of women under the age of 25 who gave birth.<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Figure 14: Percentage of Births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Paid by Medi-Cal<br />
51%<br />
55%<br />
FIRST 5 SANTA CRUZ COUNTY<br />
77%<br />
82%<br />
88%<br />
83%<br />
83%<br />
78%<br />
48%<br />
45%<br />
29% 32%<br />
Overall 17 and under 18‐19 20‐24 25‐34 35 and over<br />
2009 <strong>2010</strong><br />
COUNTY TRENDS<br />
Source: <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>.<br />
Note: The data from the report were considered provisional.<br />
2009 N: Overall=3,290, ≤17=<strong>11</strong>9, 18‐19=200, 20‐24=618, 25‐34=1,709, 35+=644; <strong>2010</strong> N: Overall=3,170, ≤17=89, 18‐19=169, 20‐24=6<strong>11</strong>, 25‐34=1,663,<br />
35+=639<br />
Indicator: Percentage of children who are diagnosed with special needs and/or with<br />
Individualized Education Program (IEP)<br />
In <strong>2010</strong>‐<strong>11</strong>, 976 parents of children in local preschool programs completed Child Snapshots, in which<br />
they were asked about their children’s health and developmental history, including whether their<br />
children had any special needs.<br />
� As seen in the following figure, almost 6% of parents in preschools that participated in the<br />
Child Snapshot program indicated that their child had an Individualized Education Plan (IEP)<br />
or an Individualized Family Service Plan (IFSP).<br />
� This figure also shows that 6% of kindergarten students in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> received special<br />
education services. As can be seen from these data, the percentage of children with an IEP in<br />
the sampled preschool programs is very similar to those in kindergarten, and both samples<br />
show a gradual decline in IEPs over the last five years.<br />
27
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
COUNTY TRENDS<br />
Figure 15: Percentage of Children in Preschool Programs and Kindergarten Who Have<br />
Individualized Education or Family Service Plans (IEP/IFSP)<br />
14%<br />
12%<br />
10%<br />
8%<br />
6%<br />
4%<br />
2%<br />
0%<br />
9.0%<br />
6.7%<br />
6.6% 6.3%<br />
7.9%<br />
5.5%<br />
6.0% 6.0%<br />
Sources and Ns: (Preschools rates of IEP) Child Snapshot forms, 2006 – 20<strong>11</strong>. N= 388 in 2006‐7, 671 in 2007‐8, 580 in 2008‐9, 774 in 2009‐10, and 878<br />
in <strong>2010</strong>‐<strong>11</strong>. (Kindergraten rates of IEP) California Department of Education, Special Education Division. N= 2909 in 2006‐7, 2921 in 2007‐8, 3031 in<br />
2008‐09, 3,267 in 2009‐10, 3,149 in <strong>2010</strong>‐<strong>11</strong>.<br />
28 FIRST 5 SANTA CRUZ COUNTY<br />
5.0%<br />
5.5%<br />
2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
Kindergarten<br />
Preschool
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Profile of Participants PROFILE OF PARTICIPANTS<br />
Number of Children and Families Served<br />
FIRST 5 SANTA CRUZ COUNTY<br />
PROFILE OF PARTICIPANTS<br />
Since the development of its evaluation system, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has had the unique ability<br />
to gather unduplicated counts of individuals served within partner programs and across those<br />
programs. These data, or client characteristic data (hereafter referred to as “CCDs”), are submitted<br />
by partners to <strong>First</strong> 5 on a quarterly basis. This information is gathered in one of two ways: the <strong>Santa</strong><br />
<strong>Cruz</strong> <strong>County</strong> SUN database, or partner‐specific data collection forms. These data are then analyzed<br />
to determine the unduplicated count of individuals served by program, by goal area, and overall. 8<br />
Note that not all programs submit data on individual parents and children.<br />
Figure 16: Total Unduplicated Children and Parents Served, by Goal Area and Age<br />
GOAL AREA<br />
CHILDREN<br />
(AGES 0‐5)<br />
NUMBER PERCENT<br />
NUMBER<br />
(AGES
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
PROFILE OF PARTICIPANTS<br />
children and their parents, but have collected CCDs only for the children. These partners include the<br />
Health Care Outreach Coalition, Raising A Reader, Migrant Education (Summer Pre‐K and School<br />
Readiness Programs), Side by Side, and the Child Snapshot project.<br />
Indicator: Percentage of children in the <strong>County</strong> served by <strong>First</strong> 5<br />
According to the 20<strong>11</strong> population estimates for <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, there are approximately 21,258<br />
children ages 0‐5 residing in the county. 9<br />
� Funded partners served 9,292 unique children, or over two‐fifths of all children in the county<br />
(44%), during the <strong>2010</strong>‐20<strong>11</strong> year.<br />
� Among the Latino population, 62% of all children ages 0‐5 participated in services funded by<br />
<strong>First</strong> 5.<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Figure 17: Percentage of Children 0-5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Served by <strong>First</strong> 5<br />
31% 30%<br />
23%<br />
35%<br />
Sources: Population figures are for calendar years, taken from State of California, Department of Finance, Race/Ethnic Population with Age and Sex<br />
Detail, 2000–2050. Sacramento, CA, July 2007‐20<strong>11</strong>. Client counts are for fiscal years, taken from SUN database/CCD data, July 1, 2006 – June 30,<br />
20<strong>11</strong>.<br />
It is important to note that the percentage of children served in the county is actually higher if one<br />
includes children who were indirectly supported by a <strong>First</strong> 5‐funded program, such as children<br />
whose child care providers received professional training through funded partner programs,<br />
children whose parents received a Kit for New Parents or attended a parent workshop, and children<br />
benefiting from service providers who attended brown bags and customer service trainings.<br />
9 State of California, Department of Finance, Race/Ethnic Population with Age and Sex Detail, 2000–2050. Sacramento, CA, 20<strong>11</strong>.<br />
41%<br />
27% 26% 27%<br />
30 FIRST 5 SANTA CRUZ COUNTY<br />
62%<br />
44%<br />
2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
Percent of SCC Latino Children 0‐5<br />
Served by <strong>First</strong> 5<br />
Percent of SCC Children 0‐5 Served<br />
by <strong>First</strong> 5
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Increase Services into Communities with the Highest Needs<br />
Indicator: Demographic Trends in Children participating in <strong>First</strong> 5 Programs<br />
FIRST 5 SANTA CRUZ COUNTY<br />
PROFILE OF PARTICIPANTS<br />
As can be seen in the following figure, over the past four years funded partners have consistently<br />
served Latino and Spanish‐speaking children, children who reside in South <strong>County</strong>, and children<br />
from low‐income backgrounds. Across the years, at least three‐fourths of families served lived<br />
below the Federal Poverty Level, and beginning in 2009‐10, around 90% of families have had<br />
incomes below this level.<br />
Figure 18: Demographics of Children Participating in <strong>First</strong> 5 Programs, by Year<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
86.6%<br />
81.7% 83.0% 85.1%<br />
74.9% 80.5%<br />
73.7% 74.4% 70.6%<br />
75.2%<br />
65.8%<br />
54.9%<br />
Latino Spanish as Primary<br />
Language<br />
2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
Source: (Latino, Spanish, South <strong>County</strong>, Income) SUN database/CCD data for July 1, 2007 – June 30, 20<strong>11</strong>. (Federal Poverty Level for family of five) U.S.<br />
Department of Health and Human Services, 20<strong>11</strong> HHS Federal Poverty Guidelines.<br />
2007‐2008 data: N for Ethnicity = 4,235; N for Spanish = 4,192; N for Federal Poverty Level (FPL) = 1,346; N for Region of <strong>County</strong> = 5,214. 2008‐2009<br />
data: N for Ethnicity = 4,968; N for Spanish = 4,896; N for FPL = 1,<strong>11</strong>3; N for Region of <strong>County</strong> = 5,440. 2009‐<strong>2010</strong> data: N for Ethnicity = 5,620; N for<br />
Spanish = 5,563; N for FPL = 537; N for Region of <strong>County</strong> = 5,276. <strong>2010</strong>‐20<strong>11</strong> data: N for Ethnicity = 8,848; N for Spanish = 9,086; N for Region of<br />
<strong>County</strong> = 8,932; N for FPL = 561.<br />
The following figure presents participant income data, and compares these data with the<br />
20<strong>11</strong> Federal Poverty Level (FPL) and the 2008 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Self‐Sufficiency Standard. 10<br />
Drawing from previous <strong>First</strong> 5 data, an average family size of five persons is used in these<br />
comparisons. The income thresholds are as follows:<br />
� The 20<strong>11</strong> Federal Poverty Level for a family of five was $26,170. Data show that 89% of the<br />
families served by <strong>First</strong> 5 in <strong>2010</strong>‐<strong>11</strong> earned less than $25,000 per year.<br />
� The 2008 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Self‐Sufficiency Standard for a family of five was $86,566. Data<br />
show that 99.6% of <strong>First</strong> 5 families in <strong>2010</strong>‐<strong>11</strong> earned less than $75,000 a year.<br />
10 2008 is the most recent year for which the <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Self‐Sufficiency Standard is available.<br />
91.8%<br />
78.2%<br />
88.8%<br />
78.0%<br />
South <strong>County</strong> Below Federal Poverty<br />
Line<br />
Indicator: Percentage of <strong>First</strong> 5 families with incomes below the <strong>County</strong> Self‐Sufficiency<br />
Standard / Federal Poverty Levels<br />
31
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
PROFILE OF PARTICIPANTS<br />
As seen in the following figure, these data suggest that families being served have very limited<br />
financial resources, and that <strong>First</strong> 5 is targeting their services toward the families most in need.<br />
Figure 19: <strong>Annual</strong> Family Income of Parents Participating in <strong>First</strong> 5 Programs, <strong>2010</strong>-<strong>11</strong><br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
34.4%<br />
22.6%<br />
17.6%<br />
14.1%<br />
4.5% 5.0%<br />
Sources: (Income) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>. N=561. (Federal Poverty Level) U.S. Department of Health and Human<br />
Services, 20<strong>11</strong> HHS Federal Poverty Guidelines. (California Self‐Sufficiency Standard) Insight Center for Community Economic Development, California<br />
Family Economic Self‐Sufficiency Standard by <strong>County</strong>, 2008.<br />
Note: Families with unknown income, or who declined to answer, were omitted from this analysis. N=561. While not all programs collect income data<br />
from families, these results are considered to be representative of the <strong>First</strong> 5 client population.<br />
The following figure presents the percentage of <strong>First</strong> 5 families below the federal poverty and self<br />
sufficiency thresholds over time. As seen below, <strong>First</strong> 5 is reaching an increasingly low income<br />
population.<br />
Figure 20: Percentage of <strong>First</strong> 5 Families with Income below Poverty and Self-<br />
Sufficiency Thresholds, by Year<br />
100%<br />
80%<br />
60%<br />
40%<br />
Less than<br />
$10,000<br />
71.6%<br />
$10,000 ‐<br />
$14,999<br />
90.5%<br />
$15,000 ‐<br />
$19,999<br />
$20,000 ‐<br />
$24,999<br />
94.9% 95.3%<br />
78.2% 78.0%<br />
20<strong>11</strong> Federal Poverty<br />
Level for a family or<br />
household of 5:<br />
$26,170<br />
$25,000 ‐<br />
$29,999<br />
$30,000‐<br />
$39,999<br />
Sources: (Income) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>. N=561. (Federal Poverty Level) U.S. Department of Health and Human<br />
Services, 20<strong>11</strong> HHS Federal Poverty Guidelines. (California Self‐Sufficiency Standard) Insight Center for Community Economic Development, California<br />
Family Economic Self‐Sufficiency Standard by <strong>County</strong>, 2008.<br />
Note: While not all programs collect income data from families, these results are considered to be representative of the <strong>First</strong> 5 client population.<br />
32 FIRST 5 SANTA CRUZ COUNTY<br />
0.4%<br />
$40,000 ‐<br />
$49,000<br />
99.5% 99.6%<br />
91.8%<br />
88.8%<br />
2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
2008 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
Self‐Sufficiency Standard<br />
for a family of 5:<br />
$86,566<br />
1.1%<br />
$50,000 ‐<br />
$74,999<br />
0.0%<br />
$75,000 ‐<br />
$99,999<br />
0.4%<br />
$100,000 or<br />
more<br />
Percent with<br />
Incomes Below the<br />
Federal Poverty<br />
Level<br />
Percent with<br />
Incomes Below the<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
Self‐Sufficiency<br />
Standard
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Indicator: Levels of children’s vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, by ZIP code<br />
FIRST 5 SANTA CRUZ COUNTY<br />
PROFILE OF PARTICIPANTS<br />
In a 2005 assessment of the levels of children’s vulnerability within <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 10 indicators<br />
of risk were measured and tracked by ZIP code within <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: income relative to the<br />
Federal Poverty Threshold, self‐sufficiency, Medi‐Cal births, parental unemployment, births to<br />
teens, referrals to child welfare services, child abuse, child witnesses to domestic violence, adults<br />
without a high school degree, and linguistic isolation. For each indicator, one of four levels of risk<br />
was assigned.<br />
In the following map, the combined risk of these 10 indicators has been determined and displayed<br />
for each ZIP code to illustrate the areas of highest vulnerability for children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong>. In addition to the combined risk for each ZIP code, dots indicate if the ZIP code had a school<br />
that had an Academic Performance Index (API) score of 3 or lower.<br />
Figure 21: Levels of Children’s Vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, by ZIP code<br />
Source: Applied Survey Research, Geo‐Mapping Children’s Vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Presentation to <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2005.<br />
In order to determine whether <strong>First</strong> 5 partners are serving children in the highest need areas of the<br />
county, a second map displays the relative size of client populations, with darker colors indicating<br />
more <strong>First</strong> 5 participants served than lighter colors. As seen in the following figure, 92% of children<br />
served by funded partners lived in the areas of the county that ranked highest on a cumulative index<br />
33
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
PROFILE OF PARTICIPANTS<br />
of risk factors (such as the Live Oak area of <strong>Santa</strong> <strong>Cruz</strong>, the city of <strong>Santa</strong> <strong>Cruz</strong>, Watsonville and<br />
Freedom), showing that <strong>First</strong> 5 partners are reaching the most vulnerable children.<br />
Figure 22: Distribution of Children Who Received Services (<strong>2010</strong>-<strong>11</strong>), by ZIP Code<br />
Figure 23: Number of Children Who Received Services, by ZIP Code<br />
AREA ZIP CODE<br />
NUMBER OF<br />
CHILDREN<br />
SERVED<br />
AREA ZIP CODE<br />
NUMBER OF<br />
CHILDREN<br />
SERVED<br />
Aptos, Rio Del Mar 95003 127 Mt. Hermon 95041 5<br />
Ben Lomond 95005 48 <strong>Santa</strong> <strong>Cruz</strong>* 95060 692<br />
Boulder Creek 95006 56 <strong>Santa</strong> <strong>Cruz</strong> (Live Oak) 95062 753<br />
Brookdale 95007 5 <strong>Santa</strong> <strong>Cruz</strong> 95064 16<br />
Capitola 95010 98 <strong>Santa</strong> <strong>Cruz</strong> 95065 77<br />
Davenport 95017 23 Scotts Valley 95066 58<br />
Felton 95018 84 Soquel 95073 68<br />
Freedom 95019 466 Watsonville 95076 6,124<br />
Total ‐ 8,700<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
Note. <strong>First</strong> 5 programs served 9,292 children. The charts above display data for the 8,700 children with known ZIP codes.<br />
* 8 children with <strong>Santa</strong> <strong>Cruz</strong> Post Office mailing addresses were included in this area.<br />
34 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Early Childhood Educators Served by <strong>First</strong> 5 Partners<br />
FIRST 5 SANTA CRUZ COUNTY<br />
PROFILE OF PARTICIPANTS<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps support the professional development of early childhood educators<br />
in the community. In <strong>2010</strong>‐<strong>11</strong>, approximately 125 early childhood educators were served,<br />
representing preschools, family child care homes, or informal care providers who were family,<br />
friends or neighbors (FFN).<br />
There were additional early childhood educators who received services—who were not included in<br />
this official CCD database—which would raise the total number served in <strong>2010</strong>‐<strong>11</strong>. For Raising A<br />
Reader, just one early childhood educator per site is counted, when in fact each site may have<br />
several early childhood educators participating in the program.<br />
Figure 24: Early Childhood Educators Served by <strong>First</strong> 5, by Type<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
65.3%<br />
28.0%<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
5.1%<br />
Early Childhood Educators (N = <strong>11</strong>8)<br />
Preschool/Child Care Center<br />
Family Child Care Home<br />
Family, Friend, or Neighbor/Informal Care Provider<br />
Other<br />
1.7%<br />
35
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
PROFILE OF PARTICIPANTS<br />
36 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Healthy Children HEALTHY CHILDREN<br />
FIRST 5 SANTA CRUZ COUNTY<br />
HEALTHY CHILDREN<br />
This portion of <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Strategic Framework<br />
analysis includes data regarding the current estimates of children<br />
without health insurance, enrollment outcomes from the Healthy Kids<br />
Initiative’s Health Care Outreach Coalition, results from the Newborn<br />
Enrollment Project, and health insurance utilization and reenrollment<br />
data. Additional information about partners’ efforts to support Healthy Children can be found in the<br />
Partner Profiles section of this report.<br />
Increase Insurance Coverage<br />
Indicator: Percentage of children in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> with health insurance coverage<br />
In <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> the majority of children ages 0‐5 have health insurance. CHIS data show that in<br />
2009, approximately 93% of all children ages 0‐5 had health insurance. During this continuing period<br />
of economic instability, it is especially important to continue providing assistance to families to<br />
enroll in public health insurance programs, to ensure that every child ages 0‐5 is insured.<br />
Figure 25: Percentage of Children ages 0-5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Estimated to be<br />
Insured<br />
100%<br />
95%<br />
90%<br />
85%<br />
80%<br />
93.9%<br />
96.2%<br />
93.3%<br />
2001 2005 2009<br />
Source: California Health Interview Surveys.<br />
Note: CHIS data are released every two years. Data for 20<strong>11</strong> will not be available until late 2012. CHIS reports these results as being “statistically<br />
unstable,” and should only be considered as estimates of the percentage of uninsured children.<br />
37
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
HEALTHY CHILDREN<br />
Indicator: Number of children participating in <strong>First</strong> 5 who have applications submitted,<br />
accepted, and renewed for publicly‐funded health insurance<br />
Public health insurance programs are essential to the overall health and well‐being of children. The<br />
Health Care Outreach Coalition (HCOC) provides assistance with application and enrollment in public<br />
health insurance to income‐eligible families. Through community outreach workers called Certified<br />
Application Assistors (CAAs), children from families earning up to 300% of<br />
the Federal Poverty Level receive assistance in applying for Medi‐Cal,<br />
Healthy Families, and the local Healthy Kids health insurance plan.<br />
Additionally, HCOC staff participate in community events and respond to<br />
business and community agency requests for presentations and additional<br />
information regarding health insurance.<br />
Children newly enrolled<br />
in public health<br />
insurance since 2004:<br />
7, ,488<br />
The following figures present the number of applications approved (applicant becomes enrolled in<br />
health insurance), and number of enrollees who renew their health insurance. Across the years<br />
since the effort began in 2004, 7,488 children have been enrolled in public health insurance. <strong>11</strong> The<br />
large increase in Medi‐Cal enrollments in 2009‐10 is due to the Newborn Enrollment Project,<br />
described subsequently.<br />
Figure 26: Children (Ages 0-5) Newly Enrolled by HCOC in Healthy Kids, Healthy<br />
Families and Medi-Cal insurance plans<br />
2,000<br />
1,800<br />
1,600<br />
1,400<br />
1,200<br />
1,000<br />
800<br />
600<br />
400<br />
200<br />
0<br />
580<br />
519<br />
352 359<br />
Source: Health Care Outreach Coalition, <strong>County</strong> Benefits Tracking <strong>Report</strong>, <strong>2010</strong>; Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />
Note: These numbers are from Certified Application Assisters who expand enrollment and retention efforts in the <strong>County</strong>. Many families are enrolled<br />
in other ways. For example, the <strong>County</strong> Human Services Department processes Medi‐Cal applications which are not included here, and families can<br />
self‐enroll in Healthy Families.<br />
Note: The number of children in this analysis may be slightly different than related enrollment results from HCOC due to differences in the timing of<br />
the collection of data. and since families may come to HCOC for enrollment assistance more than once in the fiscal year.<br />
<strong>11</strong> Health Improvement Partnership of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 20<strong>11</strong>.<br />
620<br />
395<br />
175<br />
<strong>11</strong>8<br />
158<br />
53 42 67<br />
1,312<br />
1,741<br />
96 70<br />
38 FIRST 5 SANTA CRUZ COUNTY<br />
901<br />
315<br />
1,226<br />
445<br />
2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
Total (Healthy Kids, Healthy<br />
Families & Medi‐Cal)<br />
Healthy Kids<br />
Healthy Families<br />
Medi‐Cal
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
HEALTHY CHILDREN<br />
Figure 27: Number of Children (Ages 0-5) in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Re-Enrolled in Publicly-<br />
Funded Health Insurance Programs, by Year<br />
600<br />
500<br />
400<br />
300<br />
200<br />
100<br />
0<br />
257<br />
181<br />
27<br />
318<br />
182<br />
19<br />
4<strong>11</strong><br />
131<br />
40<br />
Source: Health Care Outreach Coalition, <strong>County</strong> Benefits Tracking <strong>Report</strong>, <strong>2010</strong>; Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />
Note: These numbers are from Certified Application Assisters who expand enrollment and retention efforts in the <strong>County</strong>. Many families are enrolled<br />
in other ways. For example, the <strong>County</strong> Human Services Department processes Medi‐Cal applications which are not included here, and families can<br />
self‐enroll in Healthy Families.<br />
Note: The number of children in this analysis may be slightly different than related enrollment results from HCOC due to differences in the timing of<br />
the collection of data. and since families may come to HCOC for enrollment assistance more than once in the fiscal year.<br />
Baby Gateway—the Newborn Enrollment Project—has now been launched in three local hospitals<br />
with funding and support provided by <strong>First</strong> 5 of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Watsonville Hospital (in August<br />
2009), Dominican Hospital (in January 20<strong>11</strong>), and Sutter Maternity & Surgery Center of <strong>Santa</strong> <strong>Cruz</strong> (in<br />
May 20<strong>11</strong>). The main goals of the project are to provide enrollment assistance to mothers and their<br />
newborns, as well as to establish a seamless Medi‐Cal coverage process for Medi‐Cal‐eligible<br />
newborns, and to link those newborns to a medical home, all before they leave the hospital.<br />
In addition, all new mothers receive the <strong>First</strong> 5 “Kit for New Parents” containing expert guidance for<br />
raising healthy infants and children. In particular, parents are oriented to the “What To Do If My Child<br />
Gets Sick” booklet, which provides information in utilizing primary care appropriately, and clarifies<br />
what issues should prompt a visit to the emergency room (and which should be handled in the medical<br />
home).<br />
487<br />
150<br />
139<br />
442<br />
269<br />
120<br />
2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
Healthy Kids<br />
Healthy Families<br />
Medi‐Cal/Medicare<br />
Indicator: Number of mothers in the <strong>County</strong> visited as part of the Newborn Enrollment<br />
Project<br />
39
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
HEALTHY CHILDREN<br />
Data from <strong>2010</strong>‐<strong>11</strong> show how successful this program has been in providing these services to <strong>Santa</strong><br />
<strong>Cruz</strong> <strong>County</strong>’s mothers and newborns.<br />
� Of all 2,103 births that occurred in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> at these hospitals after the program<br />
had been implemented, 70% of mothers received a newborn visit while in the hospital, and<br />
65% received a “Kit for New Parents.”<br />
� Of all 1,499 mothers with Medi‐Cal births during <strong>2010</strong>‐<strong>11</strong>, almost three‐fourths (74%) were<br />
assisted to complete a Medi‐Cal application for their new babies.<br />
� Of the 1,<strong>11</strong>1 mothers who were assisted to complete a Medi‐Cal application for their<br />
newborns, nearly all applications (95%) were approved, and 97% were assigned a primary<br />
care provider for their child before discharge from the hospital.<br />
Figure 28: Newborn Enrollment Project Statistics, <strong>2010</strong>-<strong>11</strong><br />
PROGRAM COMPONENT WATSONVILLE<br />
Total Number of All Births in <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong> after program implementation<br />
COMMUNITY<br />
HOSPITAL<br />
DOMINICAN<br />
HOSPITAL 1<br />
SUTTER<br />
MATERNITY &<br />
SURGERY CENTER<br />
OF SANTA CRUZ 2<br />
1,487 437 179 2,103<br />
Total Number of Medi‐Cal Births 1,247 191 61 1,499<br />
Number of Completed Newborn<br />
Medi‐Cal Applications<br />
Number of Approved Newborn<br />
Medi‐Cal Enrollments<br />
Number of Denied Newborn<br />
Medi‐Cal Applications<br />
Number of Pending Newborn<br />
Medi‐Cal Applications<br />
Number of Newborn Medi‐Cal<br />
Applicants with an Assigned<br />
Primary Care Provider<br />
Total Number of Newborn Visits<br />
(regardless of insurance status)<br />
Number of Kits for New Parents<br />
Distributed<br />
Source: Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />
1 Based on program implementation of 1/10/<strong>11</strong>.<br />
2 Based on program implementation of 5/1/<strong>11</strong>.<br />
40 FIRST 5 SANTA CRUZ COUNTY<br />
TOTAL<br />
NUMBER PERCENT OF ALL<br />
MEDI‐CAL BIRTHS<br />
919 141 51 1,<strong>11</strong>1 74.1%<br />
NUMBER PERCENT OF ALL<br />
MEDI‐CAL<br />
APPLICATIONS<br />
883 133 44 1,060 95.4%<br />
21 1 0 22 2.0%<br />
15 7 7 29 2.6%<br />
1,074 96.7%<br />
NUMBER PERCENT OF ALL<br />
COUNTY BIRTHS<br />
1,040 289 136 1,465 69.7%<br />
1,040 184 136 1,360 64.7%
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Increase Use of Medical/Dental Homes<br />
FIRST 5 SANTA CRUZ COUNTY<br />
HEALTHY CHILDREN<br />
Indicator: Percentage of children in the <strong>County</strong> enrolled in Healthy Kids (ages 2‐6) who<br />
had access to a primary care practitioner<br />
The majority of children enrolled in Healthy Kids, ages 2‐6, had access to a primary care practitioner.<br />
The percentage of children who had a medical home has varied between 90% in 2006 to 95% in<br />
<strong>2010</strong>.<br />
Figure 29: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids (Ages 2-6)<br />
Who Had Access to a Primary Care Practitioner<br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
89.9%<br />
2006<br />
(N = 227)<br />
90.1%<br />
2007<br />
(N = 221)<br />
93.8%<br />
2008<br />
(N = 227)<br />
Source: Central Coast Alliance for Health, Health Care Quality Measurement annual report, using HEDIS Indicators. There are no HEDIS data regarding<br />
access to primary care practitioners for children under age one. For children age one, there were not enough children in the HEDIS sample to draw<br />
any inferences.<br />
Parents of children receiving <strong>First</strong> 5‐funded services through the Health Care Outreach Coalition<br />
were asked when they renewed their children’s insurance whether their children had used the<br />
benefit during the previous year. During the <strong>2010</strong>‐20<strong>11</strong> year, 97% of children who received renewal<br />
assistance in a public insurance program utilized their benefits prior to their renewal, continuing the<br />
trend of high utilization across the years.<br />
89.4%<br />
2009<br />
(N = 208)<br />
95.1%<br />
<strong>2010</strong><br />
(N = 164)<br />
Indicator: Percentage of children utilizing health care prior to renewal in an insurance<br />
program<br />
Figure 30: Percentage of Parents <strong>Report</strong>ing their Children Utilized Health Care Prior to<br />
Renewal in an Insurance Program<br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
99.6% 97.9%<br />
2006‐07<br />
(N = 471)<br />
2007‐08<br />
(N = 514)<br />
99.6% 99.4%<br />
2008‐09<br />
(N = 555)<br />
2009‐10<br />
(N = 789)<br />
96.6%<br />
<strong>2010</strong>‐<strong>11</strong><br />
(N = 829)<br />
Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 2007‐20<strong>11</strong>. Results represent the status of children’s applications 2‐3 months after<br />
the end of the fiscal year. Utilization results exclude clients with missing data.<br />
41
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
HEALTHY CHILDREN<br />
Indicator: Percentage of children in the <strong>County</strong> enrolled in Healthy Kids who had a<br />
dental visit in the past year<br />
Of children ages 4‐6 enrolled in Healthy Kids in <strong>2010</strong>, the majority (89%) had a dental visit in the past<br />
year. This percentage has been slowly increasing since 2006 (69%). A smaller percentage of younger<br />
children (ages 2‐3) are getting dental visits, although this too has been increasing between 2006<br />
(49%) and <strong>2010</strong> (69%).<br />
Figure 31: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids Who Had a<br />
Dental Visit in the Past Year<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
48.9%<br />
68.7%<br />
54.8%<br />
70.6%<br />
61.4%<br />
79.2%<br />
Source: Central Coast Alliance for Health, Health Care Quality Measurement annual report, using HEDIS Indicators.<br />
* No data are available for 2009.<br />
Children ages 2‐3 N: 2006=45, 2007=42, 2008=44, <strong>2010</strong>=32; Children ages 4‐6 N: 2006=182, 2007=180, 2008=183, <strong>2010</strong>=132,<br />
Increase Use of Preventive Health Services<br />
In <strong>2010</strong>, the majority of children ages 3‐6 (83%) enrolled in Healthy Kids received a well‐child visit<br />
with their pediatrician, showing a slight increase over the past three years.<br />
Figure 32: Percentage of Children (Ages 3-6) in the <strong>County</strong> Enrolled in Healthy Kids<br />
Who Received a Well-Child Visit<br />
85%<br />
80%<br />
75%<br />
70%<br />
78.1%<br />
2006<br />
(N = 210)<br />
Source: Central Coast Alliance for Health, Health Care Quality Measurement annual report, using HEDIS Indicators.<br />
68.8%<br />
2006 2007 2008 2009* <strong>2010</strong><br />
81.6%<br />
2007<br />
(N = 207)<br />
Children ages 2‐3 Children ages 4‐6<br />
76.8%<br />
2008<br />
(N = 2<strong>11</strong>)<br />
79.6%<br />
2009<br />
(N = 191)<br />
82.9%<br />
<strong>2010</strong><br />
(N = 152)<br />
89.4%<br />
Indicator: Percentage of children in the <strong>County</strong> enrolled in Healthy Kids (ages 3‐6) who<br />
received a well‐child visit<br />
42 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
HEALTHY CHILDREN<br />
Ideally, children and their families who have insurance and who have a medical home will be more<br />
likely to access their provider for routine preventive care, and less likely to use the emergency<br />
department (ED) for non‐urgent medical care. The figure below presents data on children enrolled<br />
in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Healthy Kids program regarding the rate at which they used the emergency<br />
room each year. These data are not available in disaggregated form for children 0‐5, and therefore<br />
includes children up to age 9. The rate of ED use for children using Healthy Kids insurance was<br />
increasing up through 2008, but has shown a decrease since 2009.<br />
Figure 33: Visits to Emergency Department in the Past Year, per 1,000 Member Year<br />
(Ages 1-9)<br />
300<br />
250<br />
200<br />
150<br />
100<br />
161.4<br />
229.7<br />
266.2 265.9<br />
Source: Central California Alliance for Health, Health Care Quality Measurement annual report, using Healthcare Effectiveness Data and Information<br />
System (HEDIS) indicators.<br />
Note: Data represent only children enrolled in Healthy Kids.<br />
The services provided by the Newborn Enrollment Project may also have had an effect on the use of<br />
the Emergency Department (ED) for children less than one year old. As seen in the following figure,<br />
ED visits at Watsonville Community Hospital were at a high of 632 in the 2 nd quarter of 2009. Baby<br />
Gateway was launched at that hospital in August 2009, and after that the number of ED visits has<br />
dropped steadily to a low of 424 at the beginning of 20<strong>11</strong>.<br />
Figure 34: Number of Emergency Department Visits (Infants Less Than One Year Old)<br />
700<br />
600<br />
500<br />
400<br />
300<br />
200<br />
100<br />
0<br />
573<br />
2006<br />
(N=133)<br />
218<br />
632<br />
Baby Gateway<br />
Launched 8/2009<br />
184<br />
2007<br />
(N=185)<br />
552 558<br />
151<br />
171<br />
2008<br />
(N=178)<br />
2009<br />
(N=190)<br />
Source: Health Improvement Partnership of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Baby Gateway Program <strong>Report</strong>, August 16, 20<strong>11</strong>.<br />
506<br />
199<br />
528<br />
146<br />
471<br />
<strong>11</strong>6<br />
421 424<br />
168<br />
186<br />
Baby Gateway<br />
Launched 1/20<strong>11</strong><br />
Q1/2009 Q2/09 Q3/09 Q4/09 Q1/<strong>2010</strong> Q2/10 Q3/10 Q4/10 Q1/20<strong>11</strong><br />
214.4<br />
<strong>2010</strong><br />
(N=<strong>11</strong>9)<br />
Watsonville Community Hospital<br />
Dominican Hospital<br />
43
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
HEALTHY CHILDREN<br />
44 FIRST 5 SANTA CRUZ COUNTY
Strong Families<br />
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Strong Families STRONG FAMILIES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES<br />
This portion of <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Strategic Framework analysis<br />
includes data regarding the need to reduce the <strong>County</strong>’s rate of child<br />
maltreatment, outcomes for families served by the county’s differential<br />
response effort (Families Together), and outcomes for clients participating in the Positive Parenting<br />
Program (Triple P). Additional information about partners’ efforts to support Strong Families can be<br />
found in the Partner Profiles section of this report.<br />
Decrease Child Abuse and Neglect<br />
Indicator: Rate of substantiated allegations of child maltreatment in the <strong>County</strong><br />
The rate of substantiated allegations of child maltreatment in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has decreased from<br />
a high of 15.8 (per 1,000) in 2004, to 7.6 (per 1,000) in <strong>2010</strong>. In <strong>2010</strong>, the county rate dropped lower<br />
than the state‐wide rate of substantiated allegations of child maltreatment for the first time in<br />
reporting history. The decreasing rates in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> may have been assisted by the efforts<br />
of the Families Together program, which launched in late 2006 (see the following results for<br />
additional information about this program).<br />
Figure 35: Rate of Substantiated Allegations of Child Maltreatment in <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong> and California (per 1,000)<br />
18<br />
16<br />
14<br />
12<br />
10<br />
8<br />
6<br />
4<br />
2<br />
0<br />
15.8<br />
15.3<br />
13.5<br />
14.7<br />
<strong>11</strong>.2 <strong>11</strong>.0 10.8 10.7<br />
Families Together<br />
Launched 9/2006<br />
12.4<br />
2004 2005 2006 2007 2008 2009 <strong>2010</strong><br />
9.7<br />
Source: Needell, B., Webster, D., Armijo, M., Lee, S., Dawson, W., Magruder, J., Exel, M., Cuccaro‐Alamin, S., Putnam‐Hornstein, E., Williams, D.,<br />
Simon, V., Hamilton, D., Lou, C., Peng, C., Moore, M., Jacobs, L., & King, B. (20<strong>11</strong>). Child Welfare Services <strong>Report</strong>s for California. Retrieved 8/1/20<strong>11</strong>,<br />
from University of California at Berkeley Center for Social Services Research website. URL: <br />
Note: The rates for each year are calculated based on reports from January 1 to December 31 of each year.<br />
9.6<br />
9.3<br />
8.7<br />
7.6<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
California<br />
45
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES<br />
Indicator: Percentage of Families Together participants at each level of risk, baseline to<br />
reassessment<br />
Families Together is <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s differential response program, a strategy used to intervene<br />
early with families in which there has been an allegation of abuse. This home visiting program<br />
includes comprehensive intake and risk assessment, development of a tailored case plan, parent<br />
support and education, child development activities, and periodic assessments.<br />
In Families Together, risk assessment serves a variety of purposes. <strong>First</strong>, the assessments help staff<br />
link parents with the appropriate service pathway, including Brief services, Intensive services, and<br />
referrals to Primeros Pasos, a program for parents struggling with alcohol and drug dependency.<br />
Follow‐up assessments help assess whether risk for child abuse and neglect has been reduced.<br />
The following figure presents the percentage of families at each level of risk over four assessments<br />
(baseline, and first, second, and third reassessments). Each year’s analysis is constrained by fairly<br />
small sample sizes. Therefore, several years of data have been aggregated in order to present a<br />
more robust portrait of the extent to which Families Together participants are reducing their risk for<br />
future involvement with the child welfare system. As can be seen, 62% of families were assessed as<br />
being high risk or very high risk upon intake, and this dropped to 13% by the third reassessment,<br />
indicating that the program is helping families reduce their level of risk.<br />
Figure 36: Change in Families Together Participant’s Risk Levels Over Time,<br />
2007 - 20<strong>11</strong><br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
44.7%<br />
38.4%<br />
Baseline*<br />
(N = 237)<br />
16.9%<br />
28.1%<br />
49.7%<br />
20.0%<br />
1st Reassessment<br />
(N = 185)<br />
2.2%<br />
29.4%<br />
51.5%<br />
14.7%<br />
26.7%<br />
60.0%<br />
13.3%<br />
Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, 2007‐20<strong>11</strong>.<br />
* Although very few families had a “low risk” score at baseline, these families were omitted from these analyses so that only those who could<br />
demonstrate reduced risk on the tool remained in the analysis.<br />
Note: Due to inaccuracies in data entry in 2006‐07, clients with baseline assessments before 7/1/07 were omitted from this analysis.<br />
46 FIRST 5 SANTA CRUZ COUNTY<br />
4.4%<br />
2nd Reassessment<br />
(N = 68)<br />
0.0%<br />
3rd Reassessment<br />
(N=15)<br />
Low Risk<br />
Moderate Risk<br />
High Risk<br />
Very High Risk
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES<br />
Indicator: Percentage of Families Together participants with substantiated allegations<br />
of child maltreatment within 6 months of program completion<br />
Of the 82 families who received services from Families Together and had their cases closed in the<br />
<strong>2010</strong> calendar year, 96% had no substantiated allegations of maltreatment within six months after<br />
case closure.<br />
Figure 37: Number of Families Together Families who had Substantated Allegations of<br />
Abuse within 6 Months after Completing the Program<br />
Total number of families served, with cases closed during<br />
the <strong>2010</strong> calendar year<br />
Number of families with substantiated allegations of<br />
child abuse or neglect within 6 months after their<br />
Families Together closure date<br />
Total number and percent of families served who did<br />
not have a subsequent substantiated allegation of<br />
child abuse within 6 months of case closure<br />
NUMBER PERCENT<br />
82 100%<br />
3 3.7%<br />
79 96.3%<br />
Source: <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Human Services Department, Planning and <strong>Evaluation</strong> Unit. Staff analysis of CWS/CMS data, 20<strong>11</strong>.<br />
Indicator: Percentage of Triple P participants in the Child Welfare system with<br />
substantiated allegations of child maltreatment within 6 months of program<br />
completion<br />
Among families who have experienced child abuse or neglect, participation in the Triple P program 12<br />
was expected to be associated with lower rates of future child welfare allegations. To examine<br />
whether associations were observed between Triple P participation and improved child welfare<br />
outcomes in these <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> families, outcome data for two groups of parents who entered<br />
(or re‐entered) the child welfare system were compared, including: (1) parents who received the<br />
Triple P intervention; and (2) parents who were enrolled in a model of parenting education offered<br />
prior to the initiation of the Triple P program. Both programs were offered through a local<br />
community‐based organization called the Parents Center.<br />
12 For a detailed description of this program, see “Triple P – Positive Parenting Program” in the Partner Profile section.<br />
47
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES<br />
Results suggest that Triple P is associated with reductions in future child abuse and neglect.<br />
� After six months, parents in the comparison parenting program were more than three and a<br />
half times more likely than Triple P participants to have had a new substantiated<br />
maltreatment allegation.<br />
Figure 38: Participants with a Substantiated Allegation of Child Maltreatment Occurring<br />
Up to 6 Months after Program Entry<br />
20%<br />
15%<br />
10%<br />
5%<br />
0%<br />
1.4%<br />
Source: Applied Survey Research, Triple P – <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Special Exploratory Study to Assess Child Welfare Outcomes, 20<strong>11</strong>.<br />
N: 70 Triple P participants and 137 comparison group participants.<br />
Improve Parent and Caregiver Practices that Support Children’s<br />
Social and Emotional Development<br />
The Triple P Program<br />
5.1%<br />
Triple P Participants Comparison Group<br />
Triple P (Positive Parenting Program) is a comprehensive, evidence‐based parenting and family<br />
support system designed to increase parents’ confidence and competence in raising children,<br />
improve the quality of parent‐child relationships, and make evidence‐based parenting information<br />
and interventions widely accessible to parents. It is based on a public health model in which an<br />
ecological approach is used. This approach initiates activities at individual, family, community, and<br />
systemic levels to provide a comprehensive structure of support. There are five levels of<br />
intervention in Triple P. Level 1 is intended to reach a broad range of community members in the<br />
<strong>County</strong>, and as the levels increase, more intensive services are provided.<br />
48 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES<br />
Triple P focuses on 17 core parenting skills that are grouped into 4 areas: promoting positive<br />
relationships, encouraging desirable behavior, teaching new skills and behaviors, and managing<br />
misbehavior. It is based on a self‐regulatory framework in which the practitioner provides<br />
information, skills, training, and support based on the parents’ concerns. Parents use self‐evaluation<br />
to set goals and assess progress. While practitioners are helping parents to build confidence and<br />
competence, parents are helping children to build these skills in a parallel process.<br />
Figure 39: The 17 Core Parenting Skills Promoted by Triple P<br />
Developing Positive<br />
Relationships<br />
Encouraging Desirable<br />
Behaviors<br />
Teaching New Skills &<br />
Behaviors<br />
Managing Misbehavior<br />
1. Spending quality time with your child<br />
2. Talking to your child<br />
3. Showing affection to your child<br />
4. Using descriptive praise<br />
5. Giving attention<br />
6. Providing engaging activities<br />
7. Setting a good example<br />
8. Using incidental teaching<br />
9. Using Ask, Say, Do<br />
10. Using behavior charts<br />
<strong>11</strong>. Setting ground rules<br />
12. Directed discussion<br />
13. Planned ignoring<br />
14. Clear, calm instructions<br />
15. Logical consequences<br />
16. Quiet Time<br />
17. Time Out<br />
Implementation of the Triple P Program in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
Beginning in early <strong>2010</strong>, three local funders (<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Health Services Agency, and<br />
Human Services Department) launched a pilot of the Triple P system in partnership with other<br />
agencies that serve children and families. The pilot phase was designed to last two years. During this<br />
pilot phase, Triple P has been implemented incrementally, beginning with Levels 3, 4, and 5 in the<br />
first year, and adding Levels 1 and 2 in this second year. The long‐term vision is to implement every<br />
level of Triple P broadly in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> to make parenting information and support available<br />
to all families.<br />
49
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES<br />
Indicator: Improved parenting skills, knowledge, and support<br />
The following diagram illustrates the design of this program, and the results that have been achieved<br />
towards addressing the program’s incremental levels of parenting support and information.<br />
Level 5: Enhanced & Pathways<br />
Additional support for families where parenting issues are compounded by parental stress and/or relationship<br />
difficulties, or there is risk for child maltreatment.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Trained and accredited 18 practitioners to provide Level 5 Enhanced services, and 18 for Level 5 Pathways.<br />
� Parents are beginning to receive Level 5 services, and will complete assessments to measure improvement<br />
in their parenting skills and understanding of their children’s behavior.<br />
Level 4: Standard & Group<br />
In-depth training in positive parenting skills.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Families showed significant improvements in:<br />
– style of discipline – confidence in their parenting – levels of conflict over parenting – level of satisfaction with<br />
their relationship – levels of parental depression – stress and anxiety – child behavior<br />
� Parents who had more serious parenting issues made the most meaningful changes in their family life.<br />
� Parents reported high levels of satisfaction with their services.<br />
� Approximately 282 parents/guardians have participated in Level 4 sessions.<br />
� Trained and accredited 38 practitioners to provide Level 4 Group services, and 37 for Level 4 Standard.<br />
Level 3: Primary Care<br />
Consultations about specific parenting concerns.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Families showed significant improvements in children’s behavior, confidence in parenting skills, and support from parenting<br />
partners.<br />
� Parents reported high levels of satisfaction with both Level 3 workshops and individual/group sessions.<br />
� Approximately 336 parents have participated in Level 3 workshops, and 35 in Level 3 Individual/Group sessions.<br />
� Trained and accredited 53 practitioners to provide Level 3 Primary Care services, and 5 with Special Accreditation in Level 3.<br />
Level 2: Selected Individual & Seminar<br />
General information and tips for specific parenting concerns.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Parents reported great satisfaction with Level 2 seminars, particularly noting that they would continue to use the strategies that they learned.<br />
� Approximately 96 parents have participated in Level 2 seminars, and 104 in Level 2 Individual sessions.<br />
� Trained and accredited 20 practitioners to provide Level 2 seminars, and 53 for Level 2 Individual sessions.<br />
Level 1: Universal<br />
Media-based parenting information campaign.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners, referral processes, and a master calendar of Triple P Groups,<br />
Workshops, and Seminars.<br />
� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service providers as a means to encourage referrals.<br />
� Publicized Triple P services in print and online editions of newspapers and community calendars.<br />
� Established <strong>First</strong> 5’s main phone number as a “warmline,” publicized in all flyers, emails and media announcements as a central place to locate services.<br />
� Delivered Triple P messages on TV and the radio.<br />
50 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES<br />
Selected data are highlighted below for their significance, and more detailed data are presented in<br />
the Triple P Partner Profile found later in this report.<br />
Indicator: Use of positive discipline styles<br />
Parents who participated in Level 4 of the Triple P program were asked to complete the Parenting Scale<br />
as a pre and post assessment of their style of discipline. Scores could range from 1 (positive parenting) to<br />
7 (ineffective parenting), with lower scores indicating more positive styles of discipline. Analyses were<br />
run to see if there was any improvement between pre and post assessments, and if the amount of<br />
improvement was statistically significant. 13<br />
As seen in the figure below,<br />
Dysfunctional<br />
Parenting<br />
7<br />
6<br />
Lower 5<br />
is<br />
“Better”<br />
4<br />
3<br />
2<br />
1<br />
Functional<br />
Parenting<br />
� There was significant improvement from pre to post assessment regarding parents’ style of<br />
discipline, indicating their parenting style became less lax, less over‐reactive, and less hostile<br />
though the course of the Triple P program.<br />
� When looking at overall scores on the Parenting Scale, on average, all parents combined and<br />
all parent sub‐populations that were assessed began in the clinical range, but had achieved<br />
positive styles of discipline by the post‐assessment.<br />
� An analysis of “Effect Size” (see page 103) showed that on average, all parent<br />
sub‐populations experienced a large magnitude of change, indicating that the observed<br />
differences were not only statistically significant but also meaningful.<br />
Figure 40: Parents’ Use of Positive Discipline Styles<br />
Overall<br />
3.3 3.8 3.6 3.8 3.8 3.7 3.9 3.7 3.7<br />
2.7 2.9 3.0 2.9 3.0 2.9 3.0 2.9 3.0<br />
All Parents*<br />
(N=158)<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=86)<br />
Male*<br />
(N=20)<br />
Female*<br />
(N=66)<br />
Pre Post<br />
Latino*<br />
(N=61)<br />
Caucasian*<br />
(N=21)<br />
Spanish*<br />
(N=44)<br />
English*<br />
(N=37)<br />
Child Welfare<br />
Involved*<br />
(N=30)<br />
Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />
responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />
sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p= 3.2<br />
51
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES<br />
In Triple P, the parent is considered the agent of change to bring about improvements in the parent‐<br />
child relationship. Therefore, how parents view their children’s behavior is an important assessment<br />
of the relationship.<br />
Parents participating in Level 4 of the Triple P Program were asked to complete the Eyberg Child<br />
Behavior Inventory (ECBI), a pre and post assessment that includes an assessment of the extent to<br />
which parents viewed certain child behaviors to be a problem in their family. Scores ranged from 0<br />
(No) to 36 (Yes), with higher scores indicating greater likelihood that these behaviors were a problem<br />
to the parent. Analyses were run to see if there was any improvement between pre and post<br />
assessments, and if the amount of improvement was statistically significant. 14<br />
As seen in the following figure, after completing the Triple P Program, parents reported fewer child<br />
behaviors as actually being a problem for them. Key results include:<br />
All behaviors were<br />
a problem<br />
36<br />
Lower<br />
is<br />
“Better”<br />
Indicator: <strong>Report</strong> of child behavior problems<br />
� For all sub‐populations, there was a significant reduction in the number of child behaviors<br />
that were perceived to be a problem. Almost all parents began with scores within the clinical<br />
range, and ended with scores that were out of the clinical range.<br />
� “Effect Sizes” were also calculated on these analyses (see page 103). Results showed that on<br />
average, parents experienced a large magnitude of change, indicating that the observed<br />
differences were not only statistically significant but also meaningful.<br />
Figure 41: Level of Parental Problems with Child Behavior<br />
30<br />
24<br />
18<br />
12<br />
6<br />
0<br />
No behaviors<br />
were a problem<br />
15.0<br />
8.2<br />
All Parents*<br />
(N=129)<br />
23.0<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=62)<br />
Number of Child Behaviors Perceived to Be a Problem<br />
20.4<br />
23.5 24.1<br />
12.6 <strong>11</strong>.9 12.7 13.0<br />
Male* (N=9) Female*<br />
(N=53)<br />
Pre Post<br />
Latino*<br />
(N=44)<br />
Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />
which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always occurs),<br />
and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />
these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=15
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Follow‐Up Survey<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES<br />
Parents and guardians who participated in certain Triple P programs were given the option of<br />
voluntarily participating in a follow‐up phone survey, to help determine the long‐lasting effects of<br />
these programs on their parenting skills and experiences.<br />
Results showed that around six months after completing Triple P services, parents were still<br />
reporting high levels of parenting skills, confidence, and support. Additional survey results indicated<br />
that parents felt more effective in dealing with their children’s behavior, and report improved child<br />
behavior overall.<br />
Not at all Difficult<br />
5<br />
Higher<br />
is<br />
“Better”<br />
Indicator: Amount of positive parenting knowledge that is maintained<br />
Figure 42: Levels of Parenting Difficulty Six Months After Triple P Services<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Extremely Difficult<br />
3.58<br />
Q1: Child Behavior<br />
Problems (N=26)<br />
4.21 4.23<br />
Q2: Parental<br />
Adjustment (N=26)*<br />
Q3: Parenting<br />
Confidence (N=26)<br />
3.62 3.50<br />
Q4: Parental Support Q5: Partner Support<br />
(N=26) Over Methods of<br />
Discipline (N=18)<br />
Source: Triple P data from the Parenting Experience Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, and correspond to different<br />
Triple P outcome objectives examined in this report section. For Q1‐6, scores range from 1 to 5. Q7 was not asked in the Follow‐up Survey. Higher<br />
scores indicate more positive parenting experiences. There are no clinical cut‐offs for this assessment. See page 102 for a description of the<br />
sub‐populations and analyses that were run.<br />
* Question 2 results are averages of the 5 items in this question.<br />
3.83<br />
Q6: Parenting<br />
Support from<br />
Partner (N=18)<br />
53
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES<br />
54 FIRST 5 SANTA CRUZ COUNTY
CHILDREN LEARNING<br />
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Children Learning and Ready for School<br />
AND READY FOR SCHOOL<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
This portion of <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Strategic Framework<br />
analysis includes data regarding the need for children’s literacy<br />
support, efforts to increase use of quality child care practices to<br />
support literacy development, and data regarding young children’s<br />
gains in research‐based predictors of reading success. Additional<br />
information about partners’ efforts to support Children Learning and Ready for School can be found in the<br />
Partner Profiles section of this report<br />
Improve School Readiness Outcomes<br />
Indicator: Percentage of 3 rd grade students in the <strong>County</strong> at/above grade level in<br />
English/Language Arts<br />
Many studies have demonstrated that third grade reading scores are a bellwether of students’ later<br />
academic success, in that third grade reading proficiency is linked to students’ likelihood of<br />
graduating from high school.<br />
In 20<strong>11</strong>, 40% of third‐graders in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> scored at or above grade level in English/Language<br />
Arts (ELA), compared to 46% of students statewide. Results for the past five years show a gradual<br />
increase in the percentage of students who are scoring at or above grade level. Two county areas of<br />
historically low performance have shown particularly great improvements in scores, with PVUSD<br />
increasing from 21% in 2007 to 28% in 20<strong>11</strong>, and Freedom Elementary increasing from 12% to 28%.<br />
Figure 43: Percentage of 3 rd Grade Students in the <strong>County</strong> At / Above Grade Level In<br />
English/Language Arts<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
37%<br />
38%<br />
34% 34%<br />
21% 20%<br />
12% 12%<br />
Source: California Department of Education, STAR Test Results, 2007‐20<strong>11</strong>.<br />
44% 44% 46%<br />
40%<br />
37%<br />
25% 24%<br />
16%<br />
24%<br />
40%<br />
28%<br />
28%<br />
2006‐2007 2007‐2008 2008‐2009 2009‐<strong>2010</strong> <strong>2010</strong>‐20<strong>11</strong><br />
California<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
PVUSD<br />
Freedom Elementary<br />
55
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Increase Use of Quality Early Child Care Practices<br />
California third graders are struggling to become proficient readers. Local and statewide data<br />
indicate that well over half of third grade children are not reading at proficiency. Because language<br />
development in the early years is crucial to later reading success, early childhood educators have a<br />
unique role in influencing reading scores and later educational success. According to a report<br />
published in the Journal of Education Psychology, early childhood educators play a key role in the<br />
language development of children from high poverty backgrounds:<br />
“Language development has a profound effect on young children’s successful transition to<br />
school and, in particular, on their success in learning to read. Children who arrive in first grade<br />
with a foundation in pre‐literacy skills and the interest and motivation to learn are better<br />
prepared to engage in the complex task of learning to read.<br />
Most children acquire language and pre‐literacy skills through interactions with adults and<br />
peers who use language in ways that are consistent with the majority culture and correspond<br />
to the printed word. Unfortunately, many children raised in poverty have limited access to<br />
opportunities to develop language and literacy skills in such ways.<br />
As one important illustration, Hart and Risley (1995) reported that by the age of 3, children in<br />
poverty were already well behind their more affluent peers in their acquisition of vocabulary and<br />
oral language skills. Snow et al. (1998) also reported that children in poverty lack necessary<br />
pre‐literacy skills at the beginning of kindergarten. Similar research indicates that socioeconomic<br />
status is the strongest predictor of performance differences in children at the beginning of the<br />
first grade and that this gap persists as children progress from elementary to high school.” 15<br />
With the evidence of limited language and literacy opportunities in low‐income homes, more<br />
emphasis has been placed on showing early childhood educators how to build language<br />
opportunities into their daily child care routines, through fun and meaningful instruction.<br />
Over the past four years, <strong>First</strong> 5’s Early Literacy Foundations Initiative has addressed this need to<br />
provide strong literacy and language foundations for young children through several approaches.<br />
<strong>First</strong> 5 has implemented the SEEDS of Early Literacy model of skill development and coaching for early<br />
childhood educators, encouraged family engagement in literacy activities through expansion of the<br />
Raising A Reader program, supported child assessments for participating state Pre‐K classrooms in<br />
order to tailor differentiated instruction, and provided other literacy supports for teachers and<br />
families.<br />
15<br />
American Psychological Association (2006). The Effects of a Language and Literacy Intervention on Head Start Children and Teachers.<br />
Journal of Educational Psychology, 98, (1), 63–74.<br />
56 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
The following indicators present an overview of the Early Literacy Foundation Initiative’s efforts and<br />
outcomes this year (additional detail is included in the initiative’s Partner Profile later in this report).<br />
Indicators discussed here include:<br />
� Number of ECE teachers who completed SEEDS training<br />
� Number of SEEDS coaches<br />
� Number of children participating in Raising A Reader<br />
� Changes in early childhood educators’ practices that promote early literacy (preschool<br />
classrooms, family child care settings, and infant/toddler care classrooms)<br />
� Increased early literacy skills of children<br />
SEEDS of Early Literacy<br />
The professional development initiative mentioned above follows the SEEDS of Early Literacy curriculum<br />
that has been researched by the University of Minnesota. Research on the SEEDS model shows that<br />
teachers trained and coached on the SEEDS Curriculum score significantly higher on the Early<br />
Language and Literacy Classroom Observation (ELLCO) tool and show greater change over time in<br />
teaching strategies than teachers without such training. Results also indicate that preschool children<br />
who were taught by teachers trained in SEEDS entered kindergarten ready to read at higher rates<br />
than children in non‐SEEDS groups (Lizakowski, 2005).<br />
The SEEDS Professional Development model consists of training—and providing coaching to—early<br />
childhood educators on how to effectively integrate research‐based language and literacy strategies<br />
and materials into their classrooms. Early childhood educators are taught to use the strategies of<br />
both embedded instruction (planned strategies that occur within the typical routines of the class<br />
day) and explicit instruction (teacher‐directed activities that emphasize the teaching of a specific<br />
task), and to create a classroom environment that is designed to target early literacy predictors.<br />
These predictors of later reading success include:<br />
� Conversation and Oral Language: The ability to produce or comprehend spoken language<br />
� Alphabet Knowledge: The ability to visually discriminate the differences between letters<br />
and say the names and sounds associated with printed letters<br />
� Book and Print Rules: Refers to what children understand about how books and print work,<br />
such as left‐right, front‐back, letters, words and that print has meaning<br />
� Phonological awareness: The ability to detect, manipulate, or analyze the auditory aspects<br />
of spoken language, including the ability to distinguish or segment words, syllables, rhymes,<br />
and beginning sounds<br />
� Vocabulary and Background Knowledge: A collection of words that relate to experiences<br />
and knowledge that a child has of the world around him/her<br />
57
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
The following diagram displays the five essential SEEDS quality interactions and the five predictors of<br />
literacy.<br />
Indicator: Number of early childhood educators who complete SEEDS training, and<br />
number of educators who are SEEDS coaches<br />
The following figure presents the number of SEEDS coaches, the number of early childhood educators<br />
who completed SEEDS trainings, and the number of Family, Friend and Neighbor informal providers<br />
who attended SEEDS workshops, both in <strong>2010</strong>‐<strong>11</strong>, and cumulatively since 2007.<br />
Figure 44: Number of Early Childhood Educators Who Have Completed SEEDS<br />
trainings<br />
EARLY LITERACY FOUNDATIONS THIS FUNDING CYCLE<br />
Number of SEEDS Quality Coaches providing literacy coaching, literacy<br />
environmental assessments, and professional development advising<br />
for SEEDS instruction, fidelity, and integrity during the year<br />
Number of early childhood educators attending SEEDS of Early Literacy<br />
Courses<br />
Number of Family, Friend or Neighbor (FFN) informal child care<br />
providers attending SEEDS of Early Literacy workshops<br />
JULY 1, <strong>2010</strong> –<br />
JUNE 30, 20<strong>11</strong><br />
CUMULATIVE TOTALS<br />
2007‐20<strong>11</strong><br />
18 41<br />
77 356<br />
9 155<br />
TOTAL (unduplicated) 104 519<br />
Source: Early Literacy Foundations (ELF) Initiative, <strong>2010</strong>‐<strong>11</strong>.<br />
58 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
The figures below show additional data about Early Childhood Educators and Coaches who have<br />
been trained between 2007‐20<strong>11</strong>.<br />
Figure 45: Number of SEEDS Trained Early Childhood Educators in Licensed<br />
Programs, by type of classroom (2007-20<strong>11</strong>)<br />
State and Federally‐<br />
Subsidized Classrooms<br />
Figure 46: Primary Language of SEEDS Trained Early Childhood Educators in Licensed<br />
Programs (2007-20<strong>11</strong>)<br />
22.2%<br />
3.1%<br />
24.7%<br />
50.0%<br />
Licensed Family Child Care<br />
Homes and Private/ Non‐<br />
Profit Centers<br />
English Only<br />
Spanish Only<br />
Bilingual English/Spanish<br />
Figure 47: Educational Attainment of SEEDS Trained Early Childhood Educators in<br />
Licensed Programs (2007-20<strong>11</strong>)<br />
4.0% 4.3%<br />
7.3%<br />
8.8%<br />
10.1%<br />
No Formal Schooling<br />
Less Than High School Diploma/GED<br />
High School Diploma/GED<br />
12.2%<br />
Some College<br />
AA in non‐ECE/CD<br />
6.1%<br />
22.0%<br />
AA in ECE/CD<br />
BA in non‐ECE/CD<br />
BA in ECE/CD<br />
25.3%<br />
Some Graduate School or Postgraduate Degree<br />
Source: Early Literacy Foundations Initiative, Client and Assessment Data Entry Template, 2007‐20<strong>11</strong>.<br />
Note: Early childhood educators and coaches may have participated in more than one SEEDS class, but are only counted once in these analyses. For these<br />
clients, their language and education data are as of their earliest class, in order to assess the status of these educators at the beginning of their<br />
participation in the SEEDS program. Family, Friend or Neighbor (FFN) informal child care providers are not included in these analyses.<br />
Language N=356; Education N=328.<br />
Other<br />
Unduplicated total,<br />
Spring 2007 – June 20<strong>11</strong><br />
201 155 356<br />
59
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Indicator: Number of children participating in Raising A Reader<br />
SEEDS classrooms also implemented Raising A Reader, a weekly rotating book bag program for<br />
families, which means there were mutually complimentary interventions on site to boost shared<br />
reading practices and impact children’s early literacy skills. Over 5,000 children participated in the<br />
program during <strong>2010</strong>‐20<strong>11</strong>.<br />
Figure 48: Number of Children Participating in Raising A Reader<br />
New Existing <strong>2010</strong>‐<strong>11</strong> Total<br />
Children 2,564 2,830 5,394<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
Indicator: Percentage of early education settings that provide high quality support for<br />
language and literacy<br />
Preschool Classrooms<br />
Research on teacher effectiveness shows that by focusing professional development on language<br />
and literacy and social‐emotional development, children are shown to be much better prepared for<br />
school and have higher academic achievement. The first indicators of change are the language<br />
environment, teacher‐child interactions, and language opportunities that teachers provide to<br />
children.<br />
<strong>First</strong> 5 SEEDS Quality coaches are trained to independently assess SEEDS classrooms teaching<br />
children ages 3‐5 using the Early Language and Literacy Classroom Observation Pre‐K Tool (ELLCO<br />
Pre‐K). The ELLCO Pre‐K is used to assess the following five classroom components: classroom<br />
structure, curriculum, the language environment, books and book reading, and print and early<br />
writing (in <strong>2010</strong>‐<strong>11</strong>, the classroom structure component was not measured by most coaches and is<br />
therefore not analyzed in this report). Items are scored along a 5 point scale, where 1 is deficient<br />
and 5 is exemplary. From this scale, early childhood educators’ classroom scores can be categorized<br />
into three levels, indicating their classroom environment provides low‐quality support, basic<br />
support, or high‐quality support for language and literacy. In every Pre‐K SEEDS course since 2007,<br />
coaches used the ELLCO to assess the classrooms of their mentees (early childhood educators<br />
receiving SEEDS training) at the beginning and end of the semester.<br />
60 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Across all components, classrooms showed substantial improvements from the beginning of the<br />
semester to the end. Overall, the percentage of classrooms that were rated as having High‐Quality<br />
Support increased from 16% to 92%. Among the individual classroom components, by the end of the<br />
semester the majority of classrooms were rated as having High‐Quality Support in “Curriculum”<br />
(81%), “Language Environment” (76%), “Books and Book Reading” (87%), “Print and Early Writing”<br />
(89%).<br />
Figure 49: Classroom Support for Language and Literacy (<strong>2010</strong>-20<strong>11</strong>)<br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
16.2%<br />
54.1%<br />
91.9%<br />
Low‐Quality Support Basic Support High‐Quality Support<br />
18.9%<br />
51.4%<br />
81.1%<br />
Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) Pre‐K, <strong>2010</strong> – 20<strong>11</strong>.<br />
Note: Low‐quality support = means less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between<br />
3.51 and 5. Percentages less than 3% are not labeled.<br />
N=37.<br />
Four specific ELLCO items were chosen for individual study, using the same type of analysis:<br />
Opportunities for Child Choice and Initiative, Approaches to Book Reading, Support for Children's<br />
Writing, and Approaches to Curriculum. For these four items, several years of data have been<br />
aggregated in order to present a more robust portrait of the extent to which SEEDS‐trained early<br />
childhood educators were providing high quality support for language and literacy in their preschool<br />
classrooms.<br />
As reflected in this figure, SEEDS‐coached teachers have consistently improved the quality of<br />
support they provide in their classrooms for children’s development of early literacy. For each of the<br />
four ELLCO items, the majority of classrooms were rated as providing high quality support at post<br />
assessment: Opportunities for Child Choice and Initiative (93%), Approaches to Book Reading (88%),<br />
Support for Children's Writing (90%), and Approaches to Curriculum (87%).<br />
16.2%<br />
51.4%<br />
75.7%<br />
13.5%<br />
56.8%<br />
86.5%<br />
29.7% 29.7% 32.4% 29.7%<br />
24.3%<br />
18.9%<br />
13.5%<br />
8.1%<br />
21.6%<br />
35.1%<br />
43.2%<br />
89.2%<br />
Pre Post Pre Post Pre Post Pre Post Pre Post<br />
Overall Section 2:<br />
Curriculum<br />
Section 3:<br />
The Language<br />
Environment<br />
Section 4:<br />
Books & Book<br />
Reading<br />
61<br />
8.1%<br />
Section 5:<br />
Print & Early<br />
Writing
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Figure 50: Key Language and Literacy Questions (2007-20<strong>11</strong>)<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
53.7%<br />
35.8%<br />
93.3%<br />
10.4% 15.3% 19.5% 22.4%<br />
6.7%<br />
10.7%<br />
10.0%<br />
Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) & ELLCO Pre‐K, 2007 – 20<strong>11</strong>.<br />
Note: Clients may be included more than once if they participated in multiple SEEDS classes between 2007 and 20<strong>11</strong>. Low‐quality support = means<br />
less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between 3.51 and 5. Percentages less than 3%<br />
are not labeled.<br />
* The analysis of this question began in 2007‐08, so results reflect the combined data for 2008‐20<strong>11</strong>.<br />
Child Choice and Initiative N=134, Book Reading N=215, Children's Writing N=221, Approaches to Curriculum N=134.<br />
Family Child Care Settings<br />
35.3%<br />
49.3%<br />
88.4%<br />
The data above described the ways that SEEDS‐trained teachers made changes to their preschool<br />
classroom environments and their practices in order to better support children’s development of<br />
pre‐literacy skills. However, SEEDS training was not just limited to preschool center teachers — early<br />
childhood educators from family child care settings as well as infant/toddler centers also<br />
participated in SEEDS training and received SEEDS coaching. Their sites were observed at the<br />
beginning of their SEEDS training and again at the end.<br />
31.2%<br />
49.3%<br />
89.6%<br />
40.3%<br />
37.3%<br />
The figure below presents the PRE and POST scores gathered from Family Child Care providers on<br />
four literacy‐related indicators, for several years combined. The measurement instrument was the<br />
Family Child Care Environment Rating Scale, Revised Edition (FCCERS‐R). Items were scored using a<br />
7‐point scale ranging from inadequate to excellent. Results show that providers made pre to post<br />
gains in their abilities related to literacy promotion.<br />
86.6%<br />
12.7%<br />
Pre Post Pre Post Pre Post Pre Post<br />
Opportunities for<br />
Child Choice and<br />
Initiative*<br />
Low‐Quality Support Basic Support High‐Quality Support<br />
Approaches to<br />
Book Reading<br />
Support for<br />
Children's Writing<br />
Approaches to<br />
Curriculum*<br />
62 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Excellent<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Inadequate<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Figure 51: Average FCCERS Scores at Pre and Post Assessment on Literacy-Related<br />
Items (2009-20<strong>11</strong>)<br />
5.46 5.44<br />
3.83 3.93 3.94<br />
Source: Early Literacy Foundations (ELF) Initiative, Family Child Care Environment Rating Scale, Revised Edition, 2009‐20<strong>11</strong>.<br />
N=54.<br />
Infant/Toddler Care Classrooms<br />
The figure below presents the PRE and POST scores gathered from center‐based early childhood<br />
educators of Infant/Toddler care, for several years combined. The measurement instrument was the<br />
Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), and items were scored using a 7‐<br />
point scale ranging from inadequate to excellent. Results show that Infant/ Toddler teachers<br />
enhanced their classroom environments and practices to promote children’s early literacy<br />
development.<br />
Figure 52: Average ITERS Scores at Pre and Post Assessment on Literacy-Related<br />
Items (2009-20<strong>11</strong>)<br />
Excellent<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Inadequate<br />
Helping children<br />
understand language<br />
4.39<br />
6.02<br />
Helping children<br />
understand language<br />
Helping children use<br />
language<br />
4.82<br />
6.14<br />
Helping children use<br />
language<br />
Pre Post<br />
Pre Post<br />
Source: Early Literacy Foundations (ELF) Initiative, Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), 2009‐20<strong>11</strong>.<br />
N: Understand language=49, Use language=49, Using books=49, Interactions=48.<br />
5.65<br />
4.24<br />
5.80<br />
Using books Provider‐child<br />
interactions<br />
3.78<br />
5.76<br />
4.60<br />
5.92<br />
Using books Provider‐child interactions<br />
63
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Increase Early Literacy Skills of Children<br />
Indicator: Percentage of children who demonstrate research‐based predictors for reading<br />
success<br />
The SEEDS of Early Literacy has shown us that teachers of diverse educational backgrounds can be<br />
trained to implement strategies to help children build a strong language and literacy foundation.<br />
<strong>First</strong> 5 partnered with SEEDS state subsidized classrooms and found that, indeed, teachers have had<br />
a positive effect on children’s language and literacy development. Participating classrooms assessed<br />
children throughout the year to measure changes in three key areas of reading predictors: picture‐<br />
naming, rhyming, and alliteration. As the majority of students are dual language learners, most<br />
children were assessed in both English and Spanish, unless English was their primary language.<br />
Children showed large improvements in all three pre‐literacy skills areas between their first and last<br />
assessments. The percentage of all children scoring “At” or “Above” the target level for each of the<br />
pre‐literacy skills areas increased dramatically, with the greatest improvement occurring in rhyming<br />
and alliteration skills.<br />
Because of the number of English‐language learners in these classrooms (who comprised<br />
approximately 73% of children in this assessment), there was interest in focusing on the<br />
performance of children when assessed in their primary language. When looking at the percentage<br />
of children scoring “At” or “Above” target level, results show that when assessed in their primary<br />
language, Spanish‐speaking children started with a lower skill level than English‐speaking children,<br />
but by their last assessment they had made a greater amount of improvement (net change in<br />
percentage) in rhyming (39% increase vs. 30% increase), and in alliteration (53% increase vs. 46%<br />
increase). Primarily Spanish‐speaking children showed similar or even greater amounts of<br />
improvement when assessed in English, with the greatest increases occurring in rhyming (44%<br />
increase) and alliteration (54% increase).<br />
Figure 53: Percentage of Children Scoring “At” or “Above” the Target Level in Three<br />
Pre-Literacy Skill Areas, by Primary Language, <strong>2010</strong>-20<strong>11</strong><br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40% 32.3%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Primarily English‐Speaking<br />
Children<br />
English Assessment<br />
62.1%<br />
57.1%<br />
Picture<br />
Naming<br />
31.0%<br />
18.5%<br />
56.9%<br />
48.9%<br />
21.7%<br />
68.1%<br />
29.3%<br />
26.0%<br />
13.6%<br />
6.3%<br />
7.7%<br />
Rhyming Alliteration Picture<br />
Naming<br />
56.0%<br />
46.5%<br />
64 FIRST 5 SANTA CRUZ COUNTY<br />
18.9%<br />
72.3%<br />
Rhyming Alliteration Picture<br />
Naming<br />
Oct Jan May<br />
Primarily Spanish‐Speaking Children<br />
Spanish Assessment English Assessment<br />
50.0%<br />
25.6% 30.6%<br />
18.0%<br />
4.9% 5.8% 7.2%<br />
49.8%<br />
61.1%<br />
Rhyming Alliteration
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Figure 54: Percentage of Children Meeting Targets for Later Reading Success,<br />
by Primary Language<br />
LANGUAGE OF<br />
ASSESSMENT<br />
PRIMARILY ENGLISH‐SPEAKING CHILDREN NET CHANGE<br />
TOPIC AREA OCT JAN MAY<br />
English Picture Naming 32.3% 62.1% 57.1% 24.8%<br />
LANGUAGE OF<br />
ASSESSMENT<br />
Rhyming 18.5% 31.0% 48.9% 30.4%<br />
Alliteration 21.7% 56.9% 68.1% 46.4%<br />
PRIMARILY SPANISH‐SPEAKING CHILDREN NET CHANGE<br />
OCT JAN MAY<br />
Spanish Picture Naming 6.3% 13.6% 29.3% 23.0%<br />
Rhyming 7.7% 26.0% 46.5% 38.8%<br />
Alliteration 18.9% 56.0% 72.3% 53.4%<br />
English Picture Naming 4.9% 18.0% 25.6% 20.7%<br />
Rhyming 5.8% 30.6% 50.0% 44.2%<br />
Alliteration 7.2% 49.8% 61.1% 53.9%<br />
Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />
English Speakers: English N= Oct: Picture Naming (93); Rhyming (92); Alliteration (92). N= Jan: Picture Naming (58); Rhyming (58); Alliteration (51). N=<br />
May: Picture Naming (91); Rhyming (90); Alliteration (91). Spanish Speakers: Spanish N= Oct: Picture Naming (222); Rhyming (222); Alliteration (222).<br />
N= Jan: Picture Naming (206); Rhyming (204); Alliteration (209). N= May: Picture Naming (229); Rhyming (228); Alliteration (224). Spanish Speakers:<br />
English N= Oct: Picture Naming (247); Rhyming (240); Alliteration (236). N= Jan: Picture Naming (217); Rhyming (206); Alliteration (2<strong>11</strong>). N= May:<br />
Picture Naming (246); Rhyming (242); Alliteration (234).<br />
Note: Table displays the percentage of children scoring “at” or “above” the target level in these three pre‐literacy skill areas. Children who completed<br />
any two assessments within a pre‐literacy skill area were included in the analysis of that skill. Children were determined to be primarily English<br />
speakers if they were marked as being “English‐only” speakers on the scoring template, or if they did not take any assessments in Spanish. Children<br />
were determined to be primarily Spanish speakers if they were not marked as being “English‐only” speakers on the scoring template, and if they took<br />
at least one assessment in Spanish. The number of children marked as being “English‐only” speakers who also completed an additional assessment in<br />
Spanish was too low to analyze.<br />
Indicator: Percentage of children who recognize letter sounds (pre/post)<br />
Pre‐school children who participated in two educational programs provided by Migrant Education<br />
were assessed in their ability to recognize letter sounds in their primary language. Over 90% of all<br />
students who participated in these programs increased their letter sound recognition by at least five<br />
letter sounds, and on average, students learned to recognize 17 new letter sounds by the time they<br />
left the program.<br />
65
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Figure 55: Changes in Students’ Letter Sound Recognition Skills After Participation in<br />
Migrant Education Pre-School Programs<br />
Percentage of Students Who Increased Their Letter<br />
Sound Recognition By At Least 5 Letter Sounds<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
90.3%<br />
Average Number of Letter Sounds Recognized<br />
at Pre and Post Assessment<br />
Source: Migrant Education Summer Pre‐K and School Readiness Programs: Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool,<br />
20<strong>11</strong>.<br />
N=124.<br />
Increase Use of Kindergarten Transition Practices<br />
The Child Snapshot form was developed in partnership between kindergarten teachers and early<br />
childhood educators as an easy and effective way to support children’s transition to kindergarten.<br />
The Snapshot is a three‐page form completed by both the parent and the preschool teacher in the<br />
spring prior to kindergarten, and it includes brief information about the child’s interests and<br />
abilities, language or developmental concerns, preschool experience, and developmental<br />
information. As such, the form provides kindergarten teachers with family and preschool<br />
information about their students, and helps them become more familiar with the preschool and<br />
child care programs which feed into their elementary schools.<br />
The number of children with Child Snapshots completed on their behalf continues to grow, and<br />
illustrates increased communication between early childhood and elementary school settings, and<br />
the achievements being made to bridge children’s transition to kindergarten.<br />
� In Spring 20<strong>11</strong>, a total of 976 preschool children were assessed—509 boys (52%) and 467<br />
girls (48%). These children were drawn from 42 preschool programs throughout <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong> and their child snapshot forms were shared with kindergarten teachers at 42<br />
elementary schools in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and surrounding areas.<br />
66 FIRST 5 SANTA CRUZ COUNTY<br />
20<br />
15<br />
10<br />
5<br />
0<br />
1.2<br />
17.9<br />
Pre Post<br />
Indicator: Number of children who have a Child Snapshot completed on their behalf
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
Figure 56: Number of Child Snapshot Forms Collected from Participating Preschool<br />
Programs<br />
Source: Applied Survey Research, Child Snapshot Log, 2006‐<strong>2010</strong>, and Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot.<br />
Pre‐Kindergarten Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />
Additionally, a measurement of kindergarten readiness was included at the end of the Child<br />
Snapshot, using either the Desired Results Developmental Profile ‐ Revised, Preschool (DRDP‐PS) or<br />
the Pre‐Kindergarten Observation Form (PKOF). Children were assessed across 24 readiness skills,<br />
which can be sorted into four domains, or Basic Building Blocks of Readiness: 1) Self‐Care & Motor<br />
Skills, 2) Self‐Regulation Skills, 3) Social Expression Skills, 4) Kindergarten Academics. The figure<br />
below displays children’s overall mean readiness scores as well as their average scores on each of<br />
the four Basic Building Blocks.<br />
Proficient<br />
In Progress<br />
Beginning<br />
1,000<br />
800<br />
600<br />
400<br />
200<br />
0<br />
393<br />
889<br />
617<br />
2006‐07 2007‐08 2008‐09 2009‐<strong>2010</strong> <strong>2010</strong>‐<strong>11</strong><br />
� Average readiness scores for the Basic Building Blocks ranged from 3.44 to 3.75 (on a scale of<br />
1 to 4), with an overall readiness score of 3.54. These results indicate that children who<br />
attended these preschools will be entering kindergarten with high levels of proficiency across<br />
all domains of readiness.<br />
Figure 57: Students’ Average School Readiness Levels Across the Basic Building<br />
Blocks of Readiness<br />
4<br />
3<br />
2<br />
Not Yet<br />
1<br />
3.54<br />
3.75<br />
Overall Readiness Self‐Care & Motor<br />
Skills<br />
Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten Observation Form<br />
and crosswalked DRDP‐PS, Spring 20<strong>11</strong>.<br />
N = 900‐904.<br />
832<br />
976<br />
3.50 3.59 3.44<br />
Self‐Regulation<br />
Skills<br />
Social Expression<br />
Skills<br />
Kindergarten<br />
Academics<br />
67
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
The next figure highlights the readiness skills for which students were rated as demonstrating the<br />
most proficiency and the greatest challenges.<br />
� Readiness skill strengths were identified within the Self Care & Motor Skills, Social<br />
Expression, and Kindergarten Academics Basic Building Blocks.<br />
� Students were still developing the Kindergarten Academic skills involved in recognizing all<br />
letters of the alphabet and recognizing rhyming words, as well as the Self Regulation Skills<br />
involved in navigating peer relationships.<br />
Figure 58: Students’ Top Five Readiness Strengths & Challenges<br />
TOP FIVE STRENGTHS BASIC BUILDING BLOCK<br />
1. General coordination on the playground Self‐Care & Motor Skills<br />
2. Uses small manipulatives Self‐Care & Motor Skills<br />
3. Recognizes basic colors Kindergarten Academics<br />
4. Relates appropriately to adults other than parent/primary caregiver Social Expression<br />
5. Appropriately expresses needs and wants verbally in primary language Social Expression<br />
TOP FIVE CHALLENGES BASIC BUILDING BLOCK<br />
1. Recognizes letters of the alphabet Kindergarten Academics<br />
2. Recognizes rhyming words Kindergarten Academics<br />
3. Handles frustration well Self‐Regulation<br />
4. Negotiates with peers to resolve social conflict Self‐Regulation<br />
5. Participates successfully in circle time Self‐Regulation<br />
Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten. Pre‐Kindergarten<br />
Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />
Note: Means are based on 415‐899 students. Don’t know/ Not observed responses are not included. Scale points are as follows: 1=not yet, 2=<br />
beginning, 3=in progress, 4=proficient.<br />
68 FIRST 5 SANTA CRUZ COUNTY
SERVICE INTEGRATION &<br />
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Service Integration & Community Strengthening<br />
COMMUNITY STRENGTHENING<br />
<strong>First</strong> 5 Service Integration<br />
FIRST 5 SANTA CRUZ COUNTY<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
Indicator: Number of families who receive services from multiple <strong>First</strong> 5 grantees<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> seeks to strengthen the system of care in the county. One measure of the<br />
degree of current integration across the system is the number of children who are served by<br />
multiple <strong>First</strong> 5 grantees. Sometimes this occurs because grantees cross‐refer families, or because<br />
other agencies refer families into a coordinated network of <strong>First</strong> 5 services. In <strong>2010</strong>‐<strong>11</strong>, 18% of<br />
children received services from multiple <strong>First</strong> 5 partners.<br />
Figure 59: Number of Children Receiving Services from Multiple <strong>First</strong> 5 Partners<br />
2006‐2007 2007‐2008 2008‐2009 2009‐<strong>2010</strong> <strong>2010</strong>‐20<strong>11</strong><br />
TOTAL NUMBER OF CHILDREN 4,462 5,214 5,440 5,762 9,292<br />
PERCENT WITH MULTIPLE<br />
FIRST 5 SERVICES<br />
Source: SUN database/CCD data for July 1, 2006 ‐ June 30, 20<strong>11</strong>.<br />
12.8% 20.3% 13.0% 14.6% 17.8%<br />
Figure 60: Percentage of Children Receiving Services from Multiple <strong>First</strong> 5 Partners<br />
30%<br />
20%<br />
10%<br />
0%<br />
12.8%<br />
20.3%<br />
13.0%<br />
14.6%<br />
17.8%<br />
2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
Source: SUN database/CCD data for July 1, 2006 ‐ June 30, 20<strong>11</strong>.<br />
Note: 2006‐2007 data: N = 4,462. 2007‐2008 data: N = 5,214. 2008‐2009 data: N = 5,440. 2009‐<strong>2010</strong> data: N = 5,762. <strong>2010</strong>‐<strong>11</strong> data: N = 9,292.<br />
69
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
Indicator: Distribution of Information to Community Service Providers<br />
Many health, social services, and early education providers in the county participated in workshops<br />
on various social and community issues to better integrate services and improve customer service,<br />
including 213 who participated in brown bag lunches, and 31 who attended customer service<br />
trainings.<br />
Indicator: Network of agencies that participated in Triple P<br />
As the Triple P program has expanded its levels of service, the number of agencies providing these<br />
services has also grown. By the end of FY <strong>2010</strong>‐<strong>11</strong>, 86 practitioners from 20 agencies and programs<br />
had been accredited to provide Triple P services. <strong>First</strong> 5 implemented the following steps to build<br />
and enhance the Triple P referral system, and to provide integration between these agencies.<br />
� Maintained and distributed a contact list indicating which organizations have practitioners<br />
accredited in each Level of Triple P.<br />
� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service<br />
providers as a means to encourage referrals.<br />
� Publicized Triple P services in print and online editions of newspapers and community<br />
calendars.<br />
� Established <strong>First</strong> 5’s main phone number as a “warmline.” This number was publicized in all<br />
flyers, emails and media announcements as a central place to receive assistance locating<br />
Triple P services. <strong>First</strong> 5 staff were trained to conduct a brief screening in order to assess<br />
callers’ needs and make appropriate referrals.<br />
� Developed Triple P business cards containing <strong>First</strong> 5’s warmline and website address, as well<br />
as space for practitioners to insert their own contact information.<br />
� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners,<br />
referral processes, and a master calendar of Triple P Groups, Workshops, and Seminars.<br />
70 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
<strong>First</strong> 5 Fiscal Status and Sustainability<br />
Indicator: Average Cost per Client<br />
FIRST 5 SANTA CRUZ COUNTY<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
The following figure presents data for the number of clients served by each <strong>First</strong> 5 partner, and the<br />
average cost per client.<br />
PARTNER<br />
Figure 61: Average Cost per Client, by Goal Area and Partner (<strong>2010</strong>-20<strong>11</strong>)<br />
HEALTHY CHILDREN<br />
JULY <strong>2010</strong> –<br />
JUNE 20<strong>11</strong><br />
COSTS<br />
PARENTS<br />
CHILDREN<br />
(AGES 0‐5)<br />
NUMBERS SERVED<br />
EARLY<br />
CHILDHOOD<br />
EDUCATORS<br />
TRIPLE P<br />
CHILDREN<br />
(AGES 6+)<br />
TRIPLE P<br />
PRACTI‐<br />
TIONERS<br />
AVERAGE COST PER INDIVIDUAL<br />
TOTAL<br />
PARTICIPANTS<br />
71<br />
COST PER<br />
PARTICIPANT<br />
Healthy Kids Initiative $865,315 2,704 2,704 $320<br />
STRONG FAMILIES<br />
Families Together $585,197 137 187 324 $1,806<br />
Triple P Services 1 $363,479 437 324 278 1,039 $350<br />
Training &<br />
Accreditation<br />
$88,275 94 94 $939<br />
Side‐By‐Side $95,000 41 41 $2,317<br />
CHILDREN LEARNING AND READY FOR SCHOOL<br />
La Manzana Community<br />
Resources<br />
Early Literacy<br />
Foundations Initiative<br />
$98,000 981 1,332 2,313 $42<br />
$320,069 104 104 $3,078<br />
Raising A Reader $231,556 5,394 5,394 $43<br />
Starlight Infant / Toddler<br />
Program<br />
Literacy Continuing<br />
Education Workshops<br />
Migrant Education ‐<br />
Summer Pre‐K Academy<br />
Migrant Education School<br />
Readiness Program<br />
$515,000 104 54 158 $3,259<br />
$4,936 35 35 $141<br />
$39,622 156 156 $254<br />
$13,821 36 36 $384<br />
Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
1 Triple P provides services via several local practitioners and agencies, including three agencies that are already <strong>First</strong> 5 partners (Families Together, La<br />
Manzana Community Resources, and Mountain Community Resources). For these partners, clients who received Triple P services are reported as<br />
Triple P clients. If these clients also received other services from that partner, they are reported again as clients for that <strong>First</strong> 5 partner. Since<br />
Mountain Community Resources received <strong>First</strong> 5 funding to provide Triple P services, all of their clients are reported as Triple P clients in this table.
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
Indicator: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s <strong>Annual</strong> Balance Sheet<br />
The balances on this statement were as of June 30, 20<strong>11</strong>. The Statement of Net Assets indicates that<br />
net assets decreased by $3,864,306 from June 30, <strong>2010</strong> to June 30, 20<strong>11</strong>. This decrease in net assets<br />
is part of the Commission’s planned use of its sustainability fund for providing programmatic<br />
investments as set forth in the Strategic Plan and unforeseen liability of $3,390,246 incurred due to<br />
the passage of AB99 by the California Legislature. For the year ended June 30, 20<strong>11</strong>, the ending fund<br />
balance was $2,912,395, a decrease of $3,868,097 from the prior year. The Commission’s fund<br />
balance is allocated for the following categories:<br />
� $200,000 is restricted for private grants.<br />
� $2,712,395 is committed for program contracts.<br />
Figure 62: Balance Sheet, Fiscal Year <strong>2010</strong>-20<strong>11</strong><br />
Revenue Prop 10 Allocation $ 2,400,827<br />
Expenses Program<br />
Interest on Prop 10 Allocation $ 37,044<br />
School Readiness State Program Match $ 616,623<br />
David and Lucille Packard Foundation Grant $ 200,000<br />
Mental Health Services Act Contract $ 290,100<br />
HSD Title IV‐E Training Funds $ 82,226<br />
Other $ 20,298<br />
Total Revenue $ 3,647,<strong>11</strong>8<br />
Children Learning & Ready for School $ 1,366,259<br />
Healthy Children $ 870,015<br />
Strong Families $ 1,131,951<br />
Family Friendly Services $ 59,162<br />
Transfer to State per AB99 $ 3,390,246<br />
Program Support $ 235,436<br />
<strong>Evaluation</strong> $ 202,380<br />
Administration $ 259,766<br />
Total Expenditures $ 7,515,215<br />
Excess of expenditures over revenues $ (3,868,097)<br />
Fund balance ‐ beginning of year $ 6,780,492<br />
Fund balance ‐ end of year $ 2,912,395<br />
Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> audited financial statements (<strong>2010</strong>‐20<strong>11</strong>).<br />
72 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
FIRST 5 SANTA CRUZ COUNTY<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
Indicator: Amount of matched or leveraged investments reported by <strong>First</strong> 5 partners<br />
Many partners maximize <strong>First</strong> 5 funding by using their funds as match money. In <strong>2010</strong>‐20<strong>11</strong>, <strong>First</strong> 5<br />
funding was leveraged by these partners to bring in the following additional revenue.<br />
Figure 63: Amount of Leveraged Investments By Type<br />
SOURCE OF LEVERAGED FUNDING LEVERAGED FUNDING AMOUNT<br />
Medi‐Cal Administrative Activities (MAA) $282,604<br />
Early Periodic Screening Detection and Treatment (EPSDT) $80,215<br />
Public agency ‐ Federal $103,370<br />
Public agency ‐ State $1,321,022<br />
Public agency ‐ Local $771,000<br />
Educational Institution $131,131<br />
Private Foundation $688,660<br />
Business or Individual $384,962<br />
Total $3,762,964<br />
Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and <strong>First</strong> 5 partner <strong>Annual</strong> Progress <strong>Report</strong>s, <strong>2010</strong>‐20<strong>11</strong>.<br />
Figure 64: Total Amount of <strong>First</strong> 5 and Leveraged Investments, <strong>2010</strong>-<strong>11</strong><br />
$7,500,000<br />
$5,000,000<br />
$2,500,000<br />
$0<br />
$3,662,823<br />
$3,762,954<br />
Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and <strong>First</strong> 5 partner <strong>Annual</strong> Progress <strong>Report</strong>s, <strong>2010</strong>‐20<strong>11</strong>.<br />
$7,425,777<br />
$3,762,954<br />
$3,662,823<br />
Total <strong>First</strong> 5 Investment Total Leveraged Investments <strong>First</strong> 5 and Leveraged<br />
Investments Combined<br />
73
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
Community Strengthening<br />
Indicator: Access and utilization of the 2‐1‐1 program<br />
2‐1‐1 is a centralized point of contact for <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> residents to get information on local<br />
services, and is accessible by phone or an online website. Trained specialists refer callers to local<br />
agencies and services that match their needs, and also help relieve the burden on 9‐1‐1 during<br />
disasters by providing non‐emergency information and referrals. This new county program,<br />
operated by the United Way of the Bay Area and funded by several local agencies including <strong>First</strong> 5<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, just completed its first year of service in July, 20<strong>11</strong>.<br />
Results show how effective this program was in helping residents with their everyday needs and<br />
concerns, and during emergency situations. In its first year, a total of 5,157 people called 2‐1‐1, with<br />
a total of 5,797 needs. Common types of needs included housing issues (24%), disaster services<br />
(12%), income support/assistance (<strong>11</strong>%), and food/meals (9%). A total of 7,347 referrals to agencies<br />
were made, including referrals to human services (30%), disaster assistance (10%), and health<br />
agencies (9%).<br />
7%<br />
Figure 65: Number of 2-1-1 Callers and Needs, <strong>2010</strong>-<strong>11</strong><br />
TOTAL NUMBER OF 2‐1‐1 CALLERS TOTAL NUMBER OF NEEDS TOTAL NUMBER OF REFERRALS<br />
5,157 5,797 7,347<br />
Source: United Way of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2‐1‐1 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Year One, <strong>Report</strong> to the Community, July 21, 20<strong>11</strong>, 20<strong>11</strong>.<br />
Figure 66: Types of 2-1-1 Callers’ Needs<br />
6%<br />
8%<br />
6%<br />
8%<br />
9%<br />
9%<br />
<strong>11</strong>%<br />
24%<br />
12%<br />
Housing<br />
Disaster Services<br />
Income Support/Assistance<br />
Food/Meals<br />
Legal, Consumer, & Public Safety<br />
Health Care<br />
Information Services<br />
Individual, Family, & Community Support<br />
Mental Health/Addictions<br />
Other Needs<br />
Source: United Way of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2‐1‐1 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Year One, <strong>Report</strong> to the Community, July 21, 20<strong>11</strong>.<br />
N=5,797.<br />
74 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />
Figure 67: Types of 2-1-1 Referrals to Agencies<br />
5%<br />
6%<br />
7%<br />
4%<br />
4%<br />
8%<br />
4%<br />
Source: United Way of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2‐1‐1 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Year One, <strong>Report</strong> to the Community, July 21, 20<strong>11</strong>.<br />
N=7,347.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
5%<br />
8%<br />
9%<br />
30%<br />
10%<br />
Human Services<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
Disaster Assistance<br />
Health Agencies<br />
Volunteer Income Tax Assistance<br />
Housing Services<br />
The Salvation Army Corps Community Center<br />
Catholic Charities<br />
Community Action Board<br />
St. Vincent De Paul Society of <strong>Santa</strong> <strong>Cruz</strong><br />
Children's Services<br />
<strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong> Benefit Services<br />
Other Services<br />
75
STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />
76 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
PART 2:<br />
PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
77
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
78 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
PARTNER PROFILES<br />
This section of the report provides a snapshot of each <strong>First</strong> 5 partner’s work between July 1, <strong>2010</strong><br />
and June 30, 20<strong>11</strong>.<br />
At the beginning of the <strong>2010</strong>‐<strong>11</strong> contract period, scopes of work were developed with each partner<br />
which detailed each program’s target population, the number of people to be served, primary<br />
programmatic activities, outcome objectives, methods of measurement, and the timing of data<br />
collection activities. Partners reported their outcome data quarterly or biannually, using the SUN<br />
database, customized Excel forms, or partner‐specific reports. In addition, a narrative template was<br />
provided to partners to submit qualitative information on the progress of their services. When<br />
collecting data for their outcome objective, some programs did not administer their assessment<br />
tools to every participant. For this reason the number of participants reported in their outcome<br />
measurement may differ from the total number of participants who were served.<br />
The purpose of the Partner Profiles is to highlight the work that each partner conducted in Fiscal<br />
Year <strong>2010</strong>‐<strong>11</strong>. Organized by goal area (Healthy Children, Strong Families, and Children Learning and<br />
Ready for School), each profile briefly lists:<br />
� Description of the program<br />
� Population served<br />
� Client outcome objectives achieved (and in a few cases, program objectives achieved)<br />
Readers will note that in many cases, data that were presented in the Strategic Framework section<br />
are presented here again with the intent of summarizing the meaningful work that each of the<br />
partners carried out in the <strong>2010</strong>‐<strong>11</strong> year.<br />
Finally, it should be noted that these profiles only provide an overview of the innovative work that<br />
each partner or initiative carries out, and that more comprehensive detail about each partner’s<br />
progress is provided in their annual report to <strong>First</strong> 5.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
79
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />
Healthy Kids Initiative<br />
Health Care Outreach Coalition<br />
Program Description<br />
The Health Care Outreach Coalition (HCOC) provides assistance with application and enrollment in<br />
public health insurance to income‐eligible families. Through community outreach workers called<br />
Certified Application Assistors (CAAs), children from families earning up to 300% of the Federal<br />
Poverty Level receive assistance in applying for Medi‐Cal, Healthy Families, and the local Healthy<br />
Kids health insurance plan.<br />
Additionally, HCOC staff participate in community events and respond to business and community<br />
agency requests for presentations and additional information regarding health insurance. HCOC<br />
assists in the management of the One‐e‐App online application system, providing training and<br />
technical assistance to all CAAs.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Children 2,704<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
“[We are] most proud of our CAAs’ commitment to helping<br />
parents navigate the often difficult and confusing processes<br />
of public health insurance programs. That CAAs request<br />
presentations and trainings on other community resources<br />
further exemplifies how seriously they take their roles<br />
as assistors.”<br />
- Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong><br />
80 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />
Outcome Objective: Children will be assisted in applying for public health<br />
insurance<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Number of children assisted 2,846<br />
Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />
Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />
HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />
months after the end of the fiscal year.<br />
Outcome Objective: Children will be enrolled in public health insurance<br />
By June 20<strong>11</strong>, 75% of the children ages 0‐5 who received assistance to<br />
apply will be enrolled in a public health insurance program<br />
<strong>2010</strong>‐20<strong>11</strong><br />
89.0%<br />
N=1,944<br />
Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />
Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />
HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />
months after the end of the fiscal year.<br />
Outcome Objective: Children will be renewed in public health insurance<br />
By June 20<strong>11</strong>, 75% of the children ages 0‐5 who received assistance to<br />
apply will be renewed in a public health insurance program<br />
<strong>2010</strong>‐20<strong>11</strong><br />
92.1%<br />
Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />
Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />
HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />
months after the end of the fiscal year.<br />
System Outcome: Children will utilize public health insurance<br />
85% of children renewing in public health insurance between July 1,<br />
<strong>2010</strong> and June 30, 20<strong>11</strong> will have utilized care prior to renewal<br />
N=902<br />
<strong>2010</strong>‐20<strong>11</strong><br />
96.6%<br />
Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />
Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />
HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />
months after the end of the fiscal year, and utilization results exclude clients with missing data.<br />
N=829<br />
81
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />
The following chart presents the percentage of applicants who were enrolled in health insurance,<br />
the percentage who re‐enrolled in insurance, and the percentage who utilized their benefits.<br />
Figure 68: HCOC Child Health Insurance Enrollment, Renewal, and Utilization<br />
Percentages<br />
100%<br />
95%<br />
90%<br />
85%<br />
80%<br />
75%<br />
70%<br />
99.6%<br />
93.8%<br />
85.7%<br />
Percent who utilized care prior to renewal in an insurance program<br />
Percent who were renewed in an insurance program<br />
Percent who were enrolled in an insurance program<br />
98.5%<br />
97.9%<br />
87.9%<br />
Source: Applied Survey Research, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Final <strong>Report</strong>s, 2006 ‐ <strong>2010</strong>. Health Care Outreach Coalition, Enrollment and Utilization<br />
<strong>Report</strong>, 20<strong>11</strong>.<br />
Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come<br />
to HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications<br />
2‐3 months after the end of the fiscal year. Utilization results exclude clients with missing data.<br />
Enrollment N: June 2007=678; June 2008=580. June 2009=730, June <strong>2010</strong>=1,528, June 20<strong>11</strong>=1,944. Renewal N: June 2007=496; June 2008=530. June<br />
2009=592, June <strong>2010</strong>=826, June 20<strong>11</strong>=902. Utilization N: June 2007=471, June 2008=514. June 2009=555, June <strong>2010</strong>=789, June 20<strong>11</strong>=829.<br />
Health Care Outreach Coalition’s Newborn Enrollment Project: Baby Gateway<br />
99.6%<br />
98.0%<br />
Baby Gateway—the Newborn Enrollment Project—has now been launched in three local hospitals<br />
with funding and support provided by <strong>First</strong> 5 of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Watsonville Hospital (in August<br />
2009), Dominican Hospital (in January 20<strong>11</strong>), and Sutter Maternity & Surgery Center of <strong>Santa</strong> <strong>Cruz</strong> (in<br />
May 20<strong>11</strong>).<br />
The main goals of the project are to provide enrollment assistance to mothers and their newborns, as<br />
well as to establish a seamless Medi‐Cal coverage process for Medi‐Cal‐eligible newborns, and to link<br />
those newborns to a medical home, all before they leave the hospital. In addition, all new mothers<br />
receive the <strong>First</strong> 5 “Kit for New Parents” containing expert guidance for raising healthy infants and<br />
children. In particular, parents are oriented to the “What To Do If My Child Gets Sick” booklet, which<br />
provides information in utilizing primary care appropriately, and clarifies what issues should prompt a<br />
visit to the emergency room (and which should be handled in the medical home).<br />
82 FIRST 5 SANTA CRUZ COUNTY<br />
99.4%<br />
93.7%<br />
85.6% 85.5%<br />
96.6%<br />
92.1%<br />
89.0%<br />
June 2007 June 2008 June 2009 June <strong>2010</strong> June 20<strong>11</strong><br />
Utilization<br />
Outcome: 85%<br />
Enrollment &<br />
Renewal<br />
Outcomes:<br />
75%
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />
Data from <strong>2010</strong>‐<strong>11</strong> show how successful this program has been in providing these services to <strong>Santa</strong><br />
<strong>Cruz</strong> <strong>County</strong>’s mothers and newborns.<br />
� Of all 2,103 births that occurred in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> at these hospitals after the program<br />
had been implemented, 70% of mothers received a newborn visit while in the hospital, and<br />
65% received a “Kit for New Parents.”<br />
� Of all 1,499 mothers with Medi‐Cal births during <strong>2010</strong>‐<strong>11</strong>, almost three‐fourths (74%) were<br />
assisted to complete a Medi‐Cal application for their new babies.<br />
� Of the 1,<strong>11</strong>1 mothers who were assisted to complete a Medi‐Cal application for their<br />
newborns, nearly all applications (95%) were approved, and 97% were assigned a primary<br />
care provider for their child before discharge from the hospital.<br />
Figure 69: Newborn Enrollment Project Statistics, <strong>2010</strong>-<strong>11</strong><br />
PROGRAM COMPONENT WATSONVILLE<br />
Total Number of All Births in <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong> after program implementation<br />
COMMUNITY<br />
HOSPITAL<br />
DOMINICAN<br />
HOSPITAL 1<br />
SUTTER<br />
MATERNITY &<br />
SURGERY CENTER<br />
OF SANTA CRUZ 2<br />
1,487 437 179 2,103<br />
Total Number of Medi‐Cal Births 1,247 191 61 1,499<br />
Number of Completed Newborn<br />
Medi‐Cal Applications<br />
Number of Approved Newborn<br />
Medi‐Cal Enrollments<br />
Number of Denied Newborn<br />
Medi‐Cal Applications<br />
Number of Pending Newborn<br />
Medi‐Cal Applications<br />
Number of Newborn Medi‐Cal<br />
Applicants with an Assigned<br />
Primary Care Provider<br />
Total Number of Newborn Visits<br />
(regardless of insurance status)<br />
Number of Kits for New Parents<br />
Distributed<br />
Source: Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />
1 Based on program implementation of 1/10/<strong>11</strong>.<br />
2 Based on program implementation of 5/1/<strong>11</strong>.<br />
TOTAL<br />
NUMBER PERCENT OF ALL<br />
MEDI‐CAL BIRTHS<br />
919 141 51 1,<strong>11</strong>1 74.1%<br />
NUMBER PERCENT OF ALL<br />
83<br />
MEDI‐CAL<br />
APPLICATIONS<br />
883 133 44 1,060 95.4%<br />
21 1 0 22 2.0%<br />
15 7 7 29 2.6%<br />
1,074 96.7%<br />
NUMBER PERCENT OF ALL<br />
COUNTY BIRTHS<br />
1,040 289 136 1,465 69.7%<br />
1,040 184 136 1,360 64.7%
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />
These Newborn Enrollment Project services may also have had an effect on the use of the<br />
Emergency Department (ED) for children less than one year old. As seen in the following figure,<br />
� ED visits at Watsonville Community Hospital were at a high of 632 in the 2 nd quarter of 2009.<br />
Baby Gateway was launched at that hospital in August 2009, and after that the number of ED<br />
visits dropped steadily to a low of 424 at the beginning of 20<strong>11</strong>.<br />
Figure 70: Number of Emergency Department Visits (Infants Less Than One Year Old)<br />
700<br />
600<br />
500<br />
400<br />
300<br />
200<br />
100<br />
0<br />
573<br />
218<br />
632<br />
Baby Gateway<br />
Launched 8/2009<br />
184<br />
552 558<br />
151<br />
171<br />
Source: Health Improvement Partnership of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Baby Gateway Program <strong>Report</strong>, August 16, 20<strong>11</strong>.<br />
506<br />
199<br />
528<br />
146<br />
84 FIRST 5 SANTA CRUZ COUNTY<br />
471<br />
<strong>11</strong>6<br />
421 424<br />
Q1/2009 Q2/09 Q3/09 Q4/09 Q1/<strong>2010</strong> Q2/10 Q3/10 Q4/10 Q1/20<strong>11</strong><br />
168<br />
186<br />
Baby Gateway<br />
Launched 1/20<strong>11</strong><br />
Watsonville Community Hospital<br />
Dominican Hospital
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Families Together<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – FAMILIES TOGETHER<br />
Families Together provides an alternative, voluntary and prevention‐focused way for <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong> to respond to reports of abuse and neglect received by Family and Children’s Services (FCS).<br />
Of all the referrals to the child welfare screening unit, only about 8% meet the necessary criteria to<br />
receive services from FCS. By assisting these families, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> can intervene early, before<br />
family difficulties escalate to the point of maltreatment, in order to increase child safety, engage<br />
families in decision‐making, and to support healthy<br />
child development.<br />
<strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center is the<br />
lead agency for Families Together. Other<br />
collaborative partners, such as Family and<br />
Children’s Services, a division of the Human<br />
Services Department (HSD), Health Services Agency,<br />
and Families in Transition also play critical roles in<br />
the program.<br />
Although families are referred through the Child<br />
Welfare System, they participate in Families<br />
Together voluntarily. This home visiting program<br />
includes comprehensive intake and risk assessment,<br />
development of a tailored case plan, parent<br />
support and education, child development<br />
activities, and periodic assessments. Using a<br />
strengths‐based approach, participating families<br />
are encouraged to identify goals and objectives that<br />
will support healthy family relationships, child health<br />
and safety, positive parenting, family literacy and<br />
school readiness.<br />
“Safety and basic needs have always been—and<br />
continue to be—crucial elements of the work we<br />
do with families. This year, we have really pushed<br />
the program forward in terms of parent education<br />
and mental health services for all families.”<br />
One family’s story:<br />
“[After receiving Triple P services,] Eduardo* was<br />
taking a more active role in the parenting, and<br />
seemed to respond to [the practitioner’s] assertion<br />
that his children admire him and need him to be<br />
an active parent. [He and his daughter] are better<br />
able to communicate, and [his wife] found that<br />
she was yelling less and the children were<br />
responding more. Though this family has many<br />
challenges ahead, they have learned imperative<br />
communication skills, appropriate limit-setting,<br />
and self-care skills. This foundation will surely<br />
benefit them as they continue to raise adolescents<br />
and young children.”<br />
-Families Together, <strong>Annual</strong> Progress <strong>Report</strong><br />
(* Names have been changed)<br />
In Families Together, risk assessment serves a variety of purposes. <strong>First</strong>, the assessments help staff<br />
link parents with the appropriate service pathway, including brief services, intensive services, and<br />
referrals to Primeros Pasos, a program for parents struggling with alcohol and drug dependency.<br />
Follow up assessments help assess whether risk has been reduced.<br />
85
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – FAMILIES TOGETHER<br />
Population Served<br />
Families Together Pathway<br />
Brief Intensive Pending<br />
Subtotal<br />
All Pathways<br />
Participated in<br />
Triple P*<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Total<br />
All Pathways + Triple P<br />
(unduplicated)<br />
Parents/Guardians 57 77 3 137 25 146<br />
Children 80 104 3 187 (ages 0‐5) 27<br />
(ages 6‐16) 13<br />
(ages 0‐5) 191<br />
(ages 6‐16) 13<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
Note: The risk assessment results guide the pathway assignment decision: families who score Low or Moderate work within the Brief Pathway with a<br />
Family Support Specialist for 3‐6 months. Those who score High or Very High work within the Intensive Pathway for up to 12 months, also with a Family<br />
Support Specialist.<br />
* These Triple P client numbers are estimates only, and are likely an undercount, as these data do not include clients from program levels that do not<br />
collect CCDs, and also exclude clients who did not consent to have their assessment data included in this evaluation.<br />
Outcome Objective: Families receive referrals, initial assessments, and assigned<br />
services<br />
Program Objectives <strong>2010</strong>‐20<strong>11</strong><br />
At least 280 new families will be referred from Family and Children’s Services to<br />
Families Together.<br />
75% of these new families referred to Families Together (who were successfully<br />
contacted) will agree to an initial meeting.<br />
86 FIRST 5 SANTA CRUZ COUNTY<br />
188*<br />
88.6%<br />
N=123<br />
At least 150 primary caregivers will participate in Families Together. 137 primary caregivers<br />
95% of families participating in Families Together will receive an initial<br />
Structured Decision Making: Family Prevention Services Screening Tool<br />
(SDM:FPSST) risk assessment.<br />
99.2%<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>; Families Together Referral and Initial Engagement Form, 20<strong>11</strong> and <strong>Annual</strong> Progress<br />
<strong>Report</strong>, 20<strong>11</strong>.<br />
* This number refers to participant referrals, not unique participants. If the same participant was referred more than once, each referral is tracked<br />
separately. Due to the complicated nature of tracking the ever‐changing status of each referral, this number represents the best estimate of the total<br />
number of referrals.<br />
N=132
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Figure 71: Case Flow Diagram (<strong>2010</strong>-<strong>11</strong>)<br />
Contact<br />
and<br />
meeting<br />
plans still<br />
in progress<br />
29<br />
FIRST 5 SANTA CRUZ COUNTY<br />
Contact ended:<br />
Unable to contact<br />
(68.7%),<br />
Declined to meet<br />
(26.4%),<br />
Case reopened in CWS<br />
(4.2%), or<br />
Ineligible for services<br />
(0.7%)<br />
Referral Closed<br />
69<br />
Cases Referred to Families Together (FT): 188*<br />
Contact ended:<br />
Did not show up to<br />
meeting<br />
(4.5%), or<br />
Met but declined to<br />
participate (95.5%)<br />
Referral Closed<br />
<strong>11</strong><br />
STRONG FAMILIES – FAMILIES TOGETHER<br />
Contacted and initial meeting scheduled<br />
90<br />
Consented to participate in FT<br />
OR<br />
Referred to Primeros Pasos**:<br />
Source: Families Together Referral and Initial Engagement Form, 20<strong>11</strong> and <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />
* Numbers in this case flow diagram refer to participant referrals, not unique participants. If the same participant was referred more than once, each<br />
referral is tracked separately. Due to the complicated nature of tracking the ever‐changing status of each referral, these numbers represent the best<br />
estimate of the total number of referrals.<br />
** Primeros Pasos is a companion program to Families Together serving participants with intensive substance abuse issues.<br />
Outcome Objective: Families demonstrate decreased levels of risk<br />
Client Outcome Objective <strong>2010</strong>‐ 20<strong>11</strong><br />
75% of primary caregivers who received intensive services will demonstrate decreased risk 76.5%<br />
Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, <strong>2010</strong>‐<strong>11</strong>.<br />
As seen in the following figure, the Structured Decision Making: Family Prevention Services Screening<br />
Tool used in the Families Together program is helping to show that families reduce their level of risk<br />
while in the Families Together program. In <strong>2010</strong>‐<strong>11</strong>, over 76% of parents were found to have lower<br />
levels of risk at post assessment than at pre assessment.<br />
79<br />
N=81<br />
87
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – FAMILIES TOGETHER<br />
Figure 72: Percentage of Families Together Participants Who Showed Decreased Risk<br />
of Child Maltreatment<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
81.0%<br />
71.1%<br />
Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, 2006‐<strong>11</strong>.<br />
Although very few families had a “low risk” score at baseline, these families were omitted from these analyses so that only those who could<br />
demonstrate reduced risk on the tool remained in the analysis.<br />
In 2008‐09, this risk assessment included both families receiving intensive services and those receiving brief intervention services. Long‐term clients<br />
were assessed at intake, 6 months, and 12 months, and clients receiving brief interventions were assessed at intake and the end of services.<br />
A second view of these risk assessment data involves a comparison of the percentage of families at<br />
each level of risk over four assessments (baseline, and first, second, and third reassessments). Each<br />
year’s analysis is constrained by fairly small sample sizes. Therefore, several years of data have been<br />
aggregated in order to present a more robust portrait of the extent to which Families Together<br />
participants are reducing their risk for future involvement with the child welfare system.<br />
60.6%<br />
63.0%<br />
As can be seen in the figure, 62% of families were assessed as being high risk or very high risk upon<br />
intake, and this dropped to 13% by the third reassessment, indicating that the program is helping<br />
families reduce their level of risk.<br />
Figure 73: Change in Families Together Participant’s Risk Levels Over Time,<br />
2007 - 20<strong>11</strong><br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
2006‐2007<br />
(N = 42)<br />
44.7%<br />
38.4%<br />
Baseline*<br />
(N = 237)<br />
16.9%<br />
2007‐2008<br />
(N = 45)<br />
28.1%<br />
49.7%<br />
20.0%<br />
1st Reassessment<br />
(N = 185)<br />
2.2%<br />
2008‐2009<br />
(N = 66)<br />
29.4%<br />
51.5%<br />
14.7%<br />
2009‐<strong>2010</strong><br />
(N = 128)<br />
26.7%<br />
60.0%<br />
76.5%<br />
<strong>2010</strong>‐20<strong>11</strong><br />
(N = 81)<br />
13.3%<br />
Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, 2007‐20<strong>11</strong>.<br />
* Although very few families had a “low risk” score at baseline, these families were omitted from these analyses so that only those who could<br />
demonstrate reduced risk on the tool remained in the analysis.<br />
Note: Due to inaccuracies in data entry in 2006‐07, clients with baseline assessments before 7/1/07 were omitted from this analysis.<br />
88 FIRST 5 SANTA CRUZ COUNTY<br />
4.4%<br />
2nd Reassessment<br />
(N = 68)<br />
0.0%<br />
3rd Reassessment<br />
(N=15)<br />
Low Risk<br />
Moderate Risk<br />
High Risk<br />
Very High Risk
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – FAMILIES TOGETHER<br />
Outcome Objective: Families are less likely to experience recurrence of abuse<br />
Client Outcome Objective <strong>2010</strong><br />
Of families who participated in the Differential Response program, at least 95%<br />
of families will not have a substantiated allegation of child maltreatment within<br />
6 months of case closure.<br />
96.3%<br />
Source: <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Human Services Department, Planning and <strong>Evaluation</strong> Unit. Staff analysis of CWS/CMS data, September 20<strong>11</strong>.<br />
Note: Data are from the <strong>2010</strong> calendar year, in order to allow at least a 6 month period after case closure.<br />
Results show that families who participated in the Differential Response program are less likely to<br />
experience recurrence of abuse.<br />
� Of the 82 families who received services from Families Together and had their cases closed in<br />
the <strong>2010</strong> calendar year, 96% had no substantiated allegations of maltreatment within six<br />
months after case closure. This figure is comparable to what was observed in the previous<br />
two years.<br />
Figure 74: Percentage of Families Together Participants Who Do Not Have a<br />
Substantiated Allegation of Maltreatment Within 6 Months After Case<br />
Closure<br />
100%<br />
90%<br />
80%<br />
95.1%<br />
92.0%<br />
Source: <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Human Services Department, staff analysis of CWS/CMS data.<br />
Note: Data are from each respective calendar year, in order to allow at least a 6 month period after case closure.<br />
N: (2008‐09) N=61, (2009‐10) N=74, (<strong>2010</strong>‐<strong>11</strong>) N=82.<br />
Outcome Objective: Children have health insurance and a medical home<br />
Client Outcome Objective <strong>2010</strong>‐ 20<strong>11</strong><br />
98% of children ages 5 and under have health insurance by exit from the<br />
program.<br />
98% of children ages 5 and under will have a medical home by exit from the<br />
program.<br />
96.3%<br />
2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />
N=82<br />
100%<br />
N=<strong>11</strong>4<br />
99.1%<br />
N=<strong>11</strong>3<br />
Source: SUN database, <strong>2010</strong>‐20<strong>11</strong>.<br />
Note: A total of <strong>11</strong>6 children had closed cases, but children in families who left the program prematurely were not included in these analyses.<br />
89
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – FAMILIES TOGETHER<br />
Outcome Objective: Families will have access to parenting support services<br />
structured by the Triple P curriculum<br />
Client Participation in Triple P*<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Parents/Guardians 25<br />
Children (ages 0‐5) 27<br />
(ages 6‐16) 13<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
* These Triple P client numbers are estimates only, and are likely an undercount, as these data do not include clients from program levels that do not<br />
collect CCDs, and also exclude clients who did not consent to have their assessment data included in this evaluation.<br />
Client Satisfaction with Triple P Services<br />
All Families Together parents receiving Triple P services were asked to complete a self‐administered<br />
satisfaction survey upon completing their services. Parents participating in Levels 3 (multi‐session),<br />
4, and 5 of the Triple P Program filled out a Parent Satisfaction Survey with 13 questions using a 7‐<br />
point scale (with 7 indicating highest satisfaction), and 3 open‐ended questions. The average parent<br />
satisfaction ratings ranged from 5.33 to 6.83, on the 7‐point scale. Most parents felt that the<br />
program met their needs, met the needs of their children, offered the help that they needed, and if<br />
they needed help in the future, they would return to Triple P.<br />
Figure 75: Parents’ Satisfaction with Various Aspects of the Triple P Program<br />
1. How would you rate the quality of the service you and your child<br />
received? (N=12)<br />
2. Did you receive the type of help you wanted from the program?<br />
(N=12)<br />
3. To what extent has the program met your child's needs? (N=12)<br />
4. To what extent has the program met your needs? (N=12)<br />
5. How satisfied were you with the amount of help you and your child<br />
received? (N=12)<br />
6. Has the program helped you to deal more effectively with your<br />
child's behavior? (N=12)<br />
7. Has the program helped you to deal more effectively with<br />
problems that arise in your family? (N=12)<br />
8. Do you think your relationship with your partner has been<br />
improved by the program? (N=9)<br />
9. In an overall sense, how satisfied are you with the program you<br />
and your child received? (N=10)<br />
10. If you were to seek help again, would you come back to this<br />
organization? (N=10)<br />
<strong>11</strong>. Has the program helped you to develop skills that can be applied<br />
to other family members? (N=10)<br />
12. In your opinion, how is your child's behavior at this point? (N=10)<br />
13. How would you describe your feelings at this point about your<br />
child's progress? (N=10)<br />
Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />
90 FIRST 5 SANTA CRUZ COUNTY<br />
5.33<br />
6.08<br />
6.08<br />
6.00<br />
6.67<br />
6.58<br />
6.50<br />
6.50<br />
6.50<br />
6.50<br />
1 2 3 4 5 6 7<br />
6.83<br />
6.75<br />
6.80
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P – Positive Parenting Program<br />
Program Description<br />
Triple P (Positive Parenting Program) is a comprehensive, evidence‐based parenting and family<br />
support system designed to increase parents’ confidence and competence in raising children, improve<br />
the quality of parent‐child relationships, and make evidence‐based parenting information and<br />
interventions widely accessible to parents. It is based on a public health model in which an ecological<br />
approach is used. This approach initiates activities at individual, family, community and systemic levels<br />
to provide a comprehensive structure of support.<br />
There are five levels of intervention in Triple P. Level<br />
One practitioner’s story:<br />
1 is intended to reach a broad range of community<br />
members in the <strong>County</strong>, and as the levels increase,<br />
more intensive services are provided:<br />
� Level 1: Universal involves a media‐based<br />
parenting information campaign.<br />
� Level 2: Selected Individual & Seminar<br />
provides information or advice for a<br />
specific parenting concern.<br />
� Level 3: Primary Care offers narrow‐focus<br />
parenting skills training.<br />
� Level 4: Standard & Group includes broad‐<br />
focus parenting skills and training.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
“The main areas that the family focused on came to<br />
the surface pretty quickly, and as we discussed<br />
assertive discipline, avoiding arguments in front of<br />
the children, planned ignoring, quiet time, and time<br />
out, the couple started to properly use the strategies<br />
they learned in the class. It seemed almost like a<br />
natural progression in which discussing the<br />
aforementioned topics led to the parents supporting<br />
each other as they tested them out with their family.<br />
It was amazing how they worked cooperatively to<br />
develop and implement their Planned Activities<br />
Routine. … [One parent] stated in the last session,<br />
‘This program gives you a positive way to<br />
discipline.’”<br />
-Triple P practitioner, <strong>Annual</strong> Progress <strong>Report</strong><br />
� Level 5: Enhanced & Pathways offers<br />
additional interventions for families with risk factors for child abuse or neglect.<br />
Triple P focuses on 17 core parenting skills that are grouped into 4 areas: promoting positive<br />
relationships, encouraging desirable behavior, teaching new skills and behaviors, and managing<br />
misbehavior. It is based on a self‐regulatory framework in which the practitioner provides<br />
information, skills, training, and support based on the parents’ concerns. Parents use self‐evaluation<br />
to set goals and assess progress. While practitioners are helping parents to build confidence and<br />
competence, parents are helping children to build these skills in a parallel process.<br />
Beginning in early <strong>2010</strong>, three local funders (<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Health Services Agency, and<br />
Human Services Department) launched a pilot of the Triple P system in partnership with other<br />
agencies that serve children and families. The pilot phase is expected to last a minimum of two<br />
years. During the pilot phase, Triple P is being implemented incrementally, beginning with Levels 3,<br />
4, and 5 in the first year, and adding Levels 1 and 2 in this second year. The long‐term vision is to<br />
implement every level of Triple P broadly in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> to make parenting information and<br />
support available to all families.<br />
91
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
The following diagram illustrates the design of this program, and the results that have been<br />
achieved towards addressing the program’s incremental levels of parenting support and<br />
information.<br />
Level 5: Enhanced & Pathways<br />
Additional support for families where parenting issues are compounded by parental stress and/or relationship<br />
difficulties, or there is risk for child maltreatment.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Trained and accredited 18 practitioners to provide Level 5 Enhanced services, and 18 for Level 5 Pathways.<br />
� Parents are beginning to receive Level 5 services, and will complete assessments to measure improvement<br />
in their parenting skills and understanding of their children’s behavior.<br />
Level 4: Standard & Group<br />
In-depth training in positive parenting skills.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Families showed significant improvements in:<br />
– style of discipline – confidence in their parenting – levels of conflict over parenting – level of satisfaction with<br />
their relationship – levels of parental depression – stress and anxiety – child behavior<br />
� Parents who had more serious parenting issues made the most meaningful changes in their family life.<br />
� Parents reported high levels of satisfaction with their services.<br />
� Approximately 282 parents/guardians have participated in Level 4 sessions.<br />
� Trained and accredited 38 practitioners to provide Level 4 Group services, and 37 for Level 4 Standard.<br />
Level 3: Primary Care<br />
Consultations about specific parenting concerns.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Families showed significant improvements in children’s behavior, confidence in parenting skills, and support from parenting<br />
partners.<br />
� Parents reported high levels of satisfaction with both Level 3 workshops and individual/group sessions.<br />
� Approximately 336 parents have participated in Level 3 workshops, and 35 in Level 3 Individual/Group sessions.<br />
� Trained and accredited 53 practitioners to provide Level 3 Primary Care services, and 5 with Special Accreditation in Level 3.<br />
Level 2: Selected Individual & Seminar<br />
General information and tips for specific parenting concerns.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Parents reported great satisfaction with Level 2 seminars, particularly noting that they would continue to use the strategies that they learned.<br />
� Approximately 96 parents have participated in Level 2 seminars, and 104 in Level 2 Individual sessions.<br />
� Trained and accredited 20 practitioners to provide Level 2 seminars, and 53 for Level 2 Individual sessions.<br />
Level 1: Universal<br />
Media-based parenting information campaign.<br />
Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners, referral processes, and a master calendar of Triple P Groups,<br />
Workshops, and Seminars.<br />
� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service providers as a means to encourage referrals.<br />
� Publicized Triple P services in print and online editions of newspapers and community calendars.<br />
� Established <strong>First</strong> 5’s main phone number as a “warmline,” publicized in all flyers, emails and media announcements as a central place to locate services.<br />
� Delivered Triple P messages on TV and the radio.<br />
92 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P Highlights<br />
Triple P is a multi‐level system of parenting and family support interventions of varying intensities<br />
and formats. Its population‐based approach to parenting support provides the minimally sufficient<br />
level of care for parents to enable them to independently manage their family issues. This section<br />
provides an overview of how families in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> have been helped to receive the levels of<br />
support that they needed through their participation in Triple P, and highlights some of the key<br />
achievements in each of these levels.<br />
Level 1: Universal<br />
Activities and media strategies for Level 1 of Triple P are providing access to positive parenting<br />
information and destigmatizing the need to get help for parenting issues.<br />
� Accessibility of information. Families are responding to print and radio media,<br />
they are using the updated website to register for parenting classes, they are<br />
calling the “warmline,” and professionals county‐wide are referring families to<br />
the classes they need.<br />
� Encouragement to participate. During this <strong>2010</strong>‐<strong>11</strong> funding cycle, at least 893<br />
parents and 1,518 children have participated in Triple P services.<br />
Client Participation in Triple P<br />
FIRST 5 SANTA CRUZ COUNTY<br />
<strong>2010</strong>‐<strong>11</strong><br />
Parents/Guardians 893<br />
Children (all ages) 1,518<br />
For more information<br />
See “Building a Population‐<br />
Based System of Parent<br />
Education” on page 125.<br />
For more information<br />
See “Population Served” on<br />
page 99.<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>; Triple P program data analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: These Triple P client numbers are estimates, as they may include some duplicates, and also exclude clients who did not consent to have their<br />
assessment data included in this evaluation.<br />
� Satisfaction with services. On average, parents rated the quality of services very<br />
high, noting that they had received the help they wanted, were dealing more<br />
effectively with problems in their family, and would come back to the program if<br />
they needed to seek help again.<br />
Parents’ Satisfaction with Various Aspects of the Triple P Program<br />
How would you rate the quality of the service you and your<br />
child received? (N=198)<br />
Did you receive the type of help you wanted from the<br />
program? (N=196)<br />
Has the program helped you to deal more effectively with<br />
problems that arise in your family? (N=198)<br />
If you were to seek help again, would you come back to this<br />
organization? (N=192)<br />
Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />
For more information<br />
See “Satisfaction with<br />
Services” on page 121.<br />
6.47<br />
6.34<br />
6.40<br />
6.43<br />
1 2 3 4 5 6 7<br />
93
Higher<br />
is<br />
“Better”<br />
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Level 2: Selected Individual & Seminar<br />
Level 2 of Triple P is giving parents an opportunity to be introduced to Triple P and is providing easy<br />
access to general parenting support.<br />
� Gateway to more services. Of parents who participated in seminars and<br />
workshops, 21% requested follow‐up services, suggesting that these brief services<br />
may be an effective way of getting parents initially engaged in the program, and<br />
gives them an opportunity to participate in further services.<br />
� Continued use of the skills they learned. On average, parents felt that the<br />
seminars answered their questions, and that they would continue to use the<br />
strategies they learned.<br />
Seminar/Workshop Satisfaction Survey<br />
Source: Triple P data from the Seminar/Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />
Level 3: Primary Care<br />
Brief consultations about specific parenting concerns are resulting in<br />
increased positive parenting experiences.<br />
� Support for specific parenting challenges. Parents are reporting<br />
increased confidence in parenting, more support from their partners,<br />
less difficulty with their children’s behavior, and increased enjoyment<br />
in their parent/child relationship.<br />
Extremely<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Not at all<br />
The seminar/workshop answered a question or concern I<br />
have had about parenting. (N=254)<br />
I am likely to use some of the parenting strategies in the<br />
tip sheet. (N=253)<br />
Increases in Positive Parenting<br />
For more information<br />
See “Requests for Further<br />
Services” on page 123.<br />
For more information<br />
See “Parents’Satisfaction with<br />
Seminars/Workshops” on<br />
page 122.<br />
For more information<br />
See the improvements parents made in each of<br />
these Level 3 domains:<br />
� “Improved levels of confidence in parenting”<br />
on p. 105.<br />
� “Reduced levels of conflict over parenting”<br />
on p. 108.<br />
� “Increased support in their role as a parent”<br />
on p. <strong>11</strong>1.<br />
� “Increased levels of satisfaction with their<br />
relationship” on p. <strong>11</strong>2.<br />
� “Decreased levels of emotional difficulties”<br />
on p. <strong>11</strong>4.<br />
� “Improvements in child behavior” on p. <strong>11</strong>7.<br />
Source: Triple P data from the Parenting Experience Survey, Question 3, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, under the corresponding<br />
domain in this analysis of the Triple P domains. For Q1‐6, scores range from 1 to 5. For Q7, scores range from 0 to 6. Higher scores indicate more<br />
positive parenting experiences. There are no clinical cut‐offs for this assessment. See page 102 for a description of the sub‐populations and<br />
analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
Lower<br />
is<br />
“Better”<br />
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Level 4: Standard & Group<br />
Through more intensive services, families are receiving in‐depth support for moderate to severe<br />
behavioral and emotional difficulties.<br />
� Increased use of positive discipline styles. There were significant improvements<br />
in parents’ style of discipline, indicating their parenting style became less lax,<br />
less over‐reactive, and less hostile though the course of the Triple P program.<br />
Dysfunctional<br />
Parenting<br />
Higher<br />
is<br />
“Better”<br />
7<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
Functional<br />
Parenting<br />
Parents’ Discipline Styles<br />
3.3<br />
All Parents*<br />
(N=158)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
3.8 3.6 3.8 3.8 3.7 3.9 3.7 3.7<br />
2.7 2.9 3.0 2.9 3.0 2.9 3.0 2.9 3.0<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=86)<br />
Male*<br />
(N=20)<br />
Female*<br />
(N=66)<br />
For more information<br />
See “Increased use of positive<br />
discipline styles” on page 103.<br />
Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />
responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />
sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
� Reduced levels of conflict over parenting. After completing the program, parents<br />
on average indicated that there were significantly fewer parenting and relationship<br />
issues that were problems. However, on average all parent sub‐populations were<br />
still in the clinical range by the post‐assessment.<br />
Number of Parenting Issues That Have Been a Source of Conflict Between Parents<br />
All issues were a<br />
problem<br />
16<br />
Pre Post<br />
Lower<br />
is<br />
“Better”<br />
12<br />
8<br />
4<br />
0<br />
No issues were a<br />
problem<br />
5.5<br />
3.5<br />
All Parents*<br />
(N=105)<br />
9.2<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=52)<br />
7.8<br />
5.7 5.2<br />
Male*<br />
(N=18)<br />
10.0 9.6 9.0<br />
Source: Triple P data from the Parent Problem Checklist, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Parent Problem Checklist measures the number of issues that have been a PROBLEM for parents, and the EXTENT of the problem for<br />
each issue. Scores for the PROBLEM subscale range from 0 (no issues were a problem) to 16 (all issues were a problem). Scores for the EXTENT<br />
subscale range from 16 (Not at all a problem) to <strong>11</strong>2 (Very much a problem). There is no clinical cut‐off for this subscale. See page 102 for a<br />
description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
� Decreased levels of emotional difficulties. The following figures indicate that on<br />
average, all sub‐populations (except Males) made significant improvement in<br />
lowering their level of depression, and all sub‐populations significantly improved<br />
their level of stress. On average they began the program within the Severe range,<br />
and ended out of a range of concern.<br />
Extremely severe<br />
distress<br />
42<br />
Lower<br />
is<br />
“Better”<br />
35<br />
28<br />
21<br />
14<br />
7<br />
0<br />
No distress<br />
Extremely severe<br />
distress<br />
42<br />
Lower<br />
is<br />
“Better”<br />
35<br />
28<br />
21<br />
14<br />
7<br />
0<br />
No distress<br />
Level of Parental Depression and Stress<br />
9.7<br />
5.8<br />
All Parents*<br />
(N=176)<br />
12.9<br />
7.8<br />
All Parents*<br />
(N=175)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
24.0<br />
10.8<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=48)<br />
21.3<br />
14.0<br />
Depression<br />
24.9 24.6 23.0 24.6 22.7 24.4<br />
9.8<br />
Male (N=12) Female*<br />
(N=36)<br />
Pre Post<br />
Stress<br />
For more information<br />
See “Decreased levels of<br />
emotional difficulties” on<br />
page <strong>11</strong>4.<br />
Source: Triple P data from the Depression, Anxiety, and Stress Scale – Short Version (DASS‐21), collected and analyzed by Applied Survey Research,<br />
Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Depression, Anxiety, and Stress Scale – Short Version (DASS‐21) measures distress along 3 scales: Depression, Anxiety, Stress. Scores for<br />
each scale are calculated by summing the participants’ responses for each of the 21 items. Higher scores on each of the scales indicate greater<br />
levels of depression, anxiety, and stress. Each scale has different clinical cut‐offs for the 5 severity levels: normal, mild, moderate, severe, and<br />
extremely severe. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=28<br />
Severe >= 21<br />
Moderate >=14<br />
Clinical Cut‐offs:<br />
Very Severe >=34<br />
Severe >=26<br />
Moderate >=19
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
� Improvements in child behavior. In Triple P, the parent is considered the agent of<br />
change to bring about improvements in the parent‐child relationship. Therefore, how<br />
parents view their children’s behavior is an important assessment of the relationship.<br />
For all sub‐populations, there was a significant reduction in the number of child<br />
behaviors that were perceived to be a problem. On average, most parents began with scores<br />
within the clinical range, and ended with scores that were out of the clinical range.<br />
All behaviors were<br />
a problem<br />
36<br />
Lower<br />
is<br />
“Better”<br />
30<br />
24<br />
18<br />
12<br />
6<br />
0<br />
No behaviors<br />
were a problem<br />
Number of Child Behaviors Perceived to Be a Problem<br />
15.0<br />
8.2<br />
All Parents*<br />
(N=129)<br />
23.0<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=62)<br />
20.4<br />
Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />
which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always<br />
occurs), and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater<br />
likelihood that these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=15<br />
For more information<br />
See “Child Welfare Study” on<br />
page 120.
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Population Served<br />
The total number of clients who participated in Triple P is comprised of three groups: clients who<br />
participated in individual or group sessions AND who consented to have their assessment data<br />
anonymously included in this evaluation (who consequently provided enough information to create a<br />
Unique ID), those who participated in seminars or workshops where no names or personal information<br />
were collected, and those who did NOT consent to participate in the evaluation of Triple P.<br />
Source: (Consenting clients ) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>; (Seminar & Workshop clients & Non‐Consenting clients) Triple P<br />
program data analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
* Includes parents and children for whom enough personal information was collected to be able to create a Unique ID. This includes parents participating<br />
in Levels 2 (Individual), and parents and children participating in Levels 3 (Primary Care), 4, and 5.<br />
**Includes parents and children in all Triple P program levels where no names or personal information were collected (such as seminars and workshops),<br />
and the children of parents who participated in Level 2 Individual sessions (where only parents had personal information collected).<br />
*** In addition to these totals, 5 parents/guardians and <strong>11</strong> children participated in individual or group sessions who did not have complete information,<br />
and therefore it is not known if they duplicate any of the clients recorded in the SUN database/CCD data.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Clients Participating in Individual or Group Sessions – Unique IDs Created*<br />
Parents/Guardians 437<br />
AGES<br />
0 – 5<br />
AGES<br />
6 – 12<br />
AGES<br />
13 – 16<br />
AGES<br />
17+<br />
Children 324 191 60 27 602<br />
Clients Participating in Seminars & Workshops – No IDs**<br />
Parents/Guardians 432<br />
Children (all ages) 864<br />
Clients Participating in Individual or Group Sessions – Did Not Consent to<br />
Participate in <strong>Evaluation</strong><br />
Parents/Guardians 24<br />
Children (all ages) 52<br />
TOTAL***<br />
Parents/Guardians 893<br />
Children (all ages) 1,518<br />
99
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
The following chart shows the approximate percentage of parents/guardians who participated in<br />
each level of Triple P.<br />
Figure 76: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>-<strong>11</strong>)<br />
32.5%<br />
1.7%<br />
<strong>11</strong>.1%<br />
12.0%<br />
Multiple Levels*<br />
4.0%<br />
38.7%<br />
Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Notes: These are estimated percentages, as the data may include duplicated clients from program levels that do not collect CCDs, and also exclude<br />
clients who did not consent to have their assessment data included in this evaluation.<br />
* The number of parents participating in multiple levels of service is probably an undercount. Exact participation data are only available for levels of<br />
services where parents provided enough personal information to be able to create a Unique ID (Level 2 Individual, Level 3 Primary Care, and Level 4).<br />
Parents who participated in seminars and workshops did not provide enough personal information to be able to create a Unique ID, so it was not<br />
possible to track whether they also participated in additional levels of service.<br />
N=868 (see notes, above).<br />
Level 3 & 4 Participant Details<br />
In fiscal year <strong>2010</strong>‐<strong>11</strong>, parents participating in Levels 3 or 4 were asked some basic information<br />
about their involvement in Triple P.<br />
� The top three ways that parents participating in Level 3 or 4 Triple P services had heard<br />
about the program were: Referred by another agency (28%), Flyer or brochure about Triple P<br />
services (<strong>11</strong>%), and Friend or relative (<strong>11</strong>%).<br />
� Approximately 42% were participating with another adult.<br />
� When parents filled out these assessments, they were asked to choose one child in their family<br />
(“Index Child”), and complete the assessments keeping just that one child in mind. Almost half<br />
(47%) of Index Children were between 0‐5 years of age, and 44% were between ages 6‐12.<br />
� Almost one quarter of parents participating in Level 3 and 4 services (24%) needed<br />
assistance filling out these assessments (e.g., having the questions read to them).<br />
Figure 77: How Participants <strong>First</strong> Heard about Triple P (<strong>2010</strong>-<strong>11</strong>)<br />
37.8%<br />
2.0%<br />
3.1%<br />
3.1%<br />
5.1%<br />
10.7%<br />
27.6%<br />
10.7%<br />
Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: Level 3 and Level 4 participants only.<br />
N=196.<br />
Level 2 Seminar<br />
Level 2 Individual<br />
Level 3 Workshop<br />
Level 3 Primary Care<br />
Level 4<br />
Referred by other agency<br />
Flyer or brochure about Triple P services<br />
Friend or relative<br />
100 FIRST 5 SANTA CRUZ COUNTY<br />
School<br />
Child care or preschool provider<br />
Doctor's office<br />
Advertisement<br />
Other
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Figure 78: Percentage of Parents Participating with Another Adult (<strong>2010</strong>-<strong>11</strong>)<br />
Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: Level 3 and Level 4 participants only.<br />
N=201.<br />
Figure 79: Ages of Children Chosen as the “Index” Child* (<strong>2010</strong>-<strong>11</strong>)<br />
43.8%<br />
Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: Level 3 and Level 4 participants only.<br />
* When parents filled out these assessments, they were asked to choose one child in their family (“Index Child”), and complete the assessments<br />
keeping just that one child in mind.<br />
N=379.<br />
Figure 80: Percentage of Parents Who Needed Assistance to Complete the<br />
Assessments (<strong>2010</strong>-<strong>11</strong>)<br />
Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: Level 3 and Level 4 participants only.<br />
N=132.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
No<br />
57.7%<br />
7.7% 1.3%<br />
No<br />
75.8%<br />
Yes<br />
42.3%<br />
Yes<br />
24.2%<br />
47.2%<br />
Ages 0‐5<br />
Ages 6‐12<br />
Ages 13‐16<br />
Ages 17+<br />
101
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P Domains and the Collection of Assessment Data<br />
Parents who participated in levels 3 and 4 of the Triple P program completed assessments that<br />
measured their levels of parenting skills and knowledge along several domains. These domains<br />
identify key parenting issues, such that improvements in these areas generally result in<br />
improvements in overall family life.<br />
These domains include:<br />
� Increased use of positive discipline styles<br />
� Improved levels of confidence in parenting<br />
� Reduced levels of conflict over parenting<br />
� Increased support in their role as a parent<br />
� Increased levels of satisfaction with their relationship<br />
� Decreased levels of emotional difficulties<br />
� Improvements in child behavior<br />
Parents participating in Triple P services began to complete their first assessments in January <strong>2010</strong>,<br />
so by the time of the 2009‐10 fiscal year evaluation, the amount of assessment data was still rather<br />
small. Therefore, in this evaluation, the assessment data from both the previous and current fiscal<br />
years (January <strong>2010</strong> – June 20<strong>11</strong>) have been aggregated in order to present a more robust portrait<br />
of the extent to which Triple P participants are developing their parenting skills and knowledge.<br />
Level 3 & 4 Assessments (Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>)<br />
� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />
following assessments (as appropriate to their relationship status and age of the child they<br />
were thinking of while completing the assessments): Eyberg Child Behavior Inventory, Child<br />
Behavior Checklist (Children’s Mental Health clients only), Parenting Scale, Parenting Tasks<br />
Checklist, DASS 21, Relationship Quality Index, and the Parent Problem Checklist. Analyses<br />
were run to see if there was any improvement between pre and post assessments, and if the<br />
amount of improvement was statistically significant.<br />
A first analysis was initially run on all parents combined, but additional analyses were run<br />
only on parents who scored in the clinical range on their pre‐assessments. Of these parents<br />
who began in the clinical range, specific “sub‐populations” were also examined to study the<br />
possible effects of certain circumstances and key demographics. These additional analyses<br />
studied the impact of gender, ethnicity, and language, and looked at parents who were<br />
currently involved in the child welfare system (identified by those receiving services at the<br />
Parents Center). Again, all of these sub‐populations only included parents who scored in the<br />
clinical range at pre‐assessment. Results were not shown for certain sub‐populations if there<br />
were not enough cases in that analysis.<br />
102 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />
Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />
in the Survey corresponds to one of the Triple P domains discussed in this profile of Triple P,<br />
and is evaluated individually under that domain.<br />
For each question in this assessment, a first analysis was initially run on all parents combined,<br />
and additional analyses were run on specific “sub‐populations” that contained enough clients<br />
to analyze separately, which included females, Latinos, and Spanish‐speaking parents.<br />
� “Effect Sizes” were also calculated on many of these analyses. When a result is statistically<br />
significant, it does not necessarily mean that the amount of change was very big. It simply<br />
means that we can be confident that there was a difference. To know if an observed<br />
difference is not only statistically significant but also important or meaningful, an “Effect<br />
Size” is calculated.<br />
Results for these assessments completed by Triple P clients are described under each of the<br />
following domains.<br />
Triple P Domain: Increased use of positive discipline styles<br />
Parents who participated in Level 4 of the Triple P program were asked to complete the Parenting<br />
Scale as a pre and post assessment of their style of discipline, such as being lax, over‐reactive, or<br />
hostile. Scores could range from 1 (positive parenting) to 7 (ineffective parenting), with lower scores<br />
indicating more positive styles of discipline. Analyses were run to see if there was any improvement<br />
between pre and post assessments, and if the amount of improvement was statistically significant. 16<br />
As seen in the figures below, there were significant improvements from pre to post assessment<br />
regarding parents’ style of discipline, indicating their parenting style became less lax, less over‐<br />
reactive, and less hostile though the course of the Triple P program. Key results include:<br />
� When looking at Overall scores on the Parenting Scale,<br />
o On average, all parents combined and all parent sub‐populations that were assessed<br />
began in the clinical range, but by post‐assessment there had been significant<br />
improvement, and on average all parents had achieved positive styles of discipline.<br />
� For the Laxness, Overreactivity, and Hostility subscales,<br />
o All of the parent sub‐populations that were analyzed showed pre‐assessment results in<br />
the clinical range, and all of these sub‐populations had improved significantly out of this<br />
range by the end of the program.<br />
16<br />
For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />
of Assessment Data” on page 102.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
103
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Dysfunctional<br />
Parenting<br />
7<br />
6<br />
Lower 5<br />
is<br />
“Better” 4<br />
3<br />
2<br />
1<br />
Functional<br />
Parenting<br />
Dysfunctional<br />
Parenting<br />
7<br />
6<br />
Lower 5<br />
is<br />
“Better”<br />
4<br />
3<br />
2<br />
1<br />
Functional<br />
Parenting<br />
� “Effect Sizes” were also calculated on these analyses (see page 103).<br />
o An analysis of “Effect Size” showed that on average, all parent sub‐populations<br />
experienced a large magnitude of change, indicating that the observed differences were<br />
not only statistically significant but also meaningful.<br />
o For the Overreactivity and Hostility subscales, there was also an interesting comparison<br />
between “all parents combined” and the parents who began with scores in the clinical<br />
range (“Clinical range at Pre‐test”). On average, effect sizes were much higher for “Clinical<br />
range at Pre‐test” parents, which could be used as evidence that the program has a<br />
stronger impact (benefit) on parents with more serious parenting issues.<br />
Figure 81: Parents’ Use of Positive Discipline Styles<br />
Overall<br />
3.3 3.8 3.6 3.8 3.8 3.7 3.9 3.7 3.7<br />
2.7 2.9 3.0 2.9 3.0 2.9 3.0 2.9 3.0<br />
All Parents*<br />
(N=158)<br />
3.0<br />
2.4<br />
All Parents*<br />
(N=159)<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=86)<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=55)<br />
Male*<br />
(N=20)<br />
Male*<br />
(N=14)<br />
Female*<br />
(N=66)<br />
Female*<br />
(N=41)<br />
Pre Post<br />
Latino*<br />
(N=61)<br />
Laxness Subscale<br />
Pre Post<br />
Latino*<br />
(N=39)<br />
Caucasian*<br />
(N=21)<br />
Caucasian*<br />
(N=13)<br />
Spanish*<br />
(N=44)<br />
Spanish*<br />
(N=28)<br />
English*<br />
(N=37)<br />
English*<br />
(N=25)<br />
Child Welfare<br />
Involved*<br />
(N=30)<br />
Child Welfare<br />
Involved*<br />
(N=24)<br />
104 FIRST 5 SANTA CRUZ COUNTY<br />
Clinical Cut‐Off:***<br />
>= 3.2<br />
4.2 3.9<br />
4.4 4.3<br />
4.0<br />
4.4<br />
4.1<br />
4.3<br />
Clinical Cut‐Off:***<br />
Female<br />
>= 3.6<br />
Male<br />
2.9 2.8 2.9 2.9 2.7 2.9 2.9 3.1 >= 3.4
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Dysfunctional<br />
Parenting<br />
7<br />
Lower<br />
is<br />
“Better”<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
Functional<br />
Parenting<br />
Dysfunctional<br />
Parenting<br />
7<br />
6<br />
Lower 5<br />
is 4<br />
“Better”<br />
3<br />
2<br />
1<br />
Functional<br />
Parenting<br />
3.2<br />
2.8<br />
All Parents*<br />
(N=158)<br />
1.8 1.5<br />
All Parents*<br />
(N=160)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
4.8<br />
3.6<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=43)<br />
5.1<br />
Overreactivity Subscale<br />
Hostility Subscale<br />
Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />
responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />
sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p= 4.0<br />
105<br />
Male<br />
>= 3.9<br />
Clinical Cut‐Off:***<br />
Male<br />
>= 3.5<br />
Female<br />
>= 2.4
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
last 6 weeks, how confident have you felt to undertake your responsibilities as a parent?” For<br />
this question, scores could range from 1 to 5, with higher scores indicating more positive<br />
parenting experiences.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 17<br />
As seen in the figures below, after parents participated in the program, they indicated having more<br />
confidence in their abilities to manage their children in difficult situations and more confidence in<br />
their abilities to handle difficult child behaviors. Key results include:<br />
� For the Parenting Tasks Checklist “Setting Self‐Efficacy” subscale,<br />
o Every parent sub‐population began in the clinical range, but almost all had improved<br />
significantly out of the clinical range by the end of the program.<br />
o For parents who were “Child Welfare involved,” on average they were still in the clinical<br />
range by the post‐assessment, but there was still significant improvement in their scores.<br />
� Similarly, for the Parenting Tasks Checklist “Behavioral Self‐Efficacy” subscale,<br />
o Every parent sub‐population began in the clinical range, but almost all had improved<br />
significantly out of the clinical range by the end of the program.<br />
o On average, parents who were male, or who were “Child Welfare involved,” were still in<br />
the clinical range by the post‐assessment, but for both of these sub‐populations there was<br />
still significant improvement in their scores.<br />
� For the Parenting Experience Survey, Question 3,<br />
o On average, all parents had significant increases in their confidence to undertake their<br />
responsibilities as a parent.<br />
o Female, Latino, and Spanish‐speaking sub‐populations also had significant increases in<br />
confidence in their parenting.<br />
� “Effect Sizes” were also calculated on these analyses (see page 103).<br />
o An analysis of “Effect Size” showed that on average, all parents combined, and all parent<br />
sub‐populations, experienced a large magnitude of change, indicating that the observed<br />
differences were not only statistically significant but also meaningful.<br />
17<br />
For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />
of Assessment Data” on page 102.<br />
106 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Higher<br />
is<br />
“Better”<br />
Higher<br />
is<br />
“Better”<br />
Higher<br />
is<br />
“Better”<br />
Figure 82: Level of Parent Confidence<br />
Certain I can<br />
do it<br />
100<br />
80<br />
60<br />
40<br />
20<br />
0<br />
Certain I can't<br />
do it<br />
Certain I can<br />
do it<br />
100<br />
80<br />
60<br />
40<br />
20<br />
0<br />
Certain I can't<br />
do it<br />
90.2<br />
83.9<br />
All Parents*<br />
(N=176)<br />
84.9<br />
74.0<br />
All Parents*<br />
(N=176)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
Setting Self‐Efficacy<br />
81.2 82.6 83.0 84.4<br />
59.4 58.8 58.1 57.1<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=42)<br />
Male** Female*<br />
(N=34)<br />
Pre Post<br />
Latino*<br />
(N=33)<br />
Behavioral Self‐Efficacy<br />
Caucasian** Spanish*<br />
(N=28)<br />
Source: Triple P data from the Parenting Tasks Checklist, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Parenting Tasks Checklist measures confidence ratings in two factors: setting self‐efficacy and behavioral self‐efficacy. Each factor is<br />
comprised of 14 questions. Scores are calculated as the average of these 14 questions (unanswered questions are excluded). Higher scores indicate a<br />
greater degree of parenting confidence. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P Domain: Reduced levels of conflict over parenting<br />
This domain was measured using two different assessments:<br />
� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />
Parent Problem Checklist as a way to gauge changes in the level of conflict in their<br />
relationships due to parenting disagreements. In this scale, parents were given a range of<br />
parenting and relationship issues and asked to identify whether or not each issue was a<br />
problem for them, and the extent of the problem. Higher scores indicated a greater degree of<br />
conflict in the relationship.<br />
� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />
Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />
in the Survey is analyzed separately, and for this domain, two questions were analyzed:<br />
Questions 5 (“To what extent do you both agree over methods of disciplining your child?”)<br />
and 6 (“How supportive has your partner been towards you in your role as a parent over the<br />
last 6 weeks?”). For these questions, scores could range from 1 to 5, with higher scores<br />
indicating more positive parenting experiences.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 18<br />
After completing the program, parents on average indicated that fewer parenting and relationship<br />
issues were actually problems. These data from parents also indicated a decrease in the extent to<br />
which those issues were actually viewed as problems.<br />
Key results include:<br />
� For the Parent Problem Checklist “Number of Problems” subscale,<br />
o On average, for all parents combined and all parent sub‐populations studied, by the end<br />
of the program there were significant reductions in the number of problems reported.<br />
o On average, however, all parent sub‐populations were still in the clinical range by the<br />
post‐assessment.<br />
� For the Parent Problem Checklist “Extent of Problems” subscale,<br />
o On average, for all parents combined and all parent sub‐populations studied, the extent of<br />
the problems was reduced by the end of the program.<br />
o This reduction of intensity was only statistically significant for certain populations: all<br />
parents combined, parents who scored in the clinical range at pre‐assessment, females,<br />
Latinos, and Spanish‐speaking parents.<br />
18<br />
For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />
of Assessment Data” on page 102.<br />
108 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
� For the Parenting Experience Survey, Questions 5 and 6,<br />
o Although there was improvement in the extent to which both parents agreed over<br />
methods of disciplining their child, the amount of improvement was not statistically<br />
significant.<br />
o On average, there was significant improvement in the amount of support showed by the<br />
partners for all parents combined, Latinos, and Spanish‐speaking parents.<br />
� “Effect Sizes” were also calculated on these analyses (see page 103).<br />
All issues were a<br />
problem<br />
16<br />
Lower<br />
is<br />
“Better”<br />
o An analysis of “Effect Size” on the improvements made in the Number of Problems<br />
showed that on average, all parents combined, and all parent sub‐populations,<br />
experienced a large magnitude of change, indicating that the observed differences were<br />
not only statistically significant but also meaningful.<br />
o An analysis of “Effect Size” on the improvements made in the Extent of Problems showed<br />
that on average, almost all parent sub‐populations experienced a large magnitude of<br />
change. The Male sub‐population showed only a small effect size, and the English sub‐<br />
population showed a moderate magnitude of change.<br />
o For the Extent of Problems subscale, there was also an interesting comparison between<br />
“all parents combined” and the parents who began with scores in the clinical range<br />
(“Clinical range at Pre‐test”). On average, effect sizes were much higher for “Clinical range<br />
at Pre‐test” parents, which could be used as evidence that the program has a stronger<br />
impact (benefit) on parents with more serious parenting issues.<br />
o Question 5 (“agreement over discipline method”) of the Parenting Experience Survey<br />
showed a moderate magnitude of change, and Question 6 (“support from partner”)<br />
showed a large magnitude of change for all parents and parent sub‐populations.<br />
Figure 83: Levels of Conflict Over Parenting<br />
12<br />
8<br />
4<br />
0<br />
No issues were a<br />
problem<br />
5.5<br />
3.5<br />
All Parents*<br />
(N=105)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
9.2<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=52)<br />
7.8<br />
5.7 5.2<br />
Male*<br />
(N=18)<br />
Number of Problems<br />
10.0 9.6 9.0<br />
Female*<br />
(N=34)<br />
Pre Post<br />
5.9 5.2<br />
Latino*<br />
(N=33)<br />
6.7<br />
Caucasian*<br />
(N=17)<br />
9.8<br />
Spanish*<br />
(N=26)<br />
8.7<br />
5.6 5.7<br />
English*<br />
(N=26)<br />
9.3<br />
7.0<br />
Child<br />
Welfare<br />
Involved*<br />
(N=20)<br />
109<br />
Clinical<br />
Cut‐Off:<br />
>5
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Very much a<br />
problem<br />
<strong>11</strong>2<br />
96<br />
Lower 80<br />
is<br />
“Better” 64<br />
48<br />
32<br />
16<br />
Not at all a<br />
problem<br />
Higher<br />
is<br />
“Better”<br />
Higher<br />
is<br />
“Better”<br />
Extent of Problems<br />
50.5<br />
54.9 52.1 54.0<br />
48.8<br />
39.1<br />
41.8<br />
46.1<br />
31.7 38.3 37.7 38.6 37.2 38.7 39.1 37.4<br />
All Parents*<br />
(N=85)<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=45)<br />
Male (N=15) Female*<br />
(N=30)<br />
Pre Post<br />
Latino*<br />
(N=31)<br />
Caucasian<br />
(N=12)<br />
Spanish*<br />
(N=25)<br />
Source: Triple P data from the Parent Problem Checklist, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Parent Problem Checklist measures the number of issues that have been a PROBLEM for parents, and the EXTENT of the problem for each<br />
issue. Scores for the PROBLEM subscale range from 0 (no issues were a problem) to 16 (all issues were a problem). Scores for the EXTENT subscale<br />
range from 16 (Not at all a problem) to <strong>11</strong>2 (Very much a problem). There is no clinical cut‐off for this subscale. See page 102 for a description of the<br />
sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
Higher<br />
is<br />
“Better”<br />
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P Domain: Increased support in their role as a parent<br />
Parents who participated in Level 3 of the Triple P program were asked to complete the Parenting<br />
Experience Survey as a measure of issues related to being a parent. Each question in the Survey is<br />
analyzed separately, and for this domain, Question 4 was analyzed (“How supported have you felt in<br />
your role as a parent over the last 6 weeks?”). For this question, scores could range from 1 to 5, with<br />
higher scores indicating more positive parenting experiences.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 19<br />
Key results include:<br />
� After completing the program, on average, there was significant improvement in the amount<br />
of support felt by all parents combined and all sub‐populations (Females, Latinos, and<br />
Spanish‐speaking parents).<br />
� “Effect Sizes” were also calculated on this analysis (see page 103), which showed that on<br />
average, all parents combined, and all parent sub‐populations, experienced a large<br />
magnitude of change, indicating that the observed differences were not only statistically<br />
significant but also meaningful.<br />
Extremely<br />
5<br />
Figure 84: Feelings of Support in Their Role as a Parent<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Not at all<br />
Source: Triple P data from the Parenting Experience Survey, Question 4, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, under the corresponding<br />
domain in this Triple P analysis. For Q1‐6, scores range from 1 to 5. For Q7, scores range from 0 to 6. Higher scores indicate more positive parenting<br />
experiences. There are no clinical cut‐offs for this assessment. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P Domain: Increased levels of satisfaction with their relationship<br />
As parents learn new ways of interacting with their children, Triple P has found that conflicts<br />
between partners regarding parenting decrease, and consequently, partners’ satisfaction with their<br />
relationship increases. Two different assessments were used to assess parents’ satisfaction with<br />
their relationship:<br />
� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />
Relationship Quality Index. For this assessment, scores are calculated by summing all six<br />
questions. Scores range from 6 (Very unsatisfied with relationship) to 45 (Very satisfied), with<br />
higher scores indicating higher satisfaction with their relationship.<br />
� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />
Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />
in the Survey is analyzed separately, and for this domain, Question 7 was analyzed, “In an<br />
overall sense, how happy do you consider your relationship with your partner to be?” For this<br />
question, scores could range from 0 to 6, with higher scores indicating more positive<br />
parenting experiences.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 20<br />
As seen in the figures below, parents reported improved satisfaction in the relationship with their<br />
partners. Key results include:<br />
� For the Relationship Quality Index,<br />
o On average, for all parents combined and all sub‐populations (except Caucasians), there<br />
was significant improvement in their amount of satisfaction with their relationship by the<br />
end of the program.<br />
o However, all sub‐populations were still in the clinical range by the post‐assessment.<br />
� For the Parenting Experience Survey, Question 7,<br />
o Although there was improvement in how happy they were with their relationship, the<br />
amount of improvement was not statistically significant.<br />
� “Effect Sizes” were also calculated on these analyses (see page 103).<br />
o For the Relationship Quality Index:<br />
� An analysis of “Effect Size” on the improvements made showed that on average, all<br />
parent sub‐populations experienced a large magnitude of change, indicating that the<br />
observed differences were not only statistically significant but also meaningful.<br />
� There was also an interesting comparison between “all parents combined” and the<br />
parents who began with scores in the clinical range (“Clinical range at Pre‐test”). On<br />
average, effect sizes were much higher for “Clinical range at Pre‐test” parents, which<br />
could be used as evidence that the program has a stronger impact (benefit) on<br />
parents with more serious parenting issues.<br />
o Question 7 of the Parenting Experience Survey showed moderate magnitudes of change.<br />
20<br />
For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />
of Assessment Data” on page 102.<br />
<strong>11</strong>2 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Very satisfied<br />
with relationship<br />
45<br />
Higher<br />
is<br />
“Better”<br />
10<br />
6 5<br />
Very unsatisfied<br />
with relationship<br />
Higher<br />
is<br />
“Better”<br />
Figure 85: Level of Parents’ Satisfaction with Their Relationship<br />
40<br />
35<br />
30<br />
25<br />
20<br />
15<br />
33.0<br />
31.3<br />
All Parents*<br />
(N=126)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
Satisfaction with The Relationship<br />
24.5 24.6 24.5 24.2 24.9 25.0 25.2<br />
23.0<br />
18.9 18.9 18.9 18.4 19.3 18.7 19.5 20.0<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=44)<br />
Male*<br />
(N=14)<br />
Female*<br />
(N=30)<br />
Pre Post<br />
Latino*<br />
(N=27)<br />
Caucasian<br />
(N=10)<br />
Spanish*<br />
(N=18)<br />
Source: Triple P data from the Relationship Quality Index, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Relationship Quality Index measures parents’ level of satisfaction with their relationship. Scores are calculated by summing all six questions<br />
in the assessment, with total scores ranging from 6 (Very unsatisfied with relationship) to 45 (Very satisfied). See page 102 for a description of the<br />
sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P Domain: Decreased levels of emotional difficulties<br />
This domain was measured using two different assessments:<br />
� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />
Depression, Anxiety, and Stress Scale – Short Version (DASS‐21), which measures distress in<br />
these three areas. Scores for each of these three scales range from 0 (no distress) to 42<br />
(extremely severe distress), with higher scores indicating greater levels of depression,<br />
anxiety, and stress.<br />
� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />
Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />
in the Survey is analyzed separately, and for this domain, Question 2 was analyzed, “To what<br />
extent do the following statements describe your experience as a parent in the last 6<br />
weeks?” Question 2 contained five statements regarding how rewarding, demanding,<br />
stressful, fulfilling, and depressing parenting was for them, which were averaged to create a<br />
total score for this question. Scores could range from 1 to 5, with higher scores indicating<br />
more positive parenting experiences.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 21<br />
The following figures indicate that parents’ levels of emotional difficulties improved during the<br />
program. Key results include:<br />
� For the DASS‐21 “Depression” subscale,<br />
o All sub‐populations (except Males) made significant improvement in lowering their level<br />
of depression. All began within the Severe range, and ended out of a range of concern.<br />
� For the DASS‐21 “Anxiety” subscale,<br />
o All sub‐populations (except Caucasians) made significant improvement in lowering their<br />
level of anxiety. All began within the Severe or Very Severe range, and ended in the lower<br />
range of Moderate, or out of a range of concern completely.<br />
� For the DASS‐21 “Stress” subscale,<br />
o All sub‐populations made significant improvement in lowering their level of stress. All<br />
began within the Severe range, and ended out of a range of concern.<br />
� For the Parenting Experience Survey, Question 2,<br />
o When all parents were combined, they showed significant improvement in how positively<br />
they described their experience as a parent by the end of the program.<br />
o Parent sub‐populations also made improvements, but they were not statistically<br />
significant.<br />
21<br />
For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />
of Assessment Data” on page 102.<br />
<strong>11</strong>4 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
� “Effect Sizes” were also calculated on these analyses (see page 103).<br />
Extremely severe<br />
distress<br />
42<br />
Lower<br />
is<br />
“Better”<br />
o An analysis of “Effect Size” on the improvements made showed that on average, all parent<br />
sub‐populations experienced a moderate or large magnitude of change, indicating that<br />
the observed differences were not only statistically significant but also meaningful.<br />
o For the Depression and Anxiety subscales, there was also an interesting comparison<br />
between “all parents combined” and the parents who began with scores in the clinical<br />
range (“Clinical range at Pre‐test”). On average, effect sizes were much higher for “Clinical<br />
range at Pre‐test” parents, which could be used as evidence that the program has a<br />
stronger impact (benefit) on parents with more serious parenting issues.<br />
o Question 2 of the Parenting Experience Survey showed large magnitudes of change.<br />
Figure 86: Level of Parents’ Emotional Difficulties<br />
35<br />
28<br />
21<br />
14<br />
7<br />
0<br />
No distress<br />
Extremely severe<br />
distress<br />
42<br />
Lower<br />
is<br />
“Better”<br />
35<br />
28<br />
21<br />
14<br />
7<br />
0<br />
No distress<br />
9.7<br />
5.8<br />
All Parents*<br />
(N=176)<br />
8.4<br />
4.9<br />
All Parents*<br />
(N=176)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
24.0<br />
10.8<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=48)<br />
21.3<br />
14.0<br />
Depression<br />
24.9 24.6 23.0 24.6 22.7 24.4<br />
9.8<br />
Male (N=12) Female*<br />
(N=36)<br />
19.7 21.1 19.3 20.7<br />
9.6<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=63)<br />
<strong>11</strong>.6<br />
Male*<br />
(N=14)<br />
Female*<br />
(N=49)<br />
Pre Post<br />
<strong>11</strong>.3<br />
Latino*<br />
(N=38)<br />
Anxiety<br />
Pre Post<br />
9.0 8.6<br />
Latino*<br />
(N=47)<br />
9.8<br />
Caucasian*<br />
(N=8)<br />
17.1<br />
13.1<br />
Caucasian<br />
(N=14)<br />
<strong>11</strong>.4<br />
Spanish*<br />
(N=31)<br />
21.0<br />
7.4<br />
Spanish*<br />
(N=38)<br />
8.1<br />
English*<br />
(N=14)<br />
17.8<br />
English*<br />
(N=22)<br />
<strong>11</strong>.3<br />
Child<br />
Welfare<br />
Involved*<br />
(N=16)<br />
18.8<br />
<strong>11</strong>.5 <strong>11</strong>.7<br />
Child<br />
Welfare<br />
Involved*<br />
(N=24)<br />
<strong>11</strong>5<br />
Clinical<br />
Cut‐offs:<br />
Very Severe >=28<br />
Severe >= 21<br />
Moderate >=14<br />
Clinical Cut‐offs:<br />
Very Severe >=20<br />
Severe >=15<br />
Moderate >=10
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Extremely severe<br />
distress<br />
42<br />
Lower<br />
is<br />
“Better”<br />
35<br />
28<br />
21<br />
14<br />
7<br />
0<br />
No distress<br />
Extremely positive<br />
5<br />
Higher<br />
is<br />
“Better”<br />
12.9<br />
7.8<br />
All Parents*<br />
(N=175)<br />
Stress<br />
28.8 26.0 29.4 29.7 26.3 29.9 27.5 26.5<br />
12.2<br />
Clinical<br />
Range at<br />
PreTest*<br />
(N=42)<br />
9.0<br />
Male* (N=8) Female*<br />
(N=34)<br />
12.9 <strong>11</strong>.7<br />
Latino*<br />
(N=30)<br />
Source: Triple P data from the Depression, Anxiety, and Stress Scale – Short Version (DASS‐21), collected and analyzed by Applied Survey Research,<br />
Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Depression, Anxiety, and Stress Scale – Short Version (DASS‐21) measures distress along 3 scales: Depression, Anxiety, Stress. Scores for<br />
each scale are calculated by summing the participants’ responses for each of the 21 items. Higher scores on each of the scales indicate greater levels<br />
of depression, anxiety, and stress. Each scale has different clinical cut‐offs for the 5 severity levels: normal, mild, moderate, severe, and extremely<br />
severe. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=26<br />
Moderate >=19
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Triple P Domain: Improvements in child behavior<br />
In Triple P, the parent is considered the agent of change to bring about improvements in the parent‐<br />
child relationship. Therefore, how parents view their children’s behavior is an important assessment<br />
of the relationship. This domain was measured using three different assessments:<br />
� Parents participating in Level 4 of the Triple P Program were asked to complete the Eyberg<br />
Child Behavior Inventory (ECBI), a pre and post assessment of the frequency with which<br />
certain child behaviors occur (Intensity subscale), and the extent to which parents view those<br />
behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never<br />
occurs) to 252 (Always occurs), and Problem scores ranged from 0 (No) to 36 (Yes), with<br />
higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />
these behaviors were a problem to the parent.<br />
� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />
Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />
in the Survey is analyzed separately, and for this domain, Question 1 was analyzed, “In an<br />
overall sense, how difficult has your child’s behavior been over the last 6 weeks?” Scores<br />
could range from 1 to 5, and for this question the scale was reversed so that higher scores<br />
indicated more positive parenting experiences.<br />
� Parents who participated in Level 4 of the Triple P program and who received services from<br />
the Health Services Agency ‐ Children's Mental Health completed the Child Behavior Checklist<br />
which is a screening tool used to assess behavioral and emotional problems in children and<br />
adolescents. It contains about 100 items that can cluster into several syndromes,<br />
competence scales, and codes from the Diagnostic and Statistical Manual of Mental<br />
Disorders, 4th Edition (DSM‐IV). Children are ranked according to the severity of certain<br />
problems, thus percentile rankings show how a child compares to the general population. A<br />
significant improvement in percentile rank indicates a decrease in clinical risk.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 22<br />
As seen in the following figures, after completing the Triple P Program, fewer parents viewed their<br />
children’s behavior as problematic, and parents also reported fewer problematic child behaviors as<br />
actually being a problem for them. Key results include:<br />
� For the ECBI “Intensity” subscale,<br />
o On average, for all parents combined and all parent sub‐populations, there was a<br />
significant reduction in the frequency of potentially problematic child behaviors. On<br />
average, these parents began with scores within the clinical range, and ended with scores<br />
that were out of the clinical range.<br />
22<br />
For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />
of Assessment Data” on page 102.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
<strong>11</strong>7
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Lower<br />
is<br />
“Better”<br />
� For the ECBI “Problem” subscale,<br />
o For all sub‐populations, there was a significant reduction in the number of child behaviors<br />
that were perceived to be a problem. On average, these parents began with scores within<br />
the clinical range, and ended with scores that were out of the clinical range (parents<br />
involved in Child Welfare were within 1/10 th of a point of being out of the clinical range).<br />
� For the Parenting Experience Survey, Question 1,<br />
o On average, for all parents combined and all sub‐populations, there was significant<br />
reduction in how difficult their child’s behavior had been.<br />
� For the Child Behavior Checklist,<br />
o Parents reported significant improvements in their children’s problematic behaviors in<br />
both Internalizing and Externalizing Syndromes, as well as in all Syndromes overall.<br />
o There were significant improvements in two DSM disorders: Anxiety and Oppositional.<br />
o There was a significant improvement in children’s social competence behaviors.<br />
� “Effect Sizes” were also calculated on these analyses (see page 103).<br />
o An analysis of “Effect Size” on all the improvements made showed that on average, all<br />
parents combined and all parent sub‐populations experienced a large magnitude of<br />
change, indicating that the observed differences were not only statistically significant but<br />
also meaningful.<br />
Figure 87: Level of Parental Problems with Child Behavior<br />
Behavior always<br />
occurs<br />
252<br />
216<br />
180<br />
144<br />
108<br />
72<br />
36<br />
Behavior<br />
never occurs<br />
120.6<br />
92.6<br />
All Parents*<br />
(N=144)<br />
Frequency of Potentially Problematic Child Behaviors<br />
164.0 151.3 167.1<br />
Clinical Range<br />
at PreTest*<br />
(N=57)<br />
<strong>11</strong>4.0 <strong>11</strong>8.2 <strong>11</strong>3.0 <strong>11</strong>1.9<br />
Male*<br />
(N=<strong>11</strong>)<br />
Female*<br />
(N=46)<br />
Pre Post<br />
164.8 161.0 164.7 162.3 162.5<br />
Latino*<br />
(N=45)<br />
<strong>11</strong>8 FIRST 5 SANTA CRUZ COUNTY<br />
122.0<br />
Caucasian*<br />
(N=12)<br />
<strong>11</strong>0.6<br />
Spanish*<br />
(N=34)<br />
120.1<br />
English*<br />
(N=21)<br />
129.4<br />
Child Welfare<br />
Involved*<br />
(N=16)<br />
Clinical<br />
Cut‐off:<br />
>=131
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
All behaviors were<br />
a problem<br />
36<br />
Lower<br />
is<br />
“Better”<br />
30<br />
24<br />
18<br />
12<br />
6<br />
0<br />
No behaviors<br />
were a problem<br />
Not at all Difficult<br />
5<br />
Higher<br />
is<br />
“Better”<br />
15.0<br />
8.2<br />
FIRST 5 SANTA CRUZ COUNTY<br />
23.0<br />
Number of Child Behaviors Perceived to Be a Problem<br />
20.4<br />
23.5 24.1<br />
12.6 <strong>11</strong>.9 12.7 13.0<br />
Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />
which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always occurs),<br />
and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />
these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Additional Triple P Studies and Client Data Collection<br />
Child Welfare Study: Possible effects of Triple P participation on future child<br />
welfare allegations<br />
Among families who have experienced child abuse or neglect, participation in the Triple P program<br />
was expected to be associated with lower rates of future child welfare allegations. To examine<br />
whether associations were observed between Triple P participation and improved child welfare<br />
outcomes in these <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> families, outcome data for two groups of parents who entered<br />
(or re‐entered) the child welfare system were compared, including: (1) parents who received the<br />
Triple P intervention; and (2) parents who were enrolled in a model of parenting education offered<br />
prior to the initiation of the Triple P program. Both programs were offered through a local<br />
community‐based organization called the Parents Center.<br />
The following research question was examined:<br />
� To what extent is Triple P participation associated with lower rates of new substantiated<br />
child maltreatment allegations, compared to participants in other parenting programs?<br />
To determine whether participation in Triple P was associated with lower rates of new substantiated<br />
child maltreatment allegations, parents’ child welfare records were examined at two time periods:<br />
within the first six months after their program started and in the period from 6 to 12 months after<br />
beginning the program (as there was a low number of families at the 12 month time period, only the<br />
6 month results are reported at this point). Rates were compared for Triple P participants and<br />
participants in the comparison parenting program.<br />
The following figure shows the rates of new substantiated cases of child maltreatment within the<br />
first six months of parents’ participation in either Triple P or the comparison parenting program.<br />
� After six months, parents in the comparison parenting program were more than three and a<br />
half times more likely than Triple P participants to have had a new substantiated<br />
maltreatment allegation.<br />
Figure 88: Participants with a Substantiated Allegation of Child Maltreatment Occurring<br />
Up to 6 Months after Program Entry<br />
20%<br />
15%<br />
10%<br />
5%<br />
1.4%<br />
0%<br />
Triple P Participants Comparison Group<br />
Source: Applied Survey Research, Triple P – <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Special Exploratory Study to Assess Child Welfare Outcomes, 20<strong>11</strong>.<br />
N: 70 Triple P participants and 137 comparison group participants.<br />
Results suggest that Triple P is associated with reductions in future child abuse and neglect. A re‐<br />
examination of these data at a later date, when more participants have reached the 6‐ and<br />
12‐month time periods, may provide a better measurement of the program’s impact on outcomes<br />
that are themselves fairly low‐frequency events.<br />
120 FIRST 5 SANTA CRUZ COUNTY<br />
5.1%
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Satisfaction with Services<br />
Satisfaction Surveys (Jan. <strong>2010</strong> – June 20<strong>11</strong>)<br />
All parents in the Triple P program (except those attending brief Level 2 Individual sessions) were<br />
asked to complete a self‐administered satisfaction survey upon completing their services.<br />
� Parents participating in Levels 3 (multi‐session) and Levels 4 and 5 of the Triple P Program<br />
filled out a Parent Satisfaction Survey with 13 questions using a 7‐point scale (with 7<br />
indicating highest satisfaction), and 3 open‐ended questions. Key results include:<br />
o Over half (55%) of Triple P parents who responded to the survey indicated that they were<br />
very satisfied with their overall program experience.<br />
o The average parent satisfaction ratings ranged from 5.30 to 6.51, on the 7‐point scale.<br />
Most parents felt that the program met their needs, as well as the needs of their children,<br />
offered the help that they needed, and if they needed help in the future, they would<br />
return to Triple P.<br />
� Parents participating in the Level 2 Seminars and Level 3 Workshops filled out a shorter<br />
Satisfaction Survey with 3 questions using a 5‐point scale (with 1=Disagree, and 5=Agree),<br />
and 1 open‐ended question.<br />
o Almost three‐fourths (72%) of Triple P parents who participated in the seminars and<br />
workshops and who responded to the survey indicated that they were very satisfied with<br />
their overall program experience.<br />
o The average parent satisfaction ratings ranged from 4.53 to 4.74, on the 5‐point scale.<br />
Most parents felt that the program answered their questions, that they would continue to<br />
use the tip sheets, and were very satisfied with the services they received.<br />
Figure 89: Parents’ Satisfaction with the Triple P Program: Levels 3 (Multi-session),<br />
and Levels 4 and 5<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
FIRST 5 SANTA CRUZ COUNTY<br />
Overall Satisfaction, by Response Option<br />
1.4% 0.4% 2.0% 3.1%<br />
16.4%<br />
22.1%<br />
1 2 3 4 5 6 7<br />
Lowest<br />
Satisfaction<br />
Response Options<br />
54.6%<br />
Highest<br />
Satisfaction<br />
Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />
N = 198 respondents with a total of 2,509 responses.<br />
121
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
1. How would you rate the quality of the service you and your<br />
child received? (N=198)<br />
2. Did you receive the type of help you wanted from the<br />
program? (N=196)<br />
3. To what extent has the program met your child's needs?<br />
(N=196)<br />
4. To what extent has the program met your needs? (N=197)<br />
5. How satisfied were you with the amount of help you and your<br />
child received? (N=197)<br />
6. Has the program helped you to deal more effectively with<br />
your child's behavior? (N=198)<br />
7. Has the program helped you to deal more effectively with<br />
problems that arise in your family? (N=198)<br />
8. Do you think your relationship with your partner has been<br />
improved by the program? (N=169)<br />
9. In an overall sense, how satisfied are you with the program<br />
you and your child received? (N=191)<br />
10. If you were to seek help again, would you come back to this<br />
organization? (N=192)<br />
<strong>11</strong>. Has the program helped you to develop skills that can be<br />
applied to other family members? (N=193)<br />
12. In your opinion, how is your child's behavior at this point?<br />
(N=192)<br />
13. How would you describe your feelings at this point about<br />
your child's progress? (N=192)<br />
Average Ratings of Various Program Aspects<br />
Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />
Figure 90: Parents’Satisfaction with the Triple P Seminars/Workshops<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Overall Satisfaction with Seminars/Workshops, by Response Option<br />
0.3% 0.4% 4.7%<br />
Source: Triple P data from the Seminar/Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: 1=Disagree, and 5=Agree.<br />
N = 254 respondents with a total of 760 responses.<br />
122 FIRST 5 SANTA CRUZ COUNTY<br />
5.30<br />
5.91<br />
5.88<br />
6.<strong>11</strong><br />
6.07<br />
6.06<br />
6.47<br />
6.34<br />
6.51<br />
6.40<br />
6.35<br />
6.43<br />
6.33<br />
1 2 3 4 5 6 7<br />
23.0%<br />
1 2 3 4 5<br />
Lowest<br />
Satisfaction<br />
Response Options<br />
71.6%<br />
Highest<br />
Satisfaction
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
1. The seminar/workshop answered a question or concern I have<br />
had about parenting. (N=254)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
Average Ratings of Various Seminar/Workshop Aspects<br />
2. I am likely to use some of the parenting strategies in the tip<br />
sheet. (N=253)<br />
Source: Triple P data from the Seminar/Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />
Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />
Requests for Further Services<br />
During <strong>2010</strong>‐<strong>11</strong>, 12 Level 2 seminars were provided to 96 participants, and 50 Level 3 workshops<br />
were provided to 336 participants. Of these participants, 21% requested follow‐up services,<br />
suggesting that these brief Triple P seminars and workshops help some families find additional<br />
parenting resources, and may be an effective way of giving participants a chance to try out the<br />
Triple program, getting them interested, and giving them an opportunity to participate in further<br />
services.<br />
Follow-Up Survey: Maintenance of parenting knowledge and practices gained<br />
from Triple P<br />
Parents and guardians who completed certain Triple P programs were given the option of voluntarily<br />
participating in a follow‐up phone survey six months later, to help determine the long‐lasting effects of<br />
these programs on their parenting skills and experiences. This survey consisted of 18 questions, some<br />
with multiple parts, that asked about their parenting abilities and effectiveness in dealing with certain<br />
parenting problems, their confidence in their parenting skills, the Triple P strategies that they are<br />
currently using, changes in their child’s behavior, and where applicable, their relationship with and<br />
support from their partner. Participants were also given the option of commenting on their experience<br />
with the program. Parents were assured that the survey was confidential, and that their individual<br />
responses would be kept anonymous and reported as a summary with other data. Participants who<br />
completed the survey were given a $25 gift certificate to Target.<br />
Key results include:<br />
3. Overall I was satisfied with the workshop. (N=253)<br />
� Results showed that around six months after completing Triple P services, parents are<br />
reporting high levels of parenting skills, confidence, and support (measured using questions<br />
from the Parenting Experience Survey).<br />
As more parents complete the Triple P program, it may be possible to compare their “six‐<br />
month follow‐up” parenting skills with similar data collected at the beginning (Pre) and very<br />
end of their services (Post).<br />
123<br />
4.53<br />
4.74<br />
4.68<br />
1 2 3 4 5
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Not at all Difficult<br />
5<br />
Higher<br />
is<br />
“Better”<br />
0<br />
Extremely Difficult<br />
� Additional survey results indicate that six months after their Triple P services, parents feel<br />
highly effective in dealing with their children’s behavior, and report improved child behavior<br />
overall.<br />
Figure 91: Levels of Parenting Difficulty Six Months After Triple P Services<br />
4<br />
3<br />
2<br />
1<br />
3.58<br />
Q1: Child Behavior<br />
Problems (N=26)<br />
4.21 4.23<br />
Q2: Parental<br />
Adjustment (N=26)*<br />
Q3: Parenting<br />
Confidence (N=26)<br />
3.62 3.50<br />
Q4: Parental Support Q5: Partner Support<br />
(N=26) Over Methods of<br />
Discipline (N=18)<br />
Figure 92: Parenting Difficulty Six Months After Triple P Services:<br />
Frequency of Each Response Option<br />
20<br />
15<br />
10<br />
5<br />
0<br />
3<br />
<strong>11</strong><br />
6<br />
4<br />
2 2<br />
1<br />
Q1: Child Behavior<br />
Problems (N=26)<br />
2<br />
9<br />
13<br />
Q2: Parental<br />
Adjustment (N=26)*<br />
1<br />
1<br />
Source: Triple P data from the Parenting Experience Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, and correspond to different<br />
Triple P domains examined in this report section. For Q1‐6, scores range from 1 to 5. Q7 was not asked in the follow‐up survey. Higher scores indicate<br />
more positive parenting experiences. There are no clinical cut‐offs for this assessment.<br />
* Question 2 results are averages of the 5 items in this question.<br />
124 FIRST 5 SANTA CRUZ COUNTY<br />
15<br />
9<br />
Q3: Parenting<br />
Confidence (N=26)<br />
2<br />
3<br />
1 (Extremely a Problem)<br />
3<br />
13<br />
5<br />
Q4: Parental Support<br />
(N=26)<br />
2 (Very Much a Problem)<br />
3 (Moderately A Problem)<br />
4 (Slightly a Problem)<br />
5 (Not At All A Problem)<br />
2<br />
7<br />
7<br />
2<br />
Q5: Partner Support<br />
Over Methods of<br />
Discipline (N=18)<br />
3.83<br />
Q6: Parenting<br />
Support from<br />
Partner (N=18)<br />
3<br />
2<br />
8<br />
5<br />
Q6: Parenting<br />
Support from Partner<br />
(N=18)
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
Building a Population‐Based System of Parent Education<br />
Triple P Practitioners<br />
Between 2009 and June 30, 20<strong>11</strong>, 20 agencies and 4 independent practitioners in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
have been providing Triple P services to clients. Participating agencies were those that provide a<br />
range of services for families, such as mental health counseling, early education, health care, case<br />
management, and support for victims of domestic violence and sexual assault:<br />
� Community Bridges ‐ La Manzana<br />
Community Resources<br />
� Community Bridges ‐ Roots & Wings<br />
� Dominican Hospital ‐ Outreach<br />
� Familia Center<br />
� <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />
� Health Services Agency ‐ Children's<br />
Mental Health<br />
� Health Services Agency ‐ South <strong>County</strong><br />
Clinic<br />
� Human Services Department ‐<br />
Employment & Benefit Services<br />
� Human Services Department ‐ Family<br />
& Children's Services<br />
� MidPeninsula Housing – Services<br />
Corporation<br />
FIRST 5 SANTA CRUZ COUNTY<br />
� Mountain Community Resources<br />
� Optimal Solutions Consulting<br />
� Parents Center<br />
� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />
Families Together<br />
� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />
Head Start<br />
� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />
Youth Services<br />
� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />
Primeros Pasos<br />
� <strong>Santa</strong> <strong>Cruz</strong> Women's Health Center<br />
� Women's Crisis Support ~ Defensa de<br />
Mujeres<br />
� YWCA Watsonville<br />
Agency staff and independent practitioners attended workshops to become trained and accredited<br />
practitioners of the Triple P Program, and many of these practitioners were trained in multiple<br />
levels. Since 2009, a total of 86 practitioners have been accredited to provide Triple P services.<br />
Figure 93: Number of Practitioners Trained and Accredited with Triple P (2009-<strong>11</strong>)<br />
COURSE TYPE<br />
NUMBER OF<br />
TRAINING COURSES<br />
CONDUCTED<br />
TRAINING ACCREDITATION<br />
NUMBER OF<br />
PRACTITIONERS<br />
TRAINED<br />
NUMBER OF<br />
ACCREDITATION<br />
COURSES CONDUCTED<br />
NUMBER OF<br />
PRACTITIONERS<br />
ACCREDITED<br />
L2 Seminars 1 20 1 20<br />
L3 Primary Care 3 58 3 53<br />
L3 Primary Care ‐ Special Accreditation 1 6 (Quiz Only) 5<br />
L4 Group 2 40 2 38<br />
L4 Standard 2 37 2 37<br />
L5 Enhanced 1 18 1 18<br />
L5 Pathways 1 18 1 18<br />
Total Number of Courses <strong>11</strong> 10<br />
Total Number of Practitioners (unduplicated) 94 86<br />
Source: Optimal Solutions Consulting, Triple P Practitioner Training Data, 2009‐20<strong>11</strong>.<br />
125
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Efficacy of Staff Training on Triple P<br />
In addition to offering structured trainings to practitioners, Triple P America also provides measures<br />
to assess the effectiveness of such trainings. The first measure is a Parent Consultation Skills<br />
Checklist (PCSC), an instrument to gauge changes in practitioners’ ability and confidence to conduct<br />
parent consultations. The second instrument is a Workshop <strong>Evaluation</strong> Survey that measures<br />
practitioners’ satisfactions with the trainings. These data are described below.<br />
Changes in self‐efficacy related to parent consultation<br />
The Parent Consultation Skills Checklist (PCSC) was used to measure practitioners’ self‐efficacy, or<br />
perceived competency, in core skills including assessment, active skills training, dealing with process<br />
issues, and clinical application of positive parenting strategies.<br />
Practitioners rated their proficiency on a 7‐point scale (1 = not at all confident or definitely not<br />
adequately trained, 7 = very confident or definitely adequately trained). The questionnaire was<br />
administered prior to beginning training (Pre), immediately after training (Post), and at the end of<br />
accreditation (Follow‐up).<br />
Results indicate that during <strong>2010</strong>‐<strong>11</strong>, participants’ ratings of self‐efficacy increased from pre to post<br />
training across all levels, and improvements were maintained or were higher at follow‐up. The only<br />
exception was a slight decrease in pre‐post ratings of “Adequately Trained in Parent Consultations”<br />
and “Confidence in Conducting Parent Consultations” for the Level 4 Group training, although for<br />
both there was an increase by the time of their follow‐up ratings. The mean ratings for all levels of<br />
trainings and accreditations are summarized below.<br />
Figure 94: Summary of Parent Consultation Skills Checklist Ratings (<strong>2010</strong>-<strong>11</strong>)<br />
ADEQUATELY TRAINED IN<br />
PARENT CONSULTATIONS<br />
CONFIDENCE IN CONDUCTING<br />
PARENT CONSULTATIONS<br />
OVERALL PROFICIENCY IN PARENT<br />
CONSULTATION SKILLS<br />
LEVEL OF TRIPLE P Pre Post Follow‐up Pre Post Follow‐up Pre Post Follow‐up<br />
Level 2 Seminar 5.41 6.35 6.18 5.47 5.82 5.82 5.22 5.91 5.92<br />
Level 3 Primary Care 4.15 5.23 6.00 4.15 4.77 5.69 3.90 4.92 5.68<br />
Level 4 Group 5.93 5.67 6.60 6.00 5.23 6.43 5.59 5.69 6.27<br />
Level 4 Standard 4.23 6.23 6.54 4.00 6.15 6.31 4.69 6.07 6.53<br />
Source: Triple P America and Optimal Solutions Consulting, 20<strong>11</strong>.<br />
Satisfaction with Training<br />
Participants completed a Workshop <strong>Evaluation</strong> Survey at the end of each training and on completion<br />
of the accreditation process. The survey included a 7‐point scale (1 = low, 7 = high) to assess:<br />
� Quality of the training course<br />
� Whether the amount of active participation within the course was appropriate<br />
� Quality of the content of the training<br />
� Whether respondents felt they had the skills to implement the program, and<br />
� Overall satisfaction with the training course<br />
126 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
STRONG FAMILIES – TRIPLE P<br />
On average, participants were highly satisfied with the quality and content of all levels of Triple P<br />
trainings and accreditation workshops, during <strong>2010</strong>‐<strong>11</strong>. The mean ratings for all levels of trainings<br />
and accreditations are summarized in the figure below.<br />
Figure 95: Summary of Training <strong>Evaluation</strong> Survey Ratings (<strong>2010</strong>-<strong>11</strong>)<br />
FIRST 5 SANTA CRUZ COUNTY<br />
QUALITY OF PRESENTATION WORKSHOP CONTENT OVERALL SATISFACTION<br />
LEVEL OF TRIPLE P Training Accreditation Training Accreditation Training Accreditation<br />
Level 2 Seminar 6.32 6.41 6.26 6.59 6.42 6.29<br />
Level 3 Primary Care 6.13 6.23 6.13 6.15 5.73 6.15<br />
Level 4 Group 6.39 6.53 6.28 6.47 6.06 6.<strong>11</strong><br />
Level 4 Standard 6.50 6.56 6.25 6.56 6.44 6.50<br />
Source: Triple P America and Optimal Solutions Consulting, 20<strong>11</strong>.<br />
Alignment of referral, billing, and data sharing processes across the network of<br />
agencies who support Triple P<br />
Referral System<br />
By the end of FY <strong>2010</strong>‐<strong>11</strong>, 86 practitioners (unduplicated count) from 20 agencies and programs had<br />
been accredited to provide Triple P services. As the number of practitioners expanded, <strong>First</strong> 5<br />
implemented the following steps to build and enhance the Triple P referral system:<br />
� Maintained and distributed a contact list indicating which organizations have practitioners<br />
accredited in each Level of Triple P.<br />
� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service<br />
providers as a means to encourage referrals.<br />
� Publicized Triple P services in print and online editions of newspapers and community<br />
calendars.<br />
� Established <strong>First</strong> 5’s main phone number as a “warmline.” This number was publicized in all<br />
flyers, emails and media announcements as a central place to receive assistance locating<br />
Triple P services. <strong>First</strong> 5 staff were trained to conduct a brief screening in order to assess<br />
callers’ needs and make appropriate referrals.<br />
� Developed Triple P business cards containing <strong>First</strong> 5’s warmline and website address, as well<br />
as space for practitioners to insert their own contact information.<br />
� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners,<br />
referral processes, and a master calendar of Triple P Groups, Workshops, and Seminars.<br />
127
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – TRIPLE P<br />
Billing and Funding<br />
<strong>First</strong> 5, Health Services Agency (Children’s Mental Health), and the Human Services Department<br />
established a collaborative system for funding Triple P trainings, parent resources, and services.<br />
� Children’s Mental Health contracted with <strong>First</strong> 5 to implement Prevention and Early<br />
Intervention strategies in the Mental Health Services Act (MHSA) Plan, including the<br />
coordination and implementation of Triple P.<br />
� In FY <strong>2010</strong>‐<strong>11</strong>, the Human Services Department contracted with <strong>First</strong> 5 to provide Triple P<br />
trainings that qualified for partial reimbursement from Federal Title IV‐E training funds. <strong>First</strong><br />
5 provided the required match, enabling the Human Services Department to access $82,226<br />
in Title IV‐E funds. The reimbursement was passed through to <strong>First</strong> 5 to help cover training<br />
costs, which allowed more resources to be directed toward service provision.<br />
� <strong>First</strong> 5 blended its own resources with funds from Children’s Mental Health and the Title IV‐E<br />
reimbursement to contract with Triple P America and organizations providing specific Triple P<br />
services. This blended funding strategy streamlined billing procedures and reporting<br />
requirements, which allowed resources to be used in a more flexible and coordinated manner.<br />
� Agencies that provided mental health services billed Medi‐Cal EPSDT.<br />
� Families in the Child Welfare System received services funded from a contract between the<br />
Human Services Department (HSD) and the Parents Center.<br />
� Individual practitioners billed clients’ private insurance.<br />
� Medical offices are beginning to explore billing health insurance for parent education.<br />
Data Sharing<br />
<strong>First</strong> 5 and Applied Survey Research (ASR) developed evaluation protocols and forms for each level<br />
of Triple P services. Practitioners were trained to obtain parents’ informed consent to participate in<br />
the evaluation of the Triple P program, collect the required intake and assessment data, and submit<br />
the data to ASR on a monthly basis. Specific protocols were established to protect the privacy and<br />
confidentiality of parents participating in Triple P services.<br />
ASR also developed an Excel‐based scoring application that enabled practitioners to enter and<br />
summarize parents’ assessment data quickly and accurately. Practitioners used the assessment data<br />
to help parents set goals for change, then submitted data electronically to ASR (maintaining client<br />
anonymity) for further analysis.<br />
128 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Side-by-Side<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – SIDE‐BY‐SIDE<br />
The Side‐by‐Side: Early Childhood Mental Health Access Program, launched in March <strong>2010</strong>, was<br />
created to address the significant need for early mental health services for families with children<br />
between 0‐5 years of age. The program has expanded early childhood mental health services and<br />
provides intervention services to families who have children showing early signs of social/emotional<br />
difficulty. The program also provides guidance and consultation about social/emotional and mental<br />
health needs of infants and young children to early childhood educators. The program strives to<br />
support the working relationship between families and child care providers/preschool staff.<br />
Parents can elect to receive only “Site‐based” services for their children (i.e., classroom<br />
observations, in‐class intervention, and teacher consultations) or a combination of “Site‐based” and<br />
“Family services” (i.e., classroom observations, in‐class intervention, teacher consultations,<br />
individual/family counseling, and assistance from the Family Resource Specialist, if needed). Since<br />
the Ages & Stages Questionnaires (ASQ) and the Child Behavior Checklist (CBCL) are completed by<br />
parents, only parents who are participating in “Family services” fill out these assessments. For the<br />
children who are receiving “Site‐based” services only, Side‐by‐Side Clinician/Consultants provide<br />
recommendations to teachers and additional follow‐up, as needed.<br />
“The childcare/pre-school staff have told us that our services have been helpful to them. … They report<br />
that the ideas and suggestions we shared with them have improved the children’s social/emotional<br />
functioning in class, and made their jobs more satisfying.”<br />
One family’s story:<br />
“Ryan* began attending this center about a month before [services began], right after having been<br />
expelled from a different center. At the previous center, Ryan had been highly aggressive, very defiant<br />
and argumentative, and quite disruptive. Many of the children were afraid of Ryan, and no one would<br />
play with him. None of the teacher’s interventions helped improve Ryan’s conduct.<br />
Ryan made significant social/emotional gains at the center during the period of time he was<br />
involved with our program. His aggression decreased dramatically. He became much less<br />
argumentative and much more cooperative. Ryan also became able to participate fully in<br />
the classroom activities, and required less time to transition between them. Ryan improved his ability<br />
to express his distress in words rather than demonstrating it in problematic ways through actions. He<br />
also recovers from being upset much more quickly now.<br />
Perhaps more importantly, Ryan has made friends with a few children in class who seek out his<br />
companionship. He also appears much happier, more relaxed, and more playful. At the beginning of<br />
my work at the center, the teachers expressed great concerns that Ryan would not be socially and/or<br />
emotionally ready to attend Kindergarten in the fall. Now, they all feel confident that he will.”<br />
-Side-by-Side, <strong>Annual</strong> Progress <strong>Report</strong><br />
(* Names have been changed)<br />
129
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – SIDE‐BY‐SIDE<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Parents/Guardians 43<br />
SITE‐BASED SERVICES FAMILY SERVICES TOTAL<br />
Children 34 7 41<br />
Source: (Parents/Guardians) Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>; (Children) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
Note: See “Program Description” for a description of “Site‐based” and “Family” services.<br />
Program Development<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Staff/Child Care Providers 67<br />
Classrooms 22<br />
Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />
Outcome Objective: Children participating in “Family Services” will receive<br />
developmental screening and be assessed for behavioral and<br />
emotional problems<br />
90% of the families who participate in the program will complete the ASQ and CBCL.<br />
<strong>2010</strong>‐20<strong>11</strong><br />
ASQ (DEVELOPMENTAL SCREENING) 100%<br />
130 FIRST 5 SANTA CRUZ COUNTY<br />
N=7<br />
CBCL (ASSESSMENT FOR BEHAVIORAL AND EMOTIONAL PROBLEMS) 85.7%<br />
Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />
Note: Results should be interpreted with caution due to the low number of cases.<br />
Families participating in “Family Services” received initial screenings and assessments.<br />
� All families who began receiving “Family‐services” in <strong>2010</strong>‐<strong>11</strong> completed evidence‐based<br />
screenings about their child, using the ASQ.<br />
� Six of the seven families also completed the initial CBCL.<br />
� Family needs assessments were completed with all of the families, and follow‐up assistance<br />
was provided when necessary.<br />
N=7
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – SIDE‐BY‐SIDE<br />
Outcome Objective: Children participating in “Site-based” services will have their<br />
needs evaluated and addressed<br />
For children who participated in “Site‐based” services only, Side‐by‐Side Clinician/Consultants<br />
observed all these children in their classroom settings, and then had consultations with the<br />
childcare/pre‐school staff. The Clinician/Consultants individualized the services they provided,<br />
varying the number of classroom observations and consultations depending on the needs of the<br />
child and the staff.<br />
The recommendations that were provided to the staff tended to fall into the following categories:<br />
� Modifying the classroom structure, routine, and ambiance.<br />
� Changing the staff’s expectations of the child.<br />
� Altering the staff’s communication and interaction style with the child.<br />
� Implementing various strategies to address classroom challenges such as: defiance,<br />
aggression, disruptiveness, angry outbursts, argumentativeness, cursing, intimidation, and<br />
tantrums.<br />
The Clinician/Consultants later followed up with the staff about the impact and effectiveness of the<br />
recommendations that were made.<br />
Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />
Outcome Objective: Families participating in “Family Services” will report<br />
improvements in child behavior<br />
1. 85% of eligible families completing between 8‐12 psychotherapy/counseling meetings will<br />
complete the Child Behavior Checklist (CBCL) as a pre/post intervention measure.<br />
2. Of those completing both a pre and post CBCL, 75% will demonstrate improvement in at<br />
least one measure on the CBCL.<br />
Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />
Note: Results should be interpreted with caution due to the low number of cases.<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Two out of the seven families that began “Family‐services” this period completed between 8‐12<br />
psychotherapy/counseling sessions. Both of the families (100%) completed the CBCL as a pre/post<br />
intervention measure.<br />
� The post‐intervention scores on CBCL indicate that both of the children (100%) made<br />
improvements in their conduct and functioning in at least one of the assessment’s domain<br />
areas.<br />
� In actuality, both children made even greater improvement:<br />
o One of the children’s scores reflected improvements in 12 out of the 12 domains.<br />
o The other child’s score reflected improvements in <strong>11</strong> out of the 12 domains.<br />
100%<br />
131<br />
N=2<br />
100%<br />
N=2
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />
La Manzana Community Resources<br />
Program Description<br />
La Manzana Community Resources (LMCR) provides brief case management and information and<br />
referrals for vulnerable families with children ages 0‐5 to improve families’ access to services,<br />
enhancement of parenting skills, and awareness of community literacy activities. Additionally, LMCR<br />
provides access to a range of activities, workshops, and classes to ensure children are living in<br />
literacy‐rich environments that are supportive of their cognitive development. LMCR also provides<br />
parents of children ages 0‐5 with Positive Parenting Program (Triple P) education county‐wide.<br />
Population Served<br />
Information and Referral Services<br />
<strong>2010</strong>‐20<strong>11</strong><br />
(Information and Referral Services)<br />
Parents/Guardians 981<br />
Children 1,332<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
Parent/Guardian Participation in Triple P Services (Estimated)<br />
<strong>2010</strong>‐20<strong>11</strong><br />
(Triple P)*<br />
Parents/Guardians 516<br />
Children (ages 0‐5) 329<br />
(ages 6‐16) 204<br />
* These Triple P client numbers are estimates only, and are likely an undercount, as these data do not include clients from program levels that do not<br />
collect CCDs, and also exclude clients who did not consent to have their assessment data included in this evaluation.<br />
Figure 96: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>-<strong>11</strong>)<br />
16.1%<br />
13.2%<br />
16.3%<br />
3.3%<br />
51.2%<br />
Level 2 Seminar<br />
Level 3 Workshop<br />
Level 3 Primary Care<br />
Level 4 Group<br />
Level 4 Standard<br />
Source: LMCR <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />
Notes: These are estimated percentages, as the data may include duplicated clients from program levels that do not collect CCDs, and also exclude<br />
clients who did not consent to have their assessment data included in this evaluation. Exact participation data are only available for levels of services<br />
where parents provided enough personal information to be able to create a Unique ID (Level 2 Individual, Level 3 Primary Care, and Level 4). Parents<br />
who participated in seminars and workshops did not provide enough personal information to be able to create a Unique ID, so it was not possible to<br />
track whether they also participated in additional levels of service.<br />
N= 516 (see notes, above).<br />
132 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />
Outcome Objective: Families will be provided with information and referrals to<br />
meet their needs<br />
Type of I&R Service<br />
Number of Units of<br />
Service provided in<br />
<strong>2010</strong>‐20<strong>11</strong> Type of I&R Service<br />
Number of Units of<br />
Service provided in<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Food Stamps 358 Passports 65<br />
Medi‐Cal 344 Health Care 52<br />
State Disability/ Paid Family Leave 243 Translations 52<br />
General Forms & Services 206 Childcare and Education 31<br />
Healthy Families 138 Employment Development 28<br />
Housing 107<br />
Birth Certificate Correction<br />
Affidavits 24<br />
Cash‐Aid / Cal‐Works 86 Economic Justice Project 13<br />
CARE/HEAP/Lifeline programs 72 SSI/SSD 13<br />
Healthy Kids 71 Child Support 12<br />
Source: LMCR Biannual and <strong>Annual</strong> Progress <strong>Report</strong>s, <strong>2010</strong>‐<strong>11</strong>.<br />
Total 1,915<br />
Outcome Objective: Families will be assisted in developing literacy-rich<br />
environments<br />
Families with children birth‐5 were connected to a range of activities, workshops and classes to<br />
ensure children are living in literacy‐rich environments supportive of cognitive development.<br />
Type of Activity/Class<br />
Number of Parents Connected to<br />
this Activity/Class<br />
Child Development Resource Center 302<br />
Triple P 516<br />
Library Literacy Programs 187<br />
Literacy Classes (Plaza Comunitaria) 154<br />
Play & Learn 91<br />
Head Start 3<br />
PAPÁs 2<br />
Total 1,255<br />
Source: LMCR <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />
133
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />
Outcome Objective: Families will be provided with parenting information and<br />
family support<br />
“LMCR has been able to reach out to families who—prior to Triple P—may not have sought our services. We are able to not only<br />
connect them to a program that can help improve their relationship with their children, but we can offer a breadth of services<br />
that may help them improve their overall quality of life.<br />
Through Triple P, we’ve been able to partner with agencies that we had not partnered with before, which also improves our reach<br />
to Pajaro Valley residents. Those partnerships can prove to be invaluable resources for families in need.”<br />
-LMCR, <strong>Annual</strong> Progress <strong>Report</strong><br />
Parents increased their use of positive discipline styles<br />
Parents who participated in Level 4 of the Triple P program were asked to complete the Parenting<br />
Scale as a pre and post assessment of their style of discipline, such as being lax, over‐reactive, or<br />
hostile. Scores could range from 1 (positive parenting) to 7 (ineffective parenting), with lower scores<br />
indicating more positive styles of discipline.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 23<br />
Dysfunctional<br />
Parenting<br />
7<br />
6<br />
5<br />
Lower<br />
is 4<br />
“Better”<br />
3<br />
2<br />
1<br />
� As seen in the figure below, there was significant improvement from pre to post assessment<br />
regarding parents’ overall style of discipline, indicating their parenting style became less lax,<br />
less over‐reactive, and less hostile though the course of the Triple P program.<br />
� On average, all parents combined and all parent sub‐populations that were assessed began in<br />
the clinical range, but had achieved positive styles of discipline by the post‐assessment.<br />
Functional<br />
Parenting<br />
Figure 97: Parents’ Use of Positive Discipline Styles: Overall<br />
3.4<br />
All Parents*<br />
(N=70)<br />
3.8 3.7 3.8 3.8 3.8 3.7<br />
2.8 3.0 3.0 3.0 3.0 3.0 2.9<br />
Clinical Range<br />
at PreTest*<br />
(N=45)<br />
Male*<br />
(N=8)<br />
Female*<br />
(N=37)<br />
Pre Post<br />
Latino*<br />
(N=41)<br />
Caucasian** Spanish*<br />
(N=33)<br />
English*<br />
(N=9)<br />
Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />
responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />
sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p= 3.2
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Parents reported improved child behavior<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />
In Triple P, the parent is considered the agent of change to bring about improvements in the parent‐<br />
child relationship. Therefore, how parents view their children’s behavior is an important assessment<br />
of the relationship. For parents participating in Level 4 of the Triple P Program, LMCR measured this<br />
objective using the Eyberg Child Behavior Inventory (ECBI), a pre and post assessment of the<br />
frequency with which certain child behaviors occur (Intensity subscale), and the extent to which<br />
parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from<br />
36 (Never occurs) to 252 (Always occurs), and Problem scores ranged from 0 (No) to 36 (Yes), with<br />
higher scores indicating greater frequencies of problem behaviors and greater likelihood that these<br />
behaviors were a problem to the parent.<br />
Analyses were run to see if there was any improvement between pre and post assessments, and if<br />
the amount of improvement was statistically significant. 24<br />
As seen in the following figures, after completing the Triple P Program, fewer parents viewed their<br />
children’s behavior as problematic, and parents also reported fewer problematic child behaviors as<br />
actually being a problem for them. Key results include:<br />
� For the ECBI “Intensity” subscale,<br />
o For all parents overall, and all sub‐populations (with enough cases to analyze), there was a<br />
significant reduction in the frequency of potentially problematic child behaviors. On average,<br />
these parents began with scores within the clinical range, and ended with scores that were out<br />
of the clinical range.<br />
� For the ECBI “Problem” subscale,<br />
o For all sub‐populations, there was a significant reduction in the number of child behaviors<br />
that were perceived to be a problem. On average, these parents began with scores within<br />
the clinical range, and ended with scores that were out of the clinical range.<br />
24<br />
For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />
of Assessment Data” on page 102.<br />
135
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />
Lower<br />
is<br />
“Better”<br />
Figure 98: Level of Parental Problems with Child Behavior<br />
Behavior always<br />
occurs<br />
252<br />
216<br />
180<br />
144<br />
108<br />
72<br />
36<br />
Behavior<br />
never occurs<br />
All behaviors were<br />
a problem<br />
36<br />
Lower<br />
is<br />
“Better”<br />
30<br />
24<br />
18<br />
12<br />
6<br />
0<br />
No behaviors<br />
were a problem<br />
128.4<br />
92.2<br />
All Parents*<br />
(N=69)<br />
17.7<br />
9.4<br />
All Parents*<br />
(N=64)<br />
Frequency of Potentially Problematic Child Behaviors<br />
168.2 154.6 172.0 166.8 165.2<br />
Clinical Range<br />
at PreTest*<br />
(N=32)<br />
24.1<br />
<strong>11</strong>2.4 108.1<br />
Male*<br />
(N=7)<br />
Female*<br />
(N=25)<br />
Pre Post<br />
<strong>11</strong>3.6 <strong>11</strong>0.4 107.5<br />
Latino*<br />
(N=30)<br />
Caucasian** Spanish*<br />
(N=24)<br />
Number of Child Behaviors Perceived to Be a Problem<br />
12.2<br />
Clinical Range<br />
at PreTest*<br />
(N=39)<br />
22.0<br />
9.6<br />
Male*<br />
(N=5)<br />
24.4<br />
Female*<br />
(N=34)<br />
Pre Post<br />
24.1 24.0 24.4<br />
12.6 12.1 12.8<br />
Latino*<br />
(N=35)<br />
Caucasian** Spanish*<br />
(N=30)<br />
English**<br />
Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />
which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always occurs),<br />
and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />
these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />
* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=15<br />
Clinical<br />
Cut‐off:<br />
>=131
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Parents <strong>Report</strong>ed High Satisfaction with Services<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />
All parents receiving Triple P services (except those attending brief Level 2 Individual sessions) were<br />
asked to complete a self‐administered satisfaction survey upon completing their services.<br />
� Parents participating in Levels 3 (multi‐session), 4, and 5 of the Triple P Program filled out a<br />
Parent Satisfaction Survey with 13 questions using a 7‐point scale (with 7 indicating highest<br />
satisfaction), and 3 open‐ended questions. Key results include:<br />
o The average parent satisfaction ratings ranged from 5.62 to 6.71, on the 7‐point scale.<br />
Most parents felt that the program met their needs, as well as the needs of their children,<br />
offered the help that they needed, and if they needed help in the future, they would<br />
return to Triple P.<br />
� Parents participating in the Level 2 Seminars and Level 3 Workshops filled out a short<br />
Satisfaction Survey with 3 questions using a 5‐point scale (with 1=Disagree, and 5=Agree),<br />
and 1 open‐ended question.<br />
o The average parent satisfaction ratings for Level 3 Workshops ranged from 4.76 to 4.84,<br />
and Level 2 Seminars ranged from 4.47 to 4.71, on the 5‐point scale. Virtually all parents<br />
felt that the program answered their questions, that they would continue to use the tip<br />
sheets, and were very satisfied with the services they received.<br />
Figure 99: Parents’ Satisfaction with Various Aspects of the Triple P Program<br />
Levels 3 (multi‐session), 4, and 5<br />
1. How would you rate the quality of the service you and your child<br />
received? (N=99)<br />
2. Did you receive the type of help you wanted from the program?<br />
(N=98)<br />
3. To what extent has the program met your child's needs? (N=99)<br />
4. To what extent has the program met your needs? (N=98)<br />
5. How satisfied were you with the amount of help you and your<br />
child received? (N=99)<br />
6. Has the program helped you to deal more effectively with your<br />
child's behavior? (N=99)<br />
7. Has the program helped you to deal more effectively with<br />
problems that arise in your family? (N=99)<br />
8. Do you think your relationship with your partner has been<br />
improved by the program? (N=85)<br />
9. In an overall sense, how satisfied are you with the program you<br />
and your child received? (N=98)<br />
10. If you were to seek help again, would you come back to this<br />
organization? (N=98)<br />
<strong>11</strong>. Has the program helped you to develop skills that can be applied<br />
to other family members? (N=98)<br />
12. In your opinion, how is your child's behavior at this point? (N=97)<br />
13. How would you describe your feelings at this point about your<br />
child's progress? (N=97)<br />
Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />
5.73<br />
5.62<br />
6.13<br />
6.03<br />
137<br />
6.48<br />
6.37<br />
6.49<br />
6.51<br />
6.40<br />
6.29<br />
1 2 3 4 5 6 7<br />
6.58<br />
6.71<br />
6.58
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />
1. The workshop answered a question or concern I have had<br />
about parenting. (N=76)<br />
2. I am likely to use some of the parenting strategies in the tip<br />
sheet. (N=76)<br />
3. Overall I was satisfied with the workshop. (N=75)<br />
Level 3 Workshops<br />
Source: Triple P data from the Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />
1. The seminar answered a question or concern I have had about<br />
parenting.<br />
2. I am likely to use some of the parenting strategies in the tip<br />
sheet.<br />
3. Overall I was satisfied with the seminar<br />
1 2 3 4 5<br />
Level 2 Seminars<br />
Source: Triple P data from the Seminar Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />
N=17.<br />
138 FIRST 5 SANTA CRUZ COUNTY<br />
4.53<br />
4.47<br />
4.76<br />
4.82<br />
4.84<br />
4.71<br />
1 2 3 4 5
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Mountain Community Resources<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
STRONG FAMILIES – MOUNTAIN COMMUNITY RESOURCES<br />
In order to promote child and parent confidence and competence, reduce child maltreatment,<br />
destigmatize parenting information and family support, and provide evidence‐based parenting<br />
information to the San Lorenzo Valley and Scotts Valley communities, Mountain Community<br />
Resources facilitated 13 Triple P workshops (seven in English and six in Spanish) in <strong>2010</strong>‐<strong>11</strong>. This<br />
agency also conducted a series of four‐week, individual sessions with five adults, benefiting a total<br />
of seven children.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Participated in Triple P (unduplicated)<br />
Parents/Guardians 67<br />
Children (ages 0‐5) 55<br />
Source: Mountain Community Resources, <strong>2010</strong>‐<strong>11</strong>.<br />
(ages 6‐17) 48<br />
Figure 100: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>-<strong>11</strong>)<br />
7.5%<br />
Source: Mountain Community Resources, <strong>2010</strong>‐<strong>11</strong>.<br />
N=67.<br />
92.5%<br />
One client’s story:<br />
“One of [our practitioners] worked with a single mother, Candy,* who has a 4-year old son. She came to the center<br />
looking for help with her son, Jim*, because she was having problems with him. Candy had heard about Triple P but<br />
was not sure about taking parenting classes. … She agreed to attend the required visits and they met for a total of four<br />
meetings. …<br />
At the last meeting Candy decided to bring Jim to the appointment. Jim came walking rather quickly into the<br />
[practitioner’s] office and proceeded to give her a picture that he had drawn and hugged her legs with great force. He<br />
then looked at mom and said, “what was it I wanted to say?” Mom said, “I remember you wanted to say thank…”<br />
and then Jim jumped up and down and said “thank you thank you, mom doesn’t yell so much anymore and I like quiet<br />
time… a boy needs quiet times and so does mom sometimes.” He then asked to play with the toys outside of her office.<br />
Both mom and child had smiles that ran from ear to ear.”<br />
- Mountain Community Resources, <strong>Annual</strong> Progress <strong>Report</strong><br />
(* Names have been changed)<br />
Level 3 Workshop<br />
Level 3 (Primary Care/Individual)<br />
139
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
STRONG FAMILIES – MOUNTAIN COMMUNITY RESOURCES<br />
Parents <strong>Report</strong>ed High Satisfaction with Services<br />
All parents receiving Triple P services were asked to complete a self‐administered satisfaction survey<br />
upon completing their services. Parents participating in the Level 3 Workshops filled out a short<br />
Satisfaction Survey with 3 questions using a 5‐point scale (with 1=Disagree, and 5=Agree), and 1<br />
open‐ended question.<br />
� The average parent satisfaction ratings for Level 3 Workshops ranged from 4.49 to 4.72, on<br />
the 5‐point scale. Virtually all parents felt that the program answered their questions, that<br />
they would continue to use the tip sheets, and were very satisfied with the services they<br />
received.<br />
1. The workshop answered a question or concern I have had<br />
about parenting. (N=95)<br />
2. I am likely to use some of the parenting strategies in the tip<br />
sheet. (N=94)<br />
3. Overall I was satisfied with the workshop. (N=95)<br />
Level 3 Workshops<br />
Source: Triple P data from the Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />
Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction. Satisfaction Survey results for parents participating in Levels 3<br />
(multi‐session), 4, and 5 of the Triple P Program will be available when there are higher client numbers.<br />
140 FIRST 5 SANTA CRUZ COUNTY<br />
4.49<br />
4.72<br />
4.65<br />
1 2 3 4 5
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Early Literacy Foundations (ELF)<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
California third graders are struggling to become proficient readers. Local and statewide data<br />
indicate that well over half of third grade children are not reading at proficiency. Because language<br />
development in the early years is crucial to later reading success, early childhood educators have a<br />
unique role in influencing reading scores and later educational success. According to a report<br />
published in the Journal of Education Psychology, early childhood educators play a key role in the<br />
language development of children from high poverty backgrounds:<br />
“Language development has a profound effect on young children’s successful transition to<br />
school and, in particular, on their success in learning to read. Children who arrive in first grade<br />
with a foundation in pre‐literacy skills and the interest and motivation to learn are better<br />
prepared to engage in the complex task of learning to read.<br />
Most children acquire language and pre‐literacy skills through interactions with adults and<br />
peers who use language in ways that are consistent with the majority culture and correspond<br />
to the printed word. Unfortunately, many children raised in poverty have limited access to<br />
opportunities to develop language and literacy skills in such ways.<br />
As one important illustration, Hart and Risley (1995) reported that by the age of 3, children in<br />
poverty were already well behind their more affluent peers in their acquisition of vocabulary and<br />
oral language skills. Snow et al. (1998) also reported that children in poverty lack necessary<br />
pre‐literacy skills at the beginning of kindergarten. Similar research indicates that socioeconomic<br />
status is the strongest predictor of performance differences in children at the beginning of the<br />
first grade and that this gap persists as children progress from elementary to high school.” 25<br />
With the evidence of limited language and literacy opportunities in low‐income homes, more<br />
emphasis has been placed on showing early childhood educators how to build language<br />
opportunities into their daily child care routines, through fun and meaningful instruction. <strong>First</strong> 5’s<br />
Early Literacy Foundations Initiative builds skills among early childhood educators to promote strong<br />
literacy and language foundations for young children. The Initiative features:<br />
1. Professional development for early childhood educators through unit‐bearing coursework in<br />
partnership with Cabrillo College. Through the SEEDS of Early Literacy courses, educators<br />
earn three units and a stipend, receive on‐site coaching, attend literacy labs, and complete a<br />
professional development plan. Classes are available for early childhood educators who care<br />
for preschool children and infant/toddlers. Three different courses have been developed in<br />
both English and Spanish to meet the unique needs of educators new to college coursework<br />
as well as teachers with formal educational experience.<br />
25<br />
American Psychological Association (2006). The Effects of a Language and Literacy Intervention on Head Start Children and Teachers.<br />
Journal of Educational Psychology, 98, (1), 63–74.<br />
141
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
2. Assessment of children’s development of early literacy skills via the Individual Growth and<br />
Development Indicators (IGDI’s), and coaching for teachers to support response to<br />
intervention and differentiated instruction in participating State Pre‐K classrooms.<br />
3. Skill and materials development with Family, Friend and Neighbor informal providers<br />
through SEEDS early literacy workshops and coaching.<br />
4. Family Engagement through an expansion of “Raising A Reader,” a rotating book bag<br />
program. Almost all of the SEEDS classrooms were also Raising A Reader classrooms,<br />
resulting in mutually complimentary interventions to boost shared reading practices with<br />
children and their families, and to impact children’s early literacy skills. Information on this<br />
program can be found in the Raising A Reader partner profile.<br />
5. The <strong>Santa</strong> <strong>Cruz</strong> Public Libraries (SCPL) “Read to Me” program provides Read to Me Resource<br />
Kits for parents and early childhood educators via library circulation to engage children and<br />
families in early literacy activities.<br />
SEEDS of Early Literacy<br />
The professional development initiative described above (1) follows the SEEDS of Early Literacy<br />
curriculum that has been researched by the University of Minnesota. Research on the SEEDS model<br />
shows that teachers trained and coached on the SEEDS Curriculum score significantly higher on the<br />
Early Language and Literacy Classroom Observation (ELLCO) tool and show greater change over time<br />
in teaching strategies than teachers without such training. Results also indicate that preschool<br />
children who were taught by teachers trained in<br />
SEEDS entered kindergarten ready to read at higher<br />
rates than children in non‐SEEDS groups (Lizakowski,<br />
2005).<br />
“I started this course with the idea that early literacy<br />
was teaching children to write letters, help them form<br />
words, and read. Now I know that early literacy is not<br />
only symbols. It is the combination of strategies that will<br />
help the child in a playful way to build strong<br />
foundations in learning.”<br />
The SEEDS Professional Development model consists<br />
of training—and providing coaching to—early<br />
childhood educators on how to effectively integrate<br />
research‐based language and literacy strategies and<br />
materials into their classrooms. Early childhood<br />
educators are taught to use the strategies of both embedded instruction (planned strategies that<br />
occur within the typical routines of the class day) and explicit instruction (teacher‐directed activities<br />
that emphasize the teaching of a specific task), and to create a classroom environment that is<br />
designed to target early literacy predictors.<br />
These predictors of later reading success include:<br />
- Early childhood educator who just started the SEEDS program<br />
Early Literacy Foundations, <strong>Annual</strong> Progress <strong>Report</strong><br />
� Conversation and Oral Language: The ability to produce or comprehend spoken language<br />
� Alphabet Knowledge: The ability to visually discriminate the differences between letters<br />
and say the names and sounds associated with printed letters<br />
142 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
� Book and Print Rules: Refers to what children understand about how books and print work,<br />
such as left‐right, front‐back, letters, words and that print has meaning<br />
� Phonological awareness: The ability to detect, manipulate, or analyze the auditory aspects<br />
of spoken language, including the ability to distinguish or segment words, syllables, rhymes,<br />
and beginning sounds<br />
� Vocabulary and Background Knowledge: A collection of words that relate to experiences<br />
and knowledge that a child has of the world around him/her<br />
The following diagram displays the five essential SEEDS quality interactions and the five predictors of<br />
literacy.<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s SEEDS program has proven to be very effective at changing classroom<br />
environments and practices, as well as influencing changes in children’s skills on research‐based<br />
predictors of early reading.<br />
Population Served<br />
Number of new or returning SEEDS Quality Coaches providing literacy coaching, literacy<br />
environmental assessments, and professional development advising for SEEDS instruction,<br />
fidelity and integrity<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Number of early childhood educators attending SEEDS of Early Literacy Courses 77<br />
Number of Family, Friend or Neighbor (FFN) informal child care providers attending SEEDS of<br />
Early Literacy workshops<br />
TOTAL (unduplicated) 104<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
143<br />
18<br />
9
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
The figures below show additional data about Early Childhood Educators and Coaches who have<br />
been trained between 2007‐20<strong>11</strong>.<br />
Figure 101: Number of Early Childhood Educators Who Have Completed SEEDS<br />
trainings (2007-20<strong>11</strong>)<br />
Number of SEEDS Quality Coaches providing literacy coaching, literacy environmental<br />
assessments, and professional development advising for SEEDS instruction, fidelity, and<br />
integrity during the year<br />
CUMULATIVE TOTALS<br />
2007‐20<strong>11</strong><br />
Number of early childhood educators attending SEEDS of Early Literacy Courses 356<br />
Number of Family, Friend or Neighbor (FFN) informal child care providers attending SEEDS<br />
of Early Literacy workshops<br />
TOTAL (unduplicated) 519<br />
Source: Early Literacy Foundations (ELF) Initiative, <strong>2010</strong>‐<strong>11</strong>.<br />
Figure 102: Number of SEEDS Trained Early Childhood Educators in Licensed<br />
Programs, by type of classroom (2007-20<strong>11</strong>)<br />
State and Federally‐<br />
Subsidized Classrooms<br />
Source: Early Literacy Foundations (ELF) Initiative, 2007‐<strong>11</strong>.<br />
Figure 103: Primary Language of SEEDS Trained Early Childhood Educators in Licensed<br />
Programs (2007-20<strong>11</strong>)<br />
22.2%<br />
3.1%<br />
24.7%<br />
Licensed Family Child Care<br />
Homes and Private/ Non‐<br />
Profit Centers<br />
English Only<br />
Spanish Only<br />
Bilingual English/Spanish<br />
50.0%<br />
Source: Early Literacy Foundations Initiative, Client and Assessment Data Entry Template, 2007‐20<strong>11</strong>.<br />
Note: Early childhood educators and coaches may have participated in more than one SEEDS class, but are only counted once in these analyses. For these<br />
clients, their language and education data are as of their earliest class, in order to assess the status of these educators at the beginning of their<br />
participation in the SEEDS program. Family, Friend or Neighbor (FFN) informal child care providers are not included in these analyses.<br />
Language N=356; Education N=328.<br />
144 FIRST 5 SANTA CRUZ COUNTY<br />
Other<br />
41<br />
155<br />
Unduplicated total,<br />
Spring 2007 – June 20<strong>11</strong><br />
201 155 356
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
Figure 104: Educational Attainment of SEEDS Trained Early Childhood Educators in<br />
Licensed Programs (2007-20<strong>11</strong>)<br />
12.2%<br />
6.1%<br />
Source: Early Literacy Foundations Initiative, Client and Assessment Data Entry Template, 2007‐20<strong>11</strong>.<br />
Note: Early childhood educators and coaches may have participated in more than one SEEDS class, but are only counted once in these analyses. For these<br />
clients, their language and education data are as of their earliest class, in order to assess the status of these educators at the beginning of their<br />
participation in the SEEDS program. Family, Friend or Neighbor (FFN) informal child care providers are not included in these analyses.<br />
Language N=356; Education N=328.<br />
Outcome Objective: Increase the number of early education settings that provide<br />
high quality support for language and literacy<br />
Preschool Classrooms<br />
4.0% 4.3% 8.8%<br />
No Formal Schooling<br />
7.3%<br />
10.1%<br />
Less Than High School Diploma/GED<br />
25.3%<br />
22.0%<br />
High School Diploma/GED<br />
Some College<br />
AA in non‐ECE/CD<br />
AA in ECE/CD<br />
BA in non‐ECE/CD<br />
BA in ECE/CD<br />
Some Graduate School or above<br />
Research on teacher effectiveness shows that by focusing professional development on language<br />
and literacy and social‐emotional development, children are shown to be much better prepared for<br />
school and have higher academic achievement. The first indicators of change are the language<br />
environment, teacher‐child interactions, and language opportunities that teachers provide to<br />
children.<br />
<strong>First</strong> 5 SEEDS Quality coaches are trained to independently assess SEEDS classrooms teaching<br />
children ages 3‐5 using the Early Language and Literacy Classroom Observation Pre‐K Tool (ELLCO<br />
Pre‐K). The ELLCO Pre‐K is used to assess the following five classroom components: classroom<br />
structure, curriculum, the language environment, books and book reading, and print and early<br />
writing (in <strong>2010</strong>‐<strong>11</strong>, the classroom structure component was not measured by most coaches and is<br />
therefore not analyzed in this report). Items are scored along a 5 point scale, where 1 is deficient<br />
and 5 is exemplary. From this scale, early childhood educators’ classroom scores can be categorized<br />
into three levels, indicating their classroom environment provides low‐quality support, basic<br />
support, or high‐quality support for language and literacy. In every Pre‐K SEEDS course since 2007,<br />
coaches used the ELLCO to assess the classrooms of their mentees (early childhood educators<br />
receiving SEEDS training) at the beginning and end of the semester.<br />
Across all components, classrooms showed substantial improvements from the beginning of the<br />
semester to the end. Overall, the percentage of classrooms that were rated as having High‐Quality<br />
Support increased from 16% to 92%. Among the individual classroom components, by the end of the<br />
145
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
semester the majority of classrooms were rated as having High‐Quality Support in “Curriculum”<br />
(81%), “Language Environment” (76%), “Books and Book Reading” (87%), “Print and Early Writing”<br />
(89%).<br />
Figure 105: Classroom Support for Language and Literacy, <strong>2010</strong>-20<strong>11</strong><br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
16.2%<br />
54.1%<br />
91.9%<br />
Low‐Quality Support Basic Support High‐Quality Support<br />
18.9%<br />
51.4%<br />
81.1%<br />
Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) Pre‐K, <strong>2010</strong> – 20<strong>11</strong>.<br />
Note: Low‐quality support = means less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between<br />
3.51 and 5. Percentages less than 3% are not labeled.<br />
N=37.<br />
Four specific ELLCO items were chosen for individual study, using the same type of analysis:<br />
Opportunities for Child Choice and Initiative, Approaches to Book Reading, Support for Children's<br />
Writing, and Approaches to Curriculum. For these four items, several years of data have been<br />
aggregated in order to present a more robust portrait of the extent to which SEEDS‐trained early<br />
childhood educators were providing high quality support for language and literacy in their preschool<br />
classrooms.<br />
16.2%<br />
51.4%<br />
75.7%<br />
13.5%<br />
56.8%<br />
86.5%<br />
29.7% 29.7% 32.4% 29.7%<br />
24.3%<br />
18.9%<br />
13.5%<br />
8.1%<br />
21.6%<br />
35.1%<br />
43.2%<br />
As reflected in the following figure, SEEDS‐coached teachers have consistently improved the quality<br />
of support they provide in their classrooms for children’s development of early literacy. For each of<br />
the four ELLCO items, the majority of classrooms were rated as providing high quality support at<br />
post assessment: Opportunities for Child Choice and Initiative (93%), Approaches to Book Reading<br />
(88%), Support for Children's Writing (90%), and Approaches to Curriculum (87%).<br />
146 FIRST 5 SANTA CRUZ COUNTY<br />
89.2%<br />
Pre Post Pre Post Pre Post Pre Post Pre Post<br />
Overall Section 2:<br />
Curriculum<br />
Section 3:<br />
The Language<br />
Environment<br />
Section 4:<br />
Books & Book<br />
Reading<br />
8.1%<br />
Section 5:<br />
Print & Early<br />
Writing
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Figure 106: Key Language and Literacy Questions (2007-20<strong>11</strong>)<br />
100%<br />
53.7%<br />
35.8%<br />
FIRST 5 SANTA CRUZ COUNTY<br />
93.3%<br />
35.3%<br />
49.3%<br />
88.4%<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
10.4% 15.3% 19.5% 22.4%<br />
6.7%<br />
10.7%<br />
10.0%<br />
Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) & ELLCO Pre‐K, 2007 – 20<strong>11</strong>.<br />
Note: Clients may be included more than once if they participated in multiple SEEDS classes between 2007 and 20<strong>11</strong>. Low‐quality support = means<br />
less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between 3.51 and 5. Percentages less than 3%<br />
are not labeled.<br />
* The analysis of the question began in 2007‐08, so results reflect the combined data for 2008‐20<strong>11</strong>.<br />
Child Choice and Initiative N=134, Book Reading N=215, Children's Writing N=221, Approaches to Curriculum N=134.<br />
Family Child Care Settings<br />
The data above described the ways that SEEDS‐trained teachers made changes to their preschool<br />
classroom environments and their practices in order to better support children’s development of<br />
pre‐literacy skills. However, SEEDS training was not just limited to preschool center teachers — early<br />
childhood educators from family child care settings as well as infant/toddler centers also<br />
participated in SEEDS training and received SEEDS coaching. Their sites were observed at the<br />
beginning of their SEEDS training and again at the end.<br />
31.2%<br />
49.3%<br />
89.6%<br />
The figure below presents the PRE and POST scores gathered from Family Child Care providers on<br />
four literacy‐related indicators, for several years combined. The measurement instrument was the<br />
Family Child Care Environment Rating Scale, Revised Edition (FCCERS‐R). Items were scored using a<br />
7‐point scale ranging from inadequate to excellent. Results show that providers made pre to post<br />
gains in their abilities related to literacy promotion.<br />
Figure 107: Average FCCERS Scores at Pre and Post Assessment on Literacy-Related<br />
Items (2009-20<strong>11</strong>)<br />
Pre Post<br />
Excellent<br />
7<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Inadequate<br />
Low‐Quality Support Basic Support High‐Quality Support<br />
Source: Early Literacy Foundations (ELF) Initiative, Family Child Care Environment Rating Scale, Revised Edition, 2009‐20<strong>11</strong>.<br />
N=54.<br />
40.3%<br />
37.3%<br />
86.6%<br />
12.7%<br />
Pre Post Pre Post Pre Post Pre Post<br />
Opportunities for<br />
Child Choice and<br />
Initiative*<br />
Approaches to<br />
Book Reading<br />
3.83 3.93 3.94<br />
Helping children<br />
understand language<br />
Support for<br />
Children's Writing<br />
5.46 5.44 5.65 5.80<br />
Helping children use<br />
language<br />
4.24<br />
Using books Provider‐child<br />
interactions<br />
Approaches to<br />
Curriculum*<br />
147
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
Infant/ Toddler Care Classrooms<br />
The figure below presents the PRE and POST scores gathered from center‐based early childhood<br />
educators of Infant/Toddler care, for several years combined. The measurement instrument was the<br />
Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), and items were scored using a 7‐<br />
point scale ranging from inadequate to excellent. Results show that Infant/ Toddler teachers<br />
enhanced their classroom environments and practices to promote children’s early literacy<br />
development.<br />
Figure 108: Average ITERS Scores at Pre and Post Assessment on Literacy-Related<br />
Items (2009-20<strong>11</strong>)<br />
Excellent<br />
Pre Post<br />
7<br />
6.02 6.14 5.76 5.92<br />
6<br />
5<br />
4<br />
3<br />
2<br />
1<br />
0<br />
Inadequate<br />
4.39<br />
Helping children<br />
understand language<br />
4.82<br />
Helping children use<br />
language<br />
Source: Early Literacy Foundations (ELF) Initiative, Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), 2009‐20<strong>11</strong>.<br />
N: Understand language=49, Use language=49, Using books=49, Interactions=48.<br />
Other Outcomes: Children will increase their skills in research-based predictors<br />
for reading success<br />
The SEEDS of Early Literacy has shown us that teachers of diverse educational backgrounds can be<br />
trained to implement strategies to help children build a strong language and literacy foundation.<br />
<strong>First</strong> 5 partnered with SEEDS state subsidized classrooms and found that, indeed, teachers have had<br />
a positive effect on children’s language and literacy development.<br />
Participating classrooms assessed children throughout the year to measure changes in three key<br />
areas of reading predictors: picture‐naming, rhyming, and alliteration. As the majority of students<br />
are dual language learners, most children were assessed in both English and Spanish, unless English<br />
was their primary language.<br />
Children showed large improvements in all three pre‐literacy skills areas between their first and last<br />
assessments. The percentage of all children scoring “At” or “Above” the target level for each of the<br />
pre‐literacy skills areas increased dramatically, with the greatest improvement occurring in rhyming<br />
and alliteration skills.<br />
148 FIRST 5 SANTA CRUZ COUNTY<br />
3.78<br />
4.60<br />
Using books Provider‐child interactions
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
Figure 109: Percentage of All Children Scoring “At” or “Above” the Target Level<br />
in Three Pre-Literacy Skill Areas, <strong>2010</strong>-20<strong>11</strong><br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
12.4%<br />
27.3%<br />
34.1%<br />
English Assessment Spanish Assessment<br />
30.7%<br />
9.3%<br />
49.7%<br />
<strong>11</strong>.3%<br />
51.1%<br />
63.1%<br />
Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />
English N= Oct: Picture Naming (340); Rhyming (332); Alliteration (328). N= Jan: Picture Naming (275); Rhyming (264); Alliteration (262). N= May:<br />
Picture Naming (337); Rhyming (332); Alliteration (325). Spanish N= Oct: Picture Naming (231); Rhyming (228); Alliteration (228). N= Jan: Picture<br />
Naming (209); Rhyming (206); Alliteration (2<strong>11</strong>). N= May: Picture Naming (237); Rhyming (234); Alliteration (230).<br />
Note: Children who completed any two assessments within a pre‐literacy skill area were included in the analysis of that skill.<br />
Because of the number of English‐language learners in these classrooms (who comprised<br />
approximately 73% of children in this assessment), there was interest in focusing on the<br />
performance of children when assessed in their primary language. When looking at the percentage<br />
of children scoring “At” or “Above” target level, results show that when assessed in their primary<br />
language, Spanish‐speaking children started with a lower skill level than English‐speaking children,<br />
but by their last assessment they had made a greater amount of improvement (net change in<br />
percentage) in rhyming (39% increase vs. 30% increase), and in alliteration (53% increase vs. 46%<br />
increase). Primarily Spanish‐speaking children showed similar or even greater amounts of<br />
improvement when assessed in English, with the greatest increases occurring in rhyming (44%<br />
increase) and alliteration (54% increase).<br />
6.1%<br />
13.4%<br />
28.3%<br />
25.7%<br />
7.5%<br />
45.3%<br />
18.4%<br />
55.5%<br />
Picture Naming Rhyming Alliteration Picture Naming Rhyming Alliteration<br />
Oct Jan May<br />
70.9%<br />
149
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
Figure <strong>11</strong>0: Percentage of Children Scoring “At” or “Above” the Target Level in Three<br />
Pre-Literacy Skill Areas, by Primary Language, <strong>2010</strong>-20<strong>11</strong><br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
32.3%<br />
30%<br />
20%<br />
10%<br />
0%<br />
Figure <strong>11</strong>1: Percentage of Children Meeting Targets for Later Reading Success,<br />
by Primary Language<br />
LANGUAGE OF<br />
ASSESSMENT<br />
PRIMARILY ENGLISH‐SPEAKING CHILDREN NET CHANGE<br />
TOPIC AREA OCT JAN MAY<br />
English Picture Naming 32.3% 62.1% 57.1% 24.8%<br />
LANGUAGE OF<br />
ASSESSMENT<br />
Primarily English‐Speaking<br />
Children<br />
English Assessment<br />
62.1%<br />
57.1%<br />
Picture<br />
Naming<br />
31.0%<br />
18.5%<br />
56.9%<br />
48.9%<br />
21.7%<br />
68.1%<br />
13.6%<br />
6.3%<br />
Rhyming Alliteration Picture<br />
Naming<br />
29.3%<br />
26.0%<br />
Rhyming 18.5% 31.0% 48.9% 30.4%<br />
Alliteration 21.7% 56.9% 68.1% 46.4%<br />
PRIMARILY SPANISH‐SPEAKING CHILDREN NET CHANGE<br />
OCT JAN MAY<br />
Spanish Picture Naming 6.3% 13.6% 29.3% 23.0%<br />
Rhyming 7.7% 26.0% 46.5% 38.8%<br />
Alliteration 18.9% 56.0% 72.3% 53.4%<br />
English Picture Naming 4.9% 18.0% 25.6% 20.7%<br />
Rhyming 5.8% 30.6% 50.0% 44.2%<br />
Alliteration 7.2% 49.8% 61.1% 53.9%<br />
Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />
English Speakers: English N= Oct: Picture Naming (93); Rhyming (92); Alliteration (92). N= Jan: Picture Naming (58); Rhyming (58); Alliteration (51). N=<br />
May: Picture Naming (91); Rhyming (90); Alliteration (91). Spanish Speakers: Spanish N= Oct: Picture Naming (222); Rhyming (222); Alliteration (222).<br />
N= Jan: Picture Naming (206); Rhyming (204); Alliteration (209). N= May: Picture Naming (229); Rhyming (228); Alliteration (224). Spanish Speakers:<br />
English N= Oct: Picture Naming (247); Rhyming (240); Alliteration (236). N= Jan: Picture Naming (217); Rhyming (206); Alliteration (2<strong>11</strong>). N= May:<br />
Picture Naming (246); Rhyming (242); Alliteration (234).<br />
Note: Table displays the percentage of children scoring “at” or “above” the target level in these three pre‐literacy skill areas. Children who completed<br />
any two assessments within a pre‐literacy skill area were included in the analysis of that skill. Children were determined to be primarily English<br />
speakers if they were marked as being “English‐only” speakers on the scoring template, or if they did not take any assessments in Spanish. Children<br />
were determined to be primarily Spanish speakers if they were not marked as being “English‐only” speakers on the scoring template, and if they took<br />
at least one assessment in Spanish. The number of children marked as being “English‐only” speakers who also completed an additional assessment in<br />
Spanish was too low to analyze.<br />
150 FIRST 5 SANTA CRUZ COUNTY<br />
7.7%<br />
46.5%<br />
18.9%<br />
56.0%<br />
72.3%<br />
18.0%<br />
Rhyming Alliteration Picture<br />
Naming<br />
Oct Jan May<br />
Primarily Spanish‐Speaking Children<br />
Spanish Assessment English Assessment<br />
25.6%<br />
30.6%<br />
50.0%<br />
4.9% 5.8% 7.2%<br />
49.8%<br />
61.1%<br />
Rhyming Alliteration
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
An analysis of the percentage of children who scored at each of the four target levels (Below, Near,<br />
At, and Above) shows these results in more detail.<br />
� When examining children in their primary language, English‐speaking children made the<br />
greatest improvements in Alliteration, followed by Rhyming and Picture Naming.<br />
� A higher percentage of Spanish‐speaking children scored “below” or “near” target levels in<br />
their initial assessments when compared to English‐speaking children, but by the last<br />
assessment, they had reached or exceeded the levels attained by English‐speaking children,<br />
particularly in rhyming and alliteration, in both languages.<br />
� Spanish‐speaking children did not make the same achievements in the Picture Naming area<br />
as they did in the other two areas.<br />
Figure <strong>11</strong>2: Percentage of Children at Each Target Level in Three Pre-Literacy Skill<br />
Areas, by Primary Language, <strong>2010</strong>-20<strong>11</strong><br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
30.1%<br />
2.2%<br />
46.2%<br />
21.5%<br />
55.2%<br />
6.9%<br />
31.0%<br />
53.8%<br />
3.3%<br />
31.9%<br />
6.9% <strong>11</strong>.0%<br />
Primarily English‐Speaking Children<br />
English Assessment<br />
15.2%<br />
3.3%<br />
28.3%<br />
53.3%<br />
24.1%<br />
6.9%<br />
27.6%<br />
41.4%<br />
43.3%<br />
5.6%<br />
33.3%<br />
17.8%<br />
16.3%<br />
5.4%<br />
21.7%<br />
56.5%<br />
47.1%<br />
9.8%<br />
29.4%<br />
13.7%<br />
Oct Jan May Oct Jan May Oct Jan May<br />
63.5%<br />
Picture Naming Rhyming Alliteration<br />
4.5%<br />
1.8% 9.7%<br />
3.9%<br />
30.2%<br />
54.4%<br />
32.0%<br />
22.7%<br />
6.6%<br />
41.0%<br />
29.7%<br />
Below Near At Above<br />
Primarily Spanish‐Speaking Children<br />
Spanish Assessment<br />
3.2%<br />
4.5%<br />
14.4%<br />
77.9%<br />
18.6%<br />
7.4%<br />
33.8%<br />
40.2%<br />
41.2%<br />
5.3%<br />
30.3%<br />
23.2%<br />
14.4%<br />
4.5%<br />
18.9%<br />
62.2%<br />
50.7%<br />
5.3%<br />
16.3%<br />
27.8%<br />
57.1%<br />
<strong>11</strong>.0%<br />
12.1%<br />
19.8%<br />
63.4%<br />
8.9%<br />
13.4%<br />
Oct Jan May Oct Jan May Oct Jan May<br />
Picture Naming Rhyming Alliteration<br />
Below Near At Above<br />
14.3%<br />
151
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
3.6%<br />
1.2%<br />
19.0%<br />
76.1%<br />
16.1%<br />
1.8%<br />
25.3%<br />
56.7%<br />
22.0%<br />
3.7%<br />
32.1%<br />
42.3%<br />
Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />
English Speakers: English N= Oct: Picture Naming (93); Rhyming (92); Alliteration (92). N= Jan: Picture Naming (58); Rhyming (58); Alliteration (51). N=<br />
May: Picture Naming (91); Rhyming (90); Alliteration (91). Spanish Speakers: Spanish N= Oct: Picture Naming (222); Rhyming (222); Alliteration (222).<br />
N= Jan: Picture Naming (206); Rhyming (204); Alliteration (209). N= May: Picture Naming (229); Rhyming (228); Alliteration (224). Spanish Speakers:<br />
English N= Oct: Picture Naming (247); Rhyming (240); Alliteration (236). N= Jan: Picture Naming (217); Rhyming (206); Alliteration (2<strong>11</strong>). N= May:<br />
Picture Naming (246); Rhyming (242); Alliteration (234).<br />
Note: Children who completed any two assessments within a pre‐literacy skill area were included in the analysis of that skill. Children were<br />
determined to be primarily English speakers if they were marked as being “English‐only” speakers on the scoring template, or if they did not take any<br />
assessments in Spanish. Children were determined to be primarily Spanish speakers if they were not marked as being “English‐only” speakers on the<br />
scoring template, and if they took at least one assessment in Spanish. The number of children marked as being “English‐only” speakers who also<br />
completed an additional assessment in Spanish was too low to analyze.<br />
<strong>Santa</strong> <strong>Cruz</strong> Public Libraries – Read to Me<br />
The <strong>Santa</strong> <strong>Cruz</strong> Public Libraries (SCPL) “Read to Me” program provides Read to Me Resource Kits for<br />
parents and early childhood educators via library circulation to engage children and families in early<br />
literacy activities. SCPL also provides in‐service workshops on the use of Read to Me kits to the <strong>First</strong> 5<br />
SEEDS classes (both English and Spanish), and State Pre‐K programs (Community Bridges).<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Number of Read to Me Kits circulated 1,137<br />
Number of workshops conducted 30<br />
Source: <strong>Santa</strong> <strong>Cruz</strong> Public Libraries, <strong>Annual</strong> Progress <strong>Report</strong>, <strong>2010</strong>‐20<strong>11</strong>.<br />
Primarily Spanish‐Speaking Children<br />
English Assessment<br />
4.2%<br />
1.7%<br />
20.4%<br />
14.6%<br />
41.3%<br />
10.2%<br />
79.6%<br />
152 FIRST 5 SANTA CRUZ COUNTY<br />
36.4%<br />
33.0%<br />
8.7%<br />
27.3%<br />
22.7%<br />
5.5%<br />
1.7%<br />
19.5%<br />
73.3%<br />
41.7%<br />
8.1%<br />
19.9%<br />
30.3%<br />
Oct Jan May Oct Jan May Oct Jan May<br />
Picture Naming Rhyming Alliteration<br />
Below Near At Above<br />
“SCPL is most proud that we have not only continued quality early literacy programming in<br />
extremely stressful and difficult economic times, we have expanded our programming and<br />
reached out to more families than ever with classes and Read to Me Kits.<br />
We have begun a collaboration with the <strong>County</strong> Office of Education that serves families of<br />
preschool children and rising kindergarteners, and we have continued our partnerships with<br />
many local agencies.”<br />
-<strong>Santa</strong> <strong>Cruz</strong> Public Libraries, <strong>Annual</strong> Progress <strong>Report</strong><br />
55.6%<br />
5.6%<br />
17.1%<br />
21.8%
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Raising A Reader<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ RAISING A READER<br />
Raising A Reader (RAR) fosters healthy brain development, helps support parent‐child bonding, and<br />
motivates families to read aloud with their children which helps develop the early literacy skills that<br />
are critical for school success. Raising A Reader (RAR) began operation in Watsonville during the last<br />
quarter of the 2005‐06 funding cycle. The program provides a way for children and their parents or<br />
caregivers to participate in a weekly rotating book bag program through early care and education<br />
settings. Periodically, Raising A Reader visits participating sites to monitor how well the program is<br />
operating, and provide refresher books or trainings as needed.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
New Existing Total<br />
Children 2,564 2,830 5,394<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
One provider’s story:<br />
“Parents were skeptical at first about reading to their child at such a young age. But I shared the<br />
benefits of introducing reading at this very tender age. There's early language development,<br />
interest in reading at an earlier age, they do better in school, etc…, and as time went by, parents<br />
shared that their child was actually taking an interest and found it a place in their daily routine<br />
with their child.”<br />
-Raising A Reader, <strong>Annual</strong> Progress <strong>Report</strong><br />
Outcome Objective: Raising A Reader will support 210 sites<br />
Type of Early Educator <strong>2010</strong>‐20<strong>11</strong><br />
Family Child Care Home 133<br />
Preschool/Child Care Center 106<br />
Source: Raising A Reader/<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>‐20<strong>11</strong>.<br />
Note: The actual number of classrooms participating in Raising A Reader is likely to be higher than the total number of sites, as one site may include<br />
more than one classroom.<br />
153
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ RAISING A READER<br />
Outcome Objective: Parents will spend time reading or sharing books with their<br />
child<br />
Percentage of parents who report reading 3 or more times per week after<br />
participating in the RAR book bag program.<br />
Source: Raising A Reader Parent Survey, <strong>2010</strong>‐20<strong>11</strong>.<br />
<strong>2010</strong>‐20<strong>11</strong><br />
PRE‐TEST POST‐TEST<br />
49.3%<br />
154 FIRST 5 SANTA CRUZ COUNTY<br />
N=454<br />
Figure <strong>11</strong>3: Changes in How Frequently Parents Read With Their Child, <strong>2010</strong>-20<strong>11</strong><br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
17.4%<br />
31.9%<br />
34.6%<br />
16.1%<br />
15.1%<br />
0.4%<br />
Pre‐Test Post‐Test<br />
Source: Raising A Reader/<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>‐20<strong>11</strong>.<br />
N: Pre‐Test=454, Post‐Test=456.<br />
37.1%<br />
47.4%<br />
5+ times/week<br />
3‐4 times/week<br />
1‐2 times/week<br />
Rarely<br />
84.4%<br />
N=456
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Starlight Infant/Toddler Program<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ STARLIGHT INFANT/TODDLER PROGRAM<br />
The Starlight Infant/Toddler Program (SITP) is a collaboration between <strong>Santa</strong> <strong>Cruz</strong> Community<br />
Counseling Center’s Early Head Start and <strong>First</strong> 5 of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>. This innovative program<br />
offers a wide variety of comprehensive bilingual services for expectant parents and families with<br />
infants and toddlers in the Watsonville area of<br />
south <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>. A key goal is to create a<br />
“learning community” that promotes early<br />
literacy and social emotional skills to help lay a<br />
solid foundation for school readiness.<br />
Services include pre‐ and post‐natal support to<br />
ensure healthy outcomes, assessments on health,<br />
nutrition, and developmental areas, ongoing<br />
parent education workshops, individualized home<br />
visits and goal‐setting, infant and toddler play<br />
groups, and referrals to community resources.<br />
Population Served<br />
“The Starlight Infant/Toddler program has<br />
significantly impacted the lives of local families and<br />
very young children by providing positive early<br />
learning experiences, opportunities for growth, and<br />
access to comprehensive health and social services. The<br />
program follows high-quality best practice standards<br />
and research-based strategies with a replicable model<br />
for intervention with high-risk low-income families<br />
from pregnancy and birth up through age three. SITP<br />
offers additional support during the crucial early years<br />
to minimize disparities and ensure strong families and<br />
healthy children who are ready to learn.”<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Pregnant Women 12<br />
Parents/Guardians 92<br />
Children 54<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
- Starlight Infant/Toddler Program, <strong>Annual</strong> Progress <strong>Report</strong><br />
Outcome Objective: Pregnant women will keep medical appointments<br />
75% of pregnant women will keep all prenatal appointments and will keep all<br />
postpartum follow‐up visits and first newborn doctor visits.<br />
Source: Starlight Infant/Toddler Program, Early Head Start home based Desired Results Parent Survey, Spring 20<strong>11</strong>.<br />
Note: Results should be interpreted with caution due to the low number of cases.<br />
<strong>2010</strong>‐20<strong>11</strong><br />
88.9%<br />
Outcome Objective: Pregnant women will make positive lifestyle changes<br />
60% of pregnant women will make a positive lifestyle change such as decreased<br />
caffeine intake, smoking cessation, increased exercise, and increase information<br />
regarding health and wellness.<br />
Source: Starlight Infant/Toddler Program, Early Head Start home based Desired Results Parent Survey, Spring 20<strong>11</strong>.<br />
Note: Results should be interpreted with caution due to the low number of cases.<br />
N=9<br />
<strong>2010</strong>‐20<strong>11</strong><br />
100%<br />
N=9<br />
155
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ STARLIGHT INFANT/TODDLER PROGRAM<br />
Outcome Objective: Children’s development will be assessed using the DRDP-I/T<br />
By June 30, 20<strong>11</strong>, 40 children ages 0‐3 will be assessed using the Desired Results Developmental<br />
Profile for Infants and Toddlers (DRDP‐I/T) (indicators 6, 7, 15, 16, 17, 18, 28 and 29), with a<br />
baseline assessment completed in February and the second assessment completed in June.<br />
Supports for families in specific areas of language and literacy will be tailored based on the<br />
initial assessment and a comparison will be made to see if there have been gains.<br />
Source: Starlight Infant/Toddler Program, Desired Results Developmental Profile I/T (<strong>2010</strong>), <strong>2010</strong>‐20<strong>11</strong><br />
<strong>2010</strong>‐20<strong>11</strong><br />
55 children<br />
In their first 3 years of life, children’s neural pathways are being developed and cemented as a<br />
foundation for a life full of learning. Quality early childhood experiences help to foster better<br />
language skills, higher cognitive functions, as well as improving sensory pathways, according to the<br />
Harvard University Center on the Developing Child. Therefore, literacy promotion doesn’t begin in<br />
preschool – it starts much earlier, even in daily interactions with young babies.<br />
At the Starlight Infant/Toddler program, home visitors work with parents of infants and toddlers to<br />
build the foundations for literacy. To guide their efforts with children and their families, they assess<br />
children periodically using eight indicators of the DRDP – Infant Toddler (<strong>2010</strong>).<br />
DOMAIN ITEM<br />
Social‐interpersonal skills<br />
Language<br />
Literacy<br />
(scale of 1‐5)<br />
(scale of 1‐6)<br />
(scale of 1‐5)<br />
Interactions with adults<br />
Relationships with familiar adults<br />
Language comprehension<br />
Responsiveness to language<br />
Communication of needs, feelings, and interest<br />
Reciprocal communication<br />
Interest in literacy<br />
Recognition of symbols<br />
Assessment results show that infants and toddlers in the Starlight Infant/Toddler program are being<br />
supported to develop social and interpersonal skills, and to develop a strong foundation for later<br />
literacy. As seen in the following figures:<br />
� The majority of infants increased one or more developmental levels in all measures, with the<br />
greatest increases occurring in the measures of “Reciprocal communication” (94% of children<br />
increased one or more levels), “Responsiveness to language” (72%), and “Interest in literacy”<br />
(72%).<br />
� Toddlers also made increases in one or more developmental levels in all measures, with the<br />
greatest increases occurring in the measures of “Communication of needs, feelings, and<br />
interest” (70% of children increased one or more levels), and “Reciprocal communication”<br />
(70%).<br />
156 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ STARLIGHT INFANT/TODDLER PROGRAM<br />
Figure <strong>11</strong>4: Percentage of Children Who Made Developmental Changes in Key Social<br />
and Pre-Literacy Measures<br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
100%<br />
90%<br />
80%<br />
70%<br />
60%<br />
50%<br />
40%<br />
30%<br />
20%<br />
10%<br />
0%<br />
<strong>11</strong>.8% <strong>11</strong>.8% <strong>11</strong>.1%<br />
52.9% 52.9% 50.0%<br />
29.4%<br />
35.3%<br />
27.8%<br />
Infants (0 – 17 months)<br />
16.7%<br />
55.6%<br />
27.8%<br />
52.9%<br />
41.2%<br />
83.3%<br />
5.9% <strong>11</strong>.1%<br />
5.6% 5.6%<br />
30.0%<br />
45.0%<br />
26.3%<br />
52.6%<br />
5.0% 5.3%<br />
35.0%<br />
30.0%<br />
Toddlers (18 – 36 months)<br />
40.0%<br />
25.0%<br />
44.4%<br />
22.2%<br />
44.4%<br />
27.8%<br />
<strong>11</strong>.1%<br />
Source: Starlight Infant/Toddler Program, Desired Results Developmental Profile I/T (<strong>2010</strong>), <strong>2010</strong>‐20<strong>11</strong><br />
* Only these four questions with 6 developmental levels have the ability to increase 5 levels.<br />
Notes: Only children who completed at least the first and third assessments have been included. This analysis excludes children who already scored at<br />
the highest developmental level on the 1st assessment. Ages are calculated as of the date of the 3rd assessment. “All Children” calculations include<br />
infants, toddlers, and children older than toddlers.<br />
Infant N: Interactions with Adults=17, Relationships with Familiar Adults=17, Language Comprehension=18, Responsiveness to Language=18,<br />
Communication of Needs, Feelings, and Interest=17, Reciprocal Communication=18, Interest in Literacy=18, Recognition of Symbols=18.<br />
Toddler N: Interactions with Adults=20, Relationships with Familiar Adults=19, Language Comprehension=20, Responsiveness to Language=20,<br />
Communication of Needs, Feelings, and Interest=20, Reciprocal Communication=20, Interest in Literacy=19, Recognition of Symbols=20.<br />
5.9%<br />
50.0%<br />
<strong>11</strong>.1%<br />
5.3% 5.0%<br />
5.0%<br />
20.0% 10.5% 15.0%<br />
20.0% 20.0% 10.0%<br />
55.0%<br />
15.0% 15.0%<br />
27.8%<br />
10.5%<br />
42.1%<br />
16.7%<br />
5.0%<br />
50.0%<br />
36.8% 35.0%<br />
15.0% 15.0% 15.0% 15.0% 10.5% 10.0%<br />
Increased 2 Levels<br />
Increased 1 Level<br />
No Change in Levels<br />
Decreased in Levels<br />
Increased 4 Levels<br />
Increased 3 Levels<br />
Increased 2 Levels<br />
Increased 1 Level<br />
No Change in Levels<br />
Decreased in Levels<br />
157
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ CHILD SNAPSHOT<br />
School Readiness � Steps to Success<br />
Child Snapshot<br />
Program Description<br />
<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has continued working with kindergarten, preschool, and family child care<br />
teachers to communicate about children who are transitioning to school. The vehicle for this<br />
communication is the Child Snapshot form. The form was developed in partnership between<br />
kindergarten teachers and early childhood educators as an easy and effective way to support<br />
children’s transition to kindergarten. The Snapshot is a three‐page form completed by both the<br />
parent and the preschool teacher in the spring prior to kindergarten, and it includes brief<br />
information about the child’s interests and abilities, language and developmental concerns,<br />
preschool experience and developmental information. They are collected and delivered by <strong>First</strong> 5<br />
staff to the schools the children will be attending, and then routed to each child’s new kindergarten<br />
teacher. As such, the form provides kindergarten teachers with family and preschool information<br />
about their new students, and helps them become more familiar with the preschool and child care<br />
programs which feed into their elementary schools.<br />
Each year, the Transition to Kindergarten Advisory group receives feedback from kindergarten<br />
teachers that the Child Snapshot form is an easy and effective way to support a child’s transition to<br />
kindergarten.<br />
Over the last few years the form has been expanded to include additional information such as family<br />
activities and community supports for parents. A measurement of kindergarten readiness was also<br />
included at the end of the Child Snapshot, using either the Desired Results Developmental Profile ‐<br />
Revised, Preschool (DRDP‐PS) or the Pre‐Kindergarten Observation Form, depending upon the type<br />
of preschool that children attended. For the purposes of this project, scores on the DRDP‐PS were<br />
“crosswalked” with the P‐KOF in order to have a common frame of measurement by which to<br />
examine children’s readiness.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Children 976<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
Program Development<br />
The number of children with Child Snapshots completed on their behalf continues to grow, and<br />
illustrates the increased communication between early childhood and elementary school settings,<br />
and the achievements being made to bridge children’s transition to kindergarten.<br />
158 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ CHILD SNAPSHOT<br />
� In Spring 20<strong>11</strong>, a total of 976 preschool children were assessed—509 boys (52%) and 467<br />
girls (48%). These children were drawn from 42 preschool programs throughout <strong>Santa</strong> <strong>Cruz</strong><br />
<strong>County</strong> and their child snapshot forms were shared with kindergarten teachers at 42<br />
elementary schools in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and surrounding areas.<br />
Figure <strong>11</strong>5: Number of Child Snapshot Forms Collected from Participating Preschool<br />
Programs<br />
Source: Applied Survey Research, Child Snapshot Log, 2006‐<strong>2010</strong>, and Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot.<br />
Pre‐Kindergarten Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />
Child Snapshot Results<br />
The P‐KOF assesses children across 24 readiness skills. These readiness skills can be reliably sorted<br />
into four domains, or Basic Building Blocks of Readiness: 1) Self‐Care & Motor Skills, 2) Self‐<br />
Regulation Skills, 3) Social Expression Skills, 4) Kindergarten Academics. The figure below displays<br />
children’s overall mean readiness scores as well as their average scores on each of the four Basic<br />
Building Blocks.<br />
Proficient<br />
In Progress<br />
Beginning<br />
1,000<br />
800<br />
600<br />
400<br />
200<br />
0<br />
393<br />
889<br />
617<br />
2006‐07 2007‐08 2008‐09 2009‐<strong>2010</strong> <strong>2010</strong>‐<strong>11</strong><br />
Figure <strong>11</strong>6: Students’ Average School Readiness Levels Across the Basic Building<br />
Blocks of Readiness<br />
4<br />
3<br />
2<br />
Not Yet<br />
1<br />
3.54<br />
3.75<br />
Overall Readiness Self‐Care & Motor<br />
Skills<br />
Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten Observation Form<br />
and crosswalked DRDP‐PS, Spring 20<strong>11</strong>.<br />
N=900‐904.<br />
832<br />
976<br />
3.50 3.59 3.44<br />
Self‐Regulation<br />
Skills<br />
Social Expression<br />
Skills<br />
Kindergarten<br />
Academics<br />
159
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ CHILD SNAPSHOT<br />
The next two figures highlight the readiness skills for which students were rated as demonstrating<br />
the most proficiency and the greatest challenges. Readiness skill strengths were identified within<br />
the Self Care & Motor Skills, Social Expression, and Kindergarten Academics Basic Building Blocks.<br />
Figure <strong>11</strong>7: Students’ Top Five Readiness Strengths<br />
TOP FIVE STRENGTHS BASIC BUILDING BLOCK<br />
STUDENTS’ AVERAGE SCORE<br />
(OUT OF 4.00 POSSIBLE)<br />
1. General coordination on the playground Self‐Care & Motor Skills 3.84<br />
2. Uses small manipulatives Self‐Care & Motor Skills 3.76<br />
3. Recognizes basic colors Kindergarten Academics 3.75<br />
4. Relates appropriately to adults other than<br />
parent/primary caregiver<br />
5. Appropriately expresses needs and wants<br />
verbally in primary language<br />
Social Expression 3.65<br />
Social Expression 3.64<br />
Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten. Pre‐Kindergarten<br />
Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />
Note: Means are based on 415‐899 students. Don’t know/ Not observed responses are not included. Scale points are as follows: 1=not yet, 2=<br />
beginning, 3=in progress, 4=proficient.<br />
Students were still developing the Kindergarten Academic skills involved in recognizing all letters of<br />
the alphabet and recognizing rhyming words, as well as the Self Regulation Skills involved in<br />
navigating peer relationships.<br />
Figure <strong>11</strong>8: Students’ Top Five Readiness Challenges<br />
TOP FIVE CHALLENGES BASIC BUILDING BLOCK<br />
STUDENTS’ AVERAGE SCORE<br />
(OUT OF 4.00 POSSIBLE)<br />
1. Recognizes letters of the alphabet Kindergarten Academics 3.05<br />
2. Recognizes rhyming words Kindergarten Academics 3.29<br />
3. Handles frustration well Self‐Regulation 3.38<br />
4. Negotiates with peers to resolve social<br />
conflict<br />
Self‐Regulation 3.39<br />
5. Participates successfully in circle time Self‐Regulation 3.47<br />
Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten Observation Form<br />
and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />
Note: Means are based on 415‐899 students. Don’t know/ Not observed responses are not included. Scale points are as follows: 1=not yet, 2=<br />
beginning, 3=in progress, 4=proficient.<br />
160 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Literacy Continuing Education Workshops<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ LITERACY CONTINUING EDUCATION WORKSHOPS<br />
As continuing education support for graduates of the SEEDS of Early Literacy classes, early childhood<br />
educators receive professional development and make activities and materials that will enhance<br />
their work environment and promote literacy with young children. Early Literacy Foundation (ELF)<br />
coaches conduct the trainings.<br />
Eight workshops were provided, each with a different focus:<br />
Fall, <strong>2010</strong><br />
� The first workshop focused on how to use a non‐fiction book with the Repeated Read Aloud<br />
strategy through the making of various sorting, vocabulary, and matching games.<br />
� The second workshop focused on vocabulary development through the making of vocabulary<br />
cards.<br />
� The third workshop supported phonological awareness through the use of poems, fingerplay<br />
cards, and rhyming games.<br />
� The fourth workshop focused on conversation skills through the making of a flannel board<br />
story and puppets.<br />
Spring, 20<strong>11</strong><br />
� The first workshop supported book and print rules through creating a Big Book Song book<br />
and flannel board story.<br />
� The second workshop emphasized social‐emotional development and vocabulary through<br />
the use of emotion cards and feeling words.<br />
� The third workshop focused on book and print rules<br />
through writing and counting activities.<br />
� The fourth workshop focused on a non‐fiction book<br />
using the Repeated Read Aloud strategy through the<br />
making of matching and sorting games.<br />
Population Served<br />
Fall <strong>2010</strong> Spring 20<strong>11</strong><br />
“These workshops encourage children<br />
to learn letters, words, phonological<br />
awareness. Thank you for your help in<br />
making us better educators.”<br />
-Workshop Participant,<br />
Spring 20<strong>11</strong> Workshop Survey<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Total<br />
(Unduplicated)<br />
Early Childhood Educators 23 19 35<br />
Source: (Fall) Literacy Continuing Education Workshops program data; (Spring) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
161
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ LITERACY CONTINUING EDUCATION WORKSHOPS<br />
Participants filled out an evaluation survey after the series of four workshops, to get their feedback<br />
on the usefulness of the workshops, and how frequently they used the materials and activities in<br />
their classrooms. For each survey question, participants answered “Not at all,” “Some,” or “Very<br />
Much.” Over 90% of participants reported that they found the workshops and materials very useful,<br />
and 46% ‐ 83% were currently using the tools and activities in their classrooms.<br />
Figure <strong>11</strong>9: Percentage of Participants Who Responded “Very Much” to Workshop<br />
Survey Questions<br />
<strong>First</strong> Workshop:<br />
Book and print rules - Big<br />
Book Song book & flannel<br />
board story<br />
Second Workshop:<br />
Social-emotional<br />
development and<br />
vocabulary<br />
Third Workshop:<br />
Book and print rules -<br />
Writing and counting<br />
activities<br />
Fourth Workshop:<br />
Non-fiction books -<br />
Repeated Read Aloud<br />
strategy<br />
Please tell us if you are using these name<br />
activities/games in your program? (N=<strong>11</strong>)<br />
How useful do you find this tool? (N=<strong>11</strong>)<br />
How useful was this workshop in supporting your<br />
knowledge with oral language? (N=12)<br />
Did you find the activities/games useful and<br />
appropriate? (N=12)<br />
Are you using the game board and vocabulary<br />
cards? (N=12)<br />
How useful was this workshop in supporting<br />
thinking skills? (N=13)<br />
With what frequency are you using the activities<br />
made? (N=13)<br />
How useful was this workshop in supporting writing<br />
around the room? (N=13)<br />
How many times do you read to your group of<br />
children in one day? (N=13)<br />
Source: Literacy Continuing Education Workshops survey data, Spring 20<strong>11</strong>. No survey was conducted in Fall <strong>2010</strong>.<br />
46.2%<br />
69.2%<br />
90.9%<br />
90.9%<br />
83.3%<br />
91.7%<br />
91.7%<br />
92.3%<br />
0% 20% 40% 60% 80% 100%<br />
100.0%<br />
162 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Migrant Education – Summer Pre‐K Academy<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION – SUMMER PRE‐K ACADEMY<br />
Migrant education implements a four‐week summer academy for children about to enter<br />
kindergarten at seven Pajaro Valley Unified School District (PVUSD) elementary school sites. The<br />
program is for children who do not qualify for Migrant<br />
Education and who have little or no preschool<br />
experience. The academy is geared toward exposing<br />
children to early literacy concepts and kindergarten<br />
routines, in a safe learning environment that helps to<br />
support children’s emotional and social well‐being and<br />
build bonds with other children to ease later<br />
adjustments.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Children 156<br />
Source: (Parents/Guardians) ; (Children) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
“We are most proud of the growth our<br />
students have demonstrated after<br />
participating in the program. This growth can<br />
be seen in the pre and post data, parent<br />
feedback, and anecdotal feedback from<br />
teachers at the beginning of school.<br />
As well documented in the research literature,<br />
we are confident that these programs are<br />
changing the long term achievement and<br />
success of our students..”<br />
- Migrant Education, <strong>Annual</strong> Progress <strong>Report</strong><br />
Outcome Objective: Children will increase their recognition of letter sounds<br />
Program Objectives<br />
75% of participants who completed both the pre and post survey<br />
will increase their letter sound recognition by 5 letter sounds using<br />
the cognate alphabet in the child’s home language.<br />
All Children<br />
<strong>2010</strong>‐20<strong>11</strong><br />
90.4%<br />
Children<br />
attending at least<br />
14 sessions<br />
Source: Migrant Education – Summer Pre‐K Academy, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />
N=94<br />
92.9%<br />
As seen in the following figure, in 20<strong>11</strong>, over 90% of all students who participated in the Summer<br />
Pre‐K Academy increased their letter sound recognition by at least five letter sounds, and this rose<br />
to almost 93% for children who attended at least 14 sessions. On average, students learned to<br />
recognize 16 new letter sounds by the time they left the program.<br />
N=85<br />
163
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION – SUMMER PRE‐K ACADEMY<br />
Figure 120: Summer Pre-K Academy Letter Sound Identification Results, 20<strong>11</strong><br />
Percentage of Students who Increased Their Letter<br />
Sound Recognition By At Least 5 Letter Sounds<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
All Students<br />
90.4%<br />
92.9%<br />
Students who attended at least 14 sessions<br />
Average Number of Letter Sounds Recognized at Pre<br />
and Post Assessment<br />
17.2 17.2<br />
1.0 1.1<br />
Source: Migrant Education – Summer Pre‐K Academy, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />
All Students N=94. 14 or more sessions Students N=85.<br />
Results for the past five years show a consistent pattern of learning, with 75%‐90% of students<br />
increasing their letter sound recognition by at least 5 letter sounds, and increases in recognition of<br />
from <strong>11</strong>‐16 letter sounds.<br />
Figure 121: Percentage of Summer Pre-K Academy Students who Increased Their Letter<br />
Sound Recognition By At Least 5 Letter Sounds<br />
100% 86.9% 83.8%<br />
90.4% 92.9%<br />
82.5% 81.9% 83.0%<br />
75.4%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
Figure 122: Average Increase in the Number of Letter Sounds Recognized by Summer<br />
Pre-K Academy Students<br />
20<br />
15.4 15.5<br />
14.9<br />
16.2 16.1<br />
16<br />
13.9<br />
12.4<br />
<strong>11</strong>.1<br />
12<br />
8<br />
4<br />
0<br />
Source: Migrant Education – Summer Pre‐K Academy, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 2007 ‐ 20<strong>11</strong>.<br />
Note: Between 2006 and 2009, the Summer Pre‐K Academy was a 5‐week program. Beginning in <strong>2010</strong>, it became a 4‐week program.<br />
All Students N: 2007=84, 2008=80, 2009=<strong>11</strong>4, <strong>2010</strong>=65, 20<strong>11</strong>=94. 14 or more sessions Students N: 2009=94, <strong>2010</strong>=47, 20<strong>11</strong>=85; no data for this<br />
population are available for 2007 and 2008.<br />
164 FIRST 5 SANTA CRUZ COUNTY<br />
20<br />
15<br />
10<br />
5<br />
0<br />
All Students Students who attended at<br />
least 14 sessions<br />
Pre Post<br />
2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />
All Students Students who attended at least 14 sessions<br />
2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />
All Students Students who attended at least 14 sessions
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Migrant Education School Readiness Program<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION SCHOOL READINESS PROGRAM<br />
The Migrant Education School Readiness Program (MESRP) offers a mechanism for ensuring that<br />
at‐risk children and families will have the support they need to prepare them for a successful<br />
transition to formal schooling, by providing a high‐quality early childhood program that includes:<br />
� An effective evidence‐based, culturally responsive curriculum grounded in empirical knowledge.<br />
� Developmentally appropriate instruction and strategies, including those specific to Dual<br />
Language Learners.<br />
� Alignment with high ECE standards as set forth by the California Preschool Learning<br />
Foundations.<br />
� High quality professional development and ongoing support through coaching for the staff.<br />
� A needs assessment to ensure that the program is responsive to the needs of the families.<br />
� An ongoing partnership between the families, the school, and community services.<br />
The MESRP program improves outcomes for both children and parents by supporting the child’s<br />
preparedness for formal schooling and strengthening the parent‐child relationship.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Children 36<br />
Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />
Outcome Objective: Children will increase their recognition of letter sounds<br />
Program Objectives<br />
75% of participants who completed both the pre and post<br />
survey and have attended consistently, will increase their letter<br />
sound recognition by 10 letter sounds in their home language.<br />
<strong>2010</strong>‐20<strong>11</strong><br />
English Assessment Home Language Assessment<br />
75.0%*<br />
Source: Migrant Education School Readiness Program: English assessment, Phonological Awareness Literacy Screening (PALS) tool, 20<strong>11</strong>; Home<br />
language assessment, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />
* English language results should be interpreted with caution due to the low number of cases.<br />
Two similar assessments were used to measure children’s recognition of letter sounds; the<br />
Phonological Awareness Literacy Screening (PALS) tool measured children’s ability to identify letter<br />
sounds in English, and the Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification<br />
tool measured children’s letter sound recognition in their home language. In 20<strong>11</strong>, 75% of students<br />
N=8<br />
80.0%<br />
N=30<br />
165
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION SCHOOL READINESS PROGRAM<br />
who participated in the Migrant Education School Readiness Program (MESRP) increased their letter<br />
sound recognition in English by at least 10 letter sounds, and this rose to almost 80% for children<br />
who took the assessment in their home language. On average, students learned to recognize 18 new<br />
letter sounds by the time they left the program.<br />
Figure 123: MESRP Letter Sound Identification Results, 20<strong>11</strong><br />
Percentage of Students who Increased Their Letter<br />
Sound Recognition By At Least 10 Letter Sounds<br />
Average Number of Letter Sounds Recognized at Pre<br />
and Post Assessment<br />
Source: Migrant Education School Readiness Program: English assessment, Phonological Awareness Literacy Screening (PALS) tool, 20<strong>11</strong>; Home<br />
language assessment, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />
English language N=8; Home language N=30.<br />
* English language results should be interpreted with caution due to the low number of cases.<br />
Outcome Objective: Children will demonstrate progress in early learning skills<br />
The Brigance Preschool Screen ‐ II assessment was utilized by the Migrant Education School<br />
Readiness Program (MESRP) to identify children’s present level of performance, set goals, and<br />
measure progress in domains that align to early learning standards. Through verbal questions,<br />
drawing, and physical activities, children were given a series of age‐appropriate assessments that<br />
provided a sampling of their learning, development, and skills in a broad range of areas, such as fine‐<br />
motor skills, body awareness, general knowledge, language development, and gross‐motor skills.<br />
Results show that students’ average scores on the Brigance Preschool Screen increased from 60.4 to<br />
79.3, demonstrating an overall improvement of 31% in their early learning skills.<br />
100<br />
80<br />
60<br />
40<br />
20<br />
0<br />
100%<br />
80%<br />
60%<br />
40%<br />
20%<br />
0%<br />
75.0%<br />
80.0%<br />
English Language* Home Language<br />
Figure 124: MESRP Students’ Average Scores on the Brigance Preschool Screen-II<br />
Assessment<br />
60.4<br />
Average Scores<br />
79.3<br />
Pre Post<br />
Source: Migrant Education School Readiness Program: Brigance Preschool Screen ‐ II assessment, 20<strong>11</strong>.<br />
N=24.<br />
166 FIRST 5 SANTA CRUZ COUNTY<br />
30<br />
25<br />
20<br />
15<br />
10<br />
5<br />
0<br />
8.0<br />
26.1<br />
1.7<br />
20.3<br />
English Language* Home Language<br />
Pre Post
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION SCHOOL READINESS PROGRAM<br />
Outcome Objective: Children will improve their listening comprehension for<br />
spoken words<br />
The Peabody Picture Vocabulary Test was utilized by the Migrant Education School Readiness<br />
Program (MESRP) to measure children’s listening comprehension for spoken Standard American<br />
English. The test is administered by showing a series of pictures to the child, with four pictures to a<br />
page. The examiner states a word describing one of the pictures and asks the child to indicate which<br />
picture that word describes. Raw scores are calculated and can be used for comparison in Pre/Post<br />
tests.<br />
Results show that students’ average scores on the Peabody Picture Vocabulary Test increased from<br />
73.4 to 84.4, demonstrating a 15% increase in their listening comprehension for spoken English<br />
words.<br />
100<br />
80<br />
60<br />
40<br />
20<br />
0<br />
Figure 125: MESRP Students’ Average Scores on the Peabody Picture Vocabulary Test<br />
73.4<br />
Average Scores<br />
84.4<br />
Pre Post<br />
Source: Migrant Education School Readiness Program: Peabody Picture Vocabulary Test, 20<strong>11</strong>.<br />
Note: Results should be interpreted with caution due to the low number of cases.<br />
N=7.<br />
167
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ PVUSD PARENT CONFERENCE<br />
Pajaro Valley Unified School District (PVUSD) Parent Conference<br />
Program Description<br />
In February 20<strong>11</strong>, <strong>First</strong> 5 co‐sponsored the Pajaro Valley Unified School District’s Parent Conference.<br />
The annual event brings together parents of children of all ages to learn how they can support their<br />
children’s learning. Families participated in workshops promoting transition to kindergarten<br />
practices, healthy child development, and positive discipline.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Number of families attending this Conference 318 families<br />
Percentage of families with children ages 0‐5 55% with children ages 0‐5<br />
Source: Pajaro Valley Unified School District, 20<strong>11</strong>.<br />
168 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />
Transition to School Workshops<br />
Program Description<br />
FIRST 5 SANTA CRUZ COUNTY<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ TRANSITION TO SCHOOL WORKSHOPS<br />
Transition to School Workshops are offered to families in preschool settings. These workshops are<br />
designed to inform parents about kindergarten registration requirements, choices of language<br />
programs, how to support their child in school, and ways to ensure that their child’s entry into<br />
school is a pleasant and smooth transition.<br />
Families participated in workshops at five elementary schools (Alianza, Freedom, Landmark, Radcliff,<br />
and Starlight) and at early education sites throughout Watsonville. Parents also participated in<br />
workshops at 13 Head Start and State Preschool sites throughout Watsonville and Freedom.<br />
Population Served<br />
<strong>2010</strong>‐20<strong>11</strong><br />
Parents/Guardians 267<br />
Source: Transition to School – Workshop Schedule and Participant Data, <strong>2010</strong>‐ 20<strong>11</strong>.<br />
169
PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
CHILDREN LEARNING AND READY FOR SCHOOL ‐ TRANSITION TO SCHOOL WORKSHOPS<br />
170 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
APPENDICES<br />
FIRST 5 SANTA CRUZ COUNTY<br />
171
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
172 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
Appendix I: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Framework<br />
Based on the <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Plan for 2009‐2012, a strategic framework was<br />
developed for each of the three goal areas (Healthy Children, Strong Families, and Children Learning<br />
and Ready for School). The highlighted results have been chosen to receive Commission investment<br />
between 2009 and 2012. This diagram is an expanded version of that which is presented previously<br />
in this report.<br />
Focus Area<br />
Community<br />
Goals<br />
Results<br />
FIRST 5 SANTA CRUZ COUNTY<br />
Increase<br />
Prenatal<br />
Care<br />
Children are<br />
Born Healthy<br />
Healthy<br />
Children<br />
Increase<br />
Insurance<br />
Coverage Increase<br />
Medical/ Dental<br />
Homes<br />
Decrease<br />
Childhood<br />
Obesity<br />
Increase Number of<br />
Children Reaching<br />
Developmental<br />
Milestones<br />
Children Remain<br />
Healthy<br />
Decrease Family<br />
Food Insecurity<br />
Increase use of<br />
Preventive<br />
Health Care<br />
Increase Smoke<br />
Free Homes<br />
173
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Focus Area<br />
Community<br />
Goals<br />
Results<br />
Focus Area<br />
Community<br />
Goals<br />
Results<br />
Decrease Parent/<br />
Guardian<br />
Substance Abuse<br />
Increase<br />
Parental<br />
Involvement<br />
in Children’s<br />
Learning &<br />
Development<br />
Increase Access to<br />
Child Care/Preschool<br />
Children Live<br />
in Safe<br />
Environments<br />
Decrease Child Abuse<br />
& Neglect<br />
Decrease Child<br />
Exposure to Domestic<br />
Violence<br />
Children Grow Up in Environments<br />
that Support Learning<br />
Increase<br />
Participation<br />
in Quality<br />
Structured<br />
Activities<br />
Increase Use<br />
of Quality<br />
Child Care<br />
Practices<br />
Strong Families<br />
Improve Parent & Caregiver<br />
Practices that Support Social<br />
and Emotional Development<br />
Decrease Impact<br />
of Parental<br />
Mental Illness<br />
Children Learning and<br />
Ready for School<br />
Improve<br />
Pre‐<br />
Literacy<br />
Skills<br />
Decrease Family<br />
Financial<br />
Insecurity<br />
Children are Socially<br />
and Emotionally<br />
Healthy<br />
Schools are Ready for Children<br />
Increase Identification<br />
& Accommodation of<br />
Children with Special<br />
Needs<br />
Increase Use of<br />
Kindergarten<br />
Transition<br />
Practices<br />
Reduce Family<br />
Isolation<br />
174 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
Appendix II: Measurement Tools<br />
The following assessments and measurement tools were used to collect evaluation data during this<br />
funding cycle. They are listed in alphabetical order.<br />
Ages & Stages Questionnaires (ASQ)<br />
The Ages & Stages Questionnaires ® (ASQ) are used to screen infants and young children for<br />
developmental delays during the crucial first five years of life. Parents complete the 30‐item<br />
age‐appropriate questionnaires at designated intervals, assessing children in their natural<br />
environments to ensure valid results. Each questionnaire covers five key developmental<br />
areas: communication, gross motor, fine motor, problem solving, and personal‐social. 26<br />
Ages & Stages Questionnaires: Social Emotional (ASQ:SE)<br />
Ages & Stages Questionnaires ® : Social‐Emotional (ASQ:SE) focus on children’s social and<br />
emotional behavior. Professionals assess children’s social‐emotional development at<br />
different ages (at 6, 12, 18, 24, 30, 36, 48, and 60 months). ASQ:SE screening areas focus on<br />
personal‐social skills (self‐regulation, compliance, communication, adaptive functioning,<br />
autonomy, affect, and interaction with people). With the results, professionals can recognize<br />
young children at risk for social or emotional difficulties, identify behaviors of concern to<br />
caregivers, and identify any need for further assessment. 27<br />
Brigance Preschool Screen - II<br />
The Brigance Preschool Screen ‐ II (Curriculum Associates, 2005) was utilized by the PVUSD<br />
Migrant Education School Readiness Program to identify children’s present level of<br />
performance, set goals, and measure progress in domains that align to early learning<br />
standards. Through verbal questions, drawing, and physical activities, children are given a<br />
series of age‐appropriate assessments that provide a sampling of their learning,<br />
development, and skills in a broad range of areas, such as fine‐motor skills, body awareness,<br />
general knowledge, language development, and gross‐motor skills. The primary purpose of<br />
screening is to obtain a broad sampling of a child’s skills and behaviors for one or more of the<br />
following reasons:<br />
1. To identify any child who should be referred for a more comprehensive evaluation to<br />
determine the existence of a disability or the need for special placement<br />
2. To help determine the most appropriate initial placement or grouping of children<br />
3. To assist the teacher in planning a more appropriate program for the child<br />
4. To comply with mandated screening requirements<br />
The Brigance Preschool Screen ‐ II assessment is currently only available in English.<br />
26<br />
Brookes Publishing, Ages & Stages Questionnaires® (ASQ), http://www.brookespublishing.com/store/books/bricker-asq/, 2007.<br />
27<br />
Brookes Publishing, Ages & Stages Questionnaires‐Social Emotional (ASQ:SE), http://www.brookespublishing.com/store/books/squiresasqse/index.htm,<br />
2007.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
175
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Child Behavior Checklist (CBCL)<br />
The Child Behavior Checklist (CBCL; Achenbach, 1991; 2001) is part of the Achenbach System<br />
of Empirically Based Assessment. The CBCL is a screening tool which is used by parents (and<br />
in mental health settings) to assess behavioral and emotional problems in children and<br />
adolescents.<br />
The Child Behavior Checklist (CBCL) contains about 100 items that can cluster into several<br />
syndromes, competence scales, codes from the Diagnostic and Statistical Manual of Mental<br />
Disorders, 4th Edition (DSM‐IV). Children are ranked according to the severity of behavior,<br />
thus percentile rankings tell us how a child, or group of children, compare to the general<br />
population. Higher percentile rank indicates more problematic behavior. Rankings falling<br />
between the 65th and 70th percentile indicate “Borderline Clinical”; the 70th percentile rank<br />
and above denote the clinical range. Clients who score at or near the clinical range are more<br />
likely to have or develop a clinical diagnosis. Thus, the CBCL serves as an indicator of clinical<br />
risk based on the degree of similarity with other children who have received (or have not<br />
received) a diagnoses. A significant drop in percentile rank indicates a decrease in clinical risk.<br />
The CBCL has good psychometric properties and has been validated internationally. This tool<br />
is helpful in determining children who might benefit from additional assessment and mental<br />
health services.<br />
Child Snapshot<br />
The Kinder Transition Team Child Snapshot was a strategy within the Transition to School<br />
Plan and was identified by the Transition to School Advisory group in July 2005 as one that<br />
could help support children’s adjustment to kindergarten. The Snapshot was completed by<br />
parents and early care teachers for each child entering kindergarten in the fall, and was<br />
forwarded on to the child’s new kindergarten teacher. The form included brief (snapshot)<br />
information about the child’s interests and abilities, the child’s health, language or<br />
developmental concerns, preschool experience, and other developmental information. The<br />
form was expanded in 2009‐10 to include additional information such as family activities and<br />
community supports for parents. A measurement of kindergarten readiness was also<br />
included at the end of the Child Snapshot, using either the Desired Results Developmental<br />
Profile‐R Preschool or the Pre‐Kindergarten Observation Form, depending upon the child care<br />
site within <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> (both of these assessments are described below).<br />
Depression, Anxiety, Stress Scale (DASS-21)<br />
The Depression, Anxiety, and Stress Scale – Short Version (DASS‐21) was utilized by<br />
participants in levels 4 and 5 of the Triple P Program. It is a 21‐item brief version of the<br />
Depression Anxiety Stress Scales (Lovibond & Lovibond in 1995). It is a self‐report measure<br />
used to assess the levels of depression, anxiety, and tension/stress experienced, which was<br />
completed by parents in the program. Respondents indicate how much they felt each of the<br />
21 symptoms during the previous week. The scale is psychometrically sound – it has good<br />
176 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
convergent and discriminant validity. It also has high internal consistency in clinical and non‐<br />
clinical samples, and across different ethnic groups.<br />
Desired Results Developmental Profile<br />
The Desired Results Development Profile was created as a comprehensive program<br />
evaluation system designed to measure California Department of Education funded child<br />
development contractor effectiveness. Desired results reflect the positive effects of the child<br />
development system on the development and functioning of children and on the self‐<br />
sufficiency and functioning of families 28 . The DRDP is an observation‐based assessment and is<br />
organized into several domains, each representing a crucial area of learning and<br />
development. Each domain contains several measures, which focus on a specific competency<br />
within that domain. There are three DRDP assessment instruments: infant/toddler (birth to<br />
36 months), preschool (three years to kindergarten entry), and school‐age (kindergarten<br />
through 12 years); two of these assessments were used by <strong>First</strong> 5 partners:<br />
a) Desired Results Developmental Profile – Infant/Toddler (<strong>2010</strong>)<br />
The DRDP – Infant Toddler (<strong>2010</strong>) is used for children ages birth to 36 months, and measures<br />
five domains. The Starlight Infant Toddler Program chose to assess the infants and toddlers<br />
participating in their program in two domains, using a total of eight measures. In the Self and<br />
Social Development domain, two measures were used to assess interactions and<br />
relationships with adults. In the Language and Literacy Development domain, six measures<br />
were used to assess language comprehension, communication skills, interest in literacy, and<br />
recognition of symbols.<br />
b) Desired Results Developmental Profile - Revised, Preschool (DRDP-R, PS)<br />
The DRDP – Preschool Version is used for children 3 years of age to kindergarten entry. The<br />
DRDP‐PS has 10 overall indicators, containing 39 measures. This version of the DRDP<br />
instrument was used in conjunction with the Child Snapshot (see Child Snapshot, above).<br />
Early Language and Literacy Classroom Observation Pre-K Tool<br />
(ELLCO Pre-K)<br />
The first version of the ELLCO (ELLCO Toolkit) was designed to evaluate the teaching practices<br />
of early childhood educators in the areas of language and literacy, in pre‐kindergarten to<br />
third‐grade classrooms. 29 The newest version of the tool (ELLCO Pre‐K) is comparable to the<br />
ELLCO Toolkit, and has been reorganized so that it reduces the bias towards classrooms that<br />
28 California Department of Education. (2009). Introduction to desired results. Retrieved from<br />
http://www.cde.ca.gov/sp/cd/ci/desiredresults.asp<br />
29 Education Development Center, Inc., Center for Children and Families, Early Language and Literacy Classroom Observation Toolkit, 2002.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
177
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
have a lot of resources, and focuses more on the use of materials rather than just their<br />
presence in the preschool classrooms. 30<br />
The ELLCO Pre‐K was used by the Early Literacy Foundations to help identify the effectiveness<br />
of classroom teaching on children’s language and literacy development by focusing on five<br />
components: Classroom Structure, Curriculum, the Language Environment, Books and Book<br />
Reading, and Print and Early Writing.<br />
Eyberg Child Behavior Inventory Intensity Scale (ECBI)<br />
The Eyberg Child Behavior Inventory Intensity Scale (ECBI; Eyberg & Pincus, 1999) was utilized<br />
by participants in levels 4 and 5 of the Triple P Program. The ECBI is a 36‐item parent report<br />
measure of behavior problems among children. Parents indicate the frequency of common<br />
behavior problems, such as wetting the bed, whining, or having temper tantrums. Parents<br />
indicate how frequently each of the problem behaviors occur (from never to always) and<br />
whether or not they feel that the behavior is a problem (yes or no). The ECBI has good<br />
psychometric properties (reliability and validity). The ECBI is useful in determining children<br />
that may have a diagnosable disruptive behavior disorder, as well as for helping intervene to<br />
reduce early behavior problems and to reduce negative parent‐child interactions that may<br />
contribute to the development of disruptive behavior problems 31 .<br />
Family Child Care Environment Rating Scale, Revised Edition (FCCERS-R)<br />
The Family Child Care Environment Rating Scale – Revised Edition (FCCERS–R) assesses family<br />
child care programs conducted in a provider’s home, and is designed to ensure protection of<br />
children’s health and safety, appropriate stimulation through language and activities, and<br />
warm, supportive interaction. The 38 items are organized into seven subscales: Space and<br />
Furnishings, Personal Care Routines, Listening and Talking, Activities, Interaction, Program<br />
Structure, and Parents and Provider. <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is tracking four of these<br />
indicators: helping children understand language; helping children use language; using books;<br />
and staff‐child interaction. Since family child care homes frequently enroll a wide age range<br />
of children, this scale is designed to assess programs serving children from birth through<br />
school‐agers (up to 12 years of age), as well as children with special needs, and is sensitive to<br />
cultural and socioeconomic diversity. 32<br />
Healthcare Effectiveness Data and Information Set (HEDIS) Indicators<br />
<strong>First</strong> 5 uses the Healthcare Effectiveness Data and Information Set (HEDIS) data to track the<br />
quality of care that children enrolled in Healthy Kids are receiving in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>. A<br />
total of 10 health care quality indicators are requested annually by <strong>First</strong> 5 California and the<br />
30<br />
Review by Maria Cahill (University of Tennessee), of the User’s Guide to the Early Language & Literacy Classroom Observation Pre‐K Tool,<br />
Education Book Review website.<br />
31<br />
Berkovits, M. D., O’Brien, K. A., Carter, C. G., & Eyberg, S. M. (<strong>2010</strong>). Early identification and intervention for behavior problems in<br />
primary care: A comparison of two abbreviated versions of parent‐child interaction therapy. Behavior Therapy, 41, 375 – 387.<br />
32<br />
Environment Rating Scales – Family Child Care Environmental Rating Scale, Revised Edition: http://www.fpg.unc.edu/~ECERS/.<br />
September 18, 2009.<br />
178 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
California Endowment from every operating Healthy Kids insurance plan based on data<br />
entered into HEDIS. HEDIS is a “set of standardized performance measures designed to<br />
ensure that purchasers and consumers have the information they need to reliably compare<br />
the performance of managed health care plans.” 33<br />
Individual Growth and Development Indicators (IGDI’s)<br />
Individual Growth and Development Indicators (IGDI’s) are a set of measures designed and<br />
validated for use by early education professionals for the purpose of monitoring children’s<br />
growth and progress in early reading predictors. Unlike standardized tests that are<br />
administered infrequently, IGDI’s is designed to be used repeatedly by early childhood<br />
educators in order to estimate each child’s “rate of growth” over time. The distinctive benefit<br />
of this approach is that the information can be used to directly inform intervention design,<br />
implementation, and modification at reasonable levels of training, time, and cost. The tools<br />
provide helpful information about children’s growth in three key areas of reading predictors:<br />
picture naming (a measure of vocabulary development), rhyming, and alliteration.<br />
Infant/Toddler Environment Rating Scale, Revised Edition (ITERS-R)<br />
The Infant/Toddler Environment Rating Scale ‐ Revised Edition (ITERS‐R) is designed to assess<br />
early childhood educators working with children from birth to 30 months of age. ITERS‐R<br />
contains items to assess provision in the environment for the protection of children’s health<br />
and safety, appropriate stimulation through language and activities, and warm, supportive<br />
interaction that play an important role in improving the quality of infant/toddler care. ITERS‐<br />
R is composed of 39 items that are organized into seven subscales: Space and Furnishings,<br />
Personal Care Routines, Listening and Talking, Activities, Interaction, Program Structure, and<br />
Staff. 34 <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is tracking four of these indicators: helping children<br />
understand language; helping children use language; using books; and staff‐child interaction.<br />
Literacy Continuing Education Workshops: <strong>Evaluation</strong> Survey<br />
Early childhood educators who complete the SEEDS of Early Literacy classes can continue<br />
receiving professional development through the Literacy Continuing Education Workshops,<br />
where they make activities and materials that will enhance their work environment and<br />
promote literacy with young children. In this program, four workshops are provided, each<br />
with a different focus. At the end of the program, early childhood educators are asked to<br />
complete an <strong>Evaluation</strong> Survey that includes questions about each of the workshops,<br />
including how useful they were and what they liked best. Three additional open‐ended<br />
questions are asked about how the workshops support them in their work with children,<br />
what they like most about these workshops, and what recommendations they might have to<br />
improve these workshops.<br />
33 ®<br />
The Health Plan Employer Data and Information Set (HEDIS ), http://www.ncqa.org/Programs/HEDIS/index.htm, 2007.<br />
34<br />
Environment Rating Scales – Infant/Toddler Environmental Rating Scale, Revised Edition: http://www.fpg.unc.edu/~ECERS/. September<br />
18, 2009.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
179
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Migrant Education Even Start (MEES) Pre-K Letter Sound Identification<br />
Children attending the Migrant Education – Summer Pre‐K Academy and the School<br />
Readiness Program are assessed using the Pre‐K Letter Sound Identification tool, which is<br />
used to assess letter sound recognition in the child’s primary language. The MEES tool is a<br />
pre‐ and post‐program survey that allows early childhood educators to circle those letters for<br />
which the child can say the sound (not the name of the letter). Changes in children’s<br />
outcomes are evaluated by comparing the scores between their baseline and final<br />
assessments.<br />
Parent Problem Checklist<br />
The Parent Problem Checklist (Dadds & Powell, 1991) was utilized by Levels 4 and 5 of the<br />
Triple P Program. It is a 36‐item self‐assessment measure of parental and relationship<br />
conflict, completed by each parent. For each issue (e.g. disagreement over household rules),<br />
parents identify if the issue has been a problem (yes or no), and the extent to which the issue<br />
has been a problem, from not at all, to very much. It has been shown to have high internal<br />
consistency, test‐retest reliability, and convergent validity.<br />
Parenting Experience Survey<br />
The Parenting Experiences Survey (Sanders et. al., 1999) was utilized by Level 3 of the Triple P<br />
Program. It is a self‐report measure of issues related to being a parent, and was completed<br />
by parent participants. It consists of 7 items and assesses parents’ experiences related to<br />
issues such as how difficult they perceive their child to be, how stressful they feel parenting<br />
to be, and how rewarding they feel parenting to be. There are 3 items which are specific to<br />
parents that have a partner. Those items are used to assess agreement on discipline, partner<br />
support, and relationship happiness. This survey is not used as the primary measure for any<br />
of the variables that it measures, but it has been used to show changes in parental attitudes<br />
and behaviors from the beginning to the completion of the Triple P Program.<br />
Parenting Scale<br />
The Parenting Scale (Arnold, O’Leary, Wolff & Acker, 1993) was utilized by Levels 4 and 5 of<br />
the Triple P Program. It is a measure of parenting styles for handling child misbehavior,<br />
completed by parents. It consists of 30 items, which are grouped into 3 subscales: laxness,<br />
over‐reactivity, and hostility. The Parenting Scale has good test‐retest reliability, discriminant<br />
validity, and correlates with other self‐report measures of child behavior, marital discord,<br />
and child behavior.<br />
Parenting Tasks Checklist<br />
The Parenting Tasks Checklist was utilized by Levels 4 and 5 of the Triple P Program. It is a<br />
self‐report measure of confidence in parenting abilities, completed by parents. It is a 28‐item<br />
scale in which parents rate their confidence (from 0 – Certain I can’t do it to 100 – Certain I<br />
180 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
can do it), across a range of difficult child behaviors, such as managing their child when the<br />
child becomes upset, or when traveling in a car.<br />
Parent’s Attribution for Child’s Behavior Measure<br />
The Parent’s Attribution for Child’s Behavior Measure (Pigeon & Sanders, 2004) was utilized<br />
by Level 5 of the Triple P Program. It is a self‐report measure of attributions for children’s<br />
behaviors. The instrument consists of 6 hypothetical situations describing different types of<br />
difficult child behavior, with 4 questions related to each situation. The questions for each<br />
situation relate to innateness of the child’s behavior, the child’s intentionality, and the<br />
blameworthiness of the child. The total score and the 3 subscale scores for this tool have<br />
good internal consistency and discriminant validity.<br />
Peabody Picture Vocabulary Test, 4 th Edition (PPVT-4)<br />
The Peabody Picture Vocabulary Test (Dunn & Dunn, 2007) is a norm‐referenced test of<br />
receptive vocabulary, and was utilized by the PVUSD Migrant Education School Readiness<br />
Program to measure children’s listening comprehension for spoken Standard American<br />
English. It requires no reading or writing. The test is administered by showing a series of<br />
pictures to the child, with four pictures to a page. The examiner states a word describing one<br />
of the pictures and asks the child to indicate which picture that word describes. Children<br />
complete as many series of pictures as they can until a “ceiling set” is reached, based on the<br />
number of errors they are making. At that point, raw scores are calculated as the total<br />
number of items that child completed minus the total number of errors. Raw scores can be<br />
used for comparison in Pre/Post tests, or converted to standard scores, percentile ranks, or<br />
age equivalents. The PPVT‐4 assessment is currently only available in English.<br />
Phonological Awareness Literacy Screening (PALS)<br />
Migrant Education used the letter ID component of the Phonological Awareness Literacy<br />
Screening (University of Virginia, 2004) as an assessment tool in their School Readiness<br />
Program, to measure letter sound knowledge. The PALS assessment is currently only<br />
available in English, so this assessment was often combined with the MEES Pre‐K Letter<br />
Sound Identification tool, which is available in both English and Spanish.<br />
Pre-Kindergarten Observation Form (P-KOF)<br />
The Pre‐Kindergarten Observation Form (P‐KOF) was originally developed by Applied Survey<br />
Research in 2001 using guidelines from the National Education Goals Panel (NEGP)<br />
framework of readiness. Since 2001, four additional skills have been added to better capture<br />
children’s skills at negotiation, coping, empathy, and handling frustration. The Pre‐<br />
Kindergarten Observation Form is a 24‐item, observation‐based assessment used by child<br />
care providers to assess children on readiness skills pertaining to kindergarten academic<br />
skills, social expression, self‐regulation, and self‐care and motor skills. Child care providers<br />
were asked to observe and score each child according to his or her level of proficiency in<br />
FIRST 5 SANTA CRUZ COUNTY<br />
181
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
each skill, ranging from not yet to proficient (with an option of don’t know/not observed for<br />
each item). The P‐KOF has been shown to have good reliability and validity. The instrument<br />
was attached to the back of the Child Snapshot, and was utilized at certain sites within <strong>Santa</strong><br />
<strong>Cruz</strong> <strong>County</strong>.<br />
Raising A Reader: Parent Impact Survey<br />
The Parent Impact Survey was utilized by the Raising A Reader Program. It is a self‐report<br />
measure of parent and child engagement with books and library use. It consists of 29 items<br />
related to reading in the home, use of book bags, and parent‐child reading practices. Items<br />
assess current practices but there are also retrospective items which assess parent and child<br />
reading practices before program participation.<br />
Relationship Quality Index<br />
The Relationship Quality Index (Norton, 1983; also known at the Quality Marriage Index) was<br />
utilized by Levels 4 and 5 of the Triple P Program. It is a self‐report measure of relationship<br />
satisfaction, and was completed by parents. It consists of six statements related to<br />
dimensions of relationship satisfaction such as happiness, strength, and stability.<br />
Respondents indicate how much they agree or disagree with each statement, ranging from<br />
very strongly disagree, to very strongly agree.<br />
<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Services Unifying Network (SCC SUN) Database /<br />
CCD Data<br />
Funded partners were required to submit information on a quarterly or biannual basis on the<br />
program participants who they directly served. Client characteristic data (CCDs) were<br />
gathered in one of two ways, the SCC SUN database, and partner‐specific data collection<br />
forms. 35<br />
o The SCC SUN database was launched on January 1, 2004, and some partner agencies used<br />
this database to record their clients’ data. The database was integrated, meaning that<br />
information could be shared between agencies, if the appropriate consent was obtained.<br />
Demographic information about these clients could then be extracted for analysis, using<br />
unique IDs that maintained clients’ anonymity.<br />
o Partner agencies not using the SCC SUN database collected and submitted demographic<br />
data in partner‐specific data collection forms.<br />
In the course of evaluating these data, a “cleaning” process was performed. In this process,<br />
each program’s data were standardized to use the same response sets, reviewed for accuracy<br />
and completeness, and corrected wherever possible. These data were then migrated to a<br />
customized statistical database that aggregated them and determined the unduplicated<br />
count of individuals served by goal area, partner agency, and overall. Each client<br />
35 In this report, all client characteristic data (CCDs) collected from both the SUN database and partner‐specific data collection forms, that<br />
were then combined and comprehensively analyzed, are collectively referred to as “SUN database/CCD data.”<br />
182 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
characteristic was analyzed, with results that reported the total number of individuals with<br />
data for that variable, and the frequency and percentage of each response to that variable.<br />
o Children’s ages were determined in these ways:<br />
� For all partners except Triple P, children’s ages were calculated as of the first day of<br />
the funding cycle. This enabled all children ages 0‐5 to be included in the analyses,<br />
even if they turned six years old later in the year. Children not yet born by the first<br />
day of the funding cycle (i.e., born later in the funding cycle) were also included in<br />
the analyses and categorized as being under one year of age.<br />
� For Triple P children, their ages were calculated as of the date of their parent’s first<br />
assessments (“Pre‐assessments”), or the date of their single program session. This<br />
date was chosen since many Triple P assessments required that the child be within a<br />
certain age range for the parent to complete it. Therefore, a more exact<br />
determination of the child’s age as of the date of the assessment was needed in<br />
order to identify whether or not it was appropriate to include those data in the<br />
analysis of that assessment.<br />
o The cities where clients lived were organized into the following sub‐county areas:<br />
FIRST 5 SANTA CRUZ COUNTY<br />
SUB‐COUNTY AREA CITIES<br />
North <strong>County</strong> Bonny Doon, Capitola, Davenport, Live Oak, <strong>Santa</strong> <strong>Cruz</strong>, Scotts Valley, Soquel<br />
South <strong>County</strong> Aptos, Corralitos, Freedom, La Selva Beach, Seacliff, Watsonville<br />
San Lorenzo Valley Ben Lomond, Boulder Creek, Brookdale, Felton, Mount Hermon<br />
Structured Decision Making (SDM)<br />
The Structured Decision Making (SDM) model is a set of assessments for guiding decision‐<br />
making at each of the decision points for children in Families Together. One assessment is the<br />
SDM Family Prevention Services Screening Tool (FPSST), used to make two decisions:<br />
whether or not to offer voluntary prevention services and, if so, the frequency of ongoing<br />
case manager contact. The screening tool identifies families who have low, moderate, high,<br />
or very high probabilities of future abuse or neglect. The risk level identifies the degree of risk<br />
of future maltreatment, guides the decision to offer voluntary prevention services, and helps<br />
determine the frequency of case manager contact. 36<br />
The SDM:FPSST is also used to reassess a family in order to make two decisions: whether or<br />
not to continue voluntary prevention services past 12 months for these families receiving<br />
intensive services, and past 3 months for those receiving a brief intervention and, if so, the<br />
frequency of case manager contact. 37<br />
36 Children’s Research Center, Structured Decision Making Policy and Procedure Manual, p. 12, 2006.<br />
37 Children’s Research Center, Structured Decision Making Policy and Procedure Manual, p. 31 & 36, 2006.<br />
183
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
Triple P: Program-Specific Assessments<br />
Satisfaction Survey<br />
Multiple Sessions (Individual or Group)<br />
The Multiple Sessions Satisfaction Survey was utilized for parents who completed Levels 3, 4,<br />
and/or 5 of the Triple P Program. It consists of 16 items – 13 closed‐ended items and 3 open‐<br />
ended items. Parents assessed many different dimensions of the program including: the<br />
quality of the program, the extent to which the program met their needs and their child’s<br />
needs, how much the program helped parents deal with problems in their family or with<br />
their children, relationship improvement, child behavior improvement, and overall<br />
satisfaction.<br />
Single Sessions (Seminars & Workshops)<br />
The Single Session Satisfaction Survey was utilized for the Level 2 Seminars and Level 3<br />
Workshops of the Triple P Programs. It consists of 4 items – 3 closed‐ended questions, and 1<br />
open‐ended question. Participants filled out this short survey which assessed if they felt that<br />
the seminar or workshop addressed their questions, whether they were going to use any of<br />
the parenting strategies they learned, and if they were satisfied, overall, with the seminar or<br />
workshop. Participants could also add any additional comments they had.<br />
Follow-Up Phone Survey<br />
Parents and guardians who completed certain Triple P programs were given the option of<br />
voluntarily participating in a follow‐up phone survey six months and one year later, to help<br />
determine the long‐lasting effects of these programs on their parenting skills and<br />
experiences. This survey consisted of 18 questions, some with multiple parts, that asked<br />
about their parenting abilities and effectiveness in dealing with certain parenting problems,<br />
their confidence in their parenting skills, the Triple P strategies that they are currently using,<br />
changes in their child’s behavior, and where applicable, their relationship with and support<br />
from their partner. Participants were also given the option of commenting on their<br />
experience with the program. Participants who completed the survey were given a $25 gift<br />
certificate to Target.<br />
Effectiveness of Staff Training<br />
In addition to offering structured trainings to practitioners, Triple P America also provides<br />
measures to assess the effectiveness of such trainings. The first measure is a Parent<br />
Consultation Skills Checklist (PCSC), an instrument to gauge changes in practitioners’ ability<br />
and confidence to conduct parent consultations. The second instrument, a Workshop<br />
<strong>Evaluation</strong> Survey, is a measure of practitioners’ satisfactions with the trainings.<br />
184 FIRST 5 SANTA CRUZ COUNTY
FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />
Parent Consultation Skills Checklist<br />
The Parent Consultation Skills Checklist (PCSC) was used to measure Triple P practitioners’<br />
self‐efficacy, or perceived competency, in core skills including assessment, active skills<br />
training, dealing with process issues, and clinical application of positive parenting strategies.<br />
Practitioners rated their proficiency on a 7‐point scale (1 = not at all confident or definitely<br />
not adequately trained, 7 = very confident or definitely adequately trained). The<br />
questionnaire was administered prior to beginning training (Pre), immediately after training<br />
(Post), and at the end of accreditation (Follow‐up).<br />
Workshop <strong>Evaluation</strong> Survey<br />
Triple P practitioners completed a Workshop <strong>Evaluation</strong> Survey at the end of each training<br />
and on completion of the accreditation process. The survey included a 7‐point scale (1 = low,<br />
7 = high) to assess the quality of the training course, whether the amount of active<br />
participation within the course was appropriate, the quality of the content of the training,<br />
whether respondents felt they had the skills to implement the program, and overall<br />
satisfaction with the training course.<br />
FIRST 5 SANTA CRUZ COUNTY<br />
185
APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />
186 FIRST 5 SANTA CRUZ COUNTY