10.01.2013 Views

First 5 Santa Cruz County 2010-11 Annual Evaluation Report

First 5 Santa Cruz County 2010-11 Annual Evaluation Report

First 5 Santa Cruz County 2010-11 Annual Evaluation Report

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

FIRST 5 SANTA CRUZ COUNTY<br />

ANNUAL EVALUATION REPORT<br />

July 1, <strong>2010</strong> - June 30, 20<strong>11</strong><br />

October 20<strong>11</strong><br />

OUR MISSION:<br />

OUR VISION:<br />

All <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Children<br />

enter school ready to achieve<br />

to their greatest potential.<br />

To help children succeed in school and in life,<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> invests in health, early<br />

learning, and family support to promote optimal<br />

development of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children.


Acknowledgements<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> would like to acknowledge Applied Survey Research (ASR) for their support<br />

and assistance with the evaluation and this report. <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> also thanks Nicole<br />

Young, of Optimal Solutions Consulting, for the close collaboration in crafting the procedures<br />

necessary to successfully evaluate the Triple P program.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> would also like to thank the staff and participants of the funded partner<br />

agencies whose commitment to data collection has facilitated the gathering of the robust data<br />

included in this report.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Applied Survey Research Optimal Solutions Consulting<br />

Susan True<br />

Stephanie Bluford<br />

Vicki Boriack<br />

Angela Cline<br />

Barbara Dana<br />

Irene Freiberg<br />

Holly Maclure<br />

Alicia Zenteno<br />

Susan Brutschy<br />

Lisa Colvig‐Amir<br />

Javier Salcedo<br />

Kim Carpenter<br />

Beth Jaworski<br />

Kathryn Branscomb<br />

Laurie Jacobs<br />

Melissa Mollard<br />

Te Guerra<br />

Nicole M. Young


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT TABLE OF CONTENTS<br />

Table of Contents<br />

Executive Summary ........................................................................ 1<br />

Overall Well‐Being of Children in the <strong>County</strong> ............................................................................ 4<br />

A Profile of <strong>First</strong> 5 Participants ................................................................................................. 5<br />

Healthy Children ...................................................................................................................... 7<br />

Strong Families ........................................................................................................................ 9<br />

Children Learning and Ready for School ................................................................................. <strong>11</strong><br />

Service Integration & Community Strengthening .................................................................... 13<br />

Summary ............................................................................................................................... 14<br />

Part 1: Strategic Framework Results ............................................ 17<br />

Overview of the Strategic Framework .................................................................................... 19<br />

Overall Well-Being of Children in the <strong>County</strong> ................................................................... 21<br />

A Profile of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Youngest Children ................................................................ 21<br />

<strong>County</strong>‐Wide Trends in Indicators of Child and Family Well‐Being .......................................... 22<br />

Profile of Participants ......................................................................................................... 29<br />

Number of Children and Families Served ................................................................................ 29<br />

Increase Services into Communities with the Highest Needs .................................................. 31<br />

Healthy Children ................................................................................................................ 37<br />

Increase Insurance Coverage .................................................................................................. 37<br />

Increase Use of Medical/Dental Homes .................................................................................. 41<br />

Increase Use of Preventive Health Services ............................................................................ 42<br />

Strong Families .................................................................................................................. 45<br />

Decrease Child Abuse and Neglect ......................................................................................... 45<br />

Improve Parent and Caregiver Practices that Support Children’s Social and Emotional<br />

Development ......................................................................................................................... 48<br />

Children Learning and Ready for School ........................................................................... 55<br />

Improve School Readiness Outcomes ..................................................................................... 55<br />

Increase Use of Quality Early Child Care Practices ................................................................... 56<br />

Increase Early Literacy Skills of Children ................................................................................. 64<br />

Increase Use of Kindergarten Transition Practices .................................................................. 66<br />

FIRST 5 SANTA CRUZ COUNTY<br />

i


TABLE OF CONTENTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Service Integration & Community Strengthening ................................................................ 69<br />

<strong>First</strong> 5 Service Integration ...................................................................................................... 69<br />

<strong>First</strong> 5 Fiscal Status and Sustainability .................................................................................... 71<br />

Community Strengthening ..................................................................................................... 74<br />

Part 2: Partner Profiles ................................................................ 77<br />

Healthy Kids Initiative ............................................................................................................ 80<br />

Families Together .................................................................................................................. 85<br />

Triple P – Positive Parenting Program .................................................................................... 91<br />

Side‐by‐Side ......................................................................................................................... 129<br />

La Manzana Community Resources ...................................................................................... 132<br />

Mountain Community Resources ......................................................................................... 139<br />

Early Literacy Foundations (ELF) ........................................................................................... 141<br />

Raising A Reader .................................................................................................................. 153<br />

Starlight Infant/Toddler Program ......................................................................................... 155<br />

School Readiness � Steps to Success .................................................................................... 158<br />

Child Snapshot ...................................................................................................................................... 158<br />

Literacy Continuing Education Workshops ........................................................................................... 161<br />

Migrant Education – Summer Pre‐K Academy ..................................................................................... 163<br />

Migrant Education School Readiness Program .................................................................................... 165<br />

Pajaro Valley Unified School District (PVUSD) Parent Conference ....................................................... 168<br />

Transition to School Workshops ........................................................................................................... 169<br />

Appendices ................................................................................ 171<br />

Appendix I: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Framework .................................................. 173<br />

Appendix II: Measurement Tools ......................................................................................... 175<br />

ii FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT TABLE OF FIGURES<br />

Table of Figures<br />

Figure 1: Number of <strong>County</strong> Children ages 0‐5 .......................................................................................................... 21<br />

Figure 2: Ethnicity of <strong>County</strong> Children ages 0‐5 (20<strong>11</strong>) ............................................................................................ 21<br />

Figure 3: English Language Proficiency of <strong>County</strong> Kindergarteners (<strong>2010</strong>) ............................................................... 21<br />

Figure 4: Unemployment Rate ................................................................................................................................... 22<br />

Figure 5: <strong>County</strong> Enrollment in CalWORKS ................................................................................................................ 23<br />

Figure 6: <strong>County</strong> Enrollment in Public Assistance Nutritional Programs .................................................................... 23<br />

Figure 7: <strong>County</strong> Enrollment in Medi‐Cal ................................................................................................................... 24<br />

Figure 8: <strong>County</strong> Enrollment in Healthy Families ....................................................................................................... 24<br />

Figure 9: <strong>County</strong> Enrollment in Healthy Kids .............................................................................................................. 24<br />

Figure 10: Percentage of Mothers in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Receiving Prenatal Care in the <strong>First</strong> Trimester, by Age ....... 25<br />

Figure <strong>11</strong>: Percentage of Mothers in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Receiving Prenatal Care in the <strong>First</strong> Trimester, by<br />

Payment Method ........................................................................................................................................ 25<br />

Figure 12: Percentage of Births to Teen Mothers (Ages 19 and under) ....................................................................... 26<br />

Figure 13: Teen Birth Rate (per 1,000, Ages 15‐19) ..................................................................................................... 26<br />

Figure 14: Percentage of Births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Paid by Medi‐Cal ...................................................................... 27<br />

Figure 15: Percentage of Children in Preschool Programs and Kindergarten Who Have Individualized Education<br />

or Family Service Plans (IEP/IFSP) ............................................................................................................... 28<br />

Figure 16: Total Unduplicated Children and Parents Served, by Goal Area and Age ................................................... 29<br />

Figure 17: Percentage of Children 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Served by <strong>First</strong> 5 ............................................................ 30<br />

Figure 18: Demographics of Children Participating in <strong>First</strong> 5 Programs, by Year ......................................................... 31<br />

Figure 19: <strong>Annual</strong> Family Income of Parents Participating in <strong>First</strong> 5 Programs, <strong>2010</strong>‐<strong>11</strong>............................................. 32<br />

Figure 20: Percentage of <strong>First</strong> 5 Families with Income below Poverty and Self‐Sufficiency Thresholds, by Year ........ 32<br />

Figure 21: Levels of Children’s Vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, by ZIP code .......................................................... 33<br />

Figure 22: Distribution of Children Who Received Services (<strong>2010</strong>‐<strong>11</strong>), by ZIP Code .................................................... 34<br />

Figure 23: Number of Children Who Received Services, by ZIP Code .......................................................................... 34<br />

Figure 24: Early Childhood Educators Served by <strong>First</strong> 5, by Type ................................................................................. 35<br />

Figure 25: Percentage of Children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Estimated to be Insured ........................................ 37<br />

Figure 26: Children (Ages 0‐5) Newly Enrolled by HCOC in Healthy Kids, Healthy Families and Medi‐Cal<br />

insurance plans ........................................................................................................................................... 38<br />

Figure 27: Number of Children (Ages 0‐5) in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Re‐Enrolled in Publicly‐Funded Health<br />

Insurance Programs, by Year ....................................................................................................................... 39<br />

Figure 28: Newborn Enrollment Project Statistics, <strong>2010</strong>‐<strong>11</strong> ........................................................................................ 40<br />

Figure 29: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids (Ages 2‐6) Who Had Access to a<br />

Primary Care Practitioner ............................................................................................................................ 41<br />

Figure 30: Percentage of Parents <strong>Report</strong>ing their Children Utilized Health Care Prior to Renewal in an<br />

Insurance Program ...................................................................................................................................... 41<br />

Figure 31: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids Who Had a Dental Visit in the<br />

Past Year ..................................................................................................................................................... 42<br />

Figure 32: Percentage of Children (Ages 3‐6) in the <strong>County</strong> Enrolled in Healthy Kids Who Received a<br />

Well‐Child Visit ............................................................................................................................................ 42<br />

Figure 33: Visits to Emergency Department in the Past Year, per 1,000 Member Year (Ages 1‐9) ............................. 43<br />

Figure 34: Number of Emergency Department Visits (Infants Less Than One Year Old).............................................. 43<br />

Figure 35: Rate of Substantiated Allegations of Child Maltreatment in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and California<br />

(per 1,000) ................................................................................................................................................... 45<br />

Figure 36: Change in Families Together Participant’s Risk Levels Over Time, 2007 ‐ 20<strong>11</strong> ......................................... 46<br />

FIRST 5 SANTA CRUZ COUNTY<br />

iii


TABLE OF FIGURES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Figure 37: Number of Families Together Families who had Substantated Allegations of Abuse within 6 Months<br />

after Completing the Program .................................................................................................................... 47<br />

Figure 38: Participants with a Substantiated Allegation of Child Maltreatment Occurring Up to 6 Months after<br />

Program Entry ............................................................................................................................................. 48<br />

Figure 39: The 17 Core Parenting Skills Promoted by Triple P ..................................................................................... 49<br />

Figure 40: Parents’ Use of Positive Discipline Styles .................................................................................................... 51<br />

Figure 41: Level of Parental Problems with Child Behavior ......................................................................................... 52<br />

Figure 42: Levels of Parenting Difficulty Six Months After Triple P Services ................................................................ 53<br />

Figure 43: Percentage of 3 rd Grade Students in the <strong>County</strong> At / Above Grade Level In English/Language Arts .......... 55<br />

Figure 44: Number of Early Childhood Educators Who Have Completed SEEDS trainings .......................................... 58<br />

Figure 45: Number of SEEDS Trained Early Childhood Educators in Licensed Programs, by type of classroom<br />

(2007‐20<strong>11</strong>) ................................................................................................................................................. 59<br />

Figure 46: Primary Language of SEEDS Trained Early Childhood Educators in Licensed Programs (2007‐20<strong>11</strong>) ......... 59<br />

Figure 47: Educational Attainment of SEEDS Trained Early Childhood Educators in Licensed Programs<br />

(2007‐20<strong>11</strong>) ................................................................................................................................................. 59<br />

Figure 48: Number of Children Participating in Raising A Reader ................................................................................ 60<br />

Figure 49: Classroom Support for Language and Literacy (<strong>2010</strong>‐20<strong>11</strong>) ...................................................................... 61<br />

Figure 50: Key Language and Literacy Questions (2007‐20<strong>11</strong>).................................................................................... 62<br />

Figure 51: Average FCCERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) .................... 63<br />

Figure 52: Average ITERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) ...................... 63<br />

Figure 53: Percentage of Children Scoring “At” or “Above” the Target Level in Three Pre‐Literacy Skill Areas, by<br />

Primary Language, <strong>2010</strong>‐20<strong>11</strong>..................................................................................................................... 64<br />

Figure 54: Percentage of Children Meeting Targets for Later Reading Success, by Primary Language ........................ 65<br />

Figure 55: Changes in Students’ Letter Sound Recognition Skills After Participation in Migrant Education Pre‐<br />

School Programs ......................................................................................................................................... 66<br />

Figure 56: Number of Child Snapshot Forms Collected from Participating Preschool Programs ................................. 67<br />

Figure 57: Students’ Average School Readiness Levels Across the Basic Building Blocks of Readiness ....................... 67<br />

Figure 58: Students’ Top Five Readiness Strengths & Challenges ................................................................................ 68<br />

Figure 59: Number of Children Receiving Services from Multiple <strong>First</strong> 5 Partners ...................................................... 69<br />

Figure 60: Percentage of Children Receiving Services from Multiple <strong>First</strong> 5 Partners ................................................. 69<br />

Figure 61: Average Cost per Client, by Goal Area and Partner (<strong>2010</strong>‐20<strong>11</strong>) ................................................................ 71<br />

Figure 62: Balance Sheet, Fiscal Year <strong>2010</strong>‐20<strong>11</strong> ......................................................................................................... 72<br />

Figure 63: Amount of Leveraged Investments By Type ................................................................................................ 73<br />

Figure 64: Total Amount of <strong>First</strong> 5 and Leveraged Investments, <strong>2010</strong>‐<strong>11</strong> ................................................................... 73<br />

Figure 65: Number of 2‐1‐1 Callers and Needs, <strong>2010</strong>‐<strong>11</strong> ............................................................................................. 74<br />

Figure 66: Types of 2‐1‐1 Callers’ Needs ...................................................................................................................... 74<br />

Figure 67: Types of 2‐1‐1 Referrals to Agencies ........................................................................................................... 75<br />

Figure 68: HCOC Child Health Insurance Enrollment, Renewal, and Utilization Percentages ...................................... 82<br />

Figure 69: Newborn Enrollment Project Statistics, <strong>2010</strong>‐<strong>11</strong> ........................................................................................ 83<br />

Figure 70: Number of Emergency Department Visits (Infants Less Than One Year Old).............................................. 84<br />

Figure 71: Case Flow Diagram (<strong>2010</strong>‐<strong>11</strong>) ..................................................................................................................... 87<br />

Figure 72: Percentage of Families Together Participants Who Showed Decreased Risk of Child Maltreatment ......... 88<br />

Figure 73: Change in Families Together Participant’s Risk Levels Over Time, 2007 ‐ 20<strong>11</strong> ......................................... 88<br />

Figure 74: Percentage of Families Together Participants Who Do Not Have a Substantiated Allegation of<br />

Maltreatment Within 6 Months After Case Closure ................................................................................... 89<br />

Figure 75: Parents’ Satisfaction with Various Aspects of the Triple P Program ........................................................... 90<br />

Figure 76: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>‐<strong>11</strong>) ....................................................... 100<br />

Figure 77: How Participants <strong>First</strong> Heard about Triple P (<strong>2010</strong>‐<strong>11</strong>) ............................................................................. 100<br />

Figure 78: Percentage of Parents Participating with Another Adult (<strong>2010</strong>‐<strong>11</strong>) .......................................................... 101<br />

iv FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT TABLE OF FIGURES<br />

Figure 79: Ages of Children Chosen as the “Index” Child* (<strong>2010</strong>‐<strong>11</strong>) ........................................................................ 101<br />

Figure 80: Percentage of Parents Who Needed Assistance to Complete the Assessments (<strong>2010</strong>‐<strong>11</strong>) ...................... 101<br />

Figure 81: Parents’ Use of Positive Discipline Styles .................................................................................................. 104<br />

Figure 82: Level of Parent Confidence ....................................................................................................................... 107<br />

Figure 83: Levels of Conflict Over Parenting .............................................................................................................. 109<br />

Figure 84: Feelings of Support in Their Role as a Parent ............................................................................................ <strong>11</strong>1<br />

Figure 85: Level of Parents’ Satisfaction with Their Relationship .............................................................................. <strong>11</strong>3<br />

Figure 86: Level of Parents’ Emotional Difficulties ..................................................................................................... <strong>11</strong>5<br />

Figure 87: Level of Parental Problems with Child Behavior ....................................................................................... <strong>11</strong>8<br />

Figure 88: Participants with a Substantiated Allegation of Child Maltreatment Occurring Up to 6 Months after<br />

Program Entry ........................................................................................................................................... 120<br />

Figure 89: Parents’ Satisfaction with the Triple P Program: Levels 3 (Multi‐session), and Levels 4 and 5 ................. 121<br />

Figure 90: Parents’Satisfaction with the Triple P Seminars/Workshops .................................................................... 122<br />

Figure 91: Levels of Parenting Difficulty Six Months After Triple P Services .............................................................. 124<br />

Figure 92: Parenting Difficulty Six Months After Triple P Services: Frequency of Each Response Option ................ 124<br />

Figure 93: Number of Practitioners Trained and Accredited with Triple P (2009‐<strong>11</strong>) ................................................ 125<br />

Figure 94: Summary of Parent Consultation Skills Checklist Ratings (<strong>2010</strong>‐<strong>11</strong>) ......................................................... 126<br />

Figure 95: Summary of Training <strong>Evaluation</strong> Survey Ratings (<strong>2010</strong>‐<strong>11</strong>) ...................................................................... 127<br />

Figure 96: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>‐<strong>11</strong>) ....................................................... 132<br />

Figure 97: Parents’ Use of Positive Discipline Styles: Overall ..................................................................................... 134<br />

Figure 98: Level of Parental Problems with Child Behavior ....................................................................................... 136<br />

Figure 99: Parents’ Satisfaction with Various Aspects of the Triple P Program ......................................................... 137<br />

Figure 100: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>‐<strong>11</strong>) ....................................................... 139<br />

Figure 101: Number of Early Childhood Educators Who Have Completed SEEDS trainings (2007‐20<strong>11</strong>) .................... 144<br />

Figure 102: Number of SEEDS Trained Early Childhood Educators in Licensed Programs, by type of classroom<br />

(2007‐20<strong>11</strong>) ............................................................................................................................................... 144<br />

Figure 103: Primary Language of SEEDS Trained Early Childhood Educators in Licensed Programs (2007‐20<strong>11</strong>) ....... 144<br />

Figure 104: Educational Attainment of SEEDS Trained Early Childhood Educators in Licensed Programs<br />

(2007‐20<strong>11</strong>) ............................................................................................................................................... 145<br />

Figure 105: Classroom Support for Language and Literacy, <strong>2010</strong>‐20<strong>11</strong> ....................................................................... 146<br />

Figure 106: Key Language and Literacy Questions (2007‐20<strong>11</strong>).................................................................................. 147<br />

Figure 107: Average FCCERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) .................. 147<br />

Figure 108: Average ITERS Scores at Pre and Post Assessment on Literacy‐Related Items (2009‐20<strong>11</strong>) .................... 148<br />

Figure 109: Percentage of All Children Scoring “At” or “Above” the Target Level in Three Pre‐Literacy Skill<br />

Areas, <strong>2010</strong>‐20<strong>11</strong> ...................................................................................................................................... 149<br />

Figure <strong>11</strong>0: Percentage of Children Scoring “At” or “Above” the Target Level in Three Pre‐Literacy Skill Areas,<br />

by Primary Language, <strong>2010</strong>‐20<strong>11</strong> .............................................................................................................. 150<br />

Figure <strong>11</strong>1: Percentage of Children Meeting Targets for Later Reading Success, by Primary Language ...................... 150<br />

Figure <strong>11</strong>2: Percentage of Children at Each Target Level in Three Pre‐Literacy Skill Areas, by Primary<br />

Language, <strong>2010</strong>‐20<strong>11</strong> ................................................................................................................................ 151<br />

Figure <strong>11</strong>3: Changes in How Frequently Parents Read With Their Child, <strong>2010</strong>‐20<strong>11</strong> .................................................. 154<br />

Figure <strong>11</strong>4: Percentage of Children Who Made Developmental Changes in Key Social and Pre‐Literacy<br />

Measures ................................................................................................................................................... 157<br />

Figure <strong>11</strong>5: Number of Child Snapshot Forms Collected from Participating Preschool Programs ............................... 159<br />

Figure <strong>11</strong>6: Students’ Average School Readiness Levels Across the Basic Building Blocks of Readiness ..................... 159<br />

Figure <strong>11</strong>7: Students’ Top Five Readiness Strengths .................................................................................................... 160<br />

Figure <strong>11</strong>8: Students’ Top Five Readiness Challenges .................................................................................................. 160<br />

Figure <strong>11</strong>9: Percentage of Participants Who Responded “Very Much” to Workshop Survey Questions ..................... 162<br />

Figure 120: Summer Pre‐K Academy Letter Sound Identification Results, 20<strong>11</strong> ......................................................... 164<br />

FIRST 5 SANTA CRUZ COUNTY<br />

v


TABLE OF FIGURES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Figure 121: Percentage of Summer Pre‐K Academy Students who Increased Their Letter Sound Recognition By<br />

At Least 5 Letter Sounds ........................................................................................................................... 164<br />

Figure 122: Average Increase in the Number of Letter Sounds Recognized by Summer Pre‐K Academy Students ..... 164<br />

Figure 123: MESRP Letter Sound Identification Results, 20<strong>11</strong> ..................................................................................... 166<br />

Figure 124: MESRP Students’ Average Scores on the Brigance Preschool Screen‐II Assessment ................................ 166<br />

Figure 125: MESRP Students’ Average Scores on the Peabody Picture Vocabulary Test ............................................. 167<br />

vi FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

EXECUTIVE SUMMARY<br />

FIRST 5 SANTA CRUZ COUNTY<br />

1


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

2 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

EXECUTIVE SUMMARY<br />

The Importance of Investing in Young Children<br />

A growing body of scientific evidence points to the economic and societal impacts of wise<br />

investments in the early years. The Harvard Center for the Developing Child states:<br />

A vital and productive society with a prosperous and sustainable future is<br />

built on a foundation of healthy child development. Health in the<br />

earliest years lays the groundwork for a lifetime of vitality. 1<br />

Experiences during the first few years of life – good and bad –<br />

literally shape the architecture of the developing brain. Stable,<br />

positive relationships with adults and growth‐promoting<br />

experiences are keys to the development of the architecture that<br />

forms the foundation for all future learning, behavior, and health.<br />

When we invest wisely in children and families, the next generation<br />

will pay that back through a lifetime of productivity and responsible<br />

citizenship. 2<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is dedicated to giving children the<br />

opportunities they need to reach their full potential.<br />

Overview of this <strong>Report</strong><br />

The Strategic Plan for 2009‐2012 articulates community goals<br />

and results in three goal areas: Healthy Children, Strong Families,<br />

and Children Learning and Ready for School, and also addresses<br />

improved services for young children and their families.<br />

1 http://developingchild.harvard.edu/library/<br />

2 http://developingchild.harvard.edu/initiatives/council/<br />

FIRST 5 SANTA CRUZ COUNTY<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong>’s Vision:<br />

All <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

children enter school<br />

ready to achieve to their<br />

greatest potential.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong>’s Mission:<br />

To help children succeed in<br />

school and in life, <strong>First</strong> 5<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> invests in<br />

health, early learning, and<br />

family support to promote<br />

optimal development of<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children.<br />

This annual report summarizes<br />

findings of the <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

evaluation from July 1, <strong>2010</strong> to June 30, 20<strong>11</strong>. The Healthy Kids<br />

Initiative, Differential Response Initiative, and Early Literacy<br />

Foundations Initiative are multi‐year investments and,<br />

therefore, some information presented reflects multiple years<br />

of data.<br />

3


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Overall Well-Being of Children in the <strong>County</strong><br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> invests in health, early learning and family support to promote the well‐<br />

being of children. To help guide its investments and partnerships, <strong>First</strong> 5 monitors county‐wide<br />

trends that affect child well‐being. The year <strong>2010</strong>‐20<strong>11</strong> marked the second year of the current three<br />

year strategic plan, and the following data reflect the current status of the <strong>County</strong>:<br />

� <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has a growing and diverse population of young children. In 20<strong>11</strong>, there<br />

were 21,258 children ages 0‐5, the majority of whom were either Hispanic (57%), or White<br />

(37%). This diversity continues into kindergarten, where in <strong>2010</strong><br />

almost 49% of children had a primary language other<br />

than English.<br />

� Unemployment has grown dramatically and still varies greatly<br />

across the county. Over the past three years, the <strong>County</strong>’s<br />

unemployment rates reflected the broader economic recession.<br />

Using annual averages, the unemployment rate for the county<br />

jumped dramatically from 7% in 2008 to <strong>11</strong>% in 2009, but<br />

appears to have reached a plateau by 20<strong>11</strong> at almost 13%. Within<br />

the <strong>County</strong>, the percent of unemployed residents differed greatly<br />

by area; the August 20<strong>11</strong> unemployment rate ranged from 4% in<br />

Aptos to 22% in Watsonville.<br />

“Children have been<br />

among those hardest<br />

hit by the [economic]<br />

crisis.”<br />

- Lynch, Rene. “Children are<br />

hidden victims of the economic<br />

crisis, report says.” Los Angeles<br />

Times, 17 August 20<strong>11</strong>.<br />

<br />

Image: africa/FreeDigitalPhotos.net<br />

� There was rising enrollment in public assistance programs. Between 2008 and <strong>2010</strong>, the<br />

total number of <strong>County</strong> residents participating in CalWORKS increased 8%. In addition, more<br />

residents have been utilizing publicly‐funded health insurance programs. Between 2007 and<br />

20<strong>11</strong>, there were enrollment increases in Medi‐Cal (10%), and Healthy Families (28%).<br />

Enrollment in Healthy Kids has shown a slight decrease in the last four years, due to<br />

the waiting list for children ages 6‐18.<br />

� Enrollment in public assistance nutritional programs has<br />

increased. In the last few years, there has been an increase in the<br />

number of residents participating in CalFresh (Food Stamps), the<br />

National School Lunch Program, and Women, Infants, & Children<br />

Program (WIC).<br />

� Not enough mothers are receiving prenatal care in the first trimester.<br />

The percentage of mothers who received prenatal care in their first trimester is high – 83% —<br />

but not high enough, especially for teen moms. The Healthy People initiative recently<br />

lowered its target rate for first trimester prenatal care from 90% (<strong>2010</strong> Objective) to 78%<br />

(2020 Objective), with the result that, on average, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is achieving this<br />

4 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

objective. However, younger mothers tended to fall below this target rate (ages 24 and<br />

younger).<br />

Additionally, there were differences in receipt of early prenatal care based upon the<br />

mother’s source of payment for the care. Only 76% of mothers with Medi‐Cal began receiving<br />

prenatal care during the first trimester, compared to 92% of mothers with private insurance.<br />

� The percentage of births to teen mothers in the <strong>County</strong> is slowly decreasing. In <strong>2010</strong>, there<br />

were 258 births to teen mothers, representing 8.1% of all births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, and a<br />

teen birth rate of 30 per 1,000 (ages 15‐19). Over the past five years there has been a slight<br />

decrease in both births to teen mothers and the teen birth rate, except for 2009 when there<br />

was a small increase in both measurements. Taken together, the two measures indicate a<br />

slowly decreasing proportion of teens in the county who are becoming mothers.<br />

� Over half of the births by women in the <strong>County</strong> were paid for by Medi‐Cal. In <strong>2010</strong>, 55% of<br />

births, across all age groups, were paid for by Medi‐Cal. Medi‐Cal was utilized by over 84% of<br />

the births to women under the age of 25.<br />

� Young children are receiving services for their special needs. In participating preschools,<br />

approximately 6% of children have had an Individualized Education Plan (IEP) or an<br />

Individualized Family Service Plan (IFSP) developed for them, and 6% of kindergarteners are<br />

receiving special education services.<br />

A Profile of <strong>First</strong> 5 Participants<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> reaches children who can make great gains<br />

with early and smart investments.<br />

<strong>First</strong> 5’s goal is to serve the most vulnerable children ages 0‐5 and their families in <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong>, including very low‐income families, English language learners, and families who live in<br />

higher risk zones of the county.<br />

� <strong>First</strong> 5‐supported programs are wide‐reaching: In<br />

<strong>2010</strong>‐<strong>11</strong>, <strong>First</strong> 5 partners served 9,292 children<br />

(unduplicated), representing over two‐fifths of all<br />

children these ages (44%) in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>.<br />

� <strong>First</strong> 5 serves a high number of dual language<br />

learners: Of the children served by <strong>First</strong> 5, 85% were<br />

Latino, and 71% of participants spoke Spanish as their<br />

primary language. Of all Latino children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 62% participated in<br />

services funded by <strong>First</strong> 5.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

5


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

� <strong>First</strong> 5 is reaching an increasingly low income population. Almost 89% of the families served<br />

by <strong>First</strong> 5 earned less than the Federal Poverty Level, based on data for a family of five (the<br />

typical family size served by <strong>First</strong> 5). This also represents an increase from 78% since 2007‐08.<br />

� <strong>First</strong> 5 is serving children in the highest risk zones of the county. Of the children served who<br />

had known ZIP codes, most (92%) lived in the areas of the county that rank highest on a<br />

cumulative index of risk factors that included measures of linguistic isolation, family income,<br />

birth statistics, parental education attainment, child maltreatment and family violence. These<br />

areas include Watsonville, Freedom, Live Oak, and some areas in the city of <strong>Santa</strong> <strong>Cruz</strong>.<br />

<strong>First</strong> 5 strengthens systems by enhancing the capacity of service<br />

providers<br />

In addition to supporting direct services to children and families, <strong>First</strong> 5 aims to boost the capacity of<br />

local systems in order to extend the reach of critical early education, family support, and health<br />

services to a larger number of children and families. Systems enhancements help ensure better<br />

services for years to come. Examples of <strong>First</strong> 5’s capacity‐building work in <strong>2010</strong>‐20<strong>11</strong> include:<br />

� Skill development and coaching for early childhood educators. Training of approximately<br />

125 early childhood educators to deliver the SEEDS of Early Literacy research‐based<br />

strategies in their classrooms or homes;<br />

� Improved parent and caregiver practices that<br />

support children’s social and emotional<br />

development. Training of 86 parent education<br />

practitioners to deliver the Triple P curriculum, an<br />

evidence‐based curriculum shown to increase<br />

parental efficacy, parent‐child interaction, child<br />

behaviors and to reduce rates of child<br />

maltreatment;<br />

� Support for children’s transition to kindergarten.<br />

Training of teachers in 42 preschools to prepare Child Snapshots, a transcript of parent<br />

information and child skills that is delivered to children’s elementary schools. The Snapshots<br />

are intended to stimulate information sharing, dialogue and coordination between early<br />

education providers and elementary schools; and<br />

� Distribution of information to community service providers. Training of health, social<br />

services, and early education providers through workshops, brown bag lunches, and other<br />

trainings to better integrate services and improve customer service.<br />

6 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

Healthy Children<br />

Though coverage rates are high in the county – approximately 93% – there are still children who do<br />

not have health insurance. For the past several years, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has invested in<br />

strategies to help ensure that all children have access to care.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> insures children<br />

� <strong>First</strong> 5 helps uninsured children enroll in health plans: In 2004, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

helped create a new children’s health initiative called Healthy Kids. Healthy Kids has Certified<br />

Application Assisters who provide outreach and assistance to income‐eligible families to help<br />

them apply for public health insurance, and to renew their coverage annually. Because Medi‐<br />

Cal and Healthy Families cannot cover all of the uninsured, <strong>First</strong> 5 also funds the premiums<br />

for Healthy Kids members.<br />

� Children are getting enrolled in public health insurance plans. Since the start of the Healthy<br />

Kids Initiative (June 1, 2004‐June 30, 20<strong>11</strong>), there were 1,134 new enrollments of children<br />

ages 0‐5 in the local Healthy Kids program, 3,371 children in Healthy Families,<br />

and 2,983 children in Medi‐Cal, for a total of 7,488 new enrollments of<br />

Since 2004, 7,488 children<br />

ages 0‐5 have been enrolled<br />

children ages 0‐5.<br />

in public health insurance.<br />

� Children are renewing and using their health insurance. In<br />

order to ensure continuity of care, it’s important that parents keep<br />

In <strong>2010</strong>‐<strong>11</strong>, 71% of all<br />

mothers with Medi‐Cal<br />

births had their new babies<br />

their children enrolled in health insurance plans. During the <strong>2010</strong>‐<strong>11</strong><br />

funding cycle, the Certified Application Assisters helped ensure that<br />

enrolled in Medi‐Cal. 92% of children ages 0‐5 renewed their membership in public health<br />

insurance. Of the renewal applications that were accepted,<br />

approximately 53% were in Healthy Families, 32% were in Medi‐Cal, and 14%<br />

were in Healthy Kids. Almost 97% of children renewing in public health insurance utilized<br />

care prior to renewal.<br />

� <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s newborns are getting connected to medical<br />

care. Baby Gateway—the Newborn Enrollment Project—has now<br />

been launched in three local hospitals. While this program has been<br />

active, 70% of all mothers this year received a newborn visit while<br />

in the hospital. Baby Gateway also assisted 74% of all mothers<br />

with Medi‐Cal births to complete a Medi‐Cal application for their<br />

new babies. With this assistance, 71% of all mothers with Medi‐<br />

Cal births had their new babies enrolled in Medi‐Cal, and 72%<br />

were assigned a primary care provider for their child.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

7


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children get a medical home, preventive<br />

care, and dental care<br />

� Children have a medical home. Nearly all children (95%) ages 2‐6 who were enrolled in<br />

Healthy Kids had access to a primary care practitioner, according to the <strong>2010</strong>‐<strong>11</strong> HEDIS<br />

measures. 3 The majority of children (ages 3‐6) in Healthy Kids also had a well‐child visit<br />

(83%).<br />

� Fewer children are using the emergency<br />

department (ED). Ideally, children and their<br />

families who have insurance and who have a<br />

medical home will be more likely to access their<br />

provider for routine preventive care, and less<br />

likely to use the emergency department (ED) for<br />

non‐urgent medical care.<br />

o The rate of ED use for children using Healthy<br />

Kids insurance was increasing up through 2008, but has shown a decrease since 2009.<br />

o The services provided by the Newborn Enrollment Project may also have had an effect on<br />

the use of the ED for children less than one year old. ED visits at Watsonville Community<br />

Hospital were at a high of 632 in the 2nd quarter of 2009. Baby Gateway was launched at<br />

that hospital in August 2009, and after that the number of ED visits has dropped steadily<br />

to a low of 424 at the beginning of 20<strong>11</strong>.<br />

� Children are getting dental care. Of children ages 4‐6 enrolled in Healthy Kids in <strong>2010</strong>, the<br />

majority (89%) had a dental visit in the past year. This percentage has been slowly increasing<br />

since 2006 (69%). A smaller percentage of younger children (ages 2‐3) are getting dental<br />

visits, although this too has been increasing between 2006 (49%) and <strong>2010</strong> (69%).<br />

3 HEDIS (Healthcare Effectiveness Data and Information Set) is a set of standardized performance measures used by the Health Care Quality<br />

Measurement (HCQM) annual report to track the quality of care that children enrolled in Healthy Kids are receiving in <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong>. HEDIS results are analyzed for the calendar year; therefore, <strong>2010</strong> results are for the time period January 1 ‐ December 31, <strong>2010</strong>.<br />

8 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

Strong Families<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> historically has had higher rates of child abuse and neglect than any other Bay<br />

Area county. 4 Fortunately, the rates of child maltreatment are decreasing and in <strong>2010</strong> the county<br />

rate (7.6 per 1,000) dropped lower than the state‐wide rate (8.7 per 1,000) for the first time in<br />

reporting history.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps strengthen parent‐child relationships<br />

and reduce risk for child abuse and neglect<br />

Through two innovative programs, <strong>First</strong> 5 and its partners are helping to decrease the risk and<br />

incidence of child abuse and neglect.<br />

� In partnership with the county’s Human Services Department‐Family and Children’s Services<br />

and <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center, <strong>First</strong> 5 supports a program<br />

called Families Together. Families Together is <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s<br />

differential response program, a strategy used to intervene early<br />

At‐risk parents have improved<br />

with families in which there has been an allegation of abuse.<br />

parenting styles and reduced<br />

This home visiting program includes comprehensive intake<br />

risk of maltreatment.<br />

and risk assessment, development of a tailored case plan,<br />

parent support and education, child development activities,<br />

The percentage of Families<br />

and periodic assessments. Results of the program have been Together participants assessed<br />

as being at high risk or very high<br />

very encouraging:<br />

risk of child maltreatment<br />

dropped from 62% to 13%.<br />

o Reduction of risk. Parents/primary caregivers receiving<br />

services from Families Together had their levels of risk assessed<br />

while they were in the program. Pre and post risk assessments for<br />

several years combined indicated that families reduced their level of risk for future<br />

maltreatment.<br />

o Reduced rates of child maltreatment. Of the 82 participating families who had their cases<br />

closed in 20<strong>11</strong>, 96% had no substantiated allegations of maltreatment in the 6 month<br />

period following case closure.<br />

� <strong>First</strong> 5 continued the implementation of the Positive Parenting Program, or Triple P. The<br />

program consists of five levels of intervention, from broad‐based, universal efforts in the<br />

community to more intensive, focused efforts with individual parents. The Triple P model is<br />

an evidence‐based program shown in numerous randomized studies to increase parental<br />

4 Center for Social Services Research, School of Welfare, U.C. Berkeley. Child Welfare Dynamic <strong>Report</strong> System, A California Department of<br />

Social Services / University of California at Berkeley collaboration. Accessed online at http://cssr.berkeley.edu/ucb_childwelfare.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

9


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

confidence and efficacy, positive parent‐child interactions and child behaviors, and to reduce<br />

rates of child maltreatment. Highlights of this program include:<br />

o Evidence‐based parenting support is available. <strong>First</strong> 5 has implemented all five levels of<br />

Triple P in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, from the launch of a media campaign to intensive and<br />

focused individual services. In <strong>2010</strong>‐<strong>11</strong>, approximately 893 parents with 1,518 children<br />

participated in the program.<br />

o Parents are engaged and seek more opportunities. Of parents who participated in the<br />

seminars and workshops, 21% requested follow‐up services, suggesting that these brief<br />

services may be an effective way of getting parents engaged in the program and gives<br />

them an opportunity to participate in further services.<br />

o Parenting skills and knowledge are improving along several domains. Parents who<br />

participated in levels 3 and 4 of the Triple P program completed assessments that<br />

measured their levels of parenting skills and knowledge along several domains. Results<br />

showed significant improvements in all domains, including:<br />

Increased use of positive discipline styles � Improved levels of confidence in<br />

parenting � Reduced levels of conflict over parenting � Increased support in<br />

their role as a parent � Increased levels of satisfaction with their relationship �<br />

Decreased levels of emotional difficulties � Improvements in child behavior<br />

There was also evidence that parents who had more serious parenting issues made the<br />

most meaningful changes in their family lives.<br />

o Satisfaction with services. Parents have rated the quality of<br />

services very high, noting that they had received the help they wanted,<br />

Parents are more<br />

confident in their<br />

parenting skills, are<br />

were dealing more effectively with problems in their family, and would<br />

come back to the program if they needed to seek help again.<br />

helping to improve their<br />

o Continued use of the skills they learned. On average,<br />

children’s behavior, and<br />

are building positive<br />

relationships with their<br />

families.<br />

parents felt that the seminars answered their questions, and that they<br />

would continue to use the strategies they learned. Additional survey<br />

results indicate that six months after their Triple P services, parents felt<br />

highly effective in dealing with their children’s behavior, and reported<br />

improved child behavior overall.<br />

o Lowered rates of child maltreatment. Among families who have experienced child abuse<br />

or neglect, results suggest that Triple P is associated with lower rates of new<br />

substantiated child maltreatment allegations. Six months after beginning a Triple P<br />

program, only 1% of parents had a new substantiated maltreatment allegation, compared<br />

to 5% of parents in a comparison parenting program.<br />

10 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

Children Learning and Ready for School<br />

One of the most powerful indicators of later success is a child’s reading proficiency at the end of 3<br />

“The seeds of literacy are<br />

planted before children<br />

enter school.<br />

Important literacy skills do<br />

not develop spontaneously,<br />

instruction shapes them.”<br />

- Snow, Burns, & Griffin, 1998<br />

rd<br />

grade, 5 and data show that <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children are struggling with their reading skills. For<br />

example, only 40% of 3 rd grade students in the <strong>County</strong> scored proficient or better on the<br />

standardized California English Language Arts test (STAR) in <strong>2010</strong>, as compared to<br />

46% statewide. The good news is that there has been a gradual increase in<br />

the past five years in the percentage of county students who are scoring at<br />

or above grade level (from 34% in 2007 to 40% in 20<strong>11</strong>), and county<br />

areas of historically low performance have shown particularly great<br />

improvements in scores.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is helping to improve children’s school<br />

performance by encouraging families to read together, providing language<br />

and literacy skill development for early childhood educators, encouraging<br />

child assessments and differentiated instruction, and working to help children<br />

smoothly transition into kindergarten.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> builds early literacy foundations by<br />

training early childhood educators to enhance language rich<br />

practices in the classroom<br />

� Early childhood educators are getting trained in literacy activities. Since January 2007,<br />

<strong>First</strong> 5 has invested in early literacy training for 356 early childhood educators through the<br />

SEEDS of Early Literacy courses at Cabrillo College.<br />

356 early child educators<br />

are now promoting strong<br />

language and literacy<br />

foundations for children.<br />

Over 7,000 children are<br />

developing the skills to<br />

become successful readers.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

� The SEEDS curriculum is being used throughout <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

child care programs and preschools. Since the founding of the Early<br />

Literacy Foundations Initiative in 2006‐07, 201 SEEDS‐trained teachers and<br />

coaches are working in state‐ and federally‐subsidized classrooms, there<br />

are 155 licensed family child care providers, teachers, and coaches in<br />

private and non‐profit centers/homes, and 155 Family, Friend or Neighbor<br />

(FFN) informal child care providers.<br />

� Classrooms and home‐based settings of SEEDS‐trained early educators<br />

are being transformed into literacy‐rich environments. SEEDS‐trained early childhood<br />

educators are working to ensure their children are on target for kindergarten by using<br />

evidence‐based early literacy strategies, receiving on‐site coaching, and integrating materials<br />

into their learning environments. Assessment results are showing that SEEDS‐coached<br />

5 United States Department of Education, Promoting Educational Excellence for all Americans, Questions and Answers on No Child Left<br />

Behind, retrieved from http://www.ed.gov/nclb/methods/reading/reading.html, 2004.<br />

<strong>11</strong>


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

teachers are improving the quality of support they provide in their classrooms for children’s<br />

development of early literacy:<br />

o In preschool classrooms teaching children ages 3‐5, results from the Early Language and<br />

Literacy Classroom Observation tool (<strong>2010</strong>‐<strong>11</strong>) show that the percentage of classrooms<br />

that provided high quality support for early literacy increased from 16% at pre‐assessment<br />

to 92% at post‐assessment.<br />

o In home‐based settings, results from multiple years of the Family Child Care<br />

Environmental Rating Scale (2009‐<strong>11</strong>) indicated that family child care providers made<br />

improvements in their interactions with children, their use of books with children, and in<br />

helping children understand and use language.<br />

o In infant/ toddler classrooms, results from multiple years of the Infant Toddler<br />

Environmental Rating Scale (2009‐<strong>11</strong>) revealed that teachers made improvements in the<br />

way they interacted with children, used books with children, and helped children<br />

understand and use language.<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps children build the foundation for<br />

later reading success<br />

� Parents are getting involved in their children’s reading. SEEDS<br />

classrooms also implemented Raising A Reader, a weekly rotating<br />

book bag program for families, to boost shared reading practices<br />

and impact children’s early literacy skills. Over 5,000 children<br />

participated in the program during <strong>2010</strong>‐20<strong>11</strong>.<br />

� Children are developing skills in key areas of reading success.<br />

Many preschool classrooms throughout the county are taught by<br />

teachers who have received SEEDS training funded by <strong>First</strong> 5.<br />

Results show that children benefit when teachers enhance their<br />

skills to promote early literacy.<br />

o When they used child assessment data to tailor their instruction with children, children in<br />

these SEEDS‐trained classrooms increased their skills on 3 key predictors of later reading<br />

success (picture naming, rhyming, and alliteration).<br />

o A higher percentage of Spanish‐speaking children scored “below” or “near” target levels in<br />

their initial assessments when compared to English‐speaking children, but by the last<br />

assessment, they had reached or exceeded the levels attained by English‐speaking<br />

children, particularly in rhyming and alliteration, in both languages.<br />

� Children are learning letter sounds. In <strong>2010</strong>‐<strong>11</strong>, 90% of children in two pre‐kindergarten<br />

educational programs provided by Migrant Education increased their letter sound<br />

recognition by at least five letter sounds. On average, children recognized only 1 letter sound<br />

before the program and 18 letter sounds after the program.<br />

12 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps children successfully transition to<br />

kindergarten<br />

<strong>First</strong> 5 is investing in activities that help children successfully transition to kindergarten. Some ways<br />

to do this are to encourage parents to visit the new school with their child, to meet the new<br />

kindergarten teacher, and to attend parent orientations. The following highlights <strong>First</strong> 5’s work to<br />

support successful transitions to kindergarten:<br />

� <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is working with parents and early childhood educators to create<br />

an information “bridge” for children as they transition to kindergarten. Since 2006, parents<br />

and early childhood educators have filled out Child Snapshot forms about children before<br />

they enter kindergarten. Each Snapshot includes key parent information about their child, as<br />

well as the preschool teacher’s assessment of the child’s school readiness skills. These forms<br />

help schools understand their incoming kindergarteners to thereby build balanced<br />

classrooms, attend to individual child and family needs, and to create greater articulation<br />

between preschool and kindergarten.<br />

o This spring, teachers and parents at 42 preschools completed individual Child Snapshot<br />

forms for 976 children, which were then collected and distributed to the kindergarten<br />

teachers at each child’s school of attendance.<br />

o Average readiness scores indicated that children who attended these preschools will be<br />

entering kindergarten with high levels of proficiency across all domains of readiness.<br />

� Parents are receiving kindergarten transition information.<br />

o In February 20<strong>11</strong>, <strong>First</strong> 5 co‐sponsored the Pajaro Valley<br />

Unified School District’s Parent Conference. Over 300 families<br />

participated in workshops promoting transition to<br />

kindergarten practices, healthy child development, and<br />

positive discipline.<br />

o Approximately 267 parents participated in Transition to<br />

School Workshops where they learned about kindergarten<br />

registration requirements, choices of language programs,<br />

how to support their child in school, and ways to ensure that<br />

their child’s entry into school is a pleasant and smooth transition.<br />

Service Integration & Community Strengthening<br />

<strong>First</strong> 5 efforts are sustainable<br />

� Partners maximize <strong>First</strong> 5 investments by leveraging these funds to draw down other matching<br />

funds. In <strong>2010</strong>‐<strong>11</strong>, <strong>First</strong> 5 partners leveraged $3,762,964, more than the entire <strong>First</strong> 5 <strong>Santa</strong><br />

<strong>Cruz</strong> <strong>County</strong> annual program investment of 3,662,823.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

13


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Summary<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is serving 44% of children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, and they are<br />

serving the most vulnerable children, including those in families that are experiencing severe<br />

poverty and are living in areas of the county with the highest risk factors.<br />

<strong>First</strong> 5 and its partners are achieving results in helping these very vulnerable children and families:<br />

� In the Healthy Children goal area, data show that children are insured and using preventative<br />

health care:<br />

o Since 2004, 7,488 children ages 0‐5 have been enrolled in public health insurance.<br />

o In <strong>2010</strong>, 95% of children (ages 2‐6) in Healthy Kids had a medical home, 83% of children<br />

(ages 3‐6) had a well‐child visit in the last year, and 89% of children (ages 4‐6) had a dental<br />

visit.<br />

o In <strong>2010</strong>‐<strong>11</strong>, Baby Gateway assisted 74% of all mothers with Medi‐Cal births to complete a<br />

Medi‐Cal application for their new babies. With this assistance, 71% of all mothers with<br />

Medi‐Cal births had their new babies enrolled in Medi‐Cal, and 72% were assigned a<br />

primary care provider for their child.<br />

� In the Strong Families goal area, families are becoming more healthy and resilient, and it<br />

benefits their children:<br />

o Families who are at risk for child abuse and neglect are being helped to reduce that risk.<br />

o 96% of families who received services from the Families Together program had no<br />

substantiated allegations of maltreatment in the six months after their cases closed.<br />

o <strong>First</strong> 5 has implemented all five levels of Triple P in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, from the launch of<br />

a media campaign to intensive and focused individual services. Brief services may be an<br />

effective way of getting parents engaged in the program and provide an opportunity to<br />

participate in further services.<br />

o Parents participating in the Triple P parenting program significantly increased their<br />

confidence in parenting, used more positive discipline styles, felt more supported, and<br />

improved their relationships with their families.<br />

o Parents who had more serious parenting issues made the most meaningful changes in<br />

their family lives.<br />

o Up to six months after completing the program, Triple P parents continue to report fewer<br />

behavioral problems with their children, and are continuing to use the skills they learned.<br />

o Among families who have experienced child abuse or neglect, results suggest that Triple P<br />

is associated with lower rates of new substantiated child maltreatment allegations.<br />

14 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT EXECUTIVE SUMMARY<br />

� In the Children Learning and Ready for School goal area, data show that <strong>First</strong> 5 is successfully<br />

building teacher skills to improve children’s later school success:<br />

o The SEEDS of Early Literacy approach is transforming the early education system in the<br />

county. In <strong>2010</strong>‐<strong>11</strong>, the percentage of SEEDS‐trained preschool classrooms assessed as<br />

providing high quality literacy support for children increased from 16% to 92%. Similarly, a<br />

multiple year analysis showed that SEEDS‐trained family child care providers increased<br />

their abilities to help children use books, and understand and use language, and SEEDS‐<br />

trained Infant/Toddler teachers showed improvements in these same dimensions.<br />

o Children in SEEDS‐trained classrooms are increasing their skills in three predictors of later<br />

reading success (picture naming, rhyming and alliteration). Further analyses showed that a<br />

higher percentage of Spanish‐speaking children scored “below” or “near” target levels in<br />

their initial assessments when compared to English‐speaking children, but by the last<br />

assessment, they had reached or exceeded the levels attained by English‐speaking<br />

children, particularly in rhyming and alliteration, in both languages.<br />

o Child Snapshots are helping the kindergarten teachers of 976 children understand their<br />

strengths, as well as areas in which they can be supported for success in school.<br />

� <strong>First</strong> 5 partners are maximizing <strong>First</strong> 5 funding by leveraging their funds to bring in an<br />

additional 3.7 million dollars, and in fact, the amount leveraged exceeds <strong>First</strong> 5’s total<br />

funding for <strong>2010</strong>‐<strong>11</strong> by over $100,000. Because of <strong>First</strong> 5’s funding and this kind of additional<br />

support, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children will continue to get the help they need to become<br />

healthy, strong, and ready for school.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

15


EXECUTIVE SUMMARY FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

16 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

PART 1:<br />

STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

17


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

18 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Overview of the Strategic Framework<br />

In the <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Plan for 2009‐2012, the Commission articulated a strategic<br />

framework that included community goals and desired program results. In each of the three goal<br />

areas (Healthy Children, Strong Families, and Children Learning and Ready for School), specific<br />

results were chosen to receive Commission investment between 2009 and 2012. A detailed version<br />

of this framework is included in Appendix I, and an overview is as follows:<br />

Increase<br />

Insurance<br />

Coverage<br />

Increase Medical/Dental<br />

Homes<br />

Decrease Child<br />

Abuse &<br />

Neglect<br />

FIRST 5 SANTA CRUZ COUNTY<br />

Healthy Children<br />

Increase Number of<br />

Children Reaching<br />

Developmental<br />

Milestones<br />

Strong Families<br />

Decrease<br />

Childhood<br />

Obesity<br />

Increase use of<br />

Preventative Health Care<br />

Increase Participation in<br />

Quality Structured<br />

Activities<br />

Improve Parent & Caregiver<br />

Practices that Support Social<br />

and Emotional Development<br />

Improve Pre‐Literacy<br />

Skills<br />

Preview of the Strategic Framework Section of this <strong>Report</strong><br />

Increase Parental<br />

Involvement in<br />

Children’s Learning &<br />

Development<br />

Children Learning<br />

and Ready for<br />

School<br />

Increase Use of<br />

Quality Child<br />

Care Practices<br />

Increase Use of Kindergarten<br />

Transition Practices<br />

The Strategic Framework is also the framework for the evaluation. Thus, the Strategic Framework<br />

section of this report reviews the progress that has been made between July 1, <strong>2010</strong> and June 30,<br />

20<strong>11</strong> toward achieving the specific results in each of the three goal areas. Multiple years of data are<br />

often shown for initiatives for which there have been multiple years of investment. To contextualize<br />

these outcome data, this section begins with a review of county‐wide trends as well as a profile of<br />

<strong>First</strong> 5’s participants, and concludes with a section regarding <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s efforts to<br />

support service integration and community strengthening.<br />

19


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

20 FIRST 5 SANTA CRUZ COUNTY


OVERALL WELL-BEING OF CHILDREN<br />

FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

IN THE COUNTY<br />

Overall Well‐Being of Children in the <strong>County</strong><br />

A Profile of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Youngest Children<br />

FIRST 5 SANTA CRUZ COUNTY<br />

COUNTY TRENDS<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has a growing and diverse population of young children. In 20<strong>11</strong>, there were<br />

21,258 children ages 0‐5, the majority of whom were either Hispanic (57%), or White (37%). This<br />

diversity continues into kindergarten, where in <strong>2010</strong> almost 49% of children had a primary language<br />

other than English.<br />

Figure 1: Number of <strong>County</strong> Children ages 0-5<br />

Figure 2: Ethnicity of <strong>County</strong> Children<br />

ages 0-5 (20<strong>11</strong>)<br />

3.5%<br />

1.1%<br />

22,000<br />

18,000<br />

14,000<br />

10,000<br />

57.3%<br />

1.4%<br />

18,216 18,382 18,678 18,971 19,209<br />

21,258<br />

2006 2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />

36.7%<br />

White<br />

Hispanic<br />

Asian/Pacific Islander<br />

Other<br />

Multirace<br />

Figure 3: English Language Proficiency of<br />

<strong>County</strong> Kindergarteners (<strong>2010</strong>)<br />

47.0%<br />

51.5%<br />

Source: (Population and Ethnicity) State of California, Department of Finance, Race/Ethnic Population with Age and Sex Detail, 2000–2050. Sacramento,<br />

CA, 20<strong>11</strong>. (English Language Proficiency) California Department of Education, Special Education Division, 2009‐10.<br />

English Language Proficiency definitions:<br />

� English Learners (EL) are those students for whom there is a report of a primary language other than English on the state‐approved Home<br />

Language Survey and who, on the basis of the state approved oral language (grades K‐12) assessment procedures and including literacy (grades 3‐<br />

12 only), have been determined to lack the clearly defined English language skills of listening comprehension, speaking, reading, and writing<br />

necessary to succeed in the school's regular instructional programs.<br />

� Fluent‐English‐Proficient (FEP) students are those whose primary language is other than English and who have met the district criteria for<br />

determining proficiency in English (i.e., those students who were identified as FEP on initial identification and students redesignated from Limited‐<br />

English‐Proficient (LEP) or English learner (EL) to FEP).<br />

N: (Population and Ethnicity) N=21,258; (English Language Proficiency) N=3,267.<br />

1.5%<br />

English as Primary<br />

Language<br />

Fluent‐English‐<br />

Proficient (FEP)<br />

English Learners (EL)<br />

21


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

COUNTY TRENDS<br />

<strong>County</strong>-Wide Trends in Indicators of Child and Family Well-Being<br />

Indicator: Trends in employment and public assistance<br />

The local economy affects all aspects of community well‐being, and one barometer of how a<br />

community is faring is its trends in employment and associated demand for public assistance.<br />

As reflected in the following unemployment data for the county, state, and nation, <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong> has been impacted by the current economic climate. During the recession, the market<br />

contracted and became less able to absorb the workforce, which has resulted in increased<br />

unemployment.<br />

� Between 2006 and 20<strong>11</strong>, the <strong>County</strong> unemployment rate increased from 5.7% to 12.7%.<br />

� Within the <strong>County</strong>, the percent of unemployed residents differed greatly by area; the August<br />

20<strong>11</strong> unemployment rate ranged from 4% in Aptos to 22% in Watsonville.<br />

Figure 4: Unemployment Rate<br />

24%<br />

20%<br />

16%<br />

12%<br />

8%<br />

4%<br />

0%<br />

4.9%<br />

5.7%<br />

4.6%<br />

5.9%<br />

4.6%<br />

7.3%<br />

5.4% 7.2%<br />

5.8%<br />

<strong>11</strong>.4%<br />

<strong>11</strong>.3%<br />

9.3%<br />

22.4%<br />

12.8% 12.7%<br />

12.4%<br />

12.0%<br />

Source: U.S. Department of Labor, Bureau of Labor Statistics, 20<strong>11</strong>.<br />

* Data for 2006‐<strong>2010</strong> reflect the average monthly unemployment rate for each year. Data for 20<strong>11</strong> reflect the average monthly rate through August<br />

(the most current month available at the time of this report).<br />

22 FIRST 5 SANTA CRUZ COUNTY<br />

9.6%<br />

9.0%<br />

4.2%<br />

2006 2007 2008 2009 <strong>2010</strong> 20<strong>11</strong>*<br />

Watsonville, CA<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

California<br />

United States<br />

Aptos, CA


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

COUNTY TRENDS<br />

Unemployment has caused an increase in enrollment in public assistance programs. Between 2008<br />

and <strong>2010</strong>, the total number of <strong>County</strong> residents participating in CalWORKS increased by 8.1%, with a<br />

small decrease within the last year.<br />

Figure 5: <strong>County</strong> Enrollment in CalWORKS<br />

5,000<br />

4,500<br />

4,000<br />

3,500<br />

3,000<br />

2,500<br />

4,582 4,589 4,512<br />

4,951 4,877<br />

2006 2007 2008 2009 <strong>2010</strong><br />

Source: State of California Employment Development Department, Labor Market Information Division, Planning Information Packets, 20<strong>11</strong>.<br />

In tough economic times, food security can become a challenge for families. In <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, in<br />

20<strong>11</strong> over 19,000 people were receiving Food Stamp benefits, which was a 70% increase from 2007.<br />

The number of people receiving food stamps was equivalent to about 7% of all people in the<br />

county, 6 though in <strong>2010</strong> California Food Policy Advocates estimated that 14% of the county<br />

population was income‐eligible. 7 In <strong>2010</strong>, over 19,000 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> children were participating<br />

in the National School Lunch Program, or almost 50% of the county’s students. Enrollment in WIC<br />

increased slightly from 9,310 (in 2009) to 9,571 (in <strong>2010</strong>).<br />

Figure 6: <strong>County</strong> Enrollment in Public Assistance Nutritional Programs<br />

PROGRAM 2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />

CalFresh (Food Stamp Program) <strong>11</strong>,367 12,509 14,372 17,629 19,291<br />

National School Lunch Program (Free and<br />

reduced price lunch ) 16,494 16,665 17,666 19,228<br />

not yet<br />

available<br />

not yet<br />

Women, Infants, & Children Program (WIC) - - 9,310 9,571 available<br />

Sources: (CalFresh data) California Department of Social Services, Food Stamp Program Participation and Benefit Issuance <strong>Report</strong>, 20<strong>11</strong>; (National<br />

School Lunch Program) California Department of Education, Educational Demographics Unit, <strong>2010</strong>; (WIC) 2009 data=California Food Policy Advocates,<br />

<strong>2010</strong> <strong>County</strong> Nutrition and Food Insecurity Profiles; <strong>2010</strong> data=State of California Department of Health Services, Certified Participants (Receiving F1s),<br />

Caseload, and Unissued Food Instrument Ratios for All Agencies by Month, 20<strong>11</strong>.<br />

Notes: Based on the recommendation of the <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong> Human Services Department, the methodology for calculating the CalFresh<br />

enrollment was changed to be consistent with their reporting procedures. Results are now based on a July‐June fiscal year (e.g., 2006‐07 data are<br />

reported in 2007), and reflect the average monthly total for each fiscal year. National School Lunch Program results are also based on a July‐June<br />

fiscal year.<br />

6 State of California, Department of Finance, Population Projections for California and Its Counties 2000‐2050, Sacramento, California, 20<strong>11</strong>.<br />

7 California Food Policy Advocates, <strong>2010</strong> <strong>County</strong> Nutrition and Food Insecurity Profiles, <strong>2010</strong>.<br />

23


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

COUNTY TRENDS<br />

It is also important that families have access to health care. The following figures present enrollment<br />

trends in publicly‐funded health insurance programs.<br />

Figure 7: <strong>County</strong> Enrollment in Medi-Cal<br />

44,000<br />

40,000<br />

36,000<br />

32,000<br />

28,000<br />

24,000<br />

20,000<br />

37,804<br />

39,380<br />

40,790 41,996 41,629<br />

Source: State of California, Department of Health Care Services, Research and Analytic Studies Section, Number of Beneficiaries by <strong>County</strong>, 20<strong>11</strong>.<br />

Note: 2007‐20<strong>11</strong> data are reported for July of each year.<br />

Figure 8: <strong>County</strong> Enrollment in Healthy Families<br />

7,000<br />

6,000<br />

5,000<br />

4,000<br />

3,000<br />

2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />

5,387<br />

5,856<br />

6,446<br />

6,577<br />

Source: Managed Risk Medical Insurance Board, HFP Montly Enrollment <strong>Report</strong>s, 20<strong>11</strong>.<br />

Note: Results are as of June of each year.<br />

Figure 9: <strong>County</strong> Enrollment in Healthy Kids<br />

2,500<br />

2,000<br />

1,500<br />

1,000<br />

500<br />

0<br />

Source: Healthy Kids of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Biannual <strong>Evaluation</strong>, 2009‐20<strong>11</strong>.<br />

Note: Enrollment is the number of children as of June of each year.<br />

24 FIRST 5 SANTA CRUZ COUNTY<br />

6,871<br />

2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />

17<br />

1,909<br />

258<br />

1,518<br />

363<br />

1,313<br />

265 195 170<br />

June 2009 June <strong>2010</strong> June 20<strong>11</strong><br />

Waiting list (ages 6‐18)<br />

Ages 6‐18<br />

Ages 0‐5


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Indicator: Percentage of mothers in the <strong>County</strong> receiving prenatal care in the first<br />

trimester<br />

Prenatal Care in the <strong>County</strong><br />

FIRST 5 SANTA CRUZ COUNTY<br />

COUNTY TRENDS<br />

In <strong>2010</strong>, most women in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> received prenatal care during the first trimester of their<br />

pregnancies (83%). The Healthy People initiative recently lowered its target rate for first trimester<br />

prenatal care from 90% (<strong>2010</strong> Objective) to 78% (2020 Objective), with the result that, on average,<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is achieving this objective. However, younger mothers tended to fall below this<br />

target rate (ages 24 and younger). Additionally, there were differences in receipt of early prenatal<br />

care based upon the mother’s source of payment for the care. Only 76% of mothers with Medi‐Cal<br />

began receiving prenatal care during the first trimester, compared to 92% of mothers with private<br />

insurance.<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Figure 10: Percentage of Mothers in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Receiving Prenatal Care in the<br />

<strong>First</strong> Trimester, by Age<br />

81%<br />

83%<br />

59%<br />

63%<br />

72% 75% 75%<br />

69%<br />

84%<br />

86% 87% 87%<br />

Source: <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>.<br />

Note: The data from the report were considered provisional.<br />

2009 N: Overall=3,290,


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

COUNTY TRENDS<br />

Indicator: Percentage of births in the <strong>County</strong> to teen mothers<br />

In <strong>2010</strong>, there were 258 births to teen mothers, representing 8.1% of all births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>,<br />

and a teen birth rate of 30 per 1,000 (ages 15‐19). Over the past five years there has been a slight<br />

decrease in both births to teen mothers and the teen birth rate, except for 2009 when there was a<br />

small increase in both measurements. Taken together, the two measures indicate a slowly<br />

decreasing proportion of teens in the county who are becoming mothers.<br />

Figure 12: Percentage of Births to Teen Mothers (Ages 19 and under)<br />

<strong>11</strong>%<br />

10%<br />

9%<br />

8%<br />

7%<br />

9.5% 9.5% 9.5%<br />

8.7%<br />

8.5%<br />

8.6%<br />

Source: (<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>) <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>;<br />

California data for <strong>2010</strong> are not yet available.<br />

Figure 13: Teen Birth Rate (per 1,000, Ages 15-19)<br />

38<br />

36<br />

34<br />

32<br />

30<br />

28<br />

Source: (<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>) <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>, State<br />

of California, Department of Finance, Race/Ethnic Population with Age and Sex Detail, 2000–2050. Sacramento, CA, <strong>2010</strong>; California data for <strong>2010</strong> are<br />

not yet available.<br />

26 FIRST 5 SANTA CRUZ COUNTY<br />

9.7%<br />

9.2%<br />

8.1%<br />

2006 2007 2008 2009 <strong>2010</strong><br />

37.8<br />

37.1<br />

36.4 36.4<br />

35.2<br />

33.3<br />

35.5<br />

32.1<br />

30.0<br />

2006 2007 2008 2009 <strong>2010</strong><br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

California<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

California


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Indicator: Percentage of births in the <strong>County</strong> with Medi‐Cal insurance coverage<br />

In <strong>2010</strong>, across all age groups, 55% of births were paid for by Medi‐Cal. However, Medi‐Cal was<br />

utilized by almost 84% of women under the age of 25 who gave birth.<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Figure 14: Percentage of Births in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Paid by Medi-Cal<br />

51%<br />

55%<br />

FIRST 5 SANTA CRUZ COUNTY<br />

77%<br />

82%<br />

88%<br />

83%<br />

83%<br />

78%<br />

48%<br />

45%<br />

29% 32%<br />

Overall 17 and under 18‐19 20‐24 25‐34 35 and over<br />

2009 <strong>2010</strong><br />

COUNTY TRENDS<br />

Source: <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Public Health Department, Births, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>. <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, CA. July 20<strong>11</strong>.<br />

Note: The data from the report were considered provisional.<br />

2009 N: Overall=3,290, ≤17=<strong>11</strong>9, 18‐19=200, 20‐24=618, 25‐34=1,709, 35+=644; <strong>2010</strong> N: Overall=3,170, ≤17=89, 18‐19=169, 20‐24=6<strong>11</strong>, 25‐34=1,663,<br />

35+=639<br />

Indicator: Percentage of children who are diagnosed with special needs and/or with<br />

Individualized Education Program (IEP)<br />

In <strong>2010</strong>‐<strong>11</strong>, 976 parents of children in local preschool programs completed Child Snapshots, in which<br />

they were asked about their children’s health and developmental history, including whether their<br />

children had any special needs.<br />

� As seen in the following figure, almost 6% of parents in preschools that participated in the<br />

Child Snapshot program indicated that their child had an Individualized Education Plan (IEP)<br />

or an Individualized Family Service Plan (IFSP).<br />

� This figure also shows that 6% of kindergarten students in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> received special<br />

education services. As can be seen from these data, the percentage of children with an IEP in<br />

the sampled preschool programs is very similar to those in kindergarten, and both samples<br />

show a gradual decline in IEPs over the last five years.<br />

27


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

COUNTY TRENDS<br />

Figure 15: Percentage of Children in Preschool Programs and Kindergarten Who Have<br />

Individualized Education or Family Service Plans (IEP/IFSP)<br />

14%<br />

12%<br />

10%<br />

8%<br />

6%<br />

4%<br />

2%<br />

0%<br />

9.0%<br />

6.7%<br />

6.6% 6.3%<br />

7.9%<br />

5.5%<br />

6.0% 6.0%<br />

Sources and Ns: (Preschools rates of IEP) Child Snapshot forms, 2006 – 20<strong>11</strong>. N= 388 in 2006‐7, 671 in 2007‐8, 580 in 2008‐9, 774 in 2009‐10, and 878<br />

in <strong>2010</strong>‐<strong>11</strong>. (Kindergraten rates of IEP) California Department of Education, Special Education Division. N= 2909 in 2006‐7, 2921 in 2007‐8, 3031 in<br />

2008‐09, 3,267 in 2009‐10, 3,149 in <strong>2010</strong>‐<strong>11</strong>.<br />

28 FIRST 5 SANTA CRUZ COUNTY<br />

5.0%<br />

5.5%<br />

2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

Kindergarten<br />

Preschool


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Profile of Participants PROFILE OF PARTICIPANTS<br />

Number of Children and Families Served<br />

FIRST 5 SANTA CRUZ COUNTY<br />

PROFILE OF PARTICIPANTS<br />

Since the development of its evaluation system, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has had the unique ability<br />

to gather unduplicated counts of individuals served within partner programs and across those<br />

programs. These data, or client characteristic data (hereafter referred to as “CCDs”), are submitted<br />

by partners to <strong>First</strong> 5 on a quarterly basis. This information is gathered in one of two ways: the <strong>Santa</strong><br />

<strong>Cruz</strong> <strong>County</strong> SUN database, or partner‐specific data collection forms. These data are then analyzed<br />

to determine the unduplicated count of individuals served by program, by goal area, and overall. 8<br />

Note that not all programs submit data on individual parents and children.<br />

Figure 16: Total Unduplicated Children and Parents Served, by Goal Area and Age<br />

GOAL AREA<br />

CHILDREN<br />

(AGES 0‐5)<br />

NUMBER PERCENT<br />

NUMBER<br />

(AGES


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

PROFILE OF PARTICIPANTS<br />

children and their parents, but have collected CCDs only for the children. These partners include the<br />

Health Care Outreach Coalition, Raising A Reader, Migrant Education (Summer Pre‐K and School<br />

Readiness Programs), Side by Side, and the Child Snapshot project.<br />

Indicator: Percentage of children in the <strong>County</strong> served by <strong>First</strong> 5<br />

According to the 20<strong>11</strong> population estimates for <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, there are approximately 21,258<br />

children ages 0‐5 residing in the county. 9<br />

� Funded partners served 9,292 unique children, or over two‐fifths of all children in the county<br />

(44%), during the <strong>2010</strong>‐20<strong>11</strong> year.<br />

� Among the Latino population, 62% of all children ages 0‐5 participated in services funded by<br />

<strong>First</strong> 5.<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Figure 17: Percentage of Children 0-5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Served by <strong>First</strong> 5<br />

31% 30%<br />

23%<br />

35%<br />

Sources: Population figures are for calendar years, taken from State of California, Department of Finance, Race/Ethnic Population with Age and Sex<br />

Detail, 2000–2050. Sacramento, CA, July 2007‐20<strong>11</strong>. Client counts are for fiscal years, taken from SUN database/CCD data, July 1, 2006 – June 30,<br />

20<strong>11</strong>.<br />

It is important to note that the percentage of children served in the county is actually higher if one<br />

includes children who were indirectly supported by a <strong>First</strong> 5‐funded program, such as children<br />

whose child care providers received professional training through funded partner programs,<br />

children whose parents received a Kit for New Parents or attended a parent workshop, and children<br />

benefiting from service providers who attended brown bags and customer service trainings.<br />

9 State of California, Department of Finance, Race/Ethnic Population with Age and Sex Detail, 2000–2050. Sacramento, CA, 20<strong>11</strong>.<br />

41%<br />

27% 26% 27%<br />

30 FIRST 5 SANTA CRUZ COUNTY<br />

62%<br />

44%<br />

2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

Percent of SCC Latino Children 0‐5<br />

Served by <strong>First</strong> 5<br />

Percent of SCC Children 0‐5 Served<br />

by <strong>First</strong> 5


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Increase Services into Communities with the Highest Needs<br />

Indicator: Demographic Trends in Children participating in <strong>First</strong> 5 Programs<br />

FIRST 5 SANTA CRUZ COUNTY<br />

PROFILE OF PARTICIPANTS<br />

As can be seen in the following figure, over the past four years funded partners have consistently<br />

served Latino and Spanish‐speaking children, children who reside in South <strong>County</strong>, and children<br />

from low‐income backgrounds. Across the years, at least three‐fourths of families served lived<br />

below the Federal Poverty Level, and beginning in 2009‐10, around 90% of families have had<br />

incomes below this level.<br />

Figure 18: Demographics of Children Participating in <strong>First</strong> 5 Programs, by Year<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

86.6%<br />

81.7% 83.0% 85.1%<br />

74.9% 80.5%<br />

73.7% 74.4% 70.6%<br />

75.2%<br />

65.8%<br />

54.9%<br />

Latino Spanish as Primary<br />

Language<br />

2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

Source: (Latino, Spanish, South <strong>County</strong>, Income) SUN database/CCD data for July 1, 2007 – June 30, 20<strong>11</strong>. (Federal Poverty Level for family of five) U.S.<br />

Department of Health and Human Services, 20<strong>11</strong> HHS Federal Poverty Guidelines.<br />

2007‐2008 data: N for Ethnicity = 4,235; N for Spanish = 4,192; N for Federal Poverty Level (FPL) = 1,346; N for Region of <strong>County</strong> = 5,214. 2008‐2009<br />

data: N for Ethnicity = 4,968; N for Spanish = 4,896; N for FPL = 1,<strong>11</strong>3; N for Region of <strong>County</strong> = 5,440. 2009‐<strong>2010</strong> data: N for Ethnicity = 5,620; N for<br />

Spanish = 5,563; N for FPL = 537; N for Region of <strong>County</strong> = 5,276. <strong>2010</strong>‐20<strong>11</strong> data: N for Ethnicity = 8,848; N for Spanish = 9,086; N for Region of<br />

<strong>County</strong> = 8,932; N for FPL = 561.<br />

The following figure presents participant income data, and compares these data with the<br />

20<strong>11</strong> Federal Poverty Level (FPL) and the 2008 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Self‐Sufficiency Standard. 10<br />

Drawing from previous <strong>First</strong> 5 data, an average family size of five persons is used in these<br />

comparisons. The income thresholds are as follows:<br />

� The 20<strong>11</strong> Federal Poverty Level for a family of five was $26,170. Data show that 89% of the<br />

families served by <strong>First</strong> 5 in <strong>2010</strong>‐<strong>11</strong> earned less than $25,000 per year.<br />

� The 2008 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Self‐Sufficiency Standard for a family of five was $86,566. Data<br />

show that 99.6% of <strong>First</strong> 5 families in <strong>2010</strong>‐<strong>11</strong> earned less than $75,000 a year.<br />

10 2008 is the most recent year for which the <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Self‐Sufficiency Standard is available.<br />

91.8%<br />

78.2%<br />

88.8%<br />

78.0%<br />

South <strong>County</strong> Below Federal Poverty<br />

Line<br />

Indicator: Percentage of <strong>First</strong> 5 families with incomes below the <strong>County</strong> Self‐Sufficiency<br />

Standard / Federal Poverty Levels<br />

31


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

PROFILE OF PARTICIPANTS<br />

As seen in the following figure, these data suggest that families being served have very limited<br />

financial resources, and that <strong>First</strong> 5 is targeting their services toward the families most in need.<br />

Figure 19: <strong>Annual</strong> Family Income of Parents Participating in <strong>First</strong> 5 Programs, <strong>2010</strong>-<strong>11</strong><br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

34.4%<br />

22.6%<br />

17.6%<br />

14.1%<br />

4.5% 5.0%<br />

Sources: (Income) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>. N=561. (Federal Poverty Level) U.S. Department of Health and Human<br />

Services, 20<strong>11</strong> HHS Federal Poverty Guidelines. (California Self‐Sufficiency Standard) Insight Center for Community Economic Development, California<br />

Family Economic Self‐Sufficiency Standard by <strong>County</strong>, 2008.<br />

Note: Families with unknown income, or who declined to answer, were omitted from this analysis. N=561. While not all programs collect income data<br />

from families, these results are considered to be representative of the <strong>First</strong> 5 client population.<br />

The following figure presents the percentage of <strong>First</strong> 5 families below the federal poverty and self<br />

sufficiency thresholds over time. As seen below, <strong>First</strong> 5 is reaching an increasingly low income<br />

population.<br />

Figure 20: Percentage of <strong>First</strong> 5 Families with Income below Poverty and Self-<br />

Sufficiency Thresholds, by Year<br />

100%<br />

80%<br />

60%<br />

40%<br />

Less than<br />

$10,000<br />

71.6%<br />

$10,000 ‐<br />

$14,999<br />

90.5%<br />

$15,000 ‐<br />

$19,999<br />

$20,000 ‐<br />

$24,999<br />

94.9% 95.3%<br />

78.2% 78.0%<br />

20<strong>11</strong> Federal Poverty<br />

Level for a family or<br />

household of 5:<br />

$26,170<br />

$25,000 ‐<br />

$29,999<br />

$30,000‐<br />

$39,999<br />

Sources: (Income) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>. N=561. (Federal Poverty Level) U.S. Department of Health and Human<br />

Services, 20<strong>11</strong> HHS Federal Poverty Guidelines. (California Self‐Sufficiency Standard) Insight Center for Community Economic Development, California<br />

Family Economic Self‐Sufficiency Standard by <strong>County</strong>, 2008.<br />

Note: While not all programs collect income data from families, these results are considered to be representative of the <strong>First</strong> 5 client population.<br />

32 FIRST 5 SANTA CRUZ COUNTY<br />

0.4%<br />

$40,000 ‐<br />

$49,000<br />

99.5% 99.6%<br />

91.8%<br />

88.8%<br />

2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

2008 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

Self‐Sufficiency Standard<br />

for a family of 5:<br />

$86,566<br />

1.1%<br />

$50,000 ‐<br />

$74,999<br />

0.0%<br />

$75,000 ‐<br />

$99,999<br />

0.4%<br />

$100,000 or<br />

more<br />

Percent with<br />

Incomes Below the<br />

Federal Poverty<br />

Level<br />

Percent with<br />

Incomes Below the<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

Self‐Sufficiency<br />

Standard


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Indicator: Levels of children’s vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, by ZIP code<br />

FIRST 5 SANTA CRUZ COUNTY<br />

PROFILE OF PARTICIPANTS<br />

In a 2005 assessment of the levels of children’s vulnerability within <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 10 indicators<br />

of risk were measured and tracked by ZIP code within <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: income relative to the<br />

Federal Poverty Threshold, self‐sufficiency, Medi‐Cal births, parental unemployment, births to<br />

teens, referrals to child welfare services, child abuse, child witnesses to domestic violence, adults<br />

without a high school degree, and linguistic isolation. For each indicator, one of four levels of risk<br />

was assigned.<br />

In the following map, the combined risk of these 10 indicators has been determined and displayed<br />

for each ZIP code to illustrate the areas of highest vulnerability for children ages 0‐5 in <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong>. In addition to the combined risk for each ZIP code, dots indicate if the ZIP code had a school<br />

that had an Academic Performance Index (API) score of 3 or lower.<br />

Figure 21: Levels of Children’s Vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, by ZIP code<br />

Source: Applied Survey Research, Geo‐Mapping Children’s Vulnerability in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Presentation to <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2005.<br />

In order to determine whether <strong>First</strong> 5 partners are serving children in the highest need areas of the<br />

county, a second map displays the relative size of client populations, with darker colors indicating<br />

more <strong>First</strong> 5 participants served than lighter colors. As seen in the following figure, 92% of children<br />

served by funded partners lived in the areas of the county that ranked highest on a cumulative index<br />

33


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

PROFILE OF PARTICIPANTS<br />

of risk factors (such as the Live Oak area of <strong>Santa</strong> <strong>Cruz</strong>, the city of <strong>Santa</strong> <strong>Cruz</strong>, Watsonville and<br />

Freedom), showing that <strong>First</strong> 5 partners are reaching the most vulnerable children.<br />

Figure 22: Distribution of Children Who Received Services (<strong>2010</strong>-<strong>11</strong>), by ZIP Code<br />

Figure 23: Number of Children Who Received Services, by ZIP Code<br />

AREA ZIP CODE<br />

NUMBER OF<br />

CHILDREN<br />

SERVED<br />

AREA ZIP CODE<br />

NUMBER OF<br />

CHILDREN<br />

SERVED<br />

Aptos, Rio Del Mar 95003 127 Mt. Hermon 95041 5<br />

Ben Lomond 95005 48 <strong>Santa</strong> <strong>Cruz</strong>* 95060 692<br />

Boulder Creek 95006 56 <strong>Santa</strong> <strong>Cruz</strong> (Live Oak) 95062 753<br />

Brookdale 95007 5 <strong>Santa</strong> <strong>Cruz</strong> 95064 16<br />

Capitola 95010 98 <strong>Santa</strong> <strong>Cruz</strong> 95065 77<br />

Davenport 95017 23 Scotts Valley 95066 58<br />

Felton 95018 84 Soquel 95073 68<br />

Freedom 95019 466 Watsonville 95076 6,124<br />

Total ‐ 8,700<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

Note. <strong>First</strong> 5 programs served 9,292 children. The charts above display data for the 8,700 children with known ZIP codes.<br />

* 8 children with <strong>Santa</strong> <strong>Cruz</strong> Post Office mailing addresses were included in this area.<br />

34 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Early Childhood Educators Served by <strong>First</strong> 5 Partners<br />

FIRST 5 SANTA CRUZ COUNTY<br />

PROFILE OF PARTICIPANTS<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> helps support the professional development of early childhood educators<br />

in the community. In <strong>2010</strong>‐<strong>11</strong>, approximately 125 early childhood educators were served,<br />

representing preschools, family child care homes, or informal care providers who were family,<br />

friends or neighbors (FFN).<br />

There were additional early childhood educators who received services—who were not included in<br />

this official CCD database—which would raise the total number served in <strong>2010</strong>‐<strong>11</strong>. For Raising A<br />

Reader, just one early childhood educator per site is counted, when in fact each site may have<br />

several early childhood educators participating in the program.<br />

Figure 24: Early Childhood Educators Served by <strong>First</strong> 5, by Type<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

65.3%<br />

28.0%<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

5.1%<br />

Early Childhood Educators (N = <strong>11</strong>8)<br />

Preschool/Child Care Center<br />

Family Child Care Home<br />

Family, Friend, or Neighbor/Informal Care Provider<br />

Other<br />

1.7%<br />

35


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

PROFILE OF PARTICIPANTS<br />

36 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Healthy Children HEALTHY CHILDREN<br />

FIRST 5 SANTA CRUZ COUNTY<br />

HEALTHY CHILDREN<br />

This portion of <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Strategic Framework<br />

analysis includes data regarding the current estimates of children<br />

without health insurance, enrollment outcomes from the Healthy Kids<br />

Initiative’s Health Care Outreach Coalition, results from the Newborn<br />

Enrollment Project, and health insurance utilization and reenrollment<br />

data. Additional information about partners’ efforts to support Healthy Children can be found in the<br />

Partner Profiles section of this report.<br />

Increase Insurance Coverage<br />

Indicator: Percentage of children in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> with health insurance coverage<br />

In <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> the majority of children ages 0‐5 have health insurance. CHIS data show that in<br />

2009, approximately 93% of all children ages 0‐5 had health insurance. During this continuing period<br />

of economic instability, it is especially important to continue providing assistance to families to<br />

enroll in public health insurance programs, to ensure that every child ages 0‐5 is insured.<br />

Figure 25: Percentage of Children ages 0-5 in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Estimated to be<br />

Insured<br />

100%<br />

95%<br />

90%<br />

85%<br />

80%<br />

93.9%<br />

96.2%<br />

93.3%<br />

2001 2005 2009<br />

Source: California Health Interview Surveys.<br />

Note: CHIS data are released every two years. Data for 20<strong>11</strong> will not be available until late 2012. CHIS reports these results as being “statistically<br />

unstable,” and should only be considered as estimates of the percentage of uninsured children.<br />

37


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

HEALTHY CHILDREN<br />

Indicator: Number of children participating in <strong>First</strong> 5 who have applications submitted,<br />

accepted, and renewed for publicly‐funded health insurance<br />

Public health insurance programs are essential to the overall health and well‐being of children. The<br />

Health Care Outreach Coalition (HCOC) provides assistance with application and enrollment in public<br />

health insurance to income‐eligible families. Through community outreach workers called Certified<br />

Application Assistors (CAAs), children from families earning up to 300% of<br />

the Federal Poverty Level receive assistance in applying for Medi‐Cal,<br />

Healthy Families, and the local Healthy Kids health insurance plan.<br />

Additionally, HCOC staff participate in community events and respond to<br />

business and community agency requests for presentations and additional<br />

information regarding health insurance.<br />

Children newly enrolled<br />

in public health<br />

insurance since 2004:<br />

7, ,488<br />

The following figures present the number of applications approved (applicant becomes enrolled in<br />

health insurance), and number of enrollees who renew their health insurance. Across the years<br />

since the effort began in 2004, 7,488 children have been enrolled in public health insurance. <strong>11</strong> The<br />

large increase in Medi‐Cal enrollments in 2009‐10 is due to the Newborn Enrollment Project,<br />

described subsequently.<br />

Figure 26: Children (Ages 0-5) Newly Enrolled by HCOC in Healthy Kids, Healthy<br />

Families and Medi-Cal insurance plans<br />

2,000<br />

1,800<br />

1,600<br />

1,400<br />

1,200<br />

1,000<br />

800<br />

600<br />

400<br />

200<br />

0<br />

580<br />

519<br />

352 359<br />

Source: Health Care Outreach Coalition, <strong>County</strong> Benefits Tracking <strong>Report</strong>, <strong>2010</strong>; Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />

Note: These numbers are from Certified Application Assisters who expand enrollment and retention efforts in the <strong>County</strong>. Many families are enrolled<br />

in other ways. For example, the <strong>County</strong> Human Services Department processes Medi‐Cal applications which are not included here, and families can<br />

self‐enroll in Healthy Families.<br />

Note: The number of children in this analysis may be slightly different than related enrollment results from HCOC due to differences in the timing of<br />

the collection of data. and since families may come to HCOC for enrollment assistance more than once in the fiscal year.<br />

<strong>11</strong> Health Improvement Partnership of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 20<strong>11</strong>.<br />

620<br />

395<br />

175<br />

<strong>11</strong>8<br />

158<br />

53 42 67<br />

1,312<br />

1,741<br />

96 70<br />

38 FIRST 5 SANTA CRUZ COUNTY<br />

901<br />

315<br />

1,226<br />

445<br />

2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

Total (Healthy Kids, Healthy<br />

Families & Medi‐Cal)<br />

Healthy Kids<br />

Healthy Families<br />

Medi‐Cal


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

HEALTHY CHILDREN<br />

Figure 27: Number of Children (Ages 0-5) in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Re-Enrolled in Publicly-<br />

Funded Health Insurance Programs, by Year<br />

600<br />

500<br />

400<br />

300<br />

200<br />

100<br />

0<br />

257<br />

181<br />

27<br />

318<br />

182<br />

19<br />

4<strong>11</strong><br />

131<br />

40<br />

Source: Health Care Outreach Coalition, <strong>County</strong> Benefits Tracking <strong>Report</strong>, <strong>2010</strong>; Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />

Note: These numbers are from Certified Application Assisters who expand enrollment and retention efforts in the <strong>County</strong>. Many families are enrolled<br />

in other ways. For example, the <strong>County</strong> Human Services Department processes Medi‐Cal applications which are not included here, and families can<br />

self‐enroll in Healthy Families.<br />

Note: The number of children in this analysis may be slightly different than related enrollment results from HCOC due to differences in the timing of<br />

the collection of data. and since families may come to HCOC for enrollment assistance more than once in the fiscal year.<br />

Baby Gateway—the Newborn Enrollment Project—has now been launched in three local hospitals<br />

with funding and support provided by <strong>First</strong> 5 of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Watsonville Hospital (in August<br />

2009), Dominican Hospital (in January 20<strong>11</strong>), and Sutter Maternity & Surgery Center of <strong>Santa</strong> <strong>Cruz</strong> (in<br />

May 20<strong>11</strong>). The main goals of the project are to provide enrollment assistance to mothers and their<br />

newborns, as well as to establish a seamless Medi‐Cal coverage process for Medi‐Cal‐eligible<br />

newborns, and to link those newborns to a medical home, all before they leave the hospital.<br />

In addition, all new mothers receive the <strong>First</strong> 5 “Kit for New Parents” containing expert guidance for<br />

raising healthy infants and children. In particular, parents are oriented to the “What To Do If My Child<br />

Gets Sick” booklet, which provides information in utilizing primary care appropriately, and clarifies<br />

what issues should prompt a visit to the emergency room (and which should be handled in the medical<br />

home).<br />

487<br />

150<br />

139<br />

442<br />

269<br />

120<br />

2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

Healthy Kids<br />

Healthy Families<br />

Medi‐Cal/Medicare<br />

Indicator: Number of mothers in the <strong>County</strong> visited as part of the Newborn Enrollment<br />

Project<br />

39


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

HEALTHY CHILDREN<br />

Data from <strong>2010</strong>‐<strong>11</strong> show how successful this program has been in providing these services to <strong>Santa</strong><br />

<strong>Cruz</strong> <strong>County</strong>’s mothers and newborns.<br />

� Of all 2,103 births that occurred in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> at these hospitals after the program<br />

had been implemented, 70% of mothers received a newborn visit while in the hospital, and<br />

65% received a “Kit for New Parents.”<br />

� Of all 1,499 mothers with Medi‐Cal births during <strong>2010</strong>‐<strong>11</strong>, almost three‐fourths (74%) were<br />

assisted to complete a Medi‐Cal application for their new babies.<br />

� Of the 1,<strong>11</strong>1 mothers who were assisted to complete a Medi‐Cal application for their<br />

newborns, nearly all applications (95%) were approved, and 97% were assigned a primary<br />

care provider for their child before discharge from the hospital.<br />

Figure 28: Newborn Enrollment Project Statistics, <strong>2010</strong>-<strong>11</strong><br />

PROGRAM COMPONENT WATSONVILLE<br />

Total Number of All Births in <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong> after program implementation<br />

COMMUNITY<br />

HOSPITAL<br />

DOMINICAN<br />

HOSPITAL 1<br />

SUTTER<br />

MATERNITY &<br />

SURGERY CENTER<br />

OF SANTA CRUZ 2<br />

1,487 437 179 2,103<br />

Total Number of Medi‐Cal Births 1,247 191 61 1,499<br />

Number of Completed Newborn<br />

Medi‐Cal Applications<br />

Number of Approved Newborn<br />

Medi‐Cal Enrollments<br />

Number of Denied Newborn<br />

Medi‐Cal Applications<br />

Number of Pending Newborn<br />

Medi‐Cal Applications<br />

Number of Newborn Medi‐Cal<br />

Applicants with an Assigned<br />

Primary Care Provider<br />

Total Number of Newborn Visits<br />

(regardless of insurance status)<br />

Number of Kits for New Parents<br />

Distributed<br />

Source: Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />

1 Based on program implementation of 1/10/<strong>11</strong>.<br />

2 Based on program implementation of 5/1/<strong>11</strong>.<br />

40 FIRST 5 SANTA CRUZ COUNTY<br />

TOTAL<br />

NUMBER PERCENT OF ALL<br />

MEDI‐CAL BIRTHS<br />

919 141 51 1,<strong>11</strong>1 74.1%<br />

NUMBER PERCENT OF ALL<br />

MEDI‐CAL<br />

APPLICATIONS<br />

883 133 44 1,060 95.4%<br />

21 1 0 22 2.0%<br />

15 7 7 29 2.6%<br />

1,074 96.7%<br />

NUMBER PERCENT OF ALL<br />

COUNTY BIRTHS<br />

1,040 289 136 1,465 69.7%<br />

1,040 184 136 1,360 64.7%


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Increase Use of Medical/Dental Homes<br />

FIRST 5 SANTA CRUZ COUNTY<br />

HEALTHY CHILDREN<br />

Indicator: Percentage of children in the <strong>County</strong> enrolled in Healthy Kids (ages 2‐6) who<br />

had access to a primary care practitioner<br />

The majority of children enrolled in Healthy Kids, ages 2‐6, had access to a primary care practitioner.<br />

The percentage of children who had a medical home has varied between 90% in 2006 to 95% in<br />

<strong>2010</strong>.<br />

Figure 29: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids (Ages 2-6)<br />

Who Had Access to a Primary Care Practitioner<br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

89.9%<br />

2006<br />

(N = 227)<br />

90.1%<br />

2007<br />

(N = 221)<br />

93.8%<br />

2008<br />

(N = 227)<br />

Source: Central Coast Alliance for Health, Health Care Quality Measurement annual report, using HEDIS Indicators. There are no HEDIS data regarding<br />

access to primary care practitioners for children under age one. For children age one, there were not enough children in the HEDIS sample to draw<br />

any inferences.<br />

Parents of children receiving <strong>First</strong> 5‐funded services through the Health Care Outreach Coalition<br />

were asked when they renewed their children’s insurance whether their children had used the<br />

benefit during the previous year. During the <strong>2010</strong>‐20<strong>11</strong> year, 97% of children who received renewal<br />

assistance in a public insurance program utilized their benefits prior to their renewal, continuing the<br />

trend of high utilization across the years.<br />

89.4%<br />

2009<br />

(N = 208)<br />

95.1%<br />

<strong>2010</strong><br />

(N = 164)<br />

Indicator: Percentage of children utilizing health care prior to renewal in an insurance<br />

program<br />

Figure 30: Percentage of Parents <strong>Report</strong>ing their Children Utilized Health Care Prior to<br />

Renewal in an Insurance Program<br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

99.6% 97.9%<br />

2006‐07<br />

(N = 471)<br />

2007‐08<br />

(N = 514)<br />

99.6% 99.4%<br />

2008‐09<br />

(N = 555)<br />

2009‐10<br />

(N = 789)<br />

96.6%<br />

<strong>2010</strong>‐<strong>11</strong><br />

(N = 829)<br />

Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 2007‐20<strong>11</strong>. Results represent the status of children’s applications 2‐3 months after<br />

the end of the fiscal year. Utilization results exclude clients with missing data.<br />

41


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

HEALTHY CHILDREN<br />

Indicator: Percentage of children in the <strong>County</strong> enrolled in Healthy Kids who had a<br />

dental visit in the past year<br />

Of children ages 4‐6 enrolled in Healthy Kids in <strong>2010</strong>, the majority (89%) had a dental visit in the past<br />

year. This percentage has been slowly increasing since 2006 (69%). A smaller percentage of younger<br />

children (ages 2‐3) are getting dental visits, although this too has been increasing between 2006<br />

(49%) and <strong>2010</strong> (69%).<br />

Figure 31: Percentage of Children in the <strong>County</strong> Enrolled in Healthy Kids Who Had a<br />

Dental Visit in the Past Year<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

48.9%<br />

68.7%<br />

54.8%<br />

70.6%<br />

61.4%<br />

79.2%<br />

Source: Central Coast Alliance for Health, Health Care Quality Measurement annual report, using HEDIS Indicators.<br />

* No data are available for 2009.<br />

Children ages 2‐3 N: 2006=45, 2007=42, 2008=44, <strong>2010</strong>=32; Children ages 4‐6 N: 2006=182, 2007=180, 2008=183, <strong>2010</strong>=132,<br />

Increase Use of Preventive Health Services<br />

In <strong>2010</strong>, the majority of children ages 3‐6 (83%) enrolled in Healthy Kids received a well‐child visit<br />

with their pediatrician, showing a slight increase over the past three years.<br />

Figure 32: Percentage of Children (Ages 3-6) in the <strong>County</strong> Enrolled in Healthy Kids<br />

Who Received a Well-Child Visit<br />

85%<br />

80%<br />

75%<br />

70%<br />

78.1%<br />

2006<br />

(N = 210)<br />

Source: Central Coast Alliance for Health, Health Care Quality Measurement annual report, using HEDIS Indicators.<br />

68.8%<br />

2006 2007 2008 2009* <strong>2010</strong><br />

81.6%<br />

2007<br />

(N = 207)<br />

Children ages 2‐3 Children ages 4‐6<br />

76.8%<br />

2008<br />

(N = 2<strong>11</strong>)<br />

79.6%<br />

2009<br />

(N = 191)<br />

82.9%<br />

<strong>2010</strong><br />

(N = 152)<br />

89.4%<br />

Indicator: Percentage of children in the <strong>County</strong> enrolled in Healthy Kids (ages 3‐6) who<br />

received a well‐child visit<br />

42 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

HEALTHY CHILDREN<br />

Ideally, children and their families who have insurance and who have a medical home will be more<br />

likely to access their provider for routine preventive care, and less likely to use the emergency<br />

department (ED) for non‐urgent medical care. The figure below presents data on children enrolled<br />

in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Healthy Kids program regarding the rate at which they used the emergency<br />

room each year. These data are not available in disaggregated form for children 0‐5, and therefore<br />

includes children up to age 9. The rate of ED use for children using Healthy Kids insurance was<br />

increasing up through 2008, but has shown a decrease since 2009.<br />

Figure 33: Visits to Emergency Department in the Past Year, per 1,000 Member Year<br />

(Ages 1-9)<br />

300<br />

250<br />

200<br />

150<br />

100<br />

161.4<br />

229.7<br />

266.2 265.9<br />

Source: Central California Alliance for Health, Health Care Quality Measurement annual report, using Healthcare Effectiveness Data and Information<br />

System (HEDIS) indicators.<br />

Note: Data represent only children enrolled in Healthy Kids.<br />

The services provided by the Newborn Enrollment Project may also have had an effect on the use of<br />

the Emergency Department (ED) for children less than one year old. As seen in the following figure,<br />

ED visits at Watsonville Community Hospital were at a high of 632 in the 2 nd quarter of 2009. Baby<br />

Gateway was launched at that hospital in August 2009, and after that the number of ED visits has<br />

dropped steadily to a low of 424 at the beginning of 20<strong>11</strong>.<br />

Figure 34: Number of Emergency Department Visits (Infants Less Than One Year Old)<br />

700<br />

600<br />

500<br />

400<br />

300<br />

200<br />

100<br />

0<br />

573<br />

2006<br />

(N=133)<br />

218<br />

632<br />

Baby Gateway<br />

Launched 8/2009<br />

184<br />

2007<br />

(N=185)<br />

552 558<br />

151<br />

171<br />

2008<br />

(N=178)<br />

2009<br />

(N=190)<br />

Source: Health Improvement Partnership of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Baby Gateway Program <strong>Report</strong>, August 16, 20<strong>11</strong>.<br />

506<br />

199<br />

528<br />

146<br />

471<br />

<strong>11</strong>6<br />

421 424<br />

168<br />

186<br />

Baby Gateway<br />

Launched 1/20<strong>11</strong><br />

Q1/2009 Q2/09 Q3/09 Q4/09 Q1/<strong>2010</strong> Q2/10 Q3/10 Q4/10 Q1/20<strong>11</strong><br />

214.4<br />

<strong>2010</strong><br />

(N=<strong>11</strong>9)<br />

Watsonville Community Hospital<br />

Dominican Hospital<br />

43


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

HEALTHY CHILDREN<br />

44 FIRST 5 SANTA CRUZ COUNTY


Strong Families<br />

FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Strong Families STRONG FAMILIES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES<br />

This portion of <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Strategic Framework analysis<br />

includes data regarding the need to reduce the <strong>County</strong>’s rate of child<br />

maltreatment, outcomes for families served by the county’s differential<br />

response effort (Families Together), and outcomes for clients participating in the Positive Parenting<br />

Program (Triple P). Additional information about partners’ efforts to support Strong Families can be<br />

found in the Partner Profiles section of this report.<br />

Decrease Child Abuse and Neglect<br />

Indicator: Rate of substantiated allegations of child maltreatment in the <strong>County</strong><br />

The rate of substantiated allegations of child maltreatment in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has decreased from<br />

a high of 15.8 (per 1,000) in 2004, to 7.6 (per 1,000) in <strong>2010</strong>. In <strong>2010</strong>, the county rate dropped lower<br />

than the state‐wide rate of substantiated allegations of child maltreatment for the first time in<br />

reporting history. The decreasing rates in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> may have been assisted by the efforts<br />

of the Families Together program, which launched in late 2006 (see the following results for<br />

additional information about this program).<br />

Figure 35: Rate of Substantiated Allegations of Child Maltreatment in <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong> and California (per 1,000)<br />

18<br />

16<br />

14<br />

12<br />

10<br />

8<br />

6<br />

4<br />

2<br />

0<br />

15.8<br />

15.3<br />

13.5<br />

14.7<br />

<strong>11</strong>.2 <strong>11</strong>.0 10.8 10.7<br />

Families Together<br />

Launched 9/2006<br />

12.4<br />

2004 2005 2006 2007 2008 2009 <strong>2010</strong><br />

9.7<br />

Source: Needell, B., Webster, D., Armijo, M., Lee, S., Dawson, W., Magruder, J., Exel, M., Cuccaro‐Alamin, S., Putnam‐Hornstein, E., Williams, D.,<br />

Simon, V., Hamilton, D., Lou, C., Peng, C., Moore, M., Jacobs, L., & King, B. (20<strong>11</strong>). Child Welfare Services <strong>Report</strong>s for California. Retrieved 8/1/20<strong>11</strong>,<br />

from University of California at Berkeley Center for Social Services Research website. URL: <br />

Note: The rates for each year are calculated based on reports from January 1 to December 31 of each year.<br />

9.6<br />

9.3<br />

8.7<br />

7.6<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

California<br />

45


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES<br />

Indicator: Percentage of Families Together participants at each level of risk, baseline to<br />

reassessment<br />

Families Together is <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s differential response program, a strategy used to intervene<br />

early with families in which there has been an allegation of abuse. This home visiting program<br />

includes comprehensive intake and risk assessment, development of a tailored case plan, parent<br />

support and education, child development activities, and periodic assessments.<br />

In Families Together, risk assessment serves a variety of purposes. <strong>First</strong>, the assessments help staff<br />

link parents with the appropriate service pathway, including Brief services, Intensive services, and<br />

referrals to Primeros Pasos, a program for parents struggling with alcohol and drug dependency.<br />

Follow‐up assessments help assess whether risk for child abuse and neglect has been reduced.<br />

The following figure presents the percentage of families at each level of risk over four assessments<br />

(baseline, and first, second, and third reassessments). Each year’s analysis is constrained by fairly<br />

small sample sizes. Therefore, several years of data have been aggregated in order to present a<br />

more robust portrait of the extent to which Families Together participants are reducing their risk for<br />

future involvement with the child welfare system. As can be seen, 62% of families were assessed as<br />

being high risk or very high risk upon intake, and this dropped to 13% by the third reassessment,<br />

indicating that the program is helping families reduce their level of risk.<br />

Figure 36: Change in Families Together Participant’s Risk Levels Over Time,<br />

2007 - 20<strong>11</strong><br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

44.7%<br />

38.4%<br />

Baseline*<br />

(N = 237)<br />

16.9%<br />

28.1%<br />

49.7%<br />

20.0%<br />

1st Reassessment<br />

(N = 185)<br />

2.2%<br />

29.4%<br />

51.5%<br />

14.7%<br />

26.7%<br />

60.0%<br />

13.3%<br />

Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, 2007‐20<strong>11</strong>.<br />

* Although very few families had a “low risk” score at baseline, these families were omitted from these analyses so that only those who could<br />

demonstrate reduced risk on the tool remained in the analysis.<br />

Note: Due to inaccuracies in data entry in 2006‐07, clients with baseline assessments before 7/1/07 were omitted from this analysis.<br />

46 FIRST 5 SANTA CRUZ COUNTY<br />

4.4%<br />

2nd Reassessment<br />

(N = 68)<br />

0.0%<br />

3rd Reassessment<br />

(N=15)<br />

Low Risk<br />

Moderate Risk<br />

High Risk<br />

Very High Risk


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES<br />

Indicator: Percentage of Families Together participants with substantiated allegations<br />

of child maltreatment within 6 months of program completion<br />

Of the 82 families who received services from Families Together and had their cases closed in the<br />

<strong>2010</strong> calendar year, 96% had no substantiated allegations of maltreatment within six months after<br />

case closure.<br />

Figure 37: Number of Families Together Families who had Substantated Allegations of<br />

Abuse within 6 Months after Completing the Program<br />

Total number of families served, with cases closed during<br />

the <strong>2010</strong> calendar year<br />

Number of families with substantiated allegations of<br />

child abuse or neglect within 6 months after their<br />

Families Together closure date<br />

Total number and percent of families served who did<br />

not have a subsequent substantiated allegation of<br />

child abuse within 6 months of case closure<br />

NUMBER PERCENT<br />

82 100%<br />

3 3.7%<br />

79 96.3%<br />

Source: <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Human Services Department, Planning and <strong>Evaluation</strong> Unit. Staff analysis of CWS/CMS data, 20<strong>11</strong>.<br />

Indicator: Percentage of Triple P participants in the Child Welfare system with<br />

substantiated allegations of child maltreatment within 6 months of program<br />

completion<br />

Among families who have experienced child abuse or neglect, participation in the Triple P program 12<br />

was expected to be associated with lower rates of future child welfare allegations. To examine<br />

whether associations were observed between Triple P participation and improved child welfare<br />

outcomes in these <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> families, outcome data for two groups of parents who entered<br />

(or re‐entered) the child welfare system were compared, including: (1) parents who received the<br />

Triple P intervention; and (2) parents who were enrolled in a model of parenting education offered<br />

prior to the initiation of the Triple P program. Both programs were offered through a local<br />

community‐based organization called the Parents Center.<br />

12 For a detailed description of this program, see “Triple P – Positive Parenting Program” in the Partner Profile section.<br />

47


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES<br />

Results suggest that Triple P is associated with reductions in future child abuse and neglect.<br />

� After six months, parents in the comparison parenting program were more than three and a<br />

half times more likely than Triple P participants to have had a new substantiated<br />

maltreatment allegation.<br />

Figure 38: Participants with a Substantiated Allegation of Child Maltreatment Occurring<br />

Up to 6 Months after Program Entry<br />

20%<br />

15%<br />

10%<br />

5%<br />

0%<br />

1.4%<br />

Source: Applied Survey Research, Triple P – <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Special Exploratory Study to Assess Child Welfare Outcomes, 20<strong>11</strong>.<br />

N: 70 Triple P participants and 137 comparison group participants.<br />

Improve Parent and Caregiver Practices that Support Children’s<br />

Social and Emotional Development<br />

The Triple P Program<br />

5.1%<br />

Triple P Participants Comparison Group<br />

Triple P (Positive Parenting Program) is a comprehensive, evidence‐based parenting and family<br />

support system designed to increase parents’ confidence and competence in raising children,<br />

improve the quality of parent‐child relationships, and make evidence‐based parenting information<br />

and interventions widely accessible to parents. It is based on a public health model in which an<br />

ecological approach is used. This approach initiates activities at individual, family, community, and<br />

systemic levels to provide a comprehensive structure of support. There are five levels of<br />

intervention in Triple P. Level 1 is intended to reach a broad range of community members in the<br />

<strong>County</strong>, and as the levels increase, more intensive services are provided.<br />

48 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES<br />

Triple P focuses on 17 core parenting skills that are grouped into 4 areas: promoting positive<br />

relationships, encouraging desirable behavior, teaching new skills and behaviors, and managing<br />

misbehavior. It is based on a self‐regulatory framework in which the practitioner provides<br />

information, skills, training, and support based on the parents’ concerns. Parents use self‐evaluation<br />

to set goals and assess progress. While practitioners are helping parents to build confidence and<br />

competence, parents are helping children to build these skills in a parallel process.<br />

Figure 39: The 17 Core Parenting Skills Promoted by Triple P<br />

Developing Positive<br />

Relationships<br />

Encouraging Desirable<br />

Behaviors<br />

Teaching New Skills &<br />

Behaviors<br />

Managing Misbehavior<br />

1. Spending quality time with your child<br />

2. Talking to your child<br />

3. Showing affection to your child<br />

4. Using descriptive praise<br />

5. Giving attention<br />

6. Providing engaging activities<br />

7. Setting a good example<br />

8. Using incidental teaching<br />

9. Using Ask, Say, Do<br />

10. Using behavior charts<br />

<strong>11</strong>. Setting ground rules<br />

12. Directed discussion<br />

13. Planned ignoring<br />

14. Clear, calm instructions<br />

15. Logical consequences<br />

16. Quiet Time<br />

17. Time Out<br />

Implementation of the Triple P Program in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

Beginning in early <strong>2010</strong>, three local funders (<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Health Services Agency, and<br />

Human Services Department) launched a pilot of the Triple P system in partnership with other<br />

agencies that serve children and families. The pilot phase was designed to last two years. During this<br />

pilot phase, Triple P has been implemented incrementally, beginning with Levels 3, 4, and 5 in the<br />

first year, and adding Levels 1 and 2 in this second year. The long‐term vision is to implement every<br />

level of Triple P broadly in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> to make parenting information and support available<br />

to all families.<br />

49


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES<br />

Indicator: Improved parenting skills, knowledge, and support<br />

The following diagram illustrates the design of this program, and the results that have been achieved<br />

towards addressing the program’s incremental levels of parenting support and information.<br />

Level 5: Enhanced & Pathways<br />

Additional support for families where parenting issues are compounded by parental stress and/or relationship<br />

difficulties, or there is risk for child maltreatment.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Trained and accredited 18 practitioners to provide Level 5 Enhanced services, and 18 for Level 5 Pathways.<br />

� Parents are beginning to receive Level 5 services, and will complete assessments to measure improvement<br />

in their parenting skills and understanding of their children’s behavior.<br />

Level 4: Standard & Group<br />

In-depth training in positive parenting skills.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Families showed significant improvements in:<br />

– style of discipline – confidence in their parenting – levels of conflict over parenting – level of satisfaction with<br />

their relationship – levels of parental depression – stress and anxiety – child behavior<br />

� Parents who had more serious parenting issues made the most meaningful changes in their family life.<br />

� Parents reported high levels of satisfaction with their services.<br />

� Approximately 282 parents/guardians have participated in Level 4 sessions.<br />

� Trained and accredited 38 practitioners to provide Level 4 Group services, and 37 for Level 4 Standard.<br />

Level 3: Primary Care<br />

Consultations about specific parenting concerns.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Families showed significant improvements in children’s behavior, confidence in parenting skills, and support from parenting<br />

partners.<br />

� Parents reported high levels of satisfaction with both Level 3 workshops and individual/group sessions.<br />

� Approximately 336 parents have participated in Level 3 workshops, and 35 in Level 3 Individual/Group sessions.<br />

� Trained and accredited 53 practitioners to provide Level 3 Primary Care services, and 5 with Special Accreditation in Level 3.<br />

Level 2: Selected Individual & Seminar<br />

General information and tips for specific parenting concerns.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Parents reported great satisfaction with Level 2 seminars, particularly noting that they would continue to use the strategies that they learned.<br />

� Approximately 96 parents have participated in Level 2 seminars, and 104 in Level 2 Individual sessions.<br />

� Trained and accredited 20 practitioners to provide Level 2 seminars, and 53 for Level 2 Individual sessions.<br />

Level 1: Universal<br />

Media-based parenting information campaign.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners, referral processes, and a master calendar of Triple P Groups,<br />

Workshops, and Seminars.<br />

� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service providers as a means to encourage referrals.<br />

� Publicized Triple P services in print and online editions of newspapers and community calendars.<br />

� Established <strong>First</strong> 5’s main phone number as a “warmline,” publicized in all flyers, emails and media announcements as a central place to locate services.<br />

� Delivered Triple P messages on TV and the radio.<br />

50 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES<br />

Selected data are highlighted below for their significance, and more detailed data are presented in<br />

the Triple P Partner Profile found later in this report.<br />

Indicator: Use of positive discipline styles<br />

Parents who participated in Level 4 of the Triple P program were asked to complete the Parenting Scale<br />

as a pre and post assessment of their style of discipline. Scores could range from 1 (positive parenting) to<br />

7 (ineffective parenting), with lower scores indicating more positive styles of discipline. Analyses were<br />

run to see if there was any improvement between pre and post assessments, and if the amount of<br />

improvement was statistically significant. 13<br />

As seen in the figure below,<br />

Dysfunctional<br />

Parenting<br />

7<br />

6<br />

Lower 5<br />

is<br />

“Better”<br />

4<br />

3<br />

2<br />

1<br />

Functional<br />

Parenting<br />

� There was significant improvement from pre to post assessment regarding parents’ style of<br />

discipline, indicating their parenting style became less lax, less over‐reactive, and less hostile<br />

though the course of the Triple P program.<br />

� When looking at overall scores on the Parenting Scale, on average, all parents combined and<br />

all parent sub‐populations that were assessed began in the clinical range, but had achieved<br />

positive styles of discipline by the post‐assessment.<br />

� An analysis of “Effect Size” (see page 103) showed that on average, all parent<br />

sub‐populations experienced a large magnitude of change, indicating that the observed<br />

differences were not only statistically significant but also meaningful.<br />

Figure 40: Parents’ Use of Positive Discipline Styles<br />

Overall<br />

3.3 3.8 3.6 3.8 3.8 3.7 3.9 3.7 3.7<br />

2.7 2.9 3.0 2.9 3.0 2.9 3.0 2.9 3.0<br />

All Parents*<br />

(N=158)<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=86)<br />

Male*<br />

(N=20)<br />

Female*<br />

(N=66)<br />

Pre Post<br />

Latino*<br />

(N=61)<br />

Caucasian*<br />

(N=21)<br />

Spanish*<br />

(N=44)<br />

English*<br />

(N=37)<br />

Child Welfare<br />

Involved*<br />

(N=30)<br />

Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />

responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />

sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p= 3.2<br />

51


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES<br />

In Triple P, the parent is considered the agent of change to bring about improvements in the parent‐<br />

child relationship. Therefore, how parents view their children’s behavior is an important assessment<br />

of the relationship.<br />

Parents participating in Level 4 of the Triple P Program were asked to complete the Eyberg Child<br />

Behavior Inventory (ECBI), a pre and post assessment that includes an assessment of the extent to<br />

which parents viewed certain child behaviors to be a problem in their family. Scores ranged from 0<br />

(No) to 36 (Yes), with higher scores indicating greater likelihood that these behaviors were a problem<br />

to the parent. Analyses were run to see if there was any improvement between pre and post<br />

assessments, and if the amount of improvement was statistically significant. 14<br />

As seen in the following figure, after completing the Triple P Program, parents reported fewer child<br />

behaviors as actually being a problem for them. Key results include:<br />

All behaviors were<br />

a problem<br />

36<br />

Lower<br />

is<br />

“Better”<br />

Indicator: <strong>Report</strong> of child behavior problems<br />

� For all sub‐populations, there was a significant reduction in the number of child behaviors<br />

that were perceived to be a problem. Almost all parents began with scores within the clinical<br />

range, and ended with scores that were out of the clinical range.<br />

� “Effect Sizes” were also calculated on these analyses (see page 103). Results showed that on<br />

average, parents experienced a large magnitude of change, indicating that the observed<br />

differences were not only statistically significant but also meaningful.<br />

Figure 41: Level of Parental Problems with Child Behavior<br />

30<br />

24<br />

18<br />

12<br />

6<br />

0<br />

No behaviors<br />

were a problem<br />

15.0<br />

8.2<br />

All Parents*<br />

(N=129)<br />

23.0<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=62)<br />

Number of Child Behaviors Perceived to Be a Problem<br />

20.4<br />

23.5 24.1<br />

12.6 <strong>11</strong>.9 12.7 13.0<br />

Male* (N=9) Female*<br />

(N=53)<br />

Pre Post<br />

Latino*<br />

(N=44)<br />

Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />

which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always occurs),<br />

and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />

these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=15


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Follow‐Up Survey<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES<br />

Parents and guardians who participated in certain Triple P programs were given the option of<br />

voluntarily participating in a follow‐up phone survey, to help determine the long‐lasting effects of<br />

these programs on their parenting skills and experiences.<br />

Results showed that around six months after completing Triple P services, parents were still<br />

reporting high levels of parenting skills, confidence, and support. Additional survey results indicated<br />

that parents felt more effective in dealing with their children’s behavior, and report improved child<br />

behavior overall.<br />

Not at all Difficult<br />

5<br />

Higher<br />

is<br />

“Better”<br />

Indicator: Amount of positive parenting knowledge that is maintained<br />

Figure 42: Levels of Parenting Difficulty Six Months After Triple P Services<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Extremely Difficult<br />

3.58<br />

Q1: Child Behavior<br />

Problems (N=26)<br />

4.21 4.23<br />

Q2: Parental<br />

Adjustment (N=26)*<br />

Q3: Parenting<br />

Confidence (N=26)<br />

3.62 3.50<br />

Q4: Parental Support Q5: Partner Support<br />

(N=26) Over Methods of<br />

Discipline (N=18)<br />

Source: Triple P data from the Parenting Experience Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, and correspond to different<br />

Triple P outcome objectives examined in this report section. For Q1‐6, scores range from 1 to 5. Q7 was not asked in the Follow‐up Survey. Higher<br />

scores indicate more positive parenting experiences. There are no clinical cut‐offs for this assessment. See page 102 for a description of the<br />

sub‐populations and analyses that were run.<br />

* Question 2 results are averages of the 5 items in this question.<br />

3.83<br />

Q6: Parenting<br />

Support from<br />

Partner (N=18)<br />

53


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES<br />

54 FIRST 5 SANTA CRUZ COUNTY


CHILDREN LEARNING<br />

FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Children Learning and Ready for School<br />

AND READY FOR SCHOOL<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

This portion of <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s Strategic Framework<br />

analysis includes data regarding the need for children’s literacy<br />

support, efforts to increase use of quality child care practices to<br />

support literacy development, and data regarding young children’s<br />

gains in research‐based predictors of reading success. Additional<br />

information about partners’ efforts to support Children Learning and Ready for School can be found in the<br />

Partner Profiles section of this report<br />

Improve School Readiness Outcomes<br />

Indicator: Percentage of 3 rd grade students in the <strong>County</strong> at/above grade level in<br />

English/Language Arts<br />

Many studies have demonstrated that third grade reading scores are a bellwether of students’ later<br />

academic success, in that third grade reading proficiency is linked to students’ likelihood of<br />

graduating from high school.<br />

In 20<strong>11</strong>, 40% of third‐graders in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> scored at or above grade level in English/Language<br />

Arts (ELA), compared to 46% of students statewide. Results for the past five years show a gradual<br />

increase in the percentage of students who are scoring at or above grade level. Two county areas of<br />

historically low performance have shown particularly great improvements in scores, with PVUSD<br />

increasing from 21% in 2007 to 28% in 20<strong>11</strong>, and Freedom Elementary increasing from 12% to 28%.<br />

Figure 43: Percentage of 3 rd Grade Students in the <strong>County</strong> At / Above Grade Level In<br />

English/Language Arts<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

37%<br />

38%<br />

34% 34%<br />

21% 20%<br />

12% 12%<br />

Source: California Department of Education, STAR Test Results, 2007‐20<strong>11</strong>.<br />

44% 44% 46%<br />

40%<br />

37%<br />

25% 24%<br />

16%<br />

24%<br />

40%<br />

28%<br />

28%<br />

2006‐2007 2007‐2008 2008‐2009 2009‐<strong>2010</strong> <strong>2010</strong>‐20<strong>11</strong><br />

California<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

PVUSD<br />

Freedom Elementary<br />

55


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Increase Use of Quality Early Child Care Practices<br />

California third graders are struggling to become proficient readers. Local and statewide data<br />

indicate that well over half of third grade children are not reading at proficiency. Because language<br />

development in the early years is crucial to later reading success, early childhood educators have a<br />

unique role in influencing reading scores and later educational success. According to a report<br />

published in the Journal of Education Psychology, early childhood educators play a key role in the<br />

language development of children from high poverty backgrounds:<br />

“Language development has a profound effect on young children’s successful transition to<br />

school and, in particular, on their success in learning to read. Children who arrive in first grade<br />

with a foundation in pre‐literacy skills and the interest and motivation to learn are better<br />

prepared to engage in the complex task of learning to read.<br />

Most children acquire language and pre‐literacy skills through interactions with adults and<br />

peers who use language in ways that are consistent with the majority culture and correspond<br />

to the printed word. Unfortunately, many children raised in poverty have limited access to<br />

opportunities to develop language and literacy skills in such ways.<br />

As one important illustration, Hart and Risley (1995) reported that by the age of 3, children in<br />

poverty were already well behind their more affluent peers in their acquisition of vocabulary and<br />

oral language skills. Snow et al. (1998) also reported that children in poverty lack necessary<br />

pre‐literacy skills at the beginning of kindergarten. Similar research indicates that socioeconomic<br />

status is the strongest predictor of performance differences in children at the beginning of the<br />

first grade and that this gap persists as children progress from elementary to high school.” 15<br />

With the evidence of limited language and literacy opportunities in low‐income homes, more<br />

emphasis has been placed on showing early childhood educators how to build language<br />

opportunities into their daily child care routines, through fun and meaningful instruction.<br />

Over the past four years, <strong>First</strong> 5’s Early Literacy Foundations Initiative has addressed this need to<br />

provide strong literacy and language foundations for young children through several approaches.<br />

<strong>First</strong> 5 has implemented the SEEDS of Early Literacy model of skill development and coaching for early<br />

childhood educators, encouraged family engagement in literacy activities through expansion of the<br />

Raising A Reader program, supported child assessments for participating state Pre‐K classrooms in<br />

order to tailor differentiated instruction, and provided other literacy supports for teachers and<br />

families.<br />

15<br />

American Psychological Association (2006). The Effects of a Language and Literacy Intervention on Head Start Children and Teachers.<br />

Journal of Educational Psychology, 98, (1), 63–74.<br />

56 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

The following indicators present an overview of the Early Literacy Foundation Initiative’s efforts and<br />

outcomes this year (additional detail is included in the initiative’s Partner Profile later in this report).<br />

Indicators discussed here include:<br />

� Number of ECE teachers who completed SEEDS training<br />

� Number of SEEDS coaches<br />

� Number of children participating in Raising A Reader<br />

� Changes in early childhood educators’ practices that promote early literacy (preschool<br />

classrooms, family child care settings, and infant/toddler care classrooms)<br />

� Increased early literacy skills of children<br />

SEEDS of Early Literacy<br />

The professional development initiative mentioned above follows the SEEDS of Early Literacy curriculum<br />

that has been researched by the University of Minnesota. Research on the SEEDS model shows that<br />

teachers trained and coached on the SEEDS Curriculum score significantly higher on the Early<br />

Language and Literacy Classroom Observation (ELLCO) tool and show greater change over time in<br />

teaching strategies than teachers without such training. Results also indicate that preschool children<br />

who were taught by teachers trained in SEEDS entered kindergarten ready to read at higher rates<br />

than children in non‐SEEDS groups (Lizakowski, 2005).<br />

The SEEDS Professional Development model consists of training—and providing coaching to—early<br />

childhood educators on how to effectively integrate research‐based language and literacy strategies<br />

and materials into their classrooms. Early childhood educators are taught to use the strategies of<br />

both embedded instruction (planned strategies that occur within the typical routines of the class<br />

day) and explicit instruction (teacher‐directed activities that emphasize the teaching of a specific<br />

task), and to create a classroom environment that is designed to target early literacy predictors.<br />

These predictors of later reading success include:<br />

� Conversation and Oral Language: The ability to produce or comprehend spoken language<br />

� Alphabet Knowledge: The ability to visually discriminate the differences between letters<br />

and say the names and sounds associated with printed letters<br />

� Book and Print Rules: Refers to what children understand about how books and print work,<br />

such as left‐right, front‐back, letters, words and that print has meaning<br />

� Phonological awareness: The ability to detect, manipulate, or analyze the auditory aspects<br />

of spoken language, including the ability to distinguish or segment words, syllables, rhymes,<br />

and beginning sounds<br />

� Vocabulary and Background Knowledge: A collection of words that relate to experiences<br />

and knowledge that a child has of the world around him/her<br />

57


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

The following diagram displays the five essential SEEDS quality interactions and the five predictors of<br />

literacy.<br />

Indicator: Number of early childhood educators who complete SEEDS training, and<br />

number of educators who are SEEDS coaches<br />

The following figure presents the number of SEEDS coaches, the number of early childhood educators<br />

who completed SEEDS trainings, and the number of Family, Friend and Neighbor informal providers<br />

who attended SEEDS workshops, both in <strong>2010</strong>‐<strong>11</strong>, and cumulatively since 2007.<br />

Figure 44: Number of Early Childhood Educators Who Have Completed SEEDS<br />

trainings<br />

EARLY LITERACY FOUNDATIONS THIS FUNDING CYCLE<br />

Number of SEEDS Quality Coaches providing literacy coaching, literacy<br />

environmental assessments, and professional development advising<br />

for SEEDS instruction, fidelity, and integrity during the year<br />

Number of early childhood educators attending SEEDS of Early Literacy<br />

Courses<br />

Number of Family, Friend or Neighbor (FFN) informal child care<br />

providers attending SEEDS of Early Literacy workshops<br />

JULY 1, <strong>2010</strong> –<br />

JUNE 30, 20<strong>11</strong><br />

CUMULATIVE TOTALS<br />

2007‐20<strong>11</strong><br />

18 41<br />

77 356<br />

9 155<br />

TOTAL (unduplicated) 104 519<br />

Source: Early Literacy Foundations (ELF) Initiative, <strong>2010</strong>‐<strong>11</strong>.<br />

58 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

The figures below show additional data about Early Childhood Educators and Coaches who have<br />

been trained between 2007‐20<strong>11</strong>.<br />

Figure 45: Number of SEEDS Trained Early Childhood Educators in Licensed<br />

Programs, by type of classroom (2007-20<strong>11</strong>)<br />

State and Federally‐<br />

Subsidized Classrooms<br />

Figure 46: Primary Language of SEEDS Trained Early Childhood Educators in Licensed<br />

Programs (2007-20<strong>11</strong>)<br />

22.2%<br />

3.1%<br />

24.7%<br />

50.0%<br />

Licensed Family Child Care<br />

Homes and Private/ Non‐<br />

Profit Centers<br />

English Only<br />

Spanish Only<br />

Bilingual English/Spanish<br />

Figure 47: Educational Attainment of SEEDS Trained Early Childhood Educators in<br />

Licensed Programs (2007-20<strong>11</strong>)<br />

4.0% 4.3%<br />

7.3%<br />

8.8%<br />

10.1%<br />

No Formal Schooling<br />

Less Than High School Diploma/GED<br />

High School Diploma/GED<br />

12.2%<br />

Some College<br />

AA in non‐ECE/CD<br />

6.1%<br />

22.0%<br />

AA in ECE/CD<br />

BA in non‐ECE/CD<br />

BA in ECE/CD<br />

25.3%<br />

Some Graduate School or Postgraduate Degree<br />

Source: Early Literacy Foundations Initiative, Client and Assessment Data Entry Template, 2007‐20<strong>11</strong>.<br />

Note: Early childhood educators and coaches may have participated in more than one SEEDS class, but are only counted once in these analyses. For these<br />

clients, their language and education data are as of their earliest class, in order to assess the status of these educators at the beginning of their<br />

participation in the SEEDS program. Family, Friend or Neighbor (FFN) informal child care providers are not included in these analyses.<br />

Language N=356; Education N=328.<br />

Other<br />

Unduplicated total,<br />

Spring 2007 – June 20<strong>11</strong><br />

201 155 356<br />

59


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Indicator: Number of children participating in Raising A Reader<br />

SEEDS classrooms also implemented Raising A Reader, a weekly rotating book bag program for<br />

families, which means there were mutually complimentary interventions on site to boost shared<br />

reading practices and impact children’s early literacy skills. Over 5,000 children participated in the<br />

program during <strong>2010</strong>‐20<strong>11</strong>.<br />

Figure 48: Number of Children Participating in Raising A Reader<br />

New Existing <strong>2010</strong>‐<strong>11</strong> Total<br />

Children 2,564 2,830 5,394<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

Indicator: Percentage of early education settings that provide high quality support for<br />

language and literacy<br />

Preschool Classrooms<br />

Research on teacher effectiveness shows that by focusing professional development on language<br />

and literacy and social‐emotional development, children are shown to be much better prepared for<br />

school and have higher academic achievement. The first indicators of change are the language<br />

environment, teacher‐child interactions, and language opportunities that teachers provide to<br />

children.<br />

<strong>First</strong> 5 SEEDS Quality coaches are trained to independently assess SEEDS classrooms teaching<br />

children ages 3‐5 using the Early Language and Literacy Classroom Observation Pre‐K Tool (ELLCO<br />

Pre‐K). The ELLCO Pre‐K is used to assess the following five classroom components: classroom<br />

structure, curriculum, the language environment, books and book reading, and print and early<br />

writing (in <strong>2010</strong>‐<strong>11</strong>, the classroom structure component was not measured by most coaches and is<br />

therefore not analyzed in this report). Items are scored along a 5 point scale, where 1 is deficient<br />

and 5 is exemplary. From this scale, early childhood educators’ classroom scores can be categorized<br />

into three levels, indicating their classroom environment provides low‐quality support, basic<br />

support, or high‐quality support for language and literacy. In every Pre‐K SEEDS course since 2007,<br />

coaches used the ELLCO to assess the classrooms of their mentees (early childhood educators<br />

receiving SEEDS training) at the beginning and end of the semester.<br />

60 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Across all components, classrooms showed substantial improvements from the beginning of the<br />

semester to the end. Overall, the percentage of classrooms that were rated as having High‐Quality<br />

Support increased from 16% to 92%. Among the individual classroom components, by the end of the<br />

semester the majority of classrooms were rated as having High‐Quality Support in “Curriculum”<br />

(81%), “Language Environment” (76%), “Books and Book Reading” (87%), “Print and Early Writing”<br />

(89%).<br />

Figure 49: Classroom Support for Language and Literacy (<strong>2010</strong>-20<strong>11</strong>)<br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

16.2%<br />

54.1%<br />

91.9%<br />

Low‐Quality Support Basic Support High‐Quality Support<br />

18.9%<br />

51.4%<br />

81.1%<br />

Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) Pre‐K, <strong>2010</strong> – 20<strong>11</strong>.<br />

Note: Low‐quality support = means less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between<br />

3.51 and 5. Percentages less than 3% are not labeled.<br />

N=37.<br />

Four specific ELLCO items were chosen for individual study, using the same type of analysis:<br />

Opportunities for Child Choice and Initiative, Approaches to Book Reading, Support for Children's<br />

Writing, and Approaches to Curriculum. For these four items, several years of data have been<br />

aggregated in order to present a more robust portrait of the extent to which SEEDS‐trained early<br />

childhood educators were providing high quality support for language and literacy in their preschool<br />

classrooms.<br />

As reflected in this figure, SEEDS‐coached teachers have consistently improved the quality of<br />

support they provide in their classrooms for children’s development of early literacy. For each of the<br />

four ELLCO items, the majority of classrooms were rated as providing high quality support at post<br />

assessment: Opportunities for Child Choice and Initiative (93%), Approaches to Book Reading (88%),<br />

Support for Children's Writing (90%), and Approaches to Curriculum (87%).<br />

16.2%<br />

51.4%<br />

75.7%<br />

13.5%<br />

56.8%<br />

86.5%<br />

29.7% 29.7% 32.4% 29.7%<br />

24.3%<br />

18.9%<br />

13.5%<br />

8.1%<br />

21.6%<br />

35.1%<br />

43.2%<br />

89.2%<br />

Pre Post Pre Post Pre Post Pre Post Pre Post<br />

Overall Section 2:<br />

Curriculum<br />

Section 3:<br />

The Language<br />

Environment<br />

Section 4:<br />

Books & Book<br />

Reading<br />

61<br />

8.1%<br />

Section 5:<br />

Print & Early<br />

Writing


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Figure 50: Key Language and Literacy Questions (2007-20<strong>11</strong>)<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

53.7%<br />

35.8%<br />

93.3%<br />

10.4% 15.3% 19.5% 22.4%<br />

6.7%<br />

10.7%<br />

10.0%<br />

Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) & ELLCO Pre‐K, 2007 – 20<strong>11</strong>.<br />

Note: Clients may be included more than once if they participated in multiple SEEDS classes between 2007 and 20<strong>11</strong>. Low‐quality support = means<br />

less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between 3.51 and 5. Percentages less than 3%<br />

are not labeled.<br />

* The analysis of this question began in 2007‐08, so results reflect the combined data for 2008‐20<strong>11</strong>.<br />

Child Choice and Initiative N=134, Book Reading N=215, Children's Writing N=221, Approaches to Curriculum N=134.<br />

Family Child Care Settings<br />

35.3%<br />

49.3%<br />

88.4%<br />

The data above described the ways that SEEDS‐trained teachers made changes to their preschool<br />

classroom environments and their practices in order to better support children’s development of<br />

pre‐literacy skills. However, SEEDS training was not just limited to preschool center teachers — early<br />

childhood educators from family child care settings as well as infant/toddler centers also<br />

participated in SEEDS training and received SEEDS coaching. Their sites were observed at the<br />

beginning of their SEEDS training and again at the end.<br />

31.2%<br />

49.3%<br />

89.6%<br />

40.3%<br />

37.3%<br />

The figure below presents the PRE and POST scores gathered from Family Child Care providers on<br />

four literacy‐related indicators, for several years combined. The measurement instrument was the<br />

Family Child Care Environment Rating Scale, Revised Edition (FCCERS‐R). Items were scored using a<br />

7‐point scale ranging from inadequate to excellent. Results show that providers made pre to post<br />

gains in their abilities related to literacy promotion.<br />

86.6%<br />

12.7%<br />

Pre Post Pre Post Pre Post Pre Post<br />

Opportunities for<br />

Child Choice and<br />

Initiative*<br />

Low‐Quality Support Basic Support High‐Quality Support<br />

Approaches to<br />

Book Reading<br />

Support for<br />

Children's Writing<br />

Approaches to<br />

Curriculum*<br />

62 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Excellent<br />

7<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Inadequate<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Figure 51: Average FCCERS Scores at Pre and Post Assessment on Literacy-Related<br />

Items (2009-20<strong>11</strong>)<br />

5.46 5.44<br />

3.83 3.93 3.94<br />

Source: Early Literacy Foundations (ELF) Initiative, Family Child Care Environment Rating Scale, Revised Edition, 2009‐20<strong>11</strong>.<br />

N=54.<br />

Infant/Toddler Care Classrooms<br />

The figure below presents the PRE and POST scores gathered from center‐based early childhood<br />

educators of Infant/Toddler care, for several years combined. The measurement instrument was the<br />

Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), and items were scored using a 7‐<br />

point scale ranging from inadequate to excellent. Results show that Infant/ Toddler teachers<br />

enhanced their classroom environments and practices to promote children’s early literacy<br />

development.<br />

Figure 52: Average ITERS Scores at Pre and Post Assessment on Literacy-Related<br />

Items (2009-20<strong>11</strong>)<br />

Excellent<br />

7<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Inadequate<br />

Helping children<br />

understand language<br />

4.39<br />

6.02<br />

Helping children<br />

understand language<br />

Helping children use<br />

language<br />

4.82<br />

6.14<br />

Helping children use<br />

language<br />

Pre Post<br />

Pre Post<br />

Source: Early Literacy Foundations (ELF) Initiative, Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), 2009‐20<strong>11</strong>.<br />

N: Understand language=49, Use language=49, Using books=49, Interactions=48.<br />

5.65<br />

4.24<br />

5.80<br />

Using books Provider‐child<br />

interactions<br />

3.78<br />

5.76<br />

4.60<br />

5.92<br />

Using books Provider‐child interactions<br />

63


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Increase Early Literacy Skills of Children<br />

Indicator: Percentage of children who demonstrate research‐based predictors for reading<br />

success<br />

The SEEDS of Early Literacy has shown us that teachers of diverse educational backgrounds can be<br />

trained to implement strategies to help children build a strong language and literacy foundation.<br />

<strong>First</strong> 5 partnered with SEEDS state subsidized classrooms and found that, indeed, teachers have had<br />

a positive effect on children’s language and literacy development. Participating classrooms assessed<br />

children throughout the year to measure changes in three key areas of reading predictors: picture‐<br />

naming, rhyming, and alliteration. As the majority of students are dual language learners, most<br />

children were assessed in both English and Spanish, unless English was their primary language.<br />

Children showed large improvements in all three pre‐literacy skills areas between their first and last<br />

assessments. The percentage of all children scoring “At” or “Above” the target level for each of the<br />

pre‐literacy skills areas increased dramatically, with the greatest improvement occurring in rhyming<br />

and alliteration skills.<br />

Because of the number of English‐language learners in these classrooms (who comprised<br />

approximately 73% of children in this assessment), there was interest in focusing on the<br />

performance of children when assessed in their primary language. When looking at the percentage<br />

of children scoring “At” or “Above” target level, results show that when assessed in their primary<br />

language, Spanish‐speaking children started with a lower skill level than English‐speaking children,<br />

but by their last assessment they had made a greater amount of improvement (net change in<br />

percentage) in rhyming (39% increase vs. 30% increase), and in alliteration (53% increase vs. 46%<br />

increase). Primarily Spanish‐speaking children showed similar or even greater amounts of<br />

improvement when assessed in English, with the greatest increases occurring in rhyming (44%<br />

increase) and alliteration (54% increase).<br />

Figure 53: Percentage of Children Scoring “At” or “Above” the Target Level in Three<br />

Pre-Literacy Skill Areas, by Primary Language, <strong>2010</strong>-20<strong>11</strong><br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40% 32.3%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Primarily English‐Speaking<br />

Children<br />

English Assessment<br />

62.1%<br />

57.1%<br />

Picture<br />

Naming<br />

31.0%<br />

18.5%<br />

56.9%<br />

48.9%<br />

21.7%<br />

68.1%<br />

29.3%<br />

26.0%<br />

13.6%<br />

6.3%<br />

7.7%<br />

Rhyming Alliteration Picture<br />

Naming<br />

56.0%<br />

46.5%<br />

64 FIRST 5 SANTA CRUZ COUNTY<br />

18.9%<br />

72.3%<br />

Rhyming Alliteration Picture<br />

Naming<br />

Oct Jan May<br />

Primarily Spanish‐Speaking Children<br />

Spanish Assessment English Assessment<br />

50.0%<br />

25.6% 30.6%<br />

18.0%<br />

4.9% 5.8% 7.2%<br />

49.8%<br />

61.1%<br />

Rhyming Alliteration


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Figure 54: Percentage of Children Meeting Targets for Later Reading Success,<br />

by Primary Language<br />

LANGUAGE OF<br />

ASSESSMENT<br />

PRIMARILY ENGLISH‐SPEAKING CHILDREN NET CHANGE<br />

TOPIC AREA OCT JAN MAY<br />

English Picture Naming 32.3% 62.1% 57.1% 24.8%<br />

LANGUAGE OF<br />

ASSESSMENT<br />

Rhyming 18.5% 31.0% 48.9% 30.4%<br />

Alliteration 21.7% 56.9% 68.1% 46.4%<br />

PRIMARILY SPANISH‐SPEAKING CHILDREN NET CHANGE<br />

OCT JAN MAY<br />

Spanish Picture Naming 6.3% 13.6% 29.3% 23.0%<br />

Rhyming 7.7% 26.0% 46.5% 38.8%<br />

Alliteration 18.9% 56.0% 72.3% 53.4%<br />

English Picture Naming 4.9% 18.0% 25.6% 20.7%<br />

Rhyming 5.8% 30.6% 50.0% 44.2%<br />

Alliteration 7.2% 49.8% 61.1% 53.9%<br />

Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />

English Speakers: English N= Oct: Picture Naming (93); Rhyming (92); Alliteration (92). N= Jan: Picture Naming (58); Rhyming (58); Alliteration (51). N=<br />

May: Picture Naming (91); Rhyming (90); Alliteration (91). Spanish Speakers: Spanish N= Oct: Picture Naming (222); Rhyming (222); Alliteration (222).<br />

N= Jan: Picture Naming (206); Rhyming (204); Alliteration (209). N= May: Picture Naming (229); Rhyming (228); Alliteration (224). Spanish Speakers:<br />

English N= Oct: Picture Naming (247); Rhyming (240); Alliteration (236). N= Jan: Picture Naming (217); Rhyming (206); Alliteration (2<strong>11</strong>). N= May:<br />

Picture Naming (246); Rhyming (242); Alliteration (234).<br />

Note: Table displays the percentage of children scoring “at” or “above” the target level in these three pre‐literacy skill areas. Children who completed<br />

any two assessments within a pre‐literacy skill area were included in the analysis of that skill. Children were determined to be primarily English<br />

speakers if they were marked as being “English‐only” speakers on the scoring template, or if they did not take any assessments in Spanish. Children<br />

were determined to be primarily Spanish speakers if they were not marked as being “English‐only” speakers on the scoring template, and if they took<br />

at least one assessment in Spanish. The number of children marked as being “English‐only” speakers who also completed an additional assessment in<br />

Spanish was too low to analyze.<br />

Indicator: Percentage of children who recognize letter sounds (pre/post)<br />

Pre‐school children who participated in two educational programs provided by Migrant Education<br />

were assessed in their ability to recognize letter sounds in their primary language. Over 90% of all<br />

students who participated in these programs increased their letter sound recognition by at least five<br />

letter sounds, and on average, students learned to recognize 17 new letter sounds by the time they<br />

left the program.<br />

65


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Figure 55: Changes in Students’ Letter Sound Recognition Skills After Participation in<br />

Migrant Education Pre-School Programs<br />

Percentage of Students Who Increased Their Letter<br />

Sound Recognition By At Least 5 Letter Sounds<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

90.3%<br />

Average Number of Letter Sounds Recognized<br />

at Pre and Post Assessment<br />

Source: Migrant Education Summer Pre‐K and School Readiness Programs: Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool,<br />

20<strong>11</strong>.<br />

N=124.<br />

Increase Use of Kindergarten Transition Practices<br />

The Child Snapshot form was developed in partnership between kindergarten teachers and early<br />

childhood educators as an easy and effective way to support children’s transition to kindergarten.<br />

The Snapshot is a three‐page form completed by both the parent and the preschool teacher in the<br />

spring prior to kindergarten, and it includes brief information about the child’s interests and<br />

abilities, language or developmental concerns, preschool experience, and developmental<br />

information. As such, the form provides kindergarten teachers with family and preschool<br />

information about their students, and helps them become more familiar with the preschool and<br />

child care programs which feed into their elementary schools.<br />

The number of children with Child Snapshots completed on their behalf continues to grow, and<br />

illustrates increased communication between early childhood and elementary school settings, and<br />

the achievements being made to bridge children’s transition to kindergarten.<br />

� In Spring 20<strong>11</strong>, a total of 976 preschool children were assessed—509 boys (52%) and 467<br />

girls (48%). These children were drawn from 42 preschool programs throughout <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong> and their child snapshot forms were shared with kindergarten teachers at 42<br />

elementary schools in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and surrounding areas.<br />

66 FIRST 5 SANTA CRUZ COUNTY<br />

20<br />

15<br />

10<br />

5<br />

0<br />

1.2<br />

17.9<br />

Pre Post<br />

Indicator: Number of children who have a Child Snapshot completed on their behalf


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

Figure 56: Number of Child Snapshot Forms Collected from Participating Preschool<br />

Programs<br />

Source: Applied Survey Research, Child Snapshot Log, 2006‐<strong>2010</strong>, and Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot.<br />

Pre‐Kindergarten Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />

Additionally, a measurement of kindergarten readiness was included at the end of the Child<br />

Snapshot, using either the Desired Results Developmental Profile ‐ Revised, Preschool (DRDP‐PS) or<br />

the Pre‐Kindergarten Observation Form (PKOF). Children were assessed across 24 readiness skills,<br />

which can be sorted into four domains, or Basic Building Blocks of Readiness: 1) Self‐Care & Motor<br />

Skills, 2) Self‐Regulation Skills, 3) Social Expression Skills, 4) Kindergarten Academics. The figure<br />

below displays children’s overall mean readiness scores as well as their average scores on each of<br />

the four Basic Building Blocks.<br />

Proficient<br />

In Progress<br />

Beginning<br />

1,000<br />

800<br />

600<br />

400<br />

200<br />

0<br />

393<br />

889<br />

617<br />

2006‐07 2007‐08 2008‐09 2009‐<strong>2010</strong> <strong>2010</strong>‐<strong>11</strong><br />

� Average readiness scores for the Basic Building Blocks ranged from 3.44 to 3.75 (on a scale of<br />

1 to 4), with an overall readiness score of 3.54. These results indicate that children who<br />

attended these preschools will be entering kindergarten with high levels of proficiency across<br />

all domains of readiness.<br />

Figure 57: Students’ Average School Readiness Levels Across the Basic Building<br />

Blocks of Readiness<br />

4<br />

3<br />

2<br />

Not Yet<br />

1<br />

3.54<br />

3.75<br />

Overall Readiness Self‐Care & Motor<br />

Skills<br />

Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten Observation Form<br />

and crosswalked DRDP‐PS, Spring 20<strong>11</strong>.<br />

N = 900‐904.<br />

832<br />

976<br />

3.50 3.59 3.44<br />

Self‐Regulation<br />

Skills<br />

Social Expression<br />

Skills<br />

Kindergarten<br />

Academics<br />

67


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

The next figure highlights the readiness skills for which students were rated as demonstrating the<br />

most proficiency and the greatest challenges.<br />

� Readiness skill strengths were identified within the Self Care & Motor Skills, Social<br />

Expression, and Kindergarten Academics Basic Building Blocks.<br />

� Students were still developing the Kindergarten Academic skills involved in recognizing all<br />

letters of the alphabet and recognizing rhyming words, as well as the Self Regulation Skills<br />

involved in navigating peer relationships.<br />

Figure 58: Students’ Top Five Readiness Strengths & Challenges<br />

TOP FIVE STRENGTHS BASIC BUILDING BLOCK<br />

1. General coordination on the playground Self‐Care & Motor Skills<br />

2. Uses small manipulatives Self‐Care & Motor Skills<br />

3. Recognizes basic colors Kindergarten Academics<br />

4. Relates appropriately to adults other than parent/primary caregiver Social Expression<br />

5. Appropriately expresses needs and wants verbally in primary language Social Expression<br />

TOP FIVE CHALLENGES BASIC BUILDING BLOCK<br />

1. Recognizes letters of the alphabet Kindergarten Academics<br />

2. Recognizes rhyming words Kindergarten Academics<br />

3. Handles frustration well Self‐Regulation<br />

4. Negotiates with peers to resolve social conflict Self‐Regulation<br />

5. Participates successfully in circle time Self‐Regulation<br />

Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten. Pre‐Kindergarten<br />

Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />

Note: Means are based on 415‐899 students. Don’t know/ Not observed responses are not included. Scale points are as follows: 1=not yet, 2=<br />

beginning, 3=in progress, 4=proficient.<br />

68 FIRST 5 SANTA CRUZ COUNTY


SERVICE INTEGRATION &<br />

FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Service Integration & Community Strengthening<br />

COMMUNITY STRENGTHENING<br />

<strong>First</strong> 5 Service Integration<br />

FIRST 5 SANTA CRUZ COUNTY<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

Indicator: Number of families who receive services from multiple <strong>First</strong> 5 grantees<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> seeks to strengthen the system of care in the county. One measure of the<br />

degree of current integration across the system is the number of children who are served by<br />

multiple <strong>First</strong> 5 grantees. Sometimes this occurs because grantees cross‐refer families, or because<br />

other agencies refer families into a coordinated network of <strong>First</strong> 5 services. In <strong>2010</strong>‐<strong>11</strong>, 18% of<br />

children received services from multiple <strong>First</strong> 5 partners.<br />

Figure 59: Number of Children Receiving Services from Multiple <strong>First</strong> 5 Partners<br />

2006‐2007 2007‐2008 2008‐2009 2009‐<strong>2010</strong> <strong>2010</strong>‐20<strong>11</strong><br />

TOTAL NUMBER OF CHILDREN 4,462 5,214 5,440 5,762 9,292<br />

PERCENT WITH MULTIPLE<br />

FIRST 5 SERVICES<br />

Source: SUN database/CCD data for July 1, 2006 ‐ June 30, 20<strong>11</strong>.<br />

12.8% 20.3% 13.0% 14.6% 17.8%<br />

Figure 60: Percentage of Children Receiving Services from Multiple <strong>First</strong> 5 Partners<br />

30%<br />

20%<br />

10%<br />

0%<br />

12.8%<br />

20.3%<br />

13.0%<br />

14.6%<br />

17.8%<br />

2006‐07 2007‐08 2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

Source: SUN database/CCD data for July 1, 2006 ‐ June 30, 20<strong>11</strong>.<br />

Note: 2006‐2007 data: N = 4,462. 2007‐2008 data: N = 5,214. 2008‐2009 data: N = 5,440. 2009‐<strong>2010</strong> data: N = 5,762. <strong>2010</strong>‐<strong>11</strong> data: N = 9,292.<br />

69


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

Indicator: Distribution of Information to Community Service Providers<br />

Many health, social services, and early education providers in the county participated in workshops<br />

on various social and community issues to better integrate services and improve customer service,<br />

including 213 who participated in brown bag lunches, and 31 who attended customer service<br />

trainings.<br />

Indicator: Network of agencies that participated in Triple P<br />

As the Triple P program has expanded its levels of service, the number of agencies providing these<br />

services has also grown. By the end of FY <strong>2010</strong>‐<strong>11</strong>, 86 practitioners from 20 agencies and programs<br />

had been accredited to provide Triple P services. <strong>First</strong> 5 implemented the following steps to build<br />

and enhance the Triple P referral system, and to provide integration between these agencies.<br />

� Maintained and distributed a contact list indicating which organizations have practitioners<br />

accredited in each Level of Triple P.<br />

� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service<br />

providers as a means to encourage referrals.<br />

� Publicized Triple P services in print and online editions of newspapers and community<br />

calendars.<br />

� Established <strong>First</strong> 5’s main phone number as a “warmline.” This number was publicized in all<br />

flyers, emails and media announcements as a central place to receive assistance locating<br />

Triple P services. <strong>First</strong> 5 staff were trained to conduct a brief screening in order to assess<br />

callers’ needs and make appropriate referrals.<br />

� Developed Triple P business cards containing <strong>First</strong> 5’s warmline and website address, as well<br />

as space for practitioners to insert their own contact information.<br />

� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners,<br />

referral processes, and a master calendar of Triple P Groups, Workshops, and Seminars.<br />

70 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

<strong>First</strong> 5 Fiscal Status and Sustainability<br />

Indicator: Average Cost per Client<br />

FIRST 5 SANTA CRUZ COUNTY<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

The following figure presents data for the number of clients served by each <strong>First</strong> 5 partner, and the<br />

average cost per client.<br />

PARTNER<br />

Figure 61: Average Cost per Client, by Goal Area and Partner (<strong>2010</strong>-20<strong>11</strong>)<br />

HEALTHY CHILDREN<br />

JULY <strong>2010</strong> –<br />

JUNE 20<strong>11</strong><br />

COSTS<br />

PARENTS<br />

CHILDREN<br />

(AGES 0‐5)<br />

NUMBERS SERVED<br />

EARLY<br />

CHILDHOOD<br />

EDUCATORS<br />

TRIPLE P<br />

CHILDREN<br />

(AGES 6+)<br />

TRIPLE P<br />

PRACTI‐<br />

TIONERS<br />

AVERAGE COST PER INDIVIDUAL<br />

TOTAL<br />

PARTICIPANTS<br />

71<br />

COST PER<br />

PARTICIPANT<br />

Healthy Kids Initiative $865,315 2,704 2,704 $320<br />

STRONG FAMILIES<br />

Families Together $585,197 137 187 324 $1,806<br />

Triple P Services 1 $363,479 437 324 278 1,039 $350<br />

Training &<br />

Accreditation<br />

$88,275 94 94 $939<br />

Side‐By‐Side $95,000 41 41 $2,317<br />

CHILDREN LEARNING AND READY FOR SCHOOL<br />

La Manzana Community<br />

Resources<br />

Early Literacy<br />

Foundations Initiative<br />

$98,000 981 1,332 2,313 $42<br />

$320,069 104 104 $3,078<br />

Raising A Reader $231,556 5,394 5,394 $43<br />

Starlight Infant / Toddler<br />

Program<br />

Literacy Continuing<br />

Education Workshops<br />

Migrant Education ‐<br />

Summer Pre‐K Academy<br />

Migrant Education School<br />

Readiness Program<br />

$515,000 104 54 158 $3,259<br />

$4,936 35 35 $141<br />

$39,622 156 156 $254<br />

$13,821 36 36 $384<br />

Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

1 Triple P provides services via several local practitioners and agencies, including three agencies that are already <strong>First</strong> 5 partners (Families Together, La<br />

Manzana Community Resources, and Mountain Community Resources). For these partners, clients who received Triple P services are reported as<br />

Triple P clients. If these clients also received other services from that partner, they are reported again as clients for that <strong>First</strong> 5 partner. Since<br />

Mountain Community Resources received <strong>First</strong> 5 funding to provide Triple P services, all of their clients are reported as Triple P clients in this table.


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

Indicator: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s <strong>Annual</strong> Balance Sheet<br />

The balances on this statement were as of June 30, 20<strong>11</strong>. The Statement of Net Assets indicates that<br />

net assets decreased by $3,864,306 from June 30, <strong>2010</strong> to June 30, 20<strong>11</strong>. This decrease in net assets<br />

is part of the Commission’s planned use of its sustainability fund for providing programmatic<br />

investments as set forth in the Strategic Plan and unforeseen liability of $3,390,246 incurred due to<br />

the passage of AB99 by the California Legislature. For the year ended June 30, 20<strong>11</strong>, the ending fund<br />

balance was $2,912,395, a decrease of $3,868,097 from the prior year. The Commission’s fund<br />

balance is allocated for the following categories:<br />

� $200,000 is restricted for private grants.<br />

� $2,712,395 is committed for program contracts.<br />

Figure 62: Balance Sheet, Fiscal Year <strong>2010</strong>-20<strong>11</strong><br />

Revenue Prop 10 Allocation $ 2,400,827<br />

Expenses Program<br />

Interest on Prop 10 Allocation $ 37,044<br />

School Readiness State Program Match $ 616,623<br />

David and Lucille Packard Foundation Grant $ 200,000<br />

Mental Health Services Act Contract $ 290,100<br />

HSD Title IV‐E Training Funds $ 82,226<br />

Other $ 20,298<br />

Total Revenue $ 3,647,<strong>11</strong>8<br />

Children Learning & Ready for School $ 1,366,259<br />

Healthy Children $ 870,015<br />

Strong Families $ 1,131,951<br />

Family Friendly Services $ 59,162<br />

Transfer to State per AB99 $ 3,390,246<br />

Program Support $ 235,436<br />

<strong>Evaluation</strong> $ 202,380<br />

Administration $ 259,766<br />

Total Expenditures $ 7,515,215<br />

Excess of expenditures over revenues $ (3,868,097)<br />

Fund balance ‐ beginning of year $ 6,780,492<br />

Fund balance ‐ end of year $ 2,912,395<br />

Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> audited financial statements (<strong>2010</strong>‐20<strong>11</strong>).<br />

72 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

FIRST 5 SANTA CRUZ COUNTY<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

Indicator: Amount of matched or leveraged investments reported by <strong>First</strong> 5 partners<br />

Many partners maximize <strong>First</strong> 5 funding by using their funds as match money. In <strong>2010</strong>‐20<strong>11</strong>, <strong>First</strong> 5<br />

funding was leveraged by these partners to bring in the following additional revenue.<br />

Figure 63: Amount of Leveraged Investments By Type<br />

SOURCE OF LEVERAGED FUNDING LEVERAGED FUNDING AMOUNT<br />

Medi‐Cal Administrative Activities (MAA) $282,604<br />

Early Periodic Screening Detection and Treatment (EPSDT) $80,215<br />

Public agency ‐ Federal $103,370<br />

Public agency ‐ State $1,321,022<br />

Public agency ‐ Local $771,000<br />

Educational Institution $131,131<br />

Private Foundation $688,660<br />

Business or Individual $384,962<br />

Total $3,762,964<br />

Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and <strong>First</strong> 5 partner <strong>Annual</strong> Progress <strong>Report</strong>s, <strong>2010</strong>‐20<strong>11</strong>.<br />

Figure 64: Total Amount of <strong>First</strong> 5 and Leveraged Investments, <strong>2010</strong>-<strong>11</strong><br />

$7,500,000<br />

$5,000,000<br />

$2,500,000<br />

$0<br />

$3,662,823<br />

$3,762,954<br />

Source: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and <strong>First</strong> 5 partner <strong>Annual</strong> Progress <strong>Report</strong>s, <strong>2010</strong>‐20<strong>11</strong>.<br />

$7,425,777<br />

$3,762,954<br />

$3,662,823<br />

Total <strong>First</strong> 5 Investment Total Leveraged Investments <strong>First</strong> 5 and Leveraged<br />

Investments Combined<br />

73


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

Community Strengthening<br />

Indicator: Access and utilization of the 2‐1‐1 program<br />

2‐1‐1 is a centralized point of contact for <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> residents to get information on local<br />

services, and is accessible by phone or an online website. Trained specialists refer callers to local<br />

agencies and services that match their needs, and also help relieve the burden on 9‐1‐1 during<br />

disasters by providing non‐emergency information and referrals. This new county program,<br />

operated by the United Way of the Bay Area and funded by several local agencies including <strong>First</strong> 5<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, just completed its first year of service in July, 20<strong>11</strong>.<br />

Results show how effective this program was in helping residents with their everyday needs and<br />

concerns, and during emergency situations. In its first year, a total of 5,157 people called 2‐1‐1, with<br />

a total of 5,797 needs. Common types of needs included housing issues (24%), disaster services<br />

(12%), income support/assistance (<strong>11</strong>%), and food/meals (9%). A total of 7,347 referrals to agencies<br />

were made, including referrals to human services (30%), disaster assistance (10%), and health<br />

agencies (9%).<br />

7%<br />

Figure 65: Number of 2-1-1 Callers and Needs, <strong>2010</strong>-<strong>11</strong><br />

TOTAL NUMBER OF 2‐1‐1 CALLERS TOTAL NUMBER OF NEEDS TOTAL NUMBER OF REFERRALS<br />

5,157 5,797 7,347<br />

Source: United Way of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2‐1‐1 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Year One, <strong>Report</strong> to the Community, July 21, 20<strong>11</strong>, 20<strong>11</strong>.<br />

Figure 66: Types of 2-1-1 Callers’ Needs<br />

6%<br />

8%<br />

6%<br />

8%<br />

9%<br />

9%<br />

<strong>11</strong>%<br />

24%<br />

12%<br />

Housing<br />

Disaster Services<br />

Income Support/Assistance<br />

Food/Meals<br />

Legal, Consumer, & Public Safety<br />

Health Care<br />

Information Services<br />

Individual, Family, & Community Support<br />

Mental Health/Addictions<br />

Other Needs<br />

Source: United Way of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2‐1‐1 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Year One, <strong>Report</strong> to the Community, July 21, 20<strong>11</strong>.<br />

N=5,797.<br />

74 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT STRATEGIC FRAMEWORK RESULTS<br />

Figure 67: Types of 2-1-1 Referrals to Agencies<br />

5%<br />

6%<br />

7%<br />

4%<br />

4%<br />

8%<br />

4%<br />

Source: United Way of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, 2‐1‐1 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Year One, <strong>Report</strong> to the Community, July 21, 20<strong>11</strong>.<br />

N=7,347.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

5%<br />

8%<br />

9%<br />

30%<br />

10%<br />

Human Services<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

Disaster Assistance<br />

Health Agencies<br />

Volunteer Income Tax Assistance<br />

Housing Services<br />

The Salvation Army Corps Community Center<br />

Catholic Charities<br />

Community Action Board<br />

St. Vincent De Paul Society of <strong>Santa</strong> <strong>Cruz</strong><br />

Children's Services<br />

<strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong> Benefit Services<br />

Other Services<br />

75


STRATEGIC FRAMEWORK RESULTS FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

SERVICE INTEGRATION AND COMMUNITY STRENGTHENING<br />

76 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

PART 2:<br />

PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

77


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

78 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

PARTNER PROFILES<br />

This section of the report provides a snapshot of each <strong>First</strong> 5 partner’s work between July 1, <strong>2010</strong><br />

and June 30, 20<strong>11</strong>.<br />

At the beginning of the <strong>2010</strong>‐<strong>11</strong> contract period, scopes of work were developed with each partner<br />

which detailed each program’s target population, the number of people to be served, primary<br />

programmatic activities, outcome objectives, methods of measurement, and the timing of data<br />

collection activities. Partners reported their outcome data quarterly or biannually, using the SUN<br />

database, customized Excel forms, or partner‐specific reports. In addition, a narrative template was<br />

provided to partners to submit qualitative information on the progress of their services. When<br />

collecting data for their outcome objective, some programs did not administer their assessment<br />

tools to every participant. For this reason the number of participants reported in their outcome<br />

measurement may differ from the total number of participants who were served.<br />

The purpose of the Partner Profiles is to highlight the work that each partner conducted in Fiscal<br />

Year <strong>2010</strong>‐<strong>11</strong>. Organized by goal area (Healthy Children, Strong Families, and Children Learning and<br />

Ready for School), each profile briefly lists:<br />

� Description of the program<br />

� Population served<br />

� Client outcome objectives achieved (and in a few cases, program objectives achieved)<br />

Readers will note that in many cases, data that were presented in the Strategic Framework section<br />

are presented here again with the intent of summarizing the meaningful work that each of the<br />

partners carried out in the <strong>2010</strong>‐<strong>11</strong> year.<br />

Finally, it should be noted that these profiles only provide an overview of the innovative work that<br />

each partner or initiative carries out, and that more comprehensive detail about each partner’s<br />

progress is provided in their annual report to <strong>First</strong> 5.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

79


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />

Healthy Kids Initiative<br />

Health Care Outreach Coalition<br />

Program Description<br />

The Health Care Outreach Coalition (HCOC) provides assistance with application and enrollment in<br />

public health insurance to income‐eligible families. Through community outreach workers called<br />

Certified Application Assistors (CAAs), children from families earning up to 300% of the Federal<br />

Poverty Level receive assistance in applying for Medi‐Cal, Healthy Families, and the local Healthy<br />

Kids health insurance plan.<br />

Additionally, HCOC staff participate in community events and respond to business and community<br />

agency requests for presentations and additional information regarding health insurance. HCOC<br />

assists in the management of the One‐e‐App online application system, providing training and<br />

technical assistance to all CAAs.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Children 2,704<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

“[We are] most proud of our CAAs’ commitment to helping<br />

parents navigate the often difficult and confusing processes<br />

of public health insurance programs. That CAAs request<br />

presentations and trainings on other community resources<br />

further exemplifies how seriously they take their roles<br />

as assistors.”<br />

- Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong><br />

80 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />

Outcome Objective: Children will be assisted in applying for public health<br />

insurance<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Number of children assisted 2,846<br />

Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />

Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />

HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />

months after the end of the fiscal year.<br />

Outcome Objective: Children will be enrolled in public health insurance<br />

By June 20<strong>11</strong>, 75% of the children ages 0‐5 who received assistance to<br />

apply will be enrolled in a public health insurance program<br />

<strong>2010</strong>‐20<strong>11</strong><br />

89.0%<br />

N=1,944<br />

Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />

Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />

HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />

months after the end of the fiscal year.<br />

Outcome Objective: Children will be renewed in public health insurance<br />

By June 20<strong>11</strong>, 75% of the children ages 0‐5 who received assistance to<br />

apply will be renewed in a public health insurance program<br />

<strong>2010</strong>‐20<strong>11</strong><br />

92.1%<br />

Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />

Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />

HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />

months after the end of the fiscal year.<br />

System Outcome: Children will utilize public health insurance<br />

85% of children renewing in public health insurance between July 1,<br />

<strong>2010</strong> and June 30, 20<strong>11</strong> will have utilized care prior to renewal<br />

N=902<br />

<strong>2010</strong>‐20<strong>11</strong><br />

96.6%<br />

Source: Health Care Outreach Coalition, <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />

Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come to<br />

HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications 2‐3<br />

months after the end of the fiscal year, and utilization results exclude clients with missing data.<br />

N=829<br />

81


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />

The following chart presents the percentage of applicants who were enrolled in health insurance,<br />

the percentage who re‐enrolled in insurance, and the percentage who utilized their benefits.<br />

Figure 68: HCOC Child Health Insurance Enrollment, Renewal, and Utilization<br />

Percentages<br />

100%<br />

95%<br />

90%<br />

85%<br />

80%<br />

75%<br />

70%<br />

99.6%<br />

93.8%<br />

85.7%<br />

Percent who utilized care prior to renewal in an insurance program<br />

Percent who were renewed in an insurance program<br />

Percent who were enrolled in an insurance program<br />

98.5%<br />

97.9%<br />

87.9%<br />

Source: Applied Survey Research, <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Final <strong>Report</strong>s, 2006 ‐ <strong>2010</strong>. Health Care Outreach Coalition, Enrollment and Utilization<br />

<strong>Report</strong>, 20<strong>11</strong>.<br />

Note: The number of children in this analysis may be slightly different than the total number of unduplicated children served, since families may come<br />

to HCOC for enrollment assistance more than once in the fiscal year. Enrollment and utilization results represent the status of children’s applications<br />

2‐3 months after the end of the fiscal year. Utilization results exclude clients with missing data.<br />

Enrollment N: June 2007=678; June 2008=580. June 2009=730, June <strong>2010</strong>=1,528, June 20<strong>11</strong>=1,944. Renewal N: June 2007=496; June 2008=530. June<br />

2009=592, June <strong>2010</strong>=826, June 20<strong>11</strong>=902. Utilization N: June 2007=471, June 2008=514. June 2009=555, June <strong>2010</strong>=789, June 20<strong>11</strong>=829.<br />

Health Care Outreach Coalition’s Newborn Enrollment Project: Baby Gateway<br />

99.6%<br />

98.0%<br />

Baby Gateway—the Newborn Enrollment Project—has now been launched in three local hospitals<br />

with funding and support provided by <strong>First</strong> 5 of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Watsonville Hospital (in August<br />

2009), Dominican Hospital (in January 20<strong>11</strong>), and Sutter Maternity & Surgery Center of <strong>Santa</strong> <strong>Cruz</strong> (in<br />

May 20<strong>11</strong>).<br />

The main goals of the project are to provide enrollment assistance to mothers and their newborns, as<br />

well as to establish a seamless Medi‐Cal coverage process for Medi‐Cal‐eligible newborns, and to link<br />

those newborns to a medical home, all before they leave the hospital. In addition, all new mothers<br />

receive the <strong>First</strong> 5 “Kit for New Parents” containing expert guidance for raising healthy infants and<br />

children. In particular, parents are oriented to the “What To Do If My Child Gets Sick” booklet, which<br />

provides information in utilizing primary care appropriately, and clarifies what issues should prompt a<br />

visit to the emergency room (and which should be handled in the medical home).<br />

82 FIRST 5 SANTA CRUZ COUNTY<br />

99.4%<br />

93.7%<br />

85.6% 85.5%<br />

96.6%<br />

92.1%<br />

89.0%<br />

June 2007 June 2008 June 2009 June <strong>2010</strong> June 20<strong>11</strong><br />

Utilization<br />

Outcome: 85%<br />

Enrollment &<br />

Renewal<br />

Outcomes:<br />

75%


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />

Data from <strong>2010</strong>‐<strong>11</strong> show how successful this program has been in providing these services to <strong>Santa</strong><br />

<strong>Cruz</strong> <strong>County</strong>’s mothers and newborns.<br />

� Of all 2,103 births that occurred in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> at these hospitals after the program<br />

had been implemented, 70% of mothers received a newborn visit while in the hospital, and<br />

65% received a “Kit for New Parents.”<br />

� Of all 1,499 mothers with Medi‐Cal births during <strong>2010</strong>‐<strong>11</strong>, almost three‐fourths (74%) were<br />

assisted to complete a Medi‐Cal application for their new babies.<br />

� Of the 1,<strong>11</strong>1 mothers who were assisted to complete a Medi‐Cal application for their<br />

newborns, nearly all applications (95%) were approved, and 97% were assigned a primary<br />

care provider for their child before discharge from the hospital.<br />

Figure 69: Newborn Enrollment Project Statistics, <strong>2010</strong>-<strong>11</strong><br />

PROGRAM COMPONENT WATSONVILLE<br />

Total Number of All Births in <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong> after program implementation<br />

COMMUNITY<br />

HOSPITAL<br />

DOMINICAN<br />

HOSPITAL 1<br />

SUTTER<br />

MATERNITY &<br />

SURGERY CENTER<br />

OF SANTA CRUZ 2<br />

1,487 437 179 2,103<br />

Total Number of Medi‐Cal Births 1,247 191 61 1,499<br />

Number of Completed Newborn<br />

Medi‐Cal Applications<br />

Number of Approved Newborn<br />

Medi‐Cal Enrollments<br />

Number of Denied Newborn<br />

Medi‐Cal Applications<br />

Number of Pending Newborn<br />

Medi‐Cal Applications<br />

Number of Newborn Medi‐Cal<br />

Applicants with an Assigned<br />

Primary Care Provider<br />

Total Number of Newborn Visits<br />

(regardless of insurance status)<br />

Number of Kits for New Parents<br />

Distributed<br />

Source: Health Care Outreach Coalition, Newborn Enrollment Statistics, 20<strong>11</strong>.<br />

1 Based on program implementation of 1/10/<strong>11</strong>.<br />

2 Based on program implementation of 5/1/<strong>11</strong>.<br />

TOTAL<br />

NUMBER PERCENT OF ALL<br />

MEDI‐CAL BIRTHS<br />

919 141 51 1,<strong>11</strong>1 74.1%<br />

NUMBER PERCENT OF ALL<br />

83<br />

MEDI‐CAL<br />

APPLICATIONS<br />

883 133 44 1,060 95.4%<br />

21 1 0 22 2.0%<br />

15 7 7 29 2.6%<br />

1,074 96.7%<br />

NUMBER PERCENT OF ALL<br />

COUNTY BIRTHS<br />

1,040 289 136 1,465 69.7%<br />

1,040 184 136 1,360 64.7%


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

HEALTHY CHILDREN ‐ HEALTH CARE OUTREACH COALITION<br />

These Newborn Enrollment Project services may also have had an effect on the use of the<br />

Emergency Department (ED) for children less than one year old. As seen in the following figure,<br />

� ED visits at Watsonville Community Hospital were at a high of 632 in the 2 nd quarter of 2009.<br />

Baby Gateway was launched at that hospital in August 2009, and after that the number of ED<br />

visits dropped steadily to a low of 424 at the beginning of 20<strong>11</strong>.<br />

Figure 70: Number of Emergency Department Visits (Infants Less Than One Year Old)<br />

700<br />

600<br />

500<br />

400<br />

300<br />

200<br />

100<br />

0<br />

573<br />

218<br />

632<br />

Baby Gateway<br />

Launched 8/2009<br />

184<br />

552 558<br />

151<br />

171<br />

Source: Health Improvement Partnership of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Baby Gateway Program <strong>Report</strong>, August 16, 20<strong>11</strong>.<br />

506<br />

199<br />

528<br />

146<br />

84 FIRST 5 SANTA CRUZ COUNTY<br />

471<br />

<strong>11</strong>6<br />

421 424<br />

Q1/2009 Q2/09 Q3/09 Q4/09 Q1/<strong>2010</strong> Q2/10 Q3/10 Q4/10 Q1/20<strong>11</strong><br />

168<br />

186<br />

Baby Gateway<br />

Launched 1/20<strong>11</strong><br />

Watsonville Community Hospital<br />

Dominican Hospital


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Families Together<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – FAMILIES TOGETHER<br />

Families Together provides an alternative, voluntary and prevention‐focused way for <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong> to respond to reports of abuse and neglect received by Family and Children’s Services (FCS).<br />

Of all the referrals to the child welfare screening unit, only about 8% meet the necessary criteria to<br />

receive services from FCS. By assisting these families, <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> can intervene early, before<br />

family difficulties escalate to the point of maltreatment, in order to increase child safety, engage<br />

families in decision‐making, and to support healthy<br />

child development.<br />

<strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center is the<br />

lead agency for Families Together. Other<br />

collaborative partners, such as Family and<br />

Children’s Services, a division of the Human<br />

Services Department (HSD), Health Services Agency,<br />

and Families in Transition also play critical roles in<br />

the program.<br />

Although families are referred through the Child<br />

Welfare System, they participate in Families<br />

Together voluntarily. This home visiting program<br />

includes comprehensive intake and risk assessment,<br />

development of a tailored case plan, parent<br />

support and education, child development<br />

activities, and periodic assessments. Using a<br />

strengths‐based approach, participating families<br />

are encouraged to identify goals and objectives that<br />

will support healthy family relationships, child health<br />

and safety, positive parenting, family literacy and<br />

school readiness.<br />

“Safety and basic needs have always been—and<br />

continue to be—crucial elements of the work we<br />

do with families. This year, we have really pushed<br />

the program forward in terms of parent education<br />

and mental health services for all families.”<br />

One family’s story:<br />

“[After receiving Triple P services,] Eduardo* was<br />

taking a more active role in the parenting, and<br />

seemed to respond to [the practitioner’s] assertion<br />

that his children admire him and need him to be<br />

an active parent. [He and his daughter] are better<br />

able to communicate, and [his wife] found that<br />

she was yelling less and the children were<br />

responding more. Though this family has many<br />

challenges ahead, they have learned imperative<br />

communication skills, appropriate limit-setting,<br />

and self-care skills. This foundation will surely<br />

benefit them as they continue to raise adolescents<br />

and young children.”<br />

-Families Together, <strong>Annual</strong> Progress <strong>Report</strong><br />

(* Names have been changed)<br />

In Families Together, risk assessment serves a variety of purposes. <strong>First</strong>, the assessments help staff<br />

link parents with the appropriate service pathway, including brief services, intensive services, and<br />

referrals to Primeros Pasos, a program for parents struggling with alcohol and drug dependency.<br />

Follow up assessments help assess whether risk has been reduced.<br />

85


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – FAMILIES TOGETHER<br />

Population Served<br />

Families Together Pathway<br />

Brief Intensive Pending<br />

Subtotal<br />

All Pathways<br />

Participated in<br />

Triple P*<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Total<br />

All Pathways + Triple P<br />

(unduplicated)<br />

Parents/Guardians 57 77 3 137 25 146<br />

Children 80 104 3 187 (ages 0‐5) 27<br />

(ages 6‐16) 13<br />

(ages 0‐5) 191<br />

(ages 6‐16) 13<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

Note: The risk assessment results guide the pathway assignment decision: families who score Low or Moderate work within the Brief Pathway with a<br />

Family Support Specialist for 3‐6 months. Those who score High or Very High work within the Intensive Pathway for up to 12 months, also with a Family<br />

Support Specialist.<br />

* These Triple P client numbers are estimates only, and are likely an undercount, as these data do not include clients from program levels that do not<br />

collect CCDs, and also exclude clients who did not consent to have their assessment data included in this evaluation.<br />

Outcome Objective: Families receive referrals, initial assessments, and assigned<br />

services<br />

Program Objectives <strong>2010</strong>‐20<strong>11</strong><br />

At least 280 new families will be referred from Family and Children’s Services to<br />

Families Together.<br />

75% of these new families referred to Families Together (who were successfully<br />

contacted) will agree to an initial meeting.<br />

86 FIRST 5 SANTA CRUZ COUNTY<br />

188*<br />

88.6%<br />

N=123<br />

At least 150 primary caregivers will participate in Families Together. 137 primary caregivers<br />

95% of families participating in Families Together will receive an initial<br />

Structured Decision Making: Family Prevention Services Screening Tool<br />

(SDM:FPSST) risk assessment.<br />

99.2%<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>; Families Together Referral and Initial Engagement Form, 20<strong>11</strong> and <strong>Annual</strong> Progress<br />

<strong>Report</strong>, 20<strong>11</strong>.<br />

* This number refers to participant referrals, not unique participants. If the same participant was referred more than once, each referral is tracked<br />

separately. Due to the complicated nature of tracking the ever‐changing status of each referral, this number represents the best estimate of the total<br />

number of referrals.<br />

N=132


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Figure 71: Case Flow Diagram (<strong>2010</strong>-<strong>11</strong>)<br />

Contact<br />

and<br />

meeting<br />

plans still<br />

in progress<br />

29<br />

FIRST 5 SANTA CRUZ COUNTY<br />

Contact ended:<br />

Unable to contact<br />

(68.7%),<br />

Declined to meet<br />

(26.4%),<br />

Case reopened in CWS<br />

(4.2%), or<br />

Ineligible for services<br />

(0.7%)<br />

Referral Closed<br />

69<br />

Cases Referred to Families Together (FT): 188*<br />

Contact ended:<br />

Did not show up to<br />

meeting<br />

(4.5%), or<br />

Met but declined to<br />

participate (95.5%)<br />

Referral Closed<br />

<strong>11</strong><br />

STRONG FAMILIES – FAMILIES TOGETHER<br />

Contacted and initial meeting scheduled<br />

90<br />

Consented to participate in FT<br />

OR<br />

Referred to Primeros Pasos**:<br />

Source: Families Together Referral and Initial Engagement Form, 20<strong>11</strong> and <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />

* Numbers in this case flow diagram refer to participant referrals, not unique participants. If the same participant was referred more than once, each<br />

referral is tracked separately. Due to the complicated nature of tracking the ever‐changing status of each referral, these numbers represent the best<br />

estimate of the total number of referrals.<br />

** Primeros Pasos is a companion program to Families Together serving participants with intensive substance abuse issues.<br />

Outcome Objective: Families demonstrate decreased levels of risk<br />

Client Outcome Objective <strong>2010</strong>‐ 20<strong>11</strong><br />

75% of primary caregivers who received intensive services will demonstrate decreased risk 76.5%<br />

Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, <strong>2010</strong>‐<strong>11</strong>.<br />

As seen in the following figure, the Structured Decision Making: Family Prevention Services Screening<br />

Tool used in the Families Together program is helping to show that families reduce their level of risk<br />

while in the Families Together program. In <strong>2010</strong>‐<strong>11</strong>, over 76% of parents were found to have lower<br />

levels of risk at post assessment than at pre assessment.<br />

79<br />

N=81<br />

87


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – FAMILIES TOGETHER<br />

Figure 72: Percentage of Families Together Participants Who Showed Decreased Risk<br />

of Child Maltreatment<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

81.0%<br />

71.1%<br />

Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, 2006‐<strong>11</strong>.<br />

Although very few families had a “low risk” score at baseline, these families were omitted from these analyses so that only those who could<br />

demonstrate reduced risk on the tool remained in the analysis.<br />

In 2008‐09, this risk assessment included both families receiving intensive services and those receiving brief intervention services. Long‐term clients<br />

were assessed at intake, 6 months, and 12 months, and clients receiving brief interventions were assessed at intake and the end of services.<br />

A second view of these risk assessment data involves a comparison of the percentage of families at<br />

each level of risk over four assessments (baseline, and first, second, and third reassessments). Each<br />

year’s analysis is constrained by fairly small sample sizes. Therefore, several years of data have been<br />

aggregated in order to present a more robust portrait of the extent to which Families Together<br />

participants are reducing their risk for future involvement with the child welfare system.<br />

60.6%<br />

63.0%<br />

As can be seen in the figure, 62% of families were assessed as being high risk or very high risk upon<br />

intake, and this dropped to 13% by the third reassessment, indicating that the program is helping<br />

families reduce their level of risk.<br />

Figure 73: Change in Families Together Participant’s Risk Levels Over Time,<br />

2007 - 20<strong>11</strong><br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

2006‐2007<br />

(N = 42)<br />

44.7%<br />

38.4%<br />

Baseline*<br />

(N = 237)<br />

16.9%<br />

2007‐2008<br />

(N = 45)<br />

28.1%<br />

49.7%<br />

20.0%<br />

1st Reassessment<br />

(N = 185)<br />

2.2%<br />

2008‐2009<br />

(N = 66)<br />

29.4%<br />

51.5%<br />

14.7%<br />

2009‐<strong>2010</strong><br />

(N = 128)<br />

26.7%<br />

60.0%<br />

76.5%<br />

<strong>2010</strong>‐20<strong>11</strong><br />

(N = 81)<br />

13.3%<br />

Source: SUN database, Structured Decision Making: Family Prevention Services Screening Tool (SDM:FPSST) data, 2007‐20<strong>11</strong>.<br />

* Although very few families had a “low risk” score at baseline, these families were omitted from these analyses so that only those who could<br />

demonstrate reduced risk on the tool remained in the analysis.<br />

Note: Due to inaccuracies in data entry in 2006‐07, clients with baseline assessments before 7/1/07 were omitted from this analysis.<br />

88 FIRST 5 SANTA CRUZ COUNTY<br />

4.4%<br />

2nd Reassessment<br />

(N = 68)<br />

0.0%<br />

3rd Reassessment<br />

(N=15)<br />

Low Risk<br />

Moderate Risk<br />

High Risk<br />

Very High Risk


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – FAMILIES TOGETHER<br />

Outcome Objective: Families are less likely to experience recurrence of abuse<br />

Client Outcome Objective <strong>2010</strong><br />

Of families who participated in the Differential Response program, at least 95%<br />

of families will not have a substantiated allegation of child maltreatment within<br />

6 months of case closure.<br />

96.3%<br />

Source: <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Human Services Department, Planning and <strong>Evaluation</strong> Unit. Staff analysis of CWS/CMS data, September 20<strong>11</strong>.<br />

Note: Data are from the <strong>2010</strong> calendar year, in order to allow at least a 6 month period after case closure.<br />

Results show that families who participated in the Differential Response program are less likely to<br />

experience recurrence of abuse.<br />

� Of the 82 families who received services from Families Together and had their cases closed in<br />

the <strong>2010</strong> calendar year, 96% had no substantiated allegations of maltreatment within six<br />

months after case closure. This figure is comparable to what was observed in the previous<br />

two years.<br />

Figure 74: Percentage of Families Together Participants Who Do Not Have a<br />

Substantiated Allegation of Maltreatment Within 6 Months After Case<br />

Closure<br />

100%<br />

90%<br />

80%<br />

95.1%<br />

92.0%<br />

Source: <strong>County</strong> of <strong>Santa</strong> <strong>Cruz</strong>, Human Services Department, staff analysis of CWS/CMS data.<br />

Note: Data are from each respective calendar year, in order to allow at least a 6 month period after case closure.<br />

N: (2008‐09) N=61, (2009‐10) N=74, (<strong>2010</strong>‐<strong>11</strong>) N=82.<br />

Outcome Objective: Children have health insurance and a medical home<br />

Client Outcome Objective <strong>2010</strong>‐ 20<strong>11</strong><br />

98% of children ages 5 and under have health insurance by exit from the<br />

program.<br />

98% of children ages 5 and under will have a medical home by exit from the<br />

program.<br />

96.3%<br />

2008‐09 2009‐10 <strong>2010</strong>‐<strong>11</strong><br />

N=82<br />

100%<br />

N=<strong>11</strong>4<br />

99.1%<br />

N=<strong>11</strong>3<br />

Source: SUN database, <strong>2010</strong>‐20<strong>11</strong>.<br />

Note: A total of <strong>11</strong>6 children had closed cases, but children in families who left the program prematurely were not included in these analyses.<br />

89


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – FAMILIES TOGETHER<br />

Outcome Objective: Families will have access to parenting support services<br />

structured by the Triple P curriculum<br />

Client Participation in Triple P*<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Parents/Guardians 25<br />

Children (ages 0‐5) 27<br />

(ages 6‐16) 13<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

* These Triple P client numbers are estimates only, and are likely an undercount, as these data do not include clients from program levels that do not<br />

collect CCDs, and also exclude clients who did not consent to have their assessment data included in this evaluation.<br />

Client Satisfaction with Triple P Services<br />

All Families Together parents receiving Triple P services were asked to complete a self‐administered<br />

satisfaction survey upon completing their services. Parents participating in Levels 3 (multi‐session),<br />

4, and 5 of the Triple P Program filled out a Parent Satisfaction Survey with 13 questions using a 7‐<br />

point scale (with 7 indicating highest satisfaction), and 3 open‐ended questions. The average parent<br />

satisfaction ratings ranged from 5.33 to 6.83, on the 7‐point scale. Most parents felt that the<br />

program met their needs, met the needs of their children, offered the help that they needed, and if<br />

they needed help in the future, they would return to Triple P.<br />

Figure 75: Parents’ Satisfaction with Various Aspects of the Triple P Program<br />

1. How would you rate the quality of the service you and your child<br />

received? (N=12)<br />

2. Did you receive the type of help you wanted from the program?<br />

(N=12)<br />

3. To what extent has the program met your child's needs? (N=12)<br />

4. To what extent has the program met your needs? (N=12)<br />

5. How satisfied were you with the amount of help you and your child<br />

received? (N=12)<br />

6. Has the program helped you to deal more effectively with your<br />

child's behavior? (N=12)<br />

7. Has the program helped you to deal more effectively with<br />

problems that arise in your family? (N=12)<br />

8. Do you think your relationship with your partner has been<br />

improved by the program? (N=9)<br />

9. In an overall sense, how satisfied are you with the program you<br />

and your child received? (N=10)<br />

10. If you were to seek help again, would you come back to this<br />

organization? (N=10)<br />

<strong>11</strong>. Has the program helped you to develop skills that can be applied<br />

to other family members? (N=10)<br />

12. In your opinion, how is your child's behavior at this point? (N=10)<br />

13. How would you describe your feelings at this point about your<br />

child's progress? (N=10)<br />

Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />

90 FIRST 5 SANTA CRUZ COUNTY<br />

5.33<br />

6.08<br />

6.08<br />

6.00<br />

6.67<br />

6.58<br />

6.50<br />

6.50<br />

6.50<br />

6.50<br />

1 2 3 4 5 6 7<br />

6.83<br />

6.75<br />

6.80


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P – Positive Parenting Program<br />

Program Description<br />

Triple P (Positive Parenting Program) is a comprehensive, evidence‐based parenting and family<br />

support system designed to increase parents’ confidence and competence in raising children, improve<br />

the quality of parent‐child relationships, and make evidence‐based parenting information and<br />

interventions widely accessible to parents. It is based on a public health model in which an ecological<br />

approach is used. This approach initiates activities at individual, family, community and systemic levels<br />

to provide a comprehensive structure of support.<br />

There are five levels of intervention in Triple P. Level<br />

One practitioner’s story:<br />

1 is intended to reach a broad range of community<br />

members in the <strong>County</strong>, and as the levels increase,<br />

more intensive services are provided:<br />

� Level 1: Universal involves a media‐based<br />

parenting information campaign.<br />

� Level 2: Selected Individual & Seminar<br />

provides information or advice for a<br />

specific parenting concern.<br />

� Level 3: Primary Care offers narrow‐focus<br />

parenting skills training.<br />

� Level 4: Standard & Group includes broad‐<br />

focus parenting skills and training.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

“The main areas that the family focused on came to<br />

the surface pretty quickly, and as we discussed<br />

assertive discipline, avoiding arguments in front of<br />

the children, planned ignoring, quiet time, and time<br />

out, the couple started to properly use the strategies<br />

they learned in the class. It seemed almost like a<br />

natural progression in which discussing the<br />

aforementioned topics led to the parents supporting<br />

each other as they tested them out with their family.<br />

It was amazing how they worked cooperatively to<br />

develop and implement their Planned Activities<br />

Routine. … [One parent] stated in the last session,<br />

‘This program gives you a positive way to<br />

discipline.’”<br />

-Triple P practitioner, <strong>Annual</strong> Progress <strong>Report</strong><br />

� Level 5: Enhanced & Pathways offers<br />

additional interventions for families with risk factors for child abuse or neglect.<br />

Triple P focuses on 17 core parenting skills that are grouped into 4 areas: promoting positive<br />

relationships, encouraging desirable behavior, teaching new skills and behaviors, and managing<br />

misbehavior. It is based on a self‐regulatory framework in which the practitioner provides<br />

information, skills, training, and support based on the parents’ concerns. Parents use self‐evaluation<br />

to set goals and assess progress. While practitioners are helping parents to build confidence and<br />

competence, parents are helping children to build these skills in a parallel process.<br />

Beginning in early <strong>2010</strong>, three local funders (<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, Health Services Agency, and<br />

Human Services Department) launched a pilot of the Triple P system in partnership with other<br />

agencies that serve children and families. The pilot phase is expected to last a minimum of two<br />

years. During the pilot phase, Triple P is being implemented incrementally, beginning with Levels 3,<br />

4, and 5 in the first year, and adding Levels 1 and 2 in this second year. The long‐term vision is to<br />

implement every level of Triple P broadly in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> to make parenting information and<br />

support available to all families.<br />

91


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

The following diagram illustrates the design of this program, and the results that have been<br />

achieved towards addressing the program’s incremental levels of parenting support and<br />

information.<br />

Level 5: Enhanced & Pathways<br />

Additional support for families where parenting issues are compounded by parental stress and/or relationship<br />

difficulties, or there is risk for child maltreatment.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Trained and accredited 18 practitioners to provide Level 5 Enhanced services, and 18 for Level 5 Pathways.<br />

� Parents are beginning to receive Level 5 services, and will complete assessments to measure improvement<br />

in their parenting skills and understanding of their children’s behavior.<br />

Level 4: Standard & Group<br />

In-depth training in positive parenting skills.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Families showed significant improvements in:<br />

– style of discipline – confidence in their parenting – levels of conflict over parenting – level of satisfaction with<br />

their relationship – levels of parental depression – stress and anxiety – child behavior<br />

� Parents who had more serious parenting issues made the most meaningful changes in their family life.<br />

� Parents reported high levels of satisfaction with their services.<br />

� Approximately 282 parents/guardians have participated in Level 4 sessions.<br />

� Trained and accredited 38 practitioners to provide Level 4 Group services, and 37 for Level 4 Standard.<br />

Level 3: Primary Care<br />

Consultations about specific parenting concerns.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Families showed significant improvements in children’s behavior, confidence in parenting skills, and support from parenting<br />

partners.<br />

� Parents reported high levels of satisfaction with both Level 3 workshops and individual/group sessions.<br />

� Approximately 336 parents have participated in Level 3 workshops, and 35 in Level 3 Individual/Group sessions.<br />

� Trained and accredited 53 practitioners to provide Level 3 Primary Care services, and 5 with Special Accreditation in Level 3.<br />

Level 2: Selected Individual & Seminar<br />

General information and tips for specific parenting concerns.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Parents reported great satisfaction with Level 2 seminars, particularly noting that they would continue to use the strategies that they learned.<br />

� Approximately 96 parents have participated in Level 2 seminars, and 104 in Level 2 Individual sessions.<br />

� Trained and accredited 20 practitioners to provide Level 2 seminars, and 53 for Level 2 Individual sessions.<br />

Level 1: Universal<br />

Media-based parenting information campaign.<br />

Implementation and Results in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners, referral processes, and a master calendar of Triple P Groups,<br />

Workshops, and Seminars.<br />

� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service providers as a means to encourage referrals.<br />

� Publicized Triple P services in print and online editions of newspapers and community calendars.<br />

� Established <strong>First</strong> 5’s main phone number as a “warmline,” publicized in all flyers, emails and media announcements as a central place to locate services.<br />

� Delivered Triple P messages on TV and the radio.<br />

92 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P Highlights<br />

Triple P is a multi‐level system of parenting and family support interventions of varying intensities<br />

and formats. Its population‐based approach to parenting support provides the minimally sufficient<br />

level of care for parents to enable them to independently manage their family issues. This section<br />

provides an overview of how families in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> have been helped to receive the levels of<br />

support that they needed through their participation in Triple P, and highlights some of the key<br />

achievements in each of these levels.<br />

Level 1: Universal<br />

Activities and media strategies for Level 1 of Triple P are providing access to positive parenting<br />

information and destigmatizing the need to get help for parenting issues.<br />

� Accessibility of information. Families are responding to print and radio media,<br />

they are using the updated website to register for parenting classes, they are<br />

calling the “warmline,” and professionals county‐wide are referring families to<br />

the classes they need.<br />

� Encouragement to participate. During this <strong>2010</strong>‐<strong>11</strong> funding cycle, at least 893<br />

parents and 1,518 children have participated in Triple P services.<br />

Client Participation in Triple P<br />

FIRST 5 SANTA CRUZ COUNTY<br />

<strong>2010</strong>‐<strong>11</strong><br />

Parents/Guardians 893<br />

Children (all ages) 1,518<br />

For more information<br />

See “Building a Population‐<br />

Based System of Parent<br />

Education” on page 125.<br />

For more information<br />

See “Population Served” on<br />

page 99.<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>; Triple P program data analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: These Triple P client numbers are estimates, as they may include some duplicates, and also exclude clients who did not consent to have their<br />

assessment data included in this evaluation.<br />

� Satisfaction with services. On average, parents rated the quality of services very<br />

high, noting that they had received the help they wanted, were dealing more<br />

effectively with problems in their family, and would come back to the program if<br />

they needed to seek help again.<br />

Parents’ Satisfaction with Various Aspects of the Triple P Program<br />

How would you rate the quality of the service you and your<br />

child received? (N=198)<br />

Did you receive the type of help you wanted from the<br />

program? (N=196)<br />

Has the program helped you to deal more effectively with<br />

problems that arise in your family? (N=198)<br />

If you were to seek help again, would you come back to this<br />

organization? (N=192)<br />

Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />

For more information<br />

See “Satisfaction with<br />

Services” on page 121.<br />

6.47<br />

6.34<br />

6.40<br />

6.43<br />

1 2 3 4 5 6 7<br />

93


Higher<br />

is<br />

“Better”<br />

PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Level 2: Selected Individual & Seminar<br />

Level 2 of Triple P is giving parents an opportunity to be introduced to Triple P and is providing easy<br />

access to general parenting support.<br />

� Gateway to more services. Of parents who participated in seminars and<br />

workshops, 21% requested follow‐up services, suggesting that these brief services<br />

may be an effective way of getting parents initially engaged in the program, and<br />

gives them an opportunity to participate in further services.<br />

� Continued use of the skills they learned. On average, parents felt that the<br />

seminars answered their questions, and that they would continue to use the<br />

strategies they learned.<br />

Seminar/Workshop Satisfaction Survey<br />

Source: Triple P data from the Seminar/Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />

Level 3: Primary Care<br />

Brief consultations about specific parenting concerns are resulting in<br />

increased positive parenting experiences.<br />

� Support for specific parenting challenges. Parents are reporting<br />

increased confidence in parenting, more support from their partners,<br />

less difficulty with their children’s behavior, and increased enjoyment<br />

in their parent/child relationship.<br />

Extremely<br />

5<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Not at all<br />

The seminar/workshop answered a question or concern I<br />

have had about parenting. (N=254)<br />

I am likely to use some of the parenting strategies in the<br />

tip sheet. (N=253)<br />

Increases in Positive Parenting<br />

For more information<br />

See “Requests for Further<br />

Services” on page 123.<br />

For more information<br />

See “Parents’Satisfaction with<br />

Seminars/Workshops” on<br />

page 122.<br />

For more information<br />

See the improvements parents made in each of<br />

these Level 3 domains:<br />

� “Improved levels of confidence in parenting”<br />

on p. 105.<br />

� “Reduced levels of conflict over parenting”<br />

on p. 108.<br />

� “Increased support in their role as a parent”<br />

on p. <strong>11</strong>1.<br />

� “Increased levels of satisfaction with their<br />

relationship” on p. <strong>11</strong>2.<br />

� “Decreased levels of emotional difficulties”<br />

on p. <strong>11</strong>4.<br />

� “Improvements in child behavior” on p. <strong>11</strong>7.<br />

Source: Triple P data from the Parenting Experience Survey, Question 3, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, under the corresponding<br />

domain in this analysis of the Triple P domains. For Q1‐6, scores range from 1 to 5. For Q7, scores range from 0 to 6. Higher scores indicate more<br />

positive parenting experiences. There are no clinical cut‐offs for this assessment. See page 102 for a description of the sub‐populations and<br />

analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


Lower<br />

is<br />

“Better”<br />

FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Level 4: Standard & Group<br />

Through more intensive services, families are receiving in‐depth support for moderate to severe<br />

behavioral and emotional difficulties.<br />

� Increased use of positive discipline styles. There were significant improvements<br />

in parents’ style of discipline, indicating their parenting style became less lax,<br />

less over‐reactive, and less hostile though the course of the Triple P program.<br />

Dysfunctional<br />

Parenting<br />

Higher<br />

is<br />

“Better”<br />

7<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

Functional<br />

Parenting<br />

Parents’ Discipline Styles<br />

3.3<br />

All Parents*<br />

(N=158)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

3.8 3.6 3.8 3.8 3.7 3.9 3.7 3.7<br />

2.7 2.9 3.0 2.9 3.0 2.9 3.0 2.9 3.0<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=86)<br />

Male*<br />

(N=20)<br />

Female*<br />

(N=66)<br />

For more information<br />

See “Increased use of positive<br />

discipline styles” on page 103.<br />

Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />

responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />

sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

� Reduced levels of conflict over parenting. After completing the program, parents<br />

on average indicated that there were significantly fewer parenting and relationship<br />

issues that were problems. However, on average all parent sub‐populations were<br />

still in the clinical range by the post‐assessment.<br />

Number of Parenting Issues That Have Been a Source of Conflict Between Parents<br />

All issues were a<br />

problem<br />

16<br />

Pre Post<br />

Lower<br />

is<br />

“Better”<br />

12<br />

8<br />

4<br />

0<br />

No issues were a<br />

problem<br />

5.5<br />

3.5<br />

All Parents*<br />

(N=105)<br />

9.2<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=52)<br />

7.8<br />

5.7 5.2<br />

Male*<br />

(N=18)<br />

10.0 9.6 9.0<br />

Source: Triple P data from the Parent Problem Checklist, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Parent Problem Checklist measures the number of issues that have been a PROBLEM for parents, and the EXTENT of the problem for<br />

each issue. Scores for the PROBLEM subscale range from 0 (no issues were a problem) to 16 (all issues were a problem). Scores for the EXTENT<br />

subscale range from 16 (Not at all a problem) to <strong>11</strong>2 (Very much a problem). There is no clinical cut‐off for this subscale. See page 102 for a<br />

description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

� Decreased levels of emotional difficulties. The following figures indicate that on<br />

average, all sub‐populations (except Males) made significant improvement in<br />

lowering their level of depression, and all sub‐populations significantly improved<br />

their level of stress. On average they began the program within the Severe range,<br />

and ended out of a range of concern.<br />

Extremely severe<br />

distress<br />

42<br />

Lower<br />

is<br />

“Better”<br />

35<br />

28<br />

21<br />

14<br />

7<br />

0<br />

No distress<br />

Extremely severe<br />

distress<br />

42<br />

Lower<br />

is<br />

“Better”<br />

35<br />

28<br />

21<br />

14<br />

7<br />

0<br />

No distress<br />

Level of Parental Depression and Stress<br />

9.7<br />

5.8<br />

All Parents*<br />

(N=176)<br />

12.9<br />

7.8<br />

All Parents*<br />

(N=175)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

24.0<br />

10.8<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=48)<br />

21.3<br />

14.0<br />

Depression<br />

24.9 24.6 23.0 24.6 22.7 24.4<br />

9.8<br />

Male (N=12) Female*<br />

(N=36)<br />

Pre Post<br />

Stress<br />

For more information<br />

See “Decreased levels of<br />

emotional difficulties” on<br />

page <strong>11</strong>4.<br />

Source: Triple P data from the Depression, Anxiety, and Stress Scale – Short Version (DASS‐21), collected and analyzed by Applied Survey Research,<br />

Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Depression, Anxiety, and Stress Scale – Short Version (DASS‐21) measures distress along 3 scales: Depression, Anxiety, Stress. Scores for<br />

each scale are calculated by summing the participants’ responses for each of the 21 items. Higher scores on each of the scales indicate greater<br />

levels of depression, anxiety, and stress. Each scale has different clinical cut‐offs for the 5 severity levels: normal, mild, moderate, severe, and<br />

extremely severe. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=28<br />

Severe >= 21<br />

Moderate >=14<br />

Clinical Cut‐offs:<br />

Very Severe >=34<br />

Severe >=26<br />

Moderate >=19


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

� Improvements in child behavior. In Triple P, the parent is considered the agent of<br />

change to bring about improvements in the parent‐child relationship. Therefore, how<br />

parents view their children’s behavior is an important assessment of the relationship.<br />

For all sub‐populations, there was a significant reduction in the number of child<br />

behaviors that were perceived to be a problem. On average, most parents began with scores<br />

within the clinical range, and ended with scores that were out of the clinical range.<br />

All behaviors were<br />

a problem<br />

36<br />

Lower<br />

is<br />

“Better”<br />

30<br />

24<br />

18<br />

12<br />

6<br />

0<br />

No behaviors<br />

were a problem<br />

Number of Child Behaviors Perceived to Be a Problem<br />

15.0<br />

8.2<br />

All Parents*<br />

(N=129)<br />

23.0<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=62)<br />

20.4<br />

Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />

which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always<br />

occurs), and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater<br />

likelihood that these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=15<br />

For more information<br />

See “Child Welfare Study” on<br />

page 120.


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Population Served<br />

The total number of clients who participated in Triple P is comprised of three groups: clients who<br />

participated in individual or group sessions AND who consented to have their assessment data<br />

anonymously included in this evaluation (who consequently provided enough information to create a<br />

Unique ID), those who participated in seminars or workshops where no names or personal information<br />

were collected, and those who did NOT consent to participate in the evaluation of Triple P.<br />

Source: (Consenting clients ) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>; (Seminar & Workshop clients & Non‐Consenting clients) Triple P<br />

program data analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

* Includes parents and children for whom enough personal information was collected to be able to create a Unique ID. This includes parents participating<br />

in Levels 2 (Individual), and parents and children participating in Levels 3 (Primary Care), 4, and 5.<br />

**Includes parents and children in all Triple P program levels where no names or personal information were collected (such as seminars and workshops),<br />

and the children of parents who participated in Level 2 Individual sessions (where only parents had personal information collected).<br />

*** In addition to these totals, 5 parents/guardians and <strong>11</strong> children participated in individual or group sessions who did not have complete information,<br />

and therefore it is not known if they duplicate any of the clients recorded in the SUN database/CCD data.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Clients Participating in Individual or Group Sessions – Unique IDs Created*<br />

Parents/Guardians 437<br />

AGES<br />

0 – 5<br />

AGES<br />

6 – 12<br />

AGES<br />

13 – 16<br />

AGES<br />

17+<br />

Children 324 191 60 27 602<br />

Clients Participating in Seminars & Workshops – No IDs**<br />

Parents/Guardians 432<br />

Children (all ages) 864<br />

Clients Participating in Individual or Group Sessions – Did Not Consent to<br />

Participate in <strong>Evaluation</strong><br />

Parents/Guardians 24<br />

Children (all ages) 52<br />

TOTAL***<br />

Parents/Guardians 893<br />

Children (all ages) 1,518<br />

99


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

The following chart shows the approximate percentage of parents/guardians who participated in<br />

each level of Triple P.<br />

Figure 76: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>-<strong>11</strong>)<br />

32.5%<br />

1.7%<br />

<strong>11</strong>.1%<br />

12.0%<br />

Multiple Levels*<br />

4.0%<br />

38.7%<br />

Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Notes: These are estimated percentages, as the data may include duplicated clients from program levels that do not collect CCDs, and also exclude<br />

clients who did not consent to have their assessment data included in this evaluation.<br />

* The number of parents participating in multiple levels of service is probably an undercount. Exact participation data are only available for levels of<br />

services where parents provided enough personal information to be able to create a Unique ID (Level 2 Individual, Level 3 Primary Care, and Level 4).<br />

Parents who participated in seminars and workshops did not provide enough personal information to be able to create a Unique ID, so it was not<br />

possible to track whether they also participated in additional levels of service.<br />

N=868 (see notes, above).<br />

Level 3 & 4 Participant Details<br />

In fiscal year <strong>2010</strong>‐<strong>11</strong>, parents participating in Levels 3 or 4 were asked some basic information<br />

about their involvement in Triple P.<br />

� The top three ways that parents participating in Level 3 or 4 Triple P services had heard<br />

about the program were: Referred by another agency (28%), Flyer or brochure about Triple P<br />

services (<strong>11</strong>%), and Friend or relative (<strong>11</strong>%).<br />

� Approximately 42% were participating with another adult.<br />

� When parents filled out these assessments, they were asked to choose one child in their family<br />

(“Index Child”), and complete the assessments keeping just that one child in mind. Almost half<br />

(47%) of Index Children were between 0‐5 years of age, and 44% were between ages 6‐12.<br />

� Almost one quarter of parents participating in Level 3 and 4 services (24%) needed<br />

assistance filling out these assessments (e.g., having the questions read to them).<br />

Figure 77: How Participants <strong>First</strong> Heard about Triple P (<strong>2010</strong>-<strong>11</strong>)<br />

37.8%<br />

2.0%<br />

3.1%<br />

3.1%<br />

5.1%<br />

10.7%<br />

27.6%<br />

10.7%<br />

Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: Level 3 and Level 4 participants only.<br />

N=196.<br />

Level 2 Seminar<br />

Level 2 Individual<br />

Level 3 Workshop<br />

Level 3 Primary Care<br />

Level 4<br />

Referred by other agency<br />

Flyer or brochure about Triple P services<br />

Friend or relative<br />

100 FIRST 5 SANTA CRUZ COUNTY<br />

School<br />

Child care or preschool provider<br />

Doctor's office<br />

Advertisement<br />

Other


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Figure 78: Percentage of Parents Participating with Another Adult (<strong>2010</strong>-<strong>11</strong>)<br />

Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: Level 3 and Level 4 participants only.<br />

N=201.<br />

Figure 79: Ages of Children Chosen as the “Index” Child* (<strong>2010</strong>-<strong>11</strong>)<br />

43.8%<br />

Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: Level 3 and Level 4 participants only.<br />

* When parents filled out these assessments, they were asked to choose one child in their family (“Index Child”), and complete the assessments<br />

keeping just that one child in mind.<br />

N=379.<br />

Figure 80: Percentage of Parents Who Needed Assistance to Complete the<br />

Assessments (<strong>2010</strong>-<strong>11</strong>)<br />

Source: Triple P participation data, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: Level 3 and Level 4 participants only.<br />

N=132.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

No<br />

57.7%<br />

7.7% 1.3%<br />

No<br />

75.8%<br />

Yes<br />

42.3%<br />

Yes<br />

24.2%<br />

47.2%<br />

Ages 0‐5<br />

Ages 6‐12<br />

Ages 13‐16<br />

Ages 17+<br />

101


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P Domains and the Collection of Assessment Data<br />

Parents who participated in levels 3 and 4 of the Triple P program completed assessments that<br />

measured their levels of parenting skills and knowledge along several domains. These domains<br />

identify key parenting issues, such that improvements in these areas generally result in<br />

improvements in overall family life.<br />

These domains include:<br />

� Increased use of positive discipline styles<br />

� Improved levels of confidence in parenting<br />

� Reduced levels of conflict over parenting<br />

� Increased support in their role as a parent<br />

� Increased levels of satisfaction with their relationship<br />

� Decreased levels of emotional difficulties<br />

� Improvements in child behavior<br />

Parents participating in Triple P services began to complete their first assessments in January <strong>2010</strong>,<br />

so by the time of the 2009‐10 fiscal year evaluation, the amount of assessment data was still rather<br />

small. Therefore, in this evaluation, the assessment data from both the previous and current fiscal<br />

years (January <strong>2010</strong> – June 20<strong>11</strong>) have been aggregated in order to present a more robust portrait<br />

of the extent to which Triple P participants are developing their parenting skills and knowledge.<br />

Level 3 & 4 Assessments (Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>)<br />

� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />

following assessments (as appropriate to their relationship status and age of the child they<br />

were thinking of while completing the assessments): Eyberg Child Behavior Inventory, Child<br />

Behavior Checklist (Children’s Mental Health clients only), Parenting Scale, Parenting Tasks<br />

Checklist, DASS 21, Relationship Quality Index, and the Parent Problem Checklist. Analyses<br />

were run to see if there was any improvement between pre and post assessments, and if the<br />

amount of improvement was statistically significant.<br />

A first analysis was initially run on all parents combined, but additional analyses were run<br />

only on parents who scored in the clinical range on their pre‐assessments. Of these parents<br />

who began in the clinical range, specific “sub‐populations” were also examined to study the<br />

possible effects of certain circumstances and key demographics. These additional analyses<br />

studied the impact of gender, ethnicity, and language, and looked at parents who were<br />

currently involved in the child welfare system (identified by those receiving services at the<br />

Parents Center). Again, all of these sub‐populations only included parents who scored in the<br />

clinical range at pre‐assessment. Results were not shown for certain sub‐populations if there<br />

were not enough cases in that analysis.<br />

102 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />

Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />

in the Survey corresponds to one of the Triple P domains discussed in this profile of Triple P,<br />

and is evaluated individually under that domain.<br />

For each question in this assessment, a first analysis was initially run on all parents combined,<br />

and additional analyses were run on specific “sub‐populations” that contained enough clients<br />

to analyze separately, which included females, Latinos, and Spanish‐speaking parents.<br />

� “Effect Sizes” were also calculated on many of these analyses. When a result is statistically<br />

significant, it does not necessarily mean that the amount of change was very big. It simply<br />

means that we can be confident that there was a difference. To know if an observed<br />

difference is not only statistically significant but also important or meaningful, an “Effect<br />

Size” is calculated.<br />

Results for these assessments completed by Triple P clients are described under each of the<br />

following domains.<br />

Triple P Domain: Increased use of positive discipline styles<br />

Parents who participated in Level 4 of the Triple P program were asked to complete the Parenting<br />

Scale as a pre and post assessment of their style of discipline, such as being lax, over‐reactive, or<br />

hostile. Scores could range from 1 (positive parenting) to 7 (ineffective parenting), with lower scores<br />

indicating more positive styles of discipline. Analyses were run to see if there was any improvement<br />

between pre and post assessments, and if the amount of improvement was statistically significant. 16<br />

As seen in the figures below, there were significant improvements from pre to post assessment<br />

regarding parents’ style of discipline, indicating their parenting style became less lax, less over‐<br />

reactive, and less hostile though the course of the Triple P program. Key results include:<br />

� When looking at Overall scores on the Parenting Scale,<br />

o On average, all parents combined and all parent sub‐populations that were assessed<br />

began in the clinical range, but by post‐assessment there had been significant<br />

improvement, and on average all parents had achieved positive styles of discipline.<br />

� For the Laxness, Overreactivity, and Hostility subscales,<br />

o All of the parent sub‐populations that were analyzed showed pre‐assessment results in<br />

the clinical range, and all of these sub‐populations had improved significantly out of this<br />

range by the end of the program.<br />

16<br />

For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />

of Assessment Data” on page 102.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

103


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Dysfunctional<br />

Parenting<br />

7<br />

6<br />

Lower 5<br />

is<br />

“Better” 4<br />

3<br />

2<br />

1<br />

Functional<br />

Parenting<br />

Dysfunctional<br />

Parenting<br />

7<br />

6<br />

Lower 5<br />

is<br />

“Better”<br />

4<br />

3<br />

2<br />

1<br />

Functional<br />

Parenting<br />

� “Effect Sizes” were also calculated on these analyses (see page 103).<br />

o An analysis of “Effect Size” showed that on average, all parent sub‐populations<br />

experienced a large magnitude of change, indicating that the observed differences were<br />

not only statistically significant but also meaningful.<br />

o For the Overreactivity and Hostility subscales, there was also an interesting comparison<br />

between “all parents combined” and the parents who began with scores in the clinical<br />

range (“Clinical range at Pre‐test”). On average, effect sizes were much higher for “Clinical<br />

range at Pre‐test” parents, which could be used as evidence that the program has a<br />

stronger impact (benefit) on parents with more serious parenting issues.<br />

Figure 81: Parents’ Use of Positive Discipline Styles<br />

Overall<br />

3.3 3.8 3.6 3.8 3.8 3.7 3.9 3.7 3.7<br />

2.7 2.9 3.0 2.9 3.0 2.9 3.0 2.9 3.0<br />

All Parents*<br />

(N=158)<br />

3.0<br />

2.4<br />

All Parents*<br />

(N=159)<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=86)<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=55)<br />

Male*<br />

(N=20)<br />

Male*<br />

(N=14)<br />

Female*<br />

(N=66)<br />

Female*<br />

(N=41)<br />

Pre Post<br />

Latino*<br />

(N=61)<br />

Laxness Subscale<br />

Pre Post<br />

Latino*<br />

(N=39)<br />

Caucasian*<br />

(N=21)<br />

Caucasian*<br />

(N=13)<br />

Spanish*<br />

(N=44)<br />

Spanish*<br />

(N=28)<br />

English*<br />

(N=37)<br />

English*<br />

(N=25)<br />

Child Welfare<br />

Involved*<br />

(N=30)<br />

Child Welfare<br />

Involved*<br />

(N=24)<br />

104 FIRST 5 SANTA CRUZ COUNTY<br />

Clinical Cut‐Off:***<br />

>= 3.2<br />

4.2 3.9<br />

4.4 4.3<br />

4.0<br />

4.4<br />

4.1<br />

4.3<br />

Clinical Cut‐Off:***<br />

Female<br />

>= 3.6<br />

Male<br />

2.9 2.8 2.9 2.9 2.7 2.9 2.9 3.1 >= 3.4


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Dysfunctional<br />

Parenting<br />

7<br />

Lower<br />

is<br />

“Better”<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

Functional<br />

Parenting<br />

Dysfunctional<br />

Parenting<br />

7<br />

6<br />

Lower 5<br />

is 4<br />

“Better”<br />

3<br />

2<br />

1<br />

Functional<br />

Parenting<br />

3.2<br />

2.8<br />

All Parents*<br />

(N=158)<br />

1.8 1.5<br />

All Parents*<br />

(N=160)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

4.8<br />

3.6<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=43)<br />

5.1<br />

Overreactivity Subscale<br />

Hostility Subscale<br />

Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />

responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />

sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p= 4.0<br />

105<br />

Male<br />

>= 3.9<br />

Clinical Cut‐Off:***<br />

Male<br />

>= 3.5<br />

Female<br />

>= 2.4


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

last 6 weeks, how confident have you felt to undertake your responsibilities as a parent?” For<br />

this question, scores could range from 1 to 5, with higher scores indicating more positive<br />

parenting experiences.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 17<br />

As seen in the figures below, after parents participated in the program, they indicated having more<br />

confidence in their abilities to manage their children in difficult situations and more confidence in<br />

their abilities to handle difficult child behaviors. Key results include:<br />

� For the Parenting Tasks Checklist “Setting Self‐Efficacy” subscale,<br />

o Every parent sub‐population began in the clinical range, but almost all had improved<br />

significantly out of the clinical range by the end of the program.<br />

o For parents who were “Child Welfare involved,” on average they were still in the clinical<br />

range by the post‐assessment, but there was still significant improvement in their scores.<br />

� Similarly, for the Parenting Tasks Checklist “Behavioral Self‐Efficacy” subscale,<br />

o Every parent sub‐population began in the clinical range, but almost all had improved<br />

significantly out of the clinical range by the end of the program.<br />

o On average, parents who were male, or who were “Child Welfare involved,” were still in<br />

the clinical range by the post‐assessment, but for both of these sub‐populations there was<br />

still significant improvement in their scores.<br />

� For the Parenting Experience Survey, Question 3,<br />

o On average, all parents had significant increases in their confidence to undertake their<br />

responsibilities as a parent.<br />

o Female, Latino, and Spanish‐speaking sub‐populations also had significant increases in<br />

confidence in their parenting.<br />

� “Effect Sizes” were also calculated on these analyses (see page 103).<br />

o An analysis of “Effect Size” showed that on average, all parents combined, and all parent<br />

sub‐populations, experienced a large magnitude of change, indicating that the observed<br />

differences were not only statistically significant but also meaningful.<br />

17<br />

For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />

of Assessment Data” on page 102.<br />

106 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Higher<br />

is<br />

“Better”<br />

Higher<br />

is<br />

“Better”<br />

Higher<br />

is<br />

“Better”<br />

Figure 82: Level of Parent Confidence<br />

Certain I can<br />

do it<br />

100<br />

80<br />

60<br />

40<br />

20<br />

0<br />

Certain I can't<br />

do it<br />

Certain I can<br />

do it<br />

100<br />

80<br />

60<br />

40<br />

20<br />

0<br />

Certain I can't<br />

do it<br />

90.2<br />

83.9<br />

All Parents*<br />

(N=176)<br />

84.9<br />

74.0<br />

All Parents*<br />

(N=176)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

Setting Self‐Efficacy<br />

81.2 82.6 83.0 84.4<br />

59.4 58.8 58.1 57.1<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=42)<br />

Male** Female*<br />

(N=34)<br />

Pre Post<br />

Latino*<br />

(N=33)<br />

Behavioral Self‐Efficacy<br />

Caucasian** Spanish*<br />

(N=28)<br />

Source: Triple P data from the Parenting Tasks Checklist, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Parenting Tasks Checklist measures confidence ratings in two factors: setting self‐efficacy and behavioral self‐efficacy. Each factor is<br />

comprised of 14 questions. Scores are calculated as the average of these 14 questions (unanswered questions are excluded). Higher scores indicate a<br />

greater degree of parenting confidence. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P Domain: Reduced levels of conflict over parenting<br />

This domain was measured using two different assessments:<br />

� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />

Parent Problem Checklist as a way to gauge changes in the level of conflict in their<br />

relationships due to parenting disagreements. In this scale, parents were given a range of<br />

parenting and relationship issues and asked to identify whether or not each issue was a<br />

problem for them, and the extent of the problem. Higher scores indicated a greater degree of<br />

conflict in the relationship.<br />

� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />

Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />

in the Survey is analyzed separately, and for this domain, two questions were analyzed:<br />

Questions 5 (“To what extent do you both agree over methods of disciplining your child?”)<br />

and 6 (“How supportive has your partner been towards you in your role as a parent over the<br />

last 6 weeks?”). For these questions, scores could range from 1 to 5, with higher scores<br />

indicating more positive parenting experiences.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 18<br />

After completing the program, parents on average indicated that fewer parenting and relationship<br />

issues were actually problems. These data from parents also indicated a decrease in the extent to<br />

which those issues were actually viewed as problems.<br />

Key results include:<br />

� For the Parent Problem Checklist “Number of Problems” subscale,<br />

o On average, for all parents combined and all parent sub‐populations studied, by the end<br />

of the program there were significant reductions in the number of problems reported.<br />

o On average, however, all parent sub‐populations were still in the clinical range by the<br />

post‐assessment.<br />

� For the Parent Problem Checklist “Extent of Problems” subscale,<br />

o On average, for all parents combined and all parent sub‐populations studied, the extent of<br />

the problems was reduced by the end of the program.<br />

o This reduction of intensity was only statistically significant for certain populations: all<br />

parents combined, parents who scored in the clinical range at pre‐assessment, females,<br />

Latinos, and Spanish‐speaking parents.<br />

18<br />

For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />

of Assessment Data” on page 102.<br />

108 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

� For the Parenting Experience Survey, Questions 5 and 6,<br />

o Although there was improvement in the extent to which both parents agreed over<br />

methods of disciplining their child, the amount of improvement was not statistically<br />

significant.<br />

o On average, there was significant improvement in the amount of support showed by the<br />

partners for all parents combined, Latinos, and Spanish‐speaking parents.<br />

� “Effect Sizes” were also calculated on these analyses (see page 103).<br />

All issues were a<br />

problem<br />

16<br />

Lower<br />

is<br />

“Better”<br />

o An analysis of “Effect Size” on the improvements made in the Number of Problems<br />

showed that on average, all parents combined, and all parent sub‐populations,<br />

experienced a large magnitude of change, indicating that the observed differences were<br />

not only statistically significant but also meaningful.<br />

o An analysis of “Effect Size” on the improvements made in the Extent of Problems showed<br />

that on average, almost all parent sub‐populations experienced a large magnitude of<br />

change. The Male sub‐population showed only a small effect size, and the English sub‐<br />

population showed a moderate magnitude of change.<br />

o For the Extent of Problems subscale, there was also an interesting comparison between<br />

“all parents combined” and the parents who began with scores in the clinical range<br />

(“Clinical range at Pre‐test”). On average, effect sizes were much higher for “Clinical range<br />

at Pre‐test” parents, which could be used as evidence that the program has a stronger<br />

impact (benefit) on parents with more serious parenting issues.<br />

o Question 5 (“agreement over discipline method”) of the Parenting Experience Survey<br />

showed a moderate magnitude of change, and Question 6 (“support from partner”)<br />

showed a large magnitude of change for all parents and parent sub‐populations.<br />

Figure 83: Levels of Conflict Over Parenting<br />

12<br />

8<br />

4<br />

0<br />

No issues were a<br />

problem<br />

5.5<br />

3.5<br />

All Parents*<br />

(N=105)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

9.2<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=52)<br />

7.8<br />

5.7 5.2<br />

Male*<br />

(N=18)<br />

Number of Problems<br />

10.0 9.6 9.0<br />

Female*<br />

(N=34)<br />

Pre Post<br />

5.9 5.2<br />

Latino*<br />

(N=33)<br />

6.7<br />

Caucasian*<br />

(N=17)<br />

9.8<br />

Spanish*<br />

(N=26)<br />

8.7<br />

5.6 5.7<br />

English*<br />

(N=26)<br />

9.3<br />

7.0<br />

Child<br />

Welfare<br />

Involved*<br />

(N=20)<br />

109<br />

Clinical<br />

Cut‐Off:<br />

>5


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Very much a<br />

problem<br />

<strong>11</strong>2<br />

96<br />

Lower 80<br />

is<br />

“Better” 64<br />

48<br />

32<br />

16<br />

Not at all a<br />

problem<br />

Higher<br />

is<br />

“Better”<br />

Higher<br />

is<br />

“Better”<br />

Extent of Problems<br />

50.5<br />

54.9 52.1 54.0<br />

48.8<br />

39.1<br />

41.8<br />

46.1<br />

31.7 38.3 37.7 38.6 37.2 38.7 39.1 37.4<br />

All Parents*<br />

(N=85)<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=45)<br />

Male (N=15) Female*<br />

(N=30)<br />

Pre Post<br />

Latino*<br />

(N=31)<br />

Caucasian<br />

(N=12)<br />

Spanish*<br />

(N=25)<br />

Source: Triple P data from the Parent Problem Checklist, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Parent Problem Checklist measures the number of issues that have been a PROBLEM for parents, and the EXTENT of the problem for each<br />

issue. Scores for the PROBLEM subscale range from 0 (no issues were a problem) to 16 (all issues were a problem). Scores for the EXTENT subscale<br />

range from 16 (Not at all a problem) to <strong>11</strong>2 (Very much a problem). There is no clinical cut‐off for this subscale. See page 102 for a description of the<br />

sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


Higher<br />

is<br />

“Better”<br />

FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P Domain: Increased support in their role as a parent<br />

Parents who participated in Level 3 of the Triple P program were asked to complete the Parenting<br />

Experience Survey as a measure of issues related to being a parent. Each question in the Survey is<br />

analyzed separately, and for this domain, Question 4 was analyzed (“How supported have you felt in<br />

your role as a parent over the last 6 weeks?”). For this question, scores could range from 1 to 5, with<br />

higher scores indicating more positive parenting experiences.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 19<br />

Key results include:<br />

� After completing the program, on average, there was significant improvement in the amount<br />

of support felt by all parents combined and all sub‐populations (Females, Latinos, and<br />

Spanish‐speaking parents).<br />

� “Effect Sizes” were also calculated on this analysis (see page 103), which showed that on<br />

average, all parents combined, and all parent sub‐populations, experienced a large<br />

magnitude of change, indicating that the observed differences were not only statistically<br />

significant but also meaningful.<br />

Extremely<br />

5<br />

Figure 84: Feelings of Support in Their Role as a Parent<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Not at all<br />

Source: Triple P data from the Parenting Experience Survey, Question 4, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, under the corresponding<br />

domain in this Triple P analysis. For Q1‐6, scores range from 1 to 5. For Q7, scores range from 0 to 6. Higher scores indicate more positive parenting<br />

experiences. There are no clinical cut‐offs for this assessment. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P Domain: Increased levels of satisfaction with their relationship<br />

As parents learn new ways of interacting with their children, Triple P has found that conflicts<br />

between partners regarding parenting decrease, and consequently, partners’ satisfaction with their<br />

relationship increases. Two different assessments were used to assess parents’ satisfaction with<br />

their relationship:<br />

� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />

Relationship Quality Index. For this assessment, scores are calculated by summing all six<br />

questions. Scores range from 6 (Very unsatisfied with relationship) to 45 (Very satisfied), with<br />

higher scores indicating higher satisfaction with their relationship.<br />

� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />

Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />

in the Survey is analyzed separately, and for this domain, Question 7 was analyzed, “In an<br />

overall sense, how happy do you consider your relationship with your partner to be?” For this<br />

question, scores could range from 0 to 6, with higher scores indicating more positive<br />

parenting experiences.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 20<br />

As seen in the figures below, parents reported improved satisfaction in the relationship with their<br />

partners. Key results include:<br />

� For the Relationship Quality Index,<br />

o On average, for all parents combined and all sub‐populations (except Caucasians), there<br />

was significant improvement in their amount of satisfaction with their relationship by the<br />

end of the program.<br />

o However, all sub‐populations were still in the clinical range by the post‐assessment.<br />

� For the Parenting Experience Survey, Question 7,<br />

o Although there was improvement in how happy they were with their relationship, the<br />

amount of improvement was not statistically significant.<br />

� “Effect Sizes” were also calculated on these analyses (see page 103).<br />

o For the Relationship Quality Index:<br />

� An analysis of “Effect Size” on the improvements made showed that on average, all<br />

parent sub‐populations experienced a large magnitude of change, indicating that the<br />

observed differences were not only statistically significant but also meaningful.<br />

� There was also an interesting comparison between “all parents combined” and the<br />

parents who began with scores in the clinical range (“Clinical range at Pre‐test”). On<br />

average, effect sizes were much higher for “Clinical range at Pre‐test” parents, which<br />

could be used as evidence that the program has a stronger impact (benefit) on<br />

parents with more serious parenting issues.<br />

o Question 7 of the Parenting Experience Survey showed moderate magnitudes of change.<br />

20<br />

For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />

of Assessment Data” on page 102.<br />

<strong>11</strong>2 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Very satisfied<br />

with relationship<br />

45<br />

Higher<br />

is<br />

“Better”<br />

10<br />

6 5<br />

Very unsatisfied<br />

with relationship<br />

Higher<br />

is<br />

“Better”<br />

Figure 85: Level of Parents’ Satisfaction with Their Relationship<br />

40<br />

35<br />

30<br />

25<br />

20<br />

15<br />

33.0<br />

31.3<br />

All Parents*<br />

(N=126)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

Satisfaction with The Relationship<br />

24.5 24.6 24.5 24.2 24.9 25.0 25.2<br />

23.0<br />

18.9 18.9 18.9 18.4 19.3 18.7 19.5 20.0<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=44)<br />

Male*<br />

(N=14)<br />

Female*<br />

(N=30)<br />

Pre Post<br />

Latino*<br />

(N=27)<br />

Caucasian<br />

(N=10)<br />

Spanish*<br />

(N=18)<br />

Source: Triple P data from the Relationship Quality Index, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Relationship Quality Index measures parents’ level of satisfaction with their relationship. Scores are calculated by summing all six questions<br />

in the assessment, with total scores ranging from 6 (Very unsatisfied with relationship) to 45 (Very satisfied). See page 102 for a description of the<br />

sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P Domain: Decreased levels of emotional difficulties<br />

This domain was measured using two different assessments:<br />

� Parents who participated in Level 4 of the Triple P program were asked to complete the<br />

Depression, Anxiety, and Stress Scale – Short Version (DASS‐21), which measures distress in<br />

these three areas. Scores for each of these three scales range from 0 (no distress) to 42<br />

(extremely severe distress), with higher scores indicating greater levels of depression,<br />

anxiety, and stress.<br />

� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />

Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />

in the Survey is analyzed separately, and for this domain, Question 2 was analyzed, “To what<br />

extent do the following statements describe your experience as a parent in the last 6<br />

weeks?” Question 2 contained five statements regarding how rewarding, demanding,<br />

stressful, fulfilling, and depressing parenting was for them, which were averaged to create a<br />

total score for this question. Scores could range from 1 to 5, with higher scores indicating<br />

more positive parenting experiences.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 21<br />

The following figures indicate that parents’ levels of emotional difficulties improved during the<br />

program. Key results include:<br />

� For the DASS‐21 “Depression” subscale,<br />

o All sub‐populations (except Males) made significant improvement in lowering their level<br />

of depression. All began within the Severe range, and ended out of a range of concern.<br />

� For the DASS‐21 “Anxiety” subscale,<br />

o All sub‐populations (except Caucasians) made significant improvement in lowering their<br />

level of anxiety. All began within the Severe or Very Severe range, and ended in the lower<br />

range of Moderate, or out of a range of concern completely.<br />

� For the DASS‐21 “Stress” subscale,<br />

o All sub‐populations made significant improvement in lowering their level of stress. All<br />

began within the Severe range, and ended out of a range of concern.<br />

� For the Parenting Experience Survey, Question 2,<br />

o When all parents were combined, they showed significant improvement in how positively<br />

they described their experience as a parent by the end of the program.<br />

o Parent sub‐populations also made improvements, but they were not statistically<br />

significant.<br />

21<br />

For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />

of Assessment Data” on page 102.<br />

<strong>11</strong>4 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

� “Effect Sizes” were also calculated on these analyses (see page 103).<br />

Extremely severe<br />

distress<br />

42<br />

Lower<br />

is<br />

“Better”<br />

o An analysis of “Effect Size” on the improvements made showed that on average, all parent<br />

sub‐populations experienced a moderate or large magnitude of change, indicating that<br />

the observed differences were not only statistically significant but also meaningful.<br />

o For the Depression and Anxiety subscales, there was also an interesting comparison<br />

between “all parents combined” and the parents who began with scores in the clinical<br />

range (“Clinical range at Pre‐test”). On average, effect sizes were much higher for “Clinical<br />

range at Pre‐test” parents, which could be used as evidence that the program has a<br />

stronger impact (benefit) on parents with more serious parenting issues.<br />

o Question 2 of the Parenting Experience Survey showed large magnitudes of change.<br />

Figure 86: Level of Parents’ Emotional Difficulties<br />

35<br />

28<br />

21<br />

14<br />

7<br />

0<br />

No distress<br />

Extremely severe<br />

distress<br />

42<br />

Lower<br />

is<br />

“Better”<br />

35<br />

28<br />

21<br />

14<br />

7<br />

0<br />

No distress<br />

9.7<br />

5.8<br />

All Parents*<br />

(N=176)<br />

8.4<br />

4.9<br />

All Parents*<br />

(N=176)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

24.0<br />

10.8<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=48)<br />

21.3<br />

14.0<br />

Depression<br />

24.9 24.6 23.0 24.6 22.7 24.4<br />

9.8<br />

Male (N=12) Female*<br />

(N=36)<br />

19.7 21.1 19.3 20.7<br />

9.6<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=63)<br />

<strong>11</strong>.6<br />

Male*<br />

(N=14)<br />

Female*<br />

(N=49)<br />

Pre Post<br />

<strong>11</strong>.3<br />

Latino*<br />

(N=38)<br />

Anxiety<br />

Pre Post<br />

9.0 8.6<br />

Latino*<br />

(N=47)<br />

9.8<br />

Caucasian*<br />

(N=8)<br />

17.1<br />

13.1<br />

Caucasian<br />

(N=14)<br />

<strong>11</strong>.4<br />

Spanish*<br />

(N=31)<br />

21.0<br />

7.4<br />

Spanish*<br />

(N=38)<br />

8.1<br />

English*<br />

(N=14)<br />

17.8<br />

English*<br />

(N=22)<br />

<strong>11</strong>.3<br />

Child<br />

Welfare<br />

Involved*<br />

(N=16)<br />

18.8<br />

<strong>11</strong>.5 <strong>11</strong>.7<br />

Child<br />

Welfare<br />

Involved*<br />

(N=24)<br />

<strong>11</strong>5<br />

Clinical<br />

Cut‐offs:<br />

Very Severe >=28<br />

Severe >= 21<br />

Moderate >=14<br />

Clinical Cut‐offs:<br />

Very Severe >=20<br />

Severe >=15<br />

Moderate >=10


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Extremely severe<br />

distress<br />

42<br />

Lower<br />

is<br />

“Better”<br />

35<br />

28<br />

21<br />

14<br />

7<br />

0<br />

No distress<br />

Extremely positive<br />

5<br />

Higher<br />

is<br />

“Better”<br />

12.9<br />

7.8<br />

All Parents*<br />

(N=175)<br />

Stress<br />

28.8 26.0 29.4 29.7 26.3 29.9 27.5 26.5<br />

12.2<br />

Clinical<br />

Range at<br />

PreTest*<br />

(N=42)<br />

9.0<br />

Male* (N=8) Female*<br />

(N=34)<br />

12.9 <strong>11</strong>.7<br />

Latino*<br />

(N=30)<br />

Source: Triple P data from the Depression, Anxiety, and Stress Scale – Short Version (DASS‐21), collected and analyzed by Applied Survey Research,<br />

Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Depression, Anxiety, and Stress Scale – Short Version (DASS‐21) measures distress along 3 scales: Depression, Anxiety, Stress. Scores for<br />

each scale are calculated by summing the participants’ responses for each of the 21 items. Higher scores on each of the scales indicate greater levels<br />

of depression, anxiety, and stress. Each scale has different clinical cut‐offs for the 5 severity levels: normal, mild, moderate, severe, and extremely<br />

severe. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=26<br />

Moderate >=19


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Triple P Domain: Improvements in child behavior<br />

In Triple P, the parent is considered the agent of change to bring about improvements in the parent‐<br />

child relationship. Therefore, how parents view their children’s behavior is an important assessment<br />

of the relationship. This domain was measured using three different assessments:<br />

� Parents participating in Level 4 of the Triple P Program were asked to complete the Eyberg<br />

Child Behavior Inventory (ECBI), a pre and post assessment of the frequency with which<br />

certain child behaviors occur (Intensity subscale), and the extent to which parents view those<br />

behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never<br />

occurs) to 252 (Always occurs), and Problem scores ranged from 0 (No) to 36 (Yes), with<br />

higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />

these behaviors were a problem to the parent.<br />

� Parents who participated in Level 3 of the Triple P program were asked to complete the<br />

Parenting Experience Survey as a measure of issues related to being a parent. Each question<br />

in the Survey is analyzed separately, and for this domain, Question 1 was analyzed, “In an<br />

overall sense, how difficult has your child’s behavior been over the last 6 weeks?” Scores<br />

could range from 1 to 5, and for this question the scale was reversed so that higher scores<br />

indicated more positive parenting experiences.<br />

� Parents who participated in Level 4 of the Triple P program and who received services from<br />

the Health Services Agency ‐ Children's Mental Health completed the Child Behavior Checklist<br />

which is a screening tool used to assess behavioral and emotional problems in children and<br />

adolescents. It contains about 100 items that can cluster into several syndromes,<br />

competence scales, and codes from the Diagnostic and Statistical Manual of Mental<br />

Disorders, 4th Edition (DSM‐IV). Children are ranked according to the severity of certain<br />

problems, thus percentile rankings show how a child compares to the general population. A<br />

significant improvement in percentile rank indicates a decrease in clinical risk.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 22<br />

As seen in the following figures, after completing the Triple P Program, fewer parents viewed their<br />

children’s behavior as problematic, and parents also reported fewer problematic child behaviors as<br />

actually being a problem for them. Key results include:<br />

� For the ECBI “Intensity” subscale,<br />

o On average, for all parents combined and all parent sub‐populations, there was a<br />

significant reduction in the frequency of potentially problematic child behaviors. On<br />

average, these parents began with scores within the clinical range, and ended with scores<br />

that were out of the clinical range.<br />

22<br />

For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />

of Assessment Data” on page 102.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

<strong>11</strong>7


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Lower<br />

is<br />

“Better”<br />

� For the ECBI “Problem” subscale,<br />

o For all sub‐populations, there was a significant reduction in the number of child behaviors<br />

that were perceived to be a problem. On average, these parents began with scores within<br />

the clinical range, and ended with scores that were out of the clinical range (parents<br />

involved in Child Welfare were within 1/10 th of a point of being out of the clinical range).<br />

� For the Parenting Experience Survey, Question 1,<br />

o On average, for all parents combined and all sub‐populations, there was significant<br />

reduction in how difficult their child’s behavior had been.<br />

� For the Child Behavior Checklist,<br />

o Parents reported significant improvements in their children’s problematic behaviors in<br />

both Internalizing and Externalizing Syndromes, as well as in all Syndromes overall.<br />

o There were significant improvements in two DSM disorders: Anxiety and Oppositional.<br />

o There was a significant improvement in children’s social competence behaviors.<br />

� “Effect Sizes” were also calculated on these analyses (see page 103).<br />

o An analysis of “Effect Size” on all the improvements made showed that on average, all<br />

parents combined and all parent sub‐populations experienced a large magnitude of<br />

change, indicating that the observed differences were not only statistically significant but<br />

also meaningful.<br />

Figure 87: Level of Parental Problems with Child Behavior<br />

Behavior always<br />

occurs<br />

252<br />

216<br />

180<br />

144<br />

108<br />

72<br />

36<br />

Behavior<br />

never occurs<br />

120.6<br />

92.6<br />

All Parents*<br />

(N=144)<br />

Frequency of Potentially Problematic Child Behaviors<br />

164.0 151.3 167.1<br />

Clinical Range<br />

at PreTest*<br />

(N=57)<br />

<strong>11</strong>4.0 <strong>11</strong>8.2 <strong>11</strong>3.0 <strong>11</strong>1.9<br />

Male*<br />

(N=<strong>11</strong>)<br />

Female*<br />

(N=46)<br />

Pre Post<br />

164.8 161.0 164.7 162.3 162.5<br />

Latino*<br />

(N=45)<br />

<strong>11</strong>8 FIRST 5 SANTA CRUZ COUNTY<br />

122.0<br />

Caucasian*<br />

(N=12)<br />

<strong>11</strong>0.6<br />

Spanish*<br />

(N=34)<br />

120.1<br />

English*<br />

(N=21)<br />

129.4<br />

Child Welfare<br />

Involved*<br />

(N=16)<br />

Clinical<br />

Cut‐off:<br />

>=131


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

All behaviors were<br />

a problem<br />

36<br />

Lower<br />

is<br />

“Better”<br />

30<br />

24<br />

18<br />

12<br />

6<br />

0<br />

No behaviors<br />

were a problem<br />

Not at all Difficult<br />

5<br />

Higher<br />

is<br />

“Better”<br />

15.0<br />

8.2<br />

FIRST 5 SANTA CRUZ COUNTY<br />

23.0<br />

Number of Child Behaviors Perceived to Be a Problem<br />

20.4<br />

23.5 24.1<br />

12.6 <strong>11</strong>.9 12.7 13.0<br />

Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />

which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always occurs),<br />

and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />

these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Additional Triple P Studies and Client Data Collection<br />

Child Welfare Study: Possible effects of Triple P participation on future child<br />

welfare allegations<br />

Among families who have experienced child abuse or neglect, participation in the Triple P program<br />

was expected to be associated with lower rates of future child welfare allegations. To examine<br />

whether associations were observed between Triple P participation and improved child welfare<br />

outcomes in these <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> families, outcome data for two groups of parents who entered<br />

(or re‐entered) the child welfare system were compared, including: (1) parents who received the<br />

Triple P intervention; and (2) parents who were enrolled in a model of parenting education offered<br />

prior to the initiation of the Triple P program. Both programs were offered through a local<br />

community‐based organization called the Parents Center.<br />

The following research question was examined:<br />

� To what extent is Triple P participation associated with lower rates of new substantiated<br />

child maltreatment allegations, compared to participants in other parenting programs?<br />

To determine whether participation in Triple P was associated with lower rates of new substantiated<br />

child maltreatment allegations, parents’ child welfare records were examined at two time periods:<br />

within the first six months after their program started and in the period from 6 to 12 months after<br />

beginning the program (as there was a low number of families at the 12 month time period, only the<br />

6 month results are reported at this point). Rates were compared for Triple P participants and<br />

participants in the comparison parenting program.<br />

The following figure shows the rates of new substantiated cases of child maltreatment within the<br />

first six months of parents’ participation in either Triple P or the comparison parenting program.<br />

� After six months, parents in the comparison parenting program were more than three and a<br />

half times more likely than Triple P participants to have had a new substantiated<br />

maltreatment allegation.<br />

Figure 88: Participants with a Substantiated Allegation of Child Maltreatment Occurring<br />

Up to 6 Months after Program Entry<br />

20%<br />

15%<br />

10%<br />

5%<br />

1.4%<br />

0%<br />

Triple P Participants Comparison Group<br />

Source: Applied Survey Research, Triple P – <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>: Special Exploratory Study to Assess Child Welfare Outcomes, 20<strong>11</strong>.<br />

N: 70 Triple P participants and 137 comparison group participants.<br />

Results suggest that Triple P is associated with reductions in future child abuse and neglect. A re‐<br />

examination of these data at a later date, when more participants have reached the 6‐ and<br />

12‐month time periods, may provide a better measurement of the program’s impact on outcomes<br />

that are themselves fairly low‐frequency events.<br />

120 FIRST 5 SANTA CRUZ COUNTY<br />

5.1%


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Satisfaction with Services<br />

Satisfaction Surveys (Jan. <strong>2010</strong> – June 20<strong>11</strong>)<br />

All parents in the Triple P program (except those attending brief Level 2 Individual sessions) were<br />

asked to complete a self‐administered satisfaction survey upon completing their services.<br />

� Parents participating in Levels 3 (multi‐session) and Levels 4 and 5 of the Triple P Program<br />

filled out a Parent Satisfaction Survey with 13 questions using a 7‐point scale (with 7<br />

indicating highest satisfaction), and 3 open‐ended questions. Key results include:<br />

o Over half (55%) of Triple P parents who responded to the survey indicated that they were<br />

very satisfied with their overall program experience.<br />

o The average parent satisfaction ratings ranged from 5.30 to 6.51, on the 7‐point scale.<br />

Most parents felt that the program met their needs, as well as the needs of their children,<br />

offered the help that they needed, and if they needed help in the future, they would<br />

return to Triple P.<br />

� Parents participating in the Level 2 Seminars and Level 3 Workshops filled out a shorter<br />

Satisfaction Survey with 3 questions using a 5‐point scale (with 1=Disagree, and 5=Agree),<br />

and 1 open‐ended question.<br />

o Almost three‐fourths (72%) of Triple P parents who participated in the seminars and<br />

workshops and who responded to the survey indicated that they were very satisfied with<br />

their overall program experience.<br />

o The average parent satisfaction ratings ranged from 4.53 to 4.74, on the 5‐point scale.<br />

Most parents felt that the program answered their questions, that they would continue to<br />

use the tip sheets, and were very satisfied with the services they received.<br />

Figure 89: Parents’ Satisfaction with the Triple P Program: Levels 3 (Multi-session),<br />

and Levels 4 and 5<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

FIRST 5 SANTA CRUZ COUNTY<br />

Overall Satisfaction, by Response Option<br />

1.4% 0.4% 2.0% 3.1%<br />

16.4%<br />

22.1%<br />

1 2 3 4 5 6 7<br />

Lowest<br />

Satisfaction<br />

Response Options<br />

54.6%<br />

Highest<br />

Satisfaction<br />

Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />

N = 198 respondents with a total of 2,509 responses.<br />

121


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

1. How would you rate the quality of the service you and your<br />

child received? (N=198)<br />

2. Did you receive the type of help you wanted from the<br />

program? (N=196)<br />

3. To what extent has the program met your child's needs?<br />

(N=196)<br />

4. To what extent has the program met your needs? (N=197)<br />

5. How satisfied were you with the amount of help you and your<br />

child received? (N=197)<br />

6. Has the program helped you to deal more effectively with<br />

your child's behavior? (N=198)<br />

7. Has the program helped you to deal more effectively with<br />

problems that arise in your family? (N=198)<br />

8. Do you think your relationship with your partner has been<br />

improved by the program? (N=169)<br />

9. In an overall sense, how satisfied are you with the program<br />

you and your child received? (N=191)<br />

10. If you were to seek help again, would you come back to this<br />

organization? (N=192)<br />

<strong>11</strong>. Has the program helped you to develop skills that can be<br />

applied to other family members? (N=193)<br />

12. In your opinion, how is your child's behavior at this point?<br />

(N=192)<br />

13. How would you describe your feelings at this point about<br />

your child's progress? (N=192)<br />

Average Ratings of Various Program Aspects<br />

Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />

Figure 90: Parents’Satisfaction with the Triple P Seminars/Workshops<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Overall Satisfaction with Seminars/Workshops, by Response Option<br />

0.3% 0.4% 4.7%<br />

Source: Triple P data from the Seminar/Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: 1=Disagree, and 5=Agree.<br />

N = 254 respondents with a total of 760 responses.<br />

122 FIRST 5 SANTA CRUZ COUNTY<br />

5.30<br />

5.91<br />

5.88<br />

6.<strong>11</strong><br />

6.07<br />

6.06<br />

6.47<br />

6.34<br />

6.51<br />

6.40<br />

6.35<br />

6.43<br />

6.33<br />

1 2 3 4 5 6 7<br />

23.0%<br />

1 2 3 4 5<br />

Lowest<br />

Satisfaction<br />

Response Options<br />

71.6%<br />

Highest<br />

Satisfaction


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

1. The seminar/workshop answered a question or concern I have<br />

had about parenting. (N=254)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

Average Ratings of Various Seminar/Workshop Aspects<br />

2. I am likely to use some of the parenting strategies in the tip<br />

sheet. (N=253)<br />

Source: Triple P data from the Seminar/Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, Jan. <strong>2010</strong> ‐ June 20<strong>11</strong>.<br />

Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />

Requests for Further Services<br />

During <strong>2010</strong>‐<strong>11</strong>, 12 Level 2 seminars were provided to 96 participants, and 50 Level 3 workshops<br />

were provided to 336 participants. Of these participants, 21% requested follow‐up services,<br />

suggesting that these brief Triple P seminars and workshops help some families find additional<br />

parenting resources, and may be an effective way of giving participants a chance to try out the<br />

Triple program, getting them interested, and giving them an opportunity to participate in further<br />

services.<br />

Follow-Up Survey: Maintenance of parenting knowledge and practices gained<br />

from Triple P<br />

Parents and guardians who completed certain Triple P programs were given the option of voluntarily<br />

participating in a follow‐up phone survey six months later, to help determine the long‐lasting effects of<br />

these programs on their parenting skills and experiences. This survey consisted of 18 questions, some<br />

with multiple parts, that asked about their parenting abilities and effectiveness in dealing with certain<br />

parenting problems, their confidence in their parenting skills, the Triple P strategies that they are<br />

currently using, changes in their child’s behavior, and where applicable, their relationship with and<br />

support from their partner. Participants were also given the option of commenting on their experience<br />

with the program. Parents were assured that the survey was confidential, and that their individual<br />

responses would be kept anonymous and reported as a summary with other data. Participants who<br />

completed the survey were given a $25 gift certificate to Target.<br />

Key results include:<br />

3. Overall I was satisfied with the workshop. (N=253)<br />

� Results showed that around six months after completing Triple P services, parents are<br />

reporting high levels of parenting skills, confidence, and support (measured using questions<br />

from the Parenting Experience Survey).<br />

As more parents complete the Triple P program, it may be possible to compare their “six‐<br />

month follow‐up” parenting skills with similar data collected at the beginning (Pre) and very<br />

end of their services (Post).<br />

123<br />

4.53<br />

4.74<br />

4.68<br />

1 2 3 4 5


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Not at all Difficult<br />

5<br />

Higher<br />

is<br />

“Better”<br />

0<br />

Extremely Difficult<br />

� Additional survey results indicate that six months after their Triple P services, parents feel<br />

highly effective in dealing with their children’s behavior, and report improved child behavior<br />

overall.<br />

Figure 91: Levels of Parenting Difficulty Six Months After Triple P Services<br />

4<br />

3<br />

2<br />

1<br />

3.58<br />

Q1: Child Behavior<br />

Problems (N=26)<br />

4.21 4.23<br />

Q2: Parental<br />

Adjustment (N=26)*<br />

Q3: Parenting<br />

Confidence (N=26)<br />

3.62 3.50<br />

Q4: Parental Support Q5: Partner Support<br />

(N=26) Over Methods of<br />

Discipline (N=18)<br />

Figure 92: Parenting Difficulty Six Months After Triple P Services:<br />

Frequency of Each Response Option<br />

20<br />

15<br />

10<br />

5<br />

0<br />

3<br />

<strong>11</strong><br />

6<br />

4<br />

2 2<br />

1<br />

Q1: Child Behavior<br />

Problems (N=26)<br />

2<br />

9<br />

13<br />

Q2: Parental<br />

Adjustment (N=26)*<br />

1<br />

1<br />

Source: Triple P data from the Parenting Experience Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: The Parenting Experience Survey measures issues related to being a parent. Each question is analyzed separately, and correspond to different<br />

Triple P domains examined in this report section. For Q1‐6, scores range from 1 to 5. Q7 was not asked in the follow‐up survey. Higher scores indicate<br />

more positive parenting experiences. There are no clinical cut‐offs for this assessment.<br />

* Question 2 results are averages of the 5 items in this question.<br />

124 FIRST 5 SANTA CRUZ COUNTY<br />

15<br />

9<br />

Q3: Parenting<br />

Confidence (N=26)<br />

2<br />

3<br />

1 (Extremely a Problem)<br />

3<br />

13<br />

5<br />

Q4: Parental Support<br />

(N=26)<br />

2 (Very Much a Problem)<br />

3 (Moderately A Problem)<br />

4 (Slightly a Problem)<br />

5 (Not At All A Problem)<br />

2<br />

7<br />

7<br />

2<br />

Q5: Partner Support<br />

Over Methods of<br />

Discipline (N=18)<br />

3.83<br />

Q6: Parenting<br />

Support from<br />

Partner (N=18)<br />

3<br />

2<br />

8<br />

5<br />

Q6: Parenting<br />

Support from Partner<br />

(N=18)


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

Building a Population‐Based System of Parent Education<br />

Triple P Practitioners<br />

Between 2009 and June 30, 20<strong>11</strong>, 20 agencies and 4 independent practitioners in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

have been providing Triple P services to clients. Participating agencies were those that provide a<br />

range of services for families, such as mental health counseling, early education, health care, case<br />

management, and support for victims of domestic violence and sexual assault:<br />

� Community Bridges ‐ La Manzana<br />

Community Resources<br />

� Community Bridges ‐ Roots & Wings<br />

� Dominican Hospital ‐ Outreach<br />

� Familia Center<br />

� <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong><br />

� Health Services Agency ‐ Children's<br />

Mental Health<br />

� Health Services Agency ‐ South <strong>County</strong><br />

Clinic<br />

� Human Services Department ‐<br />

Employment & Benefit Services<br />

� Human Services Department ‐ Family<br />

& Children's Services<br />

� MidPeninsula Housing – Services<br />

Corporation<br />

FIRST 5 SANTA CRUZ COUNTY<br />

� Mountain Community Resources<br />

� Optimal Solutions Consulting<br />

� Parents Center<br />

� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />

Families Together<br />

� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />

Head Start<br />

� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />

Youth Services<br />

� <strong>Santa</strong> <strong>Cruz</strong> Community Counseling Center –<br />

Primeros Pasos<br />

� <strong>Santa</strong> <strong>Cruz</strong> Women's Health Center<br />

� Women's Crisis Support ~ Defensa de<br />

Mujeres<br />

� YWCA Watsonville<br />

Agency staff and independent practitioners attended workshops to become trained and accredited<br />

practitioners of the Triple P Program, and many of these practitioners were trained in multiple<br />

levels. Since 2009, a total of 86 practitioners have been accredited to provide Triple P services.<br />

Figure 93: Number of Practitioners Trained and Accredited with Triple P (2009-<strong>11</strong>)<br />

COURSE TYPE<br />

NUMBER OF<br />

TRAINING COURSES<br />

CONDUCTED<br />

TRAINING ACCREDITATION<br />

NUMBER OF<br />

PRACTITIONERS<br />

TRAINED<br />

NUMBER OF<br />

ACCREDITATION<br />

COURSES CONDUCTED<br />

NUMBER OF<br />

PRACTITIONERS<br />

ACCREDITED<br />

L2 Seminars 1 20 1 20<br />

L3 Primary Care 3 58 3 53<br />

L3 Primary Care ‐ Special Accreditation 1 6 (Quiz Only) 5<br />

L4 Group 2 40 2 38<br />

L4 Standard 2 37 2 37<br />

L5 Enhanced 1 18 1 18<br />

L5 Pathways 1 18 1 18<br />

Total Number of Courses <strong>11</strong> 10<br />

Total Number of Practitioners (unduplicated) 94 86<br />

Source: Optimal Solutions Consulting, Triple P Practitioner Training Data, 2009‐20<strong>11</strong>.<br />

125


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Efficacy of Staff Training on Triple P<br />

In addition to offering structured trainings to practitioners, Triple P America also provides measures<br />

to assess the effectiveness of such trainings. The first measure is a Parent Consultation Skills<br />

Checklist (PCSC), an instrument to gauge changes in practitioners’ ability and confidence to conduct<br />

parent consultations. The second instrument is a Workshop <strong>Evaluation</strong> Survey that measures<br />

practitioners’ satisfactions with the trainings. These data are described below.<br />

Changes in self‐efficacy related to parent consultation<br />

The Parent Consultation Skills Checklist (PCSC) was used to measure practitioners’ self‐efficacy, or<br />

perceived competency, in core skills including assessment, active skills training, dealing with process<br />

issues, and clinical application of positive parenting strategies.<br />

Practitioners rated their proficiency on a 7‐point scale (1 = not at all confident or definitely not<br />

adequately trained, 7 = very confident or definitely adequately trained). The questionnaire was<br />

administered prior to beginning training (Pre), immediately after training (Post), and at the end of<br />

accreditation (Follow‐up).<br />

Results indicate that during <strong>2010</strong>‐<strong>11</strong>, participants’ ratings of self‐efficacy increased from pre to post<br />

training across all levels, and improvements were maintained or were higher at follow‐up. The only<br />

exception was a slight decrease in pre‐post ratings of “Adequately Trained in Parent Consultations”<br />

and “Confidence in Conducting Parent Consultations” for the Level 4 Group training, although for<br />

both there was an increase by the time of their follow‐up ratings. The mean ratings for all levels of<br />

trainings and accreditations are summarized below.<br />

Figure 94: Summary of Parent Consultation Skills Checklist Ratings (<strong>2010</strong>-<strong>11</strong>)<br />

ADEQUATELY TRAINED IN<br />

PARENT CONSULTATIONS<br />

CONFIDENCE IN CONDUCTING<br />

PARENT CONSULTATIONS<br />

OVERALL PROFICIENCY IN PARENT<br />

CONSULTATION SKILLS<br />

LEVEL OF TRIPLE P Pre Post Follow‐up Pre Post Follow‐up Pre Post Follow‐up<br />

Level 2 Seminar 5.41 6.35 6.18 5.47 5.82 5.82 5.22 5.91 5.92<br />

Level 3 Primary Care 4.15 5.23 6.00 4.15 4.77 5.69 3.90 4.92 5.68<br />

Level 4 Group 5.93 5.67 6.60 6.00 5.23 6.43 5.59 5.69 6.27<br />

Level 4 Standard 4.23 6.23 6.54 4.00 6.15 6.31 4.69 6.07 6.53<br />

Source: Triple P America and Optimal Solutions Consulting, 20<strong>11</strong>.<br />

Satisfaction with Training<br />

Participants completed a Workshop <strong>Evaluation</strong> Survey at the end of each training and on completion<br />

of the accreditation process. The survey included a 7‐point scale (1 = low, 7 = high) to assess:<br />

� Quality of the training course<br />

� Whether the amount of active participation within the course was appropriate<br />

� Quality of the content of the training<br />

� Whether respondents felt they had the skills to implement the program, and<br />

� Overall satisfaction with the training course<br />

126 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

STRONG FAMILIES – TRIPLE P<br />

On average, participants were highly satisfied with the quality and content of all levels of Triple P<br />

trainings and accreditation workshops, during <strong>2010</strong>‐<strong>11</strong>. The mean ratings for all levels of trainings<br />

and accreditations are summarized in the figure below.<br />

Figure 95: Summary of Training <strong>Evaluation</strong> Survey Ratings (<strong>2010</strong>-<strong>11</strong>)<br />

FIRST 5 SANTA CRUZ COUNTY<br />

QUALITY OF PRESENTATION WORKSHOP CONTENT OVERALL SATISFACTION<br />

LEVEL OF TRIPLE P Training Accreditation Training Accreditation Training Accreditation<br />

Level 2 Seminar 6.32 6.41 6.26 6.59 6.42 6.29<br />

Level 3 Primary Care 6.13 6.23 6.13 6.15 5.73 6.15<br />

Level 4 Group 6.39 6.53 6.28 6.47 6.06 6.<strong>11</strong><br />

Level 4 Standard 6.50 6.56 6.25 6.56 6.44 6.50<br />

Source: Triple P America and Optimal Solutions Consulting, 20<strong>11</strong>.<br />

Alignment of referral, billing, and data sharing processes across the network of<br />

agencies who support Triple P<br />

Referral System<br />

By the end of FY <strong>2010</strong>‐<strong>11</strong>, 86 practitioners (unduplicated count) from 20 agencies and programs had<br />

been accredited to provide Triple P services. As the number of practitioners expanded, <strong>First</strong> 5<br />

implemented the following steps to build and enhance the Triple P referral system:<br />

� Maintained and distributed a contact list indicating which organizations have practitioners<br />

accredited in each Level of Triple P.<br />

� Disseminated flyers and descriptions of Triple P Seminars, Workshops, and Groups to service<br />

providers as a means to encourage referrals.<br />

� Publicized Triple P services in print and online editions of newspapers and community<br />

calendars.<br />

� Established <strong>First</strong> 5’s main phone number as a “warmline.” This number was publicized in all<br />

flyers, emails and media announcements as a central place to receive assistance locating<br />

Triple P services. <strong>First</strong> 5 staff were trained to conduct a brief screening in order to assess<br />

callers’ needs and make appropriate referrals.<br />

� Developed Triple P business cards containing <strong>First</strong> 5’s warmline and website address, as well<br />

as space for practitioners to insert their own contact information.<br />

� Enhanced <strong>First</strong> 5’s website to include information about Triple P, accredited practitioners,<br />

referral processes, and a master calendar of Triple P Groups, Workshops, and Seminars.<br />

127


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – TRIPLE P<br />

Billing and Funding<br />

<strong>First</strong> 5, Health Services Agency (Children’s Mental Health), and the Human Services Department<br />

established a collaborative system for funding Triple P trainings, parent resources, and services.<br />

� Children’s Mental Health contracted with <strong>First</strong> 5 to implement Prevention and Early<br />

Intervention strategies in the Mental Health Services Act (MHSA) Plan, including the<br />

coordination and implementation of Triple P.<br />

� In FY <strong>2010</strong>‐<strong>11</strong>, the Human Services Department contracted with <strong>First</strong> 5 to provide Triple P<br />

trainings that qualified for partial reimbursement from Federal Title IV‐E training funds. <strong>First</strong><br />

5 provided the required match, enabling the Human Services Department to access $82,226<br />

in Title IV‐E funds. The reimbursement was passed through to <strong>First</strong> 5 to help cover training<br />

costs, which allowed more resources to be directed toward service provision.<br />

� <strong>First</strong> 5 blended its own resources with funds from Children’s Mental Health and the Title IV‐E<br />

reimbursement to contract with Triple P America and organizations providing specific Triple P<br />

services. This blended funding strategy streamlined billing procedures and reporting<br />

requirements, which allowed resources to be used in a more flexible and coordinated manner.<br />

� Agencies that provided mental health services billed Medi‐Cal EPSDT.<br />

� Families in the Child Welfare System received services funded from a contract between the<br />

Human Services Department (HSD) and the Parents Center.<br />

� Individual practitioners billed clients’ private insurance.<br />

� Medical offices are beginning to explore billing health insurance for parent education.<br />

Data Sharing<br />

<strong>First</strong> 5 and Applied Survey Research (ASR) developed evaluation protocols and forms for each level<br />

of Triple P services. Practitioners were trained to obtain parents’ informed consent to participate in<br />

the evaluation of the Triple P program, collect the required intake and assessment data, and submit<br />

the data to ASR on a monthly basis. Specific protocols were established to protect the privacy and<br />

confidentiality of parents participating in Triple P services.<br />

ASR also developed an Excel‐based scoring application that enabled practitioners to enter and<br />

summarize parents’ assessment data quickly and accurately. Practitioners used the assessment data<br />

to help parents set goals for change, then submitted data electronically to ASR (maintaining client<br />

anonymity) for further analysis.<br />

128 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Side-by-Side<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – SIDE‐BY‐SIDE<br />

The Side‐by‐Side: Early Childhood Mental Health Access Program, launched in March <strong>2010</strong>, was<br />

created to address the significant need for early mental health services for families with children<br />

between 0‐5 years of age. The program has expanded early childhood mental health services and<br />

provides intervention services to families who have children showing early signs of social/emotional<br />

difficulty. The program also provides guidance and consultation about social/emotional and mental<br />

health needs of infants and young children to early childhood educators. The program strives to<br />

support the working relationship between families and child care providers/preschool staff.<br />

Parents can elect to receive only “Site‐based” services for their children (i.e., classroom<br />

observations, in‐class intervention, and teacher consultations) or a combination of “Site‐based” and<br />

“Family services” (i.e., classroom observations, in‐class intervention, teacher consultations,<br />

individual/family counseling, and assistance from the Family Resource Specialist, if needed). Since<br />

the Ages & Stages Questionnaires (ASQ) and the Child Behavior Checklist (CBCL) are completed by<br />

parents, only parents who are participating in “Family services” fill out these assessments. For the<br />

children who are receiving “Site‐based” services only, Side‐by‐Side Clinician/Consultants provide<br />

recommendations to teachers and additional follow‐up, as needed.<br />

“The childcare/pre-school staff have told us that our services have been helpful to them. … They report<br />

that the ideas and suggestions we shared with them have improved the children’s social/emotional<br />

functioning in class, and made their jobs more satisfying.”<br />

One family’s story:<br />

“Ryan* began attending this center about a month before [services began], right after having been<br />

expelled from a different center. At the previous center, Ryan had been highly aggressive, very defiant<br />

and argumentative, and quite disruptive. Many of the children were afraid of Ryan, and no one would<br />

play with him. None of the teacher’s interventions helped improve Ryan’s conduct.<br />

Ryan made significant social/emotional gains at the center during the period of time he was<br />

involved with our program. His aggression decreased dramatically. He became much less<br />

argumentative and much more cooperative. Ryan also became able to participate fully in<br />

the classroom activities, and required less time to transition between them. Ryan improved his ability<br />

to express his distress in words rather than demonstrating it in problematic ways through actions. He<br />

also recovers from being upset much more quickly now.<br />

Perhaps more importantly, Ryan has made friends with a few children in class who seek out his<br />

companionship. He also appears much happier, more relaxed, and more playful. At the beginning of<br />

my work at the center, the teachers expressed great concerns that Ryan would not be socially and/or<br />

emotionally ready to attend Kindergarten in the fall. Now, they all feel confident that he will.”<br />

-Side-by-Side, <strong>Annual</strong> Progress <strong>Report</strong><br />

(* Names have been changed)<br />

129


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – SIDE‐BY‐SIDE<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Parents/Guardians 43<br />

SITE‐BASED SERVICES FAMILY SERVICES TOTAL<br />

Children 34 7 41<br />

Source: (Parents/Guardians) Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>; (Children) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

Note: See “Program Description” for a description of “Site‐based” and “Family” services.<br />

Program Development<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Staff/Child Care Providers 67<br />

Classrooms 22<br />

Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />

Outcome Objective: Children participating in “Family Services” will receive<br />

developmental screening and be assessed for behavioral and<br />

emotional problems<br />

90% of the families who participate in the program will complete the ASQ and CBCL.<br />

<strong>2010</strong>‐20<strong>11</strong><br />

ASQ (DEVELOPMENTAL SCREENING) 100%<br />

130 FIRST 5 SANTA CRUZ COUNTY<br />

N=7<br />

CBCL (ASSESSMENT FOR BEHAVIORAL AND EMOTIONAL PROBLEMS) 85.7%<br />

Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />

Note: Results should be interpreted with caution due to the low number of cases.<br />

Families participating in “Family Services” received initial screenings and assessments.<br />

� All families who began receiving “Family‐services” in <strong>2010</strong>‐<strong>11</strong> completed evidence‐based<br />

screenings about their child, using the ASQ.<br />

� Six of the seven families also completed the initial CBCL.<br />

� Family needs assessments were completed with all of the families, and follow‐up assistance<br />

was provided when necessary.<br />

N=7


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – SIDE‐BY‐SIDE<br />

Outcome Objective: Children participating in “Site-based” services will have their<br />

needs evaluated and addressed<br />

For children who participated in “Site‐based” services only, Side‐by‐Side Clinician/Consultants<br />

observed all these children in their classroom settings, and then had consultations with the<br />

childcare/pre‐school staff. The Clinician/Consultants individualized the services they provided,<br />

varying the number of classroom observations and consultations depending on the needs of the<br />

child and the staff.<br />

The recommendations that were provided to the staff tended to fall into the following categories:<br />

� Modifying the classroom structure, routine, and ambiance.<br />

� Changing the staff’s expectations of the child.<br />

� Altering the staff’s communication and interaction style with the child.<br />

� Implementing various strategies to address classroom challenges such as: defiance,<br />

aggression, disruptiveness, angry outbursts, argumentativeness, cursing, intimidation, and<br />

tantrums.<br />

The Clinician/Consultants later followed up with the staff about the impact and effectiveness of the<br />

recommendations that were made.<br />

Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />

Outcome Objective: Families participating in “Family Services” will report<br />

improvements in child behavior<br />

1. 85% of eligible families completing between 8‐12 psychotherapy/counseling meetings will<br />

complete the Child Behavior Checklist (CBCL) as a pre/post intervention measure.<br />

2. Of those completing both a pre and post CBCL, 75% will demonstrate improvement in at<br />

least one measure on the CBCL.<br />

Source: Side by Side <strong>2010</strong>‐<strong>11</strong> <strong>Annual</strong> Progress <strong>Report</strong>.<br />

Note: Results should be interpreted with caution due to the low number of cases.<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Two out of the seven families that began “Family‐services” this period completed between 8‐12<br />

psychotherapy/counseling sessions. Both of the families (100%) completed the CBCL as a pre/post<br />

intervention measure.<br />

� The post‐intervention scores on CBCL indicate that both of the children (100%) made<br />

improvements in their conduct and functioning in at least one of the assessment’s domain<br />

areas.<br />

� In actuality, both children made even greater improvement:<br />

o One of the children’s scores reflected improvements in 12 out of the 12 domains.<br />

o The other child’s score reflected improvements in <strong>11</strong> out of the 12 domains.<br />

100%<br />

131<br />

N=2<br />

100%<br />

N=2


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />

La Manzana Community Resources<br />

Program Description<br />

La Manzana Community Resources (LMCR) provides brief case management and information and<br />

referrals for vulnerable families with children ages 0‐5 to improve families’ access to services,<br />

enhancement of parenting skills, and awareness of community literacy activities. Additionally, LMCR<br />

provides access to a range of activities, workshops, and classes to ensure children are living in<br />

literacy‐rich environments that are supportive of their cognitive development. LMCR also provides<br />

parents of children ages 0‐5 with Positive Parenting Program (Triple P) education county‐wide.<br />

Population Served<br />

Information and Referral Services<br />

<strong>2010</strong>‐20<strong>11</strong><br />

(Information and Referral Services)<br />

Parents/Guardians 981<br />

Children 1,332<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

Parent/Guardian Participation in Triple P Services (Estimated)<br />

<strong>2010</strong>‐20<strong>11</strong><br />

(Triple P)*<br />

Parents/Guardians 516<br />

Children (ages 0‐5) 329<br />

(ages 6‐16) 204<br />

* These Triple P client numbers are estimates only, and are likely an undercount, as these data do not include clients from program levels that do not<br />

collect CCDs, and also exclude clients who did not consent to have their assessment data included in this evaluation.<br />

Figure 96: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>-<strong>11</strong>)<br />

16.1%<br />

13.2%<br />

16.3%<br />

3.3%<br />

51.2%<br />

Level 2 Seminar<br />

Level 3 Workshop<br />

Level 3 Primary Care<br />

Level 4 Group<br />

Level 4 Standard<br />

Source: LMCR <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />

Notes: These are estimated percentages, as the data may include duplicated clients from program levels that do not collect CCDs, and also exclude<br />

clients who did not consent to have their assessment data included in this evaluation. Exact participation data are only available for levels of services<br />

where parents provided enough personal information to be able to create a Unique ID (Level 2 Individual, Level 3 Primary Care, and Level 4). Parents<br />

who participated in seminars and workshops did not provide enough personal information to be able to create a Unique ID, so it was not possible to<br />

track whether they also participated in additional levels of service.<br />

N= 516 (see notes, above).<br />

132 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />

Outcome Objective: Families will be provided with information and referrals to<br />

meet their needs<br />

Type of I&R Service<br />

Number of Units of<br />

Service provided in<br />

<strong>2010</strong>‐20<strong>11</strong> Type of I&R Service<br />

Number of Units of<br />

Service provided in<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Food Stamps 358 Passports 65<br />

Medi‐Cal 344 Health Care 52<br />

State Disability/ Paid Family Leave 243 Translations 52<br />

General Forms & Services 206 Childcare and Education 31<br />

Healthy Families 138 Employment Development 28<br />

Housing 107<br />

Birth Certificate Correction<br />

Affidavits 24<br />

Cash‐Aid / Cal‐Works 86 Economic Justice Project 13<br />

CARE/HEAP/Lifeline programs 72 SSI/SSD 13<br />

Healthy Kids 71 Child Support 12<br />

Source: LMCR Biannual and <strong>Annual</strong> Progress <strong>Report</strong>s, <strong>2010</strong>‐<strong>11</strong>.<br />

Total 1,915<br />

Outcome Objective: Families will be assisted in developing literacy-rich<br />

environments<br />

Families with children birth‐5 were connected to a range of activities, workshops and classes to<br />

ensure children are living in literacy‐rich environments supportive of cognitive development.<br />

Type of Activity/Class<br />

Number of Parents Connected to<br />

this Activity/Class<br />

Child Development Resource Center 302<br />

Triple P 516<br />

Library Literacy Programs 187<br />

Literacy Classes (Plaza Comunitaria) 154<br />

Play & Learn 91<br />

Head Start 3<br />

PAPÁs 2<br />

Total 1,255<br />

Source: LMCR <strong>Annual</strong> Progress <strong>Report</strong>, 20<strong>11</strong>.<br />

133


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />

Outcome Objective: Families will be provided with parenting information and<br />

family support<br />

“LMCR has been able to reach out to families who—prior to Triple P—may not have sought our services. We are able to not only<br />

connect them to a program that can help improve their relationship with their children, but we can offer a breadth of services<br />

that may help them improve their overall quality of life.<br />

Through Triple P, we’ve been able to partner with agencies that we had not partnered with before, which also improves our reach<br />

to Pajaro Valley residents. Those partnerships can prove to be invaluable resources for families in need.”<br />

-LMCR, <strong>Annual</strong> Progress <strong>Report</strong><br />

Parents increased their use of positive discipline styles<br />

Parents who participated in Level 4 of the Triple P program were asked to complete the Parenting<br />

Scale as a pre and post assessment of their style of discipline, such as being lax, over‐reactive, or<br />

hostile. Scores could range from 1 (positive parenting) to 7 (ineffective parenting), with lower scores<br />

indicating more positive styles of discipline.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 23<br />

Dysfunctional<br />

Parenting<br />

7<br />

6<br />

5<br />

Lower<br />

is 4<br />

“Better”<br />

3<br />

2<br />

1<br />

� As seen in the figure below, there was significant improvement from pre to post assessment<br />

regarding parents’ overall style of discipline, indicating their parenting style became less lax,<br />

less over‐reactive, and less hostile though the course of the Triple P program.<br />

� On average, all parents combined and all parent sub‐populations that were assessed began in<br />

the clinical range, but had achieved positive styles of discipline by the post‐assessment.<br />

Functional<br />

Parenting<br />

Figure 97: Parents’ Use of Positive Discipline Styles: Overall<br />

3.4<br />

All Parents*<br />

(N=70)<br />

3.8 3.7 3.8 3.8 3.8 3.7<br />

2.8 3.0 3.0 3.0 3.0 3.0 2.9<br />

Clinical Range<br />

at PreTest*<br />

(N=45)<br />

Male*<br />

(N=8)<br />

Female*<br />

(N=37)<br />

Pre Post<br />

Latino*<br />

(N=41)<br />

Caucasian** Spanish*<br />

(N=33)<br />

English*<br />

(N=9)<br />

Source: Triple P data from the Parenting Scale, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: The Parenting Scale measures parenting styles in 3 scales, and overall. Scores for each scale are calculated by averaging the participants’<br />

responses for each of the items. Higher scores indicate a greater degree of ineffective parenting styles. See page 102 for a description of the<br />

sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p= 3.2


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Parents reported improved child behavior<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />

In Triple P, the parent is considered the agent of change to bring about improvements in the parent‐<br />

child relationship. Therefore, how parents view their children’s behavior is an important assessment<br />

of the relationship. For parents participating in Level 4 of the Triple P Program, LMCR measured this<br />

objective using the Eyberg Child Behavior Inventory (ECBI), a pre and post assessment of the<br />

frequency with which certain child behaviors occur (Intensity subscale), and the extent to which<br />

parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from<br />

36 (Never occurs) to 252 (Always occurs), and Problem scores ranged from 0 (No) to 36 (Yes), with<br />

higher scores indicating greater frequencies of problem behaviors and greater likelihood that these<br />

behaviors were a problem to the parent.<br />

Analyses were run to see if there was any improvement between pre and post assessments, and if<br />

the amount of improvement was statistically significant. 24<br />

As seen in the following figures, after completing the Triple P Program, fewer parents viewed their<br />

children’s behavior as problematic, and parents also reported fewer problematic child behaviors as<br />

actually being a problem for them. Key results include:<br />

� For the ECBI “Intensity” subscale,<br />

o For all parents overall, and all sub‐populations (with enough cases to analyze), there was a<br />

significant reduction in the frequency of potentially problematic child behaviors. On average,<br />

these parents began with scores within the clinical range, and ended with scores that were out<br />

of the clinical range.<br />

� For the ECBI “Problem” subscale,<br />

o For all sub‐populations, there was a significant reduction in the number of child behaviors<br />

that were perceived to be a problem. On average, these parents began with scores within<br />

the clinical range, and ended with scores that were out of the clinical range.<br />

24<br />

For an explanation of the analyses that were run and the sub‐populations that were developed, see “Triple P Domains and the Collection<br />

of Assessment Data” on page 102.<br />

135


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />

Lower<br />

is<br />

“Better”<br />

Figure 98: Level of Parental Problems with Child Behavior<br />

Behavior always<br />

occurs<br />

252<br />

216<br />

180<br />

144<br />

108<br />

72<br />

36<br />

Behavior<br />

never occurs<br />

All behaviors were<br />

a problem<br />

36<br />

Lower<br />

is<br />

“Better”<br />

30<br />

24<br />

18<br />

12<br />

6<br />

0<br />

No behaviors<br />

were a problem<br />

128.4<br />

92.2<br />

All Parents*<br />

(N=69)<br />

17.7<br />

9.4<br />

All Parents*<br />

(N=64)<br />

Frequency of Potentially Problematic Child Behaviors<br />

168.2 154.6 172.0 166.8 165.2<br />

Clinical Range<br />

at PreTest*<br />

(N=32)<br />

24.1<br />

<strong>11</strong>2.4 108.1<br />

Male*<br />

(N=7)<br />

Female*<br />

(N=25)<br />

Pre Post<br />

<strong>11</strong>3.6 <strong>11</strong>0.4 107.5<br />

Latino*<br />

(N=30)<br />

Caucasian** Spanish*<br />

(N=24)<br />

Number of Child Behaviors Perceived to Be a Problem<br />

12.2<br />

Clinical Range<br />

at PreTest*<br />

(N=39)<br />

22.0<br />

9.6<br />

Male*<br />

(N=5)<br />

24.4<br />

Female*<br />

(N=34)<br />

Pre Post<br />

24.1 24.0 24.4<br />

12.6 12.1 12.8<br />

Latino*<br />

(N=35)<br />

Caucasian** Spanish*<br />

(N=30)<br />

English**<br />

Source: Triple P data from the Eyberg Child Behavior Inventory, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: The Eyberg Child Behavior Inventory measures the frequency with which certain child behaviors occur (Intensity subscale), and the extent to<br />

which parents view those behaviors to be a problem (Problem subscale). Intensity scores could range from 36 (Never occurs) to 252 (Always occurs),<br />

and Problem scores ranged from 0 (No) to 36 (Yes), with higher scores indicating greater frequencies of problem behaviors and greater likelihood that<br />

these behaviors were a problem to the parent. See page 102 for a description of the sub‐populations and analyses that were run.<br />

* Results marked with an asterisk had PRE/POST differences that were statistically significant at p=15<br />

Clinical<br />

Cut‐off:<br />

>=131


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Parents <strong>Report</strong>ed High Satisfaction with Services<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />

All parents receiving Triple P services (except those attending brief Level 2 Individual sessions) were<br />

asked to complete a self‐administered satisfaction survey upon completing their services.<br />

� Parents participating in Levels 3 (multi‐session), 4, and 5 of the Triple P Program filled out a<br />

Parent Satisfaction Survey with 13 questions using a 7‐point scale (with 7 indicating highest<br />

satisfaction), and 3 open‐ended questions. Key results include:<br />

o The average parent satisfaction ratings ranged from 5.62 to 6.71, on the 7‐point scale.<br />

Most parents felt that the program met their needs, as well as the needs of their children,<br />

offered the help that they needed, and if they needed help in the future, they would<br />

return to Triple P.<br />

� Parents participating in the Level 2 Seminars and Level 3 Workshops filled out a short<br />

Satisfaction Survey with 3 questions using a 5‐point scale (with 1=Disagree, and 5=Agree),<br />

and 1 open‐ended question.<br />

o The average parent satisfaction ratings for Level 3 Workshops ranged from 4.76 to 4.84,<br />

and Level 2 Seminars ranged from 4.47 to 4.71, on the 5‐point scale. Virtually all parents<br />

felt that the program answered their questions, that they would continue to use the tip<br />

sheets, and were very satisfied with the services they received.<br />

Figure 99: Parents’ Satisfaction with Various Aspects of the Triple P Program<br />

Levels 3 (multi‐session), 4, and 5<br />

1. How would you rate the quality of the service you and your child<br />

received? (N=99)<br />

2. Did you receive the type of help you wanted from the program?<br />

(N=98)<br />

3. To what extent has the program met your child's needs? (N=99)<br />

4. To what extent has the program met your needs? (N=98)<br />

5. How satisfied were you with the amount of help you and your<br />

child received? (N=99)<br />

6. Has the program helped you to deal more effectively with your<br />

child's behavior? (N=99)<br />

7. Has the program helped you to deal more effectively with<br />

problems that arise in your family? (N=99)<br />

8. Do you think your relationship with your partner has been<br />

improved by the program? (N=85)<br />

9. In an overall sense, how satisfied are you with the program you<br />

and your child received? (N=98)<br />

10. If you were to seek help again, would you come back to this<br />

organization? (N=98)<br />

<strong>11</strong>. Has the program helped you to develop skills that can be applied<br />

to other family members? (N=98)<br />

12. In your opinion, how is your child's behavior at this point? (N=97)<br />

13. How would you describe your feelings at this point about your<br />

child's progress? (N=97)<br />

Source: Triple P data from the Parent Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: All items were on a 7‐point scale. Higher scores indicate greater satisfaction.<br />

5.73<br />

5.62<br />

6.13<br />

6.03<br />

137<br />

6.48<br />

6.37<br />

6.49<br />

6.51<br />

6.40<br />

6.29<br />

1 2 3 4 5 6 7<br />

6.58<br />

6.71<br />

6.58


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – LA MANZANA COMMUNITY RESOURCES<br />

1. The workshop answered a question or concern I have had<br />

about parenting. (N=76)<br />

2. I am likely to use some of the parenting strategies in the tip<br />

sheet. (N=76)<br />

3. Overall I was satisfied with the workshop. (N=75)<br />

Level 3 Workshops<br />

Source: Triple P data from the Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />

1. The seminar answered a question or concern I have had about<br />

parenting.<br />

2. I am likely to use some of the parenting strategies in the tip<br />

sheet.<br />

3. Overall I was satisfied with the seminar<br />

1 2 3 4 5<br />

Level 2 Seminars<br />

Source: Triple P data from the Seminar Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction.<br />

N=17.<br />

138 FIRST 5 SANTA CRUZ COUNTY<br />

4.53<br />

4.47<br />

4.76<br />

4.82<br />

4.84<br />

4.71<br />

1 2 3 4 5


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Mountain Community Resources<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

STRONG FAMILIES – MOUNTAIN COMMUNITY RESOURCES<br />

In order to promote child and parent confidence and competence, reduce child maltreatment,<br />

destigmatize parenting information and family support, and provide evidence‐based parenting<br />

information to the San Lorenzo Valley and Scotts Valley communities, Mountain Community<br />

Resources facilitated 13 Triple P workshops (seven in English and six in Spanish) in <strong>2010</strong>‐<strong>11</strong>. This<br />

agency also conducted a series of four‐week, individual sessions with five adults, benefiting a total<br />

of seven children.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Participated in Triple P (unduplicated)<br />

Parents/Guardians 67<br />

Children (ages 0‐5) 55<br />

Source: Mountain Community Resources, <strong>2010</strong>‐<strong>11</strong>.<br />

(ages 6‐17) 48<br />

Figure 100: Estimated Percentage of Parents in Each Level of Triple P (<strong>2010</strong>-<strong>11</strong>)<br />

7.5%<br />

Source: Mountain Community Resources, <strong>2010</strong>‐<strong>11</strong>.<br />

N=67.<br />

92.5%<br />

One client’s story:<br />

“One of [our practitioners] worked with a single mother, Candy,* who has a 4-year old son. She came to the center<br />

looking for help with her son, Jim*, because she was having problems with him. Candy had heard about Triple P but<br />

was not sure about taking parenting classes. … She agreed to attend the required visits and they met for a total of four<br />

meetings. …<br />

At the last meeting Candy decided to bring Jim to the appointment. Jim came walking rather quickly into the<br />

[practitioner’s] office and proceeded to give her a picture that he had drawn and hugged her legs with great force. He<br />

then looked at mom and said, “what was it I wanted to say?” Mom said, “I remember you wanted to say thank…”<br />

and then Jim jumped up and down and said “thank you thank you, mom doesn’t yell so much anymore and I like quiet<br />

time… a boy needs quiet times and so does mom sometimes.” He then asked to play with the toys outside of her office.<br />

Both mom and child had smiles that ran from ear to ear.”<br />

- Mountain Community Resources, <strong>Annual</strong> Progress <strong>Report</strong><br />

(* Names have been changed)<br />

Level 3 Workshop<br />

Level 3 (Primary Care/Individual)<br />

139


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

STRONG FAMILIES – MOUNTAIN COMMUNITY RESOURCES<br />

Parents <strong>Report</strong>ed High Satisfaction with Services<br />

All parents receiving Triple P services were asked to complete a self‐administered satisfaction survey<br />

upon completing their services. Parents participating in the Level 3 Workshops filled out a short<br />

Satisfaction Survey with 3 questions using a 5‐point scale (with 1=Disagree, and 5=Agree), and 1<br />

open‐ended question.<br />

� The average parent satisfaction ratings for Level 3 Workshops ranged from 4.49 to 4.72, on<br />

the 5‐point scale. Virtually all parents felt that the program answered their questions, that<br />

they would continue to use the tip sheets, and were very satisfied with the services they<br />

received.<br />

1. The workshop answered a question or concern I have had<br />

about parenting. (N=95)<br />

2. I am likely to use some of the parenting strategies in the tip<br />

sheet. (N=94)<br />

3. Overall I was satisfied with the workshop. (N=95)<br />

Level 3 Workshops<br />

Source: Triple P data from the Workshop Satisfaction Survey, collected and analyzed by Applied Survey Research, 20<strong>11</strong>.<br />

Note: All items were on a 5‐point scale. Higher scores indicate greater satisfaction. Satisfaction Survey results for parents participating in Levels 3<br />

(multi‐session), 4, and 5 of the Triple P Program will be available when there are higher client numbers.<br />

140 FIRST 5 SANTA CRUZ COUNTY<br />

4.49<br />

4.72<br />

4.65<br />

1 2 3 4 5


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Early Literacy Foundations (ELF)<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

California third graders are struggling to become proficient readers. Local and statewide data<br />

indicate that well over half of third grade children are not reading at proficiency. Because language<br />

development in the early years is crucial to later reading success, early childhood educators have a<br />

unique role in influencing reading scores and later educational success. According to a report<br />

published in the Journal of Education Psychology, early childhood educators play a key role in the<br />

language development of children from high poverty backgrounds:<br />

“Language development has a profound effect on young children’s successful transition to<br />

school and, in particular, on their success in learning to read. Children who arrive in first grade<br />

with a foundation in pre‐literacy skills and the interest and motivation to learn are better<br />

prepared to engage in the complex task of learning to read.<br />

Most children acquire language and pre‐literacy skills through interactions with adults and<br />

peers who use language in ways that are consistent with the majority culture and correspond<br />

to the printed word. Unfortunately, many children raised in poverty have limited access to<br />

opportunities to develop language and literacy skills in such ways.<br />

As one important illustration, Hart and Risley (1995) reported that by the age of 3, children in<br />

poverty were already well behind their more affluent peers in their acquisition of vocabulary and<br />

oral language skills. Snow et al. (1998) also reported that children in poverty lack necessary<br />

pre‐literacy skills at the beginning of kindergarten. Similar research indicates that socioeconomic<br />

status is the strongest predictor of performance differences in children at the beginning of the<br />

first grade and that this gap persists as children progress from elementary to high school.” 25<br />

With the evidence of limited language and literacy opportunities in low‐income homes, more<br />

emphasis has been placed on showing early childhood educators how to build language<br />

opportunities into their daily child care routines, through fun and meaningful instruction. <strong>First</strong> 5’s<br />

Early Literacy Foundations Initiative builds skills among early childhood educators to promote strong<br />

literacy and language foundations for young children. The Initiative features:<br />

1. Professional development for early childhood educators through unit‐bearing coursework in<br />

partnership with Cabrillo College. Through the SEEDS of Early Literacy courses, educators<br />

earn three units and a stipend, receive on‐site coaching, attend literacy labs, and complete a<br />

professional development plan. Classes are available for early childhood educators who care<br />

for preschool children and infant/toddlers. Three different courses have been developed in<br />

both English and Spanish to meet the unique needs of educators new to college coursework<br />

as well as teachers with formal educational experience.<br />

25<br />

American Psychological Association (2006). The Effects of a Language and Literacy Intervention on Head Start Children and Teachers.<br />

Journal of Educational Psychology, 98, (1), 63–74.<br />

141


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

2. Assessment of children’s development of early literacy skills via the Individual Growth and<br />

Development Indicators (IGDI’s), and coaching for teachers to support response to<br />

intervention and differentiated instruction in participating State Pre‐K classrooms.<br />

3. Skill and materials development with Family, Friend and Neighbor informal providers<br />

through SEEDS early literacy workshops and coaching.<br />

4. Family Engagement through an expansion of “Raising A Reader,” a rotating book bag<br />

program. Almost all of the SEEDS classrooms were also Raising A Reader classrooms,<br />

resulting in mutually complimentary interventions to boost shared reading practices with<br />

children and their families, and to impact children’s early literacy skills. Information on this<br />

program can be found in the Raising A Reader partner profile.<br />

5. The <strong>Santa</strong> <strong>Cruz</strong> Public Libraries (SCPL) “Read to Me” program provides Read to Me Resource<br />

Kits for parents and early childhood educators via library circulation to engage children and<br />

families in early literacy activities.<br />

SEEDS of Early Literacy<br />

The professional development initiative described above (1) follows the SEEDS of Early Literacy<br />

curriculum that has been researched by the University of Minnesota. Research on the SEEDS model<br />

shows that teachers trained and coached on the SEEDS Curriculum score significantly higher on the<br />

Early Language and Literacy Classroom Observation (ELLCO) tool and show greater change over time<br />

in teaching strategies than teachers without such training. Results also indicate that preschool<br />

children who were taught by teachers trained in<br />

SEEDS entered kindergarten ready to read at higher<br />

rates than children in non‐SEEDS groups (Lizakowski,<br />

2005).<br />

“I started this course with the idea that early literacy<br />

was teaching children to write letters, help them form<br />

words, and read. Now I know that early literacy is not<br />

only symbols. It is the combination of strategies that will<br />

help the child in a playful way to build strong<br />

foundations in learning.”<br />

The SEEDS Professional Development model consists<br />

of training—and providing coaching to—early<br />

childhood educators on how to effectively integrate<br />

research‐based language and literacy strategies and<br />

materials into their classrooms. Early childhood<br />

educators are taught to use the strategies of both embedded instruction (planned strategies that<br />

occur within the typical routines of the class day) and explicit instruction (teacher‐directed activities<br />

that emphasize the teaching of a specific task), and to create a classroom environment that is<br />

designed to target early literacy predictors.<br />

These predictors of later reading success include:<br />

- Early childhood educator who just started the SEEDS program<br />

Early Literacy Foundations, <strong>Annual</strong> Progress <strong>Report</strong><br />

� Conversation and Oral Language: The ability to produce or comprehend spoken language<br />

� Alphabet Knowledge: The ability to visually discriminate the differences between letters<br />

and say the names and sounds associated with printed letters<br />

142 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

� Book and Print Rules: Refers to what children understand about how books and print work,<br />

such as left‐right, front‐back, letters, words and that print has meaning<br />

� Phonological awareness: The ability to detect, manipulate, or analyze the auditory aspects<br />

of spoken language, including the ability to distinguish or segment words, syllables, rhymes,<br />

and beginning sounds<br />

� Vocabulary and Background Knowledge: A collection of words that relate to experiences<br />

and knowledge that a child has of the world around him/her<br />

The following diagram displays the five essential SEEDS quality interactions and the five predictors of<br />

literacy.<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>’s SEEDS program has proven to be very effective at changing classroom<br />

environments and practices, as well as influencing changes in children’s skills on research‐based<br />

predictors of early reading.<br />

Population Served<br />

Number of new or returning SEEDS Quality Coaches providing literacy coaching, literacy<br />

environmental assessments, and professional development advising for SEEDS instruction,<br />

fidelity and integrity<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Number of early childhood educators attending SEEDS of Early Literacy Courses 77<br />

Number of Family, Friend or Neighbor (FFN) informal child care providers attending SEEDS of<br />

Early Literacy workshops<br />

TOTAL (unduplicated) 104<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

143<br />

18<br />

9


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

The figures below show additional data about Early Childhood Educators and Coaches who have<br />

been trained between 2007‐20<strong>11</strong>.<br />

Figure 101: Number of Early Childhood Educators Who Have Completed SEEDS<br />

trainings (2007-20<strong>11</strong>)<br />

Number of SEEDS Quality Coaches providing literacy coaching, literacy environmental<br />

assessments, and professional development advising for SEEDS instruction, fidelity, and<br />

integrity during the year<br />

CUMULATIVE TOTALS<br />

2007‐20<strong>11</strong><br />

Number of early childhood educators attending SEEDS of Early Literacy Courses 356<br />

Number of Family, Friend or Neighbor (FFN) informal child care providers attending SEEDS<br />

of Early Literacy workshops<br />

TOTAL (unduplicated) 519<br />

Source: Early Literacy Foundations (ELF) Initiative, <strong>2010</strong>‐<strong>11</strong>.<br />

Figure 102: Number of SEEDS Trained Early Childhood Educators in Licensed<br />

Programs, by type of classroom (2007-20<strong>11</strong>)<br />

State and Federally‐<br />

Subsidized Classrooms<br />

Source: Early Literacy Foundations (ELF) Initiative, 2007‐<strong>11</strong>.<br />

Figure 103: Primary Language of SEEDS Trained Early Childhood Educators in Licensed<br />

Programs (2007-20<strong>11</strong>)<br />

22.2%<br />

3.1%<br />

24.7%<br />

Licensed Family Child Care<br />

Homes and Private/ Non‐<br />

Profit Centers<br />

English Only<br />

Spanish Only<br />

Bilingual English/Spanish<br />

50.0%<br />

Source: Early Literacy Foundations Initiative, Client and Assessment Data Entry Template, 2007‐20<strong>11</strong>.<br />

Note: Early childhood educators and coaches may have participated in more than one SEEDS class, but are only counted once in these analyses. For these<br />

clients, their language and education data are as of their earliest class, in order to assess the status of these educators at the beginning of their<br />

participation in the SEEDS program. Family, Friend or Neighbor (FFN) informal child care providers are not included in these analyses.<br />

Language N=356; Education N=328.<br />

144 FIRST 5 SANTA CRUZ COUNTY<br />

Other<br />

41<br />

155<br />

Unduplicated total,<br />

Spring 2007 – June 20<strong>11</strong><br />

201 155 356


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

Figure 104: Educational Attainment of SEEDS Trained Early Childhood Educators in<br />

Licensed Programs (2007-20<strong>11</strong>)<br />

12.2%<br />

6.1%<br />

Source: Early Literacy Foundations Initiative, Client and Assessment Data Entry Template, 2007‐20<strong>11</strong>.<br />

Note: Early childhood educators and coaches may have participated in more than one SEEDS class, but are only counted once in these analyses. For these<br />

clients, their language and education data are as of their earliest class, in order to assess the status of these educators at the beginning of their<br />

participation in the SEEDS program. Family, Friend or Neighbor (FFN) informal child care providers are not included in these analyses.<br />

Language N=356; Education N=328.<br />

Outcome Objective: Increase the number of early education settings that provide<br />

high quality support for language and literacy<br />

Preschool Classrooms<br />

4.0% 4.3% 8.8%<br />

No Formal Schooling<br />

7.3%<br />

10.1%<br />

Less Than High School Diploma/GED<br />

25.3%<br />

22.0%<br />

High School Diploma/GED<br />

Some College<br />

AA in non‐ECE/CD<br />

AA in ECE/CD<br />

BA in non‐ECE/CD<br />

BA in ECE/CD<br />

Some Graduate School or above<br />

Research on teacher effectiveness shows that by focusing professional development on language<br />

and literacy and social‐emotional development, children are shown to be much better prepared for<br />

school and have higher academic achievement. The first indicators of change are the language<br />

environment, teacher‐child interactions, and language opportunities that teachers provide to<br />

children.<br />

<strong>First</strong> 5 SEEDS Quality coaches are trained to independently assess SEEDS classrooms teaching<br />

children ages 3‐5 using the Early Language and Literacy Classroom Observation Pre‐K Tool (ELLCO<br />

Pre‐K). The ELLCO Pre‐K is used to assess the following five classroom components: classroom<br />

structure, curriculum, the language environment, books and book reading, and print and early<br />

writing (in <strong>2010</strong>‐<strong>11</strong>, the classroom structure component was not measured by most coaches and is<br />

therefore not analyzed in this report). Items are scored along a 5 point scale, where 1 is deficient<br />

and 5 is exemplary. From this scale, early childhood educators’ classroom scores can be categorized<br />

into three levels, indicating their classroom environment provides low‐quality support, basic<br />

support, or high‐quality support for language and literacy. In every Pre‐K SEEDS course since 2007,<br />

coaches used the ELLCO to assess the classrooms of their mentees (early childhood educators<br />

receiving SEEDS training) at the beginning and end of the semester.<br />

Across all components, classrooms showed substantial improvements from the beginning of the<br />

semester to the end. Overall, the percentage of classrooms that were rated as having High‐Quality<br />

Support increased from 16% to 92%. Among the individual classroom components, by the end of the<br />

145


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

semester the majority of classrooms were rated as having High‐Quality Support in “Curriculum”<br />

(81%), “Language Environment” (76%), “Books and Book Reading” (87%), “Print and Early Writing”<br />

(89%).<br />

Figure 105: Classroom Support for Language and Literacy, <strong>2010</strong>-20<strong>11</strong><br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

16.2%<br />

54.1%<br />

91.9%<br />

Low‐Quality Support Basic Support High‐Quality Support<br />

18.9%<br />

51.4%<br />

81.1%<br />

Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) Pre‐K, <strong>2010</strong> – 20<strong>11</strong>.<br />

Note: Low‐quality support = means less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between<br />

3.51 and 5. Percentages less than 3% are not labeled.<br />

N=37.<br />

Four specific ELLCO items were chosen for individual study, using the same type of analysis:<br />

Opportunities for Child Choice and Initiative, Approaches to Book Reading, Support for Children's<br />

Writing, and Approaches to Curriculum. For these four items, several years of data have been<br />

aggregated in order to present a more robust portrait of the extent to which SEEDS‐trained early<br />

childhood educators were providing high quality support for language and literacy in their preschool<br />

classrooms.<br />

16.2%<br />

51.4%<br />

75.7%<br />

13.5%<br />

56.8%<br />

86.5%<br />

29.7% 29.7% 32.4% 29.7%<br />

24.3%<br />

18.9%<br />

13.5%<br />

8.1%<br />

21.6%<br />

35.1%<br />

43.2%<br />

As reflected in the following figure, SEEDS‐coached teachers have consistently improved the quality<br />

of support they provide in their classrooms for children’s development of early literacy. For each of<br />

the four ELLCO items, the majority of classrooms were rated as providing high quality support at<br />

post assessment: Opportunities for Child Choice and Initiative (93%), Approaches to Book Reading<br />

(88%), Support for Children's Writing (90%), and Approaches to Curriculum (87%).<br />

146 FIRST 5 SANTA CRUZ COUNTY<br />

89.2%<br />

Pre Post Pre Post Pre Post Pre Post Pre Post<br />

Overall Section 2:<br />

Curriculum<br />

Section 3:<br />

The Language<br />

Environment<br />

Section 4:<br />

Books & Book<br />

Reading<br />

8.1%<br />

Section 5:<br />

Print & Early<br />

Writing


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Figure 106: Key Language and Literacy Questions (2007-20<strong>11</strong>)<br />

100%<br />

53.7%<br />

35.8%<br />

FIRST 5 SANTA CRUZ COUNTY<br />

93.3%<br />

35.3%<br />

49.3%<br />

88.4%<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

10.4% 15.3% 19.5% 22.4%<br />

6.7%<br />

10.7%<br />

10.0%<br />

Source: Early Literacy Foundations Initiative, Early Language and Literacy Classroom Observation (ELLCO) & ELLCO Pre‐K, 2007 – 20<strong>11</strong>.<br />

Note: Clients may be included more than once if they participated in multiple SEEDS classes between 2007 and 20<strong>11</strong>. Low‐quality support = means<br />

less than or equal to 2.5; Basic support = means between 2.51 and 3.5; High‐quality support = means between 3.51 and 5. Percentages less than 3%<br />

are not labeled.<br />

* The analysis of the question began in 2007‐08, so results reflect the combined data for 2008‐20<strong>11</strong>.<br />

Child Choice and Initiative N=134, Book Reading N=215, Children's Writing N=221, Approaches to Curriculum N=134.<br />

Family Child Care Settings<br />

The data above described the ways that SEEDS‐trained teachers made changes to their preschool<br />

classroom environments and their practices in order to better support children’s development of<br />

pre‐literacy skills. However, SEEDS training was not just limited to preschool center teachers — early<br />

childhood educators from family child care settings as well as infant/toddler centers also<br />

participated in SEEDS training and received SEEDS coaching. Their sites were observed at the<br />

beginning of their SEEDS training and again at the end.<br />

31.2%<br />

49.3%<br />

89.6%<br />

The figure below presents the PRE and POST scores gathered from Family Child Care providers on<br />

four literacy‐related indicators, for several years combined. The measurement instrument was the<br />

Family Child Care Environment Rating Scale, Revised Edition (FCCERS‐R). Items were scored using a<br />

7‐point scale ranging from inadequate to excellent. Results show that providers made pre to post<br />

gains in their abilities related to literacy promotion.<br />

Figure 107: Average FCCERS Scores at Pre and Post Assessment on Literacy-Related<br />

Items (2009-20<strong>11</strong>)<br />

Pre Post<br />

Excellent<br />

7<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Inadequate<br />

Low‐Quality Support Basic Support High‐Quality Support<br />

Source: Early Literacy Foundations (ELF) Initiative, Family Child Care Environment Rating Scale, Revised Edition, 2009‐20<strong>11</strong>.<br />

N=54.<br />

40.3%<br />

37.3%<br />

86.6%<br />

12.7%<br />

Pre Post Pre Post Pre Post Pre Post<br />

Opportunities for<br />

Child Choice and<br />

Initiative*<br />

Approaches to<br />

Book Reading<br />

3.83 3.93 3.94<br />

Helping children<br />

understand language<br />

Support for<br />

Children's Writing<br />

5.46 5.44 5.65 5.80<br />

Helping children use<br />

language<br />

4.24<br />

Using books Provider‐child<br />

interactions<br />

Approaches to<br />

Curriculum*<br />

147


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

Infant/ Toddler Care Classrooms<br />

The figure below presents the PRE and POST scores gathered from center‐based early childhood<br />

educators of Infant/Toddler care, for several years combined. The measurement instrument was the<br />

Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), and items were scored using a 7‐<br />

point scale ranging from inadequate to excellent. Results show that Infant/ Toddler teachers<br />

enhanced their classroom environments and practices to promote children’s early literacy<br />

development.<br />

Figure 108: Average ITERS Scores at Pre and Post Assessment on Literacy-Related<br />

Items (2009-20<strong>11</strong>)<br />

Excellent<br />

Pre Post<br />

7<br />

6.02 6.14 5.76 5.92<br />

6<br />

5<br />

4<br />

3<br />

2<br />

1<br />

0<br />

Inadequate<br />

4.39<br />

Helping children<br />

understand language<br />

4.82<br />

Helping children use<br />

language<br />

Source: Early Literacy Foundations (ELF) Initiative, Infant/Toddler Environment Rating Scale, Revised Edition (ITERS‐R), 2009‐20<strong>11</strong>.<br />

N: Understand language=49, Use language=49, Using books=49, Interactions=48.<br />

Other Outcomes: Children will increase their skills in research-based predictors<br />

for reading success<br />

The SEEDS of Early Literacy has shown us that teachers of diverse educational backgrounds can be<br />

trained to implement strategies to help children build a strong language and literacy foundation.<br />

<strong>First</strong> 5 partnered with SEEDS state subsidized classrooms and found that, indeed, teachers have had<br />

a positive effect on children’s language and literacy development.<br />

Participating classrooms assessed children throughout the year to measure changes in three key<br />

areas of reading predictors: picture‐naming, rhyming, and alliteration. As the majority of students<br />

are dual language learners, most children were assessed in both English and Spanish, unless English<br />

was their primary language.<br />

Children showed large improvements in all three pre‐literacy skills areas between their first and last<br />

assessments. The percentage of all children scoring “At” or “Above” the target level for each of the<br />

pre‐literacy skills areas increased dramatically, with the greatest improvement occurring in rhyming<br />

and alliteration skills.<br />

148 FIRST 5 SANTA CRUZ COUNTY<br />

3.78<br />

4.60<br />

Using books Provider‐child interactions


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

Figure 109: Percentage of All Children Scoring “At” or “Above” the Target Level<br />

in Three Pre-Literacy Skill Areas, <strong>2010</strong>-20<strong>11</strong><br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

12.4%<br />

27.3%<br />

34.1%<br />

English Assessment Spanish Assessment<br />

30.7%<br />

9.3%<br />

49.7%<br />

<strong>11</strong>.3%<br />

51.1%<br />

63.1%<br />

Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />

English N= Oct: Picture Naming (340); Rhyming (332); Alliteration (328). N= Jan: Picture Naming (275); Rhyming (264); Alliteration (262). N= May:<br />

Picture Naming (337); Rhyming (332); Alliteration (325). Spanish N= Oct: Picture Naming (231); Rhyming (228); Alliteration (228). N= Jan: Picture<br />

Naming (209); Rhyming (206); Alliteration (2<strong>11</strong>). N= May: Picture Naming (237); Rhyming (234); Alliteration (230).<br />

Note: Children who completed any two assessments within a pre‐literacy skill area were included in the analysis of that skill.<br />

Because of the number of English‐language learners in these classrooms (who comprised<br />

approximately 73% of children in this assessment), there was interest in focusing on the<br />

performance of children when assessed in their primary language. When looking at the percentage<br />

of children scoring “At” or “Above” target level, results show that when assessed in their primary<br />

language, Spanish‐speaking children started with a lower skill level than English‐speaking children,<br />

but by their last assessment they had made a greater amount of improvement (net change in<br />

percentage) in rhyming (39% increase vs. 30% increase), and in alliteration (53% increase vs. 46%<br />

increase). Primarily Spanish‐speaking children showed similar or even greater amounts of<br />

improvement when assessed in English, with the greatest increases occurring in rhyming (44%<br />

increase) and alliteration (54% increase).<br />

6.1%<br />

13.4%<br />

28.3%<br />

25.7%<br />

7.5%<br />

45.3%<br />

18.4%<br />

55.5%<br />

Picture Naming Rhyming Alliteration Picture Naming Rhyming Alliteration<br />

Oct Jan May<br />

70.9%<br />

149


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

Figure <strong>11</strong>0: Percentage of Children Scoring “At” or “Above” the Target Level in Three<br />

Pre-Literacy Skill Areas, by Primary Language, <strong>2010</strong>-20<strong>11</strong><br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

32.3%<br />

30%<br />

20%<br />

10%<br />

0%<br />

Figure <strong>11</strong>1: Percentage of Children Meeting Targets for Later Reading Success,<br />

by Primary Language<br />

LANGUAGE OF<br />

ASSESSMENT<br />

PRIMARILY ENGLISH‐SPEAKING CHILDREN NET CHANGE<br />

TOPIC AREA OCT JAN MAY<br />

English Picture Naming 32.3% 62.1% 57.1% 24.8%<br />

LANGUAGE OF<br />

ASSESSMENT<br />

Primarily English‐Speaking<br />

Children<br />

English Assessment<br />

62.1%<br />

57.1%<br />

Picture<br />

Naming<br />

31.0%<br />

18.5%<br />

56.9%<br />

48.9%<br />

21.7%<br />

68.1%<br />

13.6%<br />

6.3%<br />

Rhyming Alliteration Picture<br />

Naming<br />

29.3%<br />

26.0%<br />

Rhyming 18.5% 31.0% 48.9% 30.4%<br />

Alliteration 21.7% 56.9% 68.1% 46.4%<br />

PRIMARILY SPANISH‐SPEAKING CHILDREN NET CHANGE<br />

OCT JAN MAY<br />

Spanish Picture Naming 6.3% 13.6% 29.3% 23.0%<br />

Rhyming 7.7% 26.0% 46.5% 38.8%<br />

Alliteration 18.9% 56.0% 72.3% 53.4%<br />

English Picture Naming 4.9% 18.0% 25.6% 20.7%<br />

Rhyming 5.8% 30.6% 50.0% 44.2%<br />

Alliteration 7.2% 49.8% 61.1% 53.9%<br />

Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />

English Speakers: English N= Oct: Picture Naming (93); Rhyming (92); Alliteration (92). N= Jan: Picture Naming (58); Rhyming (58); Alliteration (51). N=<br />

May: Picture Naming (91); Rhyming (90); Alliteration (91). Spanish Speakers: Spanish N= Oct: Picture Naming (222); Rhyming (222); Alliteration (222).<br />

N= Jan: Picture Naming (206); Rhyming (204); Alliteration (209). N= May: Picture Naming (229); Rhyming (228); Alliteration (224). Spanish Speakers:<br />

English N= Oct: Picture Naming (247); Rhyming (240); Alliteration (236). N= Jan: Picture Naming (217); Rhyming (206); Alliteration (2<strong>11</strong>). N= May:<br />

Picture Naming (246); Rhyming (242); Alliteration (234).<br />

Note: Table displays the percentage of children scoring “at” or “above” the target level in these three pre‐literacy skill areas. Children who completed<br />

any two assessments within a pre‐literacy skill area were included in the analysis of that skill. Children were determined to be primarily English<br />

speakers if they were marked as being “English‐only” speakers on the scoring template, or if they did not take any assessments in Spanish. Children<br />

were determined to be primarily Spanish speakers if they were not marked as being “English‐only” speakers on the scoring template, and if they took<br />

at least one assessment in Spanish. The number of children marked as being “English‐only” speakers who also completed an additional assessment in<br />

Spanish was too low to analyze.<br />

150 FIRST 5 SANTA CRUZ COUNTY<br />

7.7%<br />

46.5%<br />

18.9%<br />

56.0%<br />

72.3%<br />

18.0%<br />

Rhyming Alliteration Picture<br />

Naming<br />

Oct Jan May<br />

Primarily Spanish‐Speaking Children<br />

Spanish Assessment English Assessment<br />

25.6%<br />

30.6%<br />

50.0%<br />

4.9% 5.8% 7.2%<br />

49.8%<br />

61.1%<br />

Rhyming Alliteration


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

An analysis of the percentage of children who scored at each of the four target levels (Below, Near,<br />

At, and Above) shows these results in more detail.<br />

� When examining children in their primary language, English‐speaking children made the<br />

greatest improvements in Alliteration, followed by Rhyming and Picture Naming.<br />

� A higher percentage of Spanish‐speaking children scored “below” or “near” target levels in<br />

their initial assessments when compared to English‐speaking children, but by the last<br />

assessment, they had reached or exceeded the levels attained by English‐speaking children,<br />

particularly in rhyming and alliteration, in both languages.<br />

� Spanish‐speaking children did not make the same achievements in the Picture Naming area<br />

as they did in the other two areas.<br />

Figure <strong>11</strong>2: Percentage of Children at Each Target Level in Three Pre-Literacy Skill<br />

Areas, by Primary Language, <strong>2010</strong>-20<strong>11</strong><br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

30.1%<br />

2.2%<br />

46.2%<br />

21.5%<br />

55.2%<br />

6.9%<br />

31.0%<br />

53.8%<br />

3.3%<br />

31.9%<br />

6.9% <strong>11</strong>.0%<br />

Primarily English‐Speaking Children<br />

English Assessment<br />

15.2%<br />

3.3%<br />

28.3%<br />

53.3%<br />

24.1%<br />

6.9%<br />

27.6%<br />

41.4%<br />

43.3%<br />

5.6%<br />

33.3%<br />

17.8%<br />

16.3%<br />

5.4%<br />

21.7%<br />

56.5%<br />

47.1%<br />

9.8%<br />

29.4%<br />

13.7%<br />

Oct Jan May Oct Jan May Oct Jan May<br />

63.5%<br />

Picture Naming Rhyming Alliteration<br />

4.5%<br />

1.8% 9.7%<br />

3.9%<br />

30.2%<br />

54.4%<br />

32.0%<br />

22.7%<br />

6.6%<br />

41.0%<br />

29.7%<br />

Below Near At Above<br />

Primarily Spanish‐Speaking Children<br />

Spanish Assessment<br />

3.2%<br />

4.5%<br />

14.4%<br />

77.9%<br />

18.6%<br />

7.4%<br />

33.8%<br />

40.2%<br />

41.2%<br />

5.3%<br />

30.3%<br />

23.2%<br />

14.4%<br />

4.5%<br />

18.9%<br />

62.2%<br />

50.7%<br />

5.3%<br />

16.3%<br />

27.8%<br />

57.1%<br />

<strong>11</strong>.0%<br />

12.1%<br />

19.8%<br />

63.4%<br />

8.9%<br />

13.4%<br />

Oct Jan May Oct Jan May Oct Jan May<br />

Picture Naming Rhyming Alliteration<br />

Below Near At Above<br />

14.3%<br />

151


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ EARLY LITERACY FOUNDATIONS<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

3.6%<br />

1.2%<br />

19.0%<br />

76.1%<br />

16.1%<br />

1.8%<br />

25.3%<br />

56.7%<br />

22.0%<br />

3.7%<br />

32.1%<br />

42.3%<br />

Source: Early Literacy Foundations Initiative, Individual Growth and Development Indicators (IGDI’s) Assessment Tool, <strong>2010</strong>‐20<strong>11</strong>.<br />

English Speakers: English N= Oct: Picture Naming (93); Rhyming (92); Alliteration (92). N= Jan: Picture Naming (58); Rhyming (58); Alliteration (51). N=<br />

May: Picture Naming (91); Rhyming (90); Alliteration (91). Spanish Speakers: Spanish N= Oct: Picture Naming (222); Rhyming (222); Alliteration (222).<br />

N= Jan: Picture Naming (206); Rhyming (204); Alliteration (209). N= May: Picture Naming (229); Rhyming (228); Alliteration (224). Spanish Speakers:<br />

English N= Oct: Picture Naming (247); Rhyming (240); Alliteration (236). N= Jan: Picture Naming (217); Rhyming (206); Alliteration (2<strong>11</strong>). N= May:<br />

Picture Naming (246); Rhyming (242); Alliteration (234).<br />

Note: Children who completed any two assessments within a pre‐literacy skill area were included in the analysis of that skill. Children were<br />

determined to be primarily English speakers if they were marked as being “English‐only” speakers on the scoring template, or if they did not take any<br />

assessments in Spanish. Children were determined to be primarily Spanish speakers if they were not marked as being “English‐only” speakers on the<br />

scoring template, and if they took at least one assessment in Spanish. The number of children marked as being “English‐only” speakers who also<br />

completed an additional assessment in Spanish was too low to analyze.<br />

<strong>Santa</strong> <strong>Cruz</strong> Public Libraries – Read to Me<br />

The <strong>Santa</strong> <strong>Cruz</strong> Public Libraries (SCPL) “Read to Me” program provides Read to Me Resource Kits for<br />

parents and early childhood educators via library circulation to engage children and families in early<br />

literacy activities. SCPL also provides in‐service workshops on the use of Read to Me kits to the <strong>First</strong> 5<br />

SEEDS classes (both English and Spanish), and State Pre‐K programs (Community Bridges).<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Number of Read to Me Kits circulated 1,137<br />

Number of workshops conducted 30<br />

Source: <strong>Santa</strong> <strong>Cruz</strong> Public Libraries, <strong>Annual</strong> Progress <strong>Report</strong>, <strong>2010</strong>‐20<strong>11</strong>.<br />

Primarily Spanish‐Speaking Children<br />

English Assessment<br />

4.2%<br />

1.7%<br />

20.4%<br />

14.6%<br />

41.3%<br />

10.2%<br />

79.6%<br />

152 FIRST 5 SANTA CRUZ COUNTY<br />

36.4%<br />

33.0%<br />

8.7%<br />

27.3%<br />

22.7%<br />

5.5%<br />

1.7%<br />

19.5%<br />

73.3%<br />

41.7%<br />

8.1%<br />

19.9%<br />

30.3%<br />

Oct Jan May Oct Jan May Oct Jan May<br />

Picture Naming Rhyming Alliteration<br />

Below Near At Above<br />

“SCPL is most proud that we have not only continued quality early literacy programming in<br />

extremely stressful and difficult economic times, we have expanded our programming and<br />

reached out to more families than ever with classes and Read to Me Kits.<br />

We have begun a collaboration with the <strong>County</strong> Office of Education that serves families of<br />

preschool children and rising kindergarteners, and we have continued our partnerships with<br />

many local agencies.”<br />

-<strong>Santa</strong> <strong>Cruz</strong> Public Libraries, <strong>Annual</strong> Progress <strong>Report</strong><br />

55.6%<br />

5.6%<br />

17.1%<br />

21.8%


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Raising A Reader<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ RAISING A READER<br />

Raising A Reader (RAR) fosters healthy brain development, helps support parent‐child bonding, and<br />

motivates families to read aloud with their children which helps develop the early literacy skills that<br />

are critical for school success. Raising A Reader (RAR) began operation in Watsonville during the last<br />

quarter of the 2005‐06 funding cycle. The program provides a way for children and their parents or<br />

caregivers to participate in a weekly rotating book bag program through early care and education<br />

settings. Periodically, Raising A Reader visits participating sites to monitor how well the program is<br />

operating, and provide refresher books or trainings as needed.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

New Existing Total<br />

Children 2,564 2,830 5,394<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

One provider’s story:<br />

“Parents were skeptical at first about reading to their child at such a young age. But I shared the<br />

benefits of introducing reading at this very tender age. There's early language development,<br />

interest in reading at an earlier age, they do better in school, etc…, and as time went by, parents<br />

shared that their child was actually taking an interest and found it a place in their daily routine<br />

with their child.”<br />

-Raising A Reader, <strong>Annual</strong> Progress <strong>Report</strong><br />

Outcome Objective: Raising A Reader will support 210 sites<br />

Type of Early Educator <strong>2010</strong>‐20<strong>11</strong><br />

Family Child Care Home 133<br />

Preschool/Child Care Center 106<br />

Source: Raising A Reader/<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>‐20<strong>11</strong>.<br />

Note: The actual number of classrooms participating in Raising A Reader is likely to be higher than the total number of sites, as one site may include<br />

more than one classroom.<br />

153


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ RAISING A READER<br />

Outcome Objective: Parents will spend time reading or sharing books with their<br />

child<br />

Percentage of parents who report reading 3 or more times per week after<br />

participating in the RAR book bag program.<br />

Source: Raising A Reader Parent Survey, <strong>2010</strong>‐20<strong>11</strong>.<br />

<strong>2010</strong>‐20<strong>11</strong><br />

PRE‐TEST POST‐TEST<br />

49.3%<br />

154 FIRST 5 SANTA CRUZ COUNTY<br />

N=454<br />

Figure <strong>11</strong>3: Changes in How Frequently Parents Read With Their Child, <strong>2010</strong>-20<strong>11</strong><br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

17.4%<br />

31.9%<br />

34.6%<br />

16.1%<br />

15.1%<br />

0.4%<br />

Pre‐Test Post‐Test<br />

Source: Raising A Reader/<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>, <strong>2010</strong>‐20<strong>11</strong>.<br />

N: Pre‐Test=454, Post‐Test=456.<br />

37.1%<br />

47.4%<br />

5+ times/week<br />

3‐4 times/week<br />

1‐2 times/week<br />

Rarely<br />

84.4%<br />

N=456


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Starlight Infant/Toddler Program<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ STARLIGHT INFANT/TODDLER PROGRAM<br />

The Starlight Infant/Toddler Program (SITP) is a collaboration between <strong>Santa</strong> <strong>Cruz</strong> Community<br />

Counseling Center’s Early Head Start and <strong>First</strong> 5 of <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>. This innovative program<br />

offers a wide variety of comprehensive bilingual services for expectant parents and families with<br />

infants and toddlers in the Watsonville area of<br />

south <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>. A key goal is to create a<br />

“learning community” that promotes early<br />

literacy and social emotional skills to help lay a<br />

solid foundation for school readiness.<br />

Services include pre‐ and post‐natal support to<br />

ensure healthy outcomes, assessments on health,<br />

nutrition, and developmental areas, ongoing<br />

parent education workshops, individualized home<br />

visits and goal‐setting, infant and toddler play<br />

groups, and referrals to community resources.<br />

Population Served<br />

“The Starlight Infant/Toddler program has<br />

significantly impacted the lives of local families and<br />

very young children by providing positive early<br />

learning experiences, opportunities for growth, and<br />

access to comprehensive health and social services. The<br />

program follows high-quality best practice standards<br />

and research-based strategies with a replicable model<br />

for intervention with high-risk low-income families<br />

from pregnancy and birth up through age three. SITP<br />

offers additional support during the crucial early years<br />

to minimize disparities and ensure strong families and<br />

healthy children who are ready to learn.”<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Pregnant Women 12<br />

Parents/Guardians 92<br />

Children 54<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

- Starlight Infant/Toddler Program, <strong>Annual</strong> Progress <strong>Report</strong><br />

Outcome Objective: Pregnant women will keep medical appointments<br />

75% of pregnant women will keep all prenatal appointments and will keep all<br />

postpartum follow‐up visits and first newborn doctor visits.<br />

Source: Starlight Infant/Toddler Program, Early Head Start home based Desired Results Parent Survey, Spring 20<strong>11</strong>.<br />

Note: Results should be interpreted with caution due to the low number of cases.<br />

<strong>2010</strong>‐20<strong>11</strong><br />

88.9%<br />

Outcome Objective: Pregnant women will make positive lifestyle changes<br />

60% of pregnant women will make a positive lifestyle change such as decreased<br />

caffeine intake, smoking cessation, increased exercise, and increase information<br />

regarding health and wellness.<br />

Source: Starlight Infant/Toddler Program, Early Head Start home based Desired Results Parent Survey, Spring 20<strong>11</strong>.<br />

Note: Results should be interpreted with caution due to the low number of cases.<br />

N=9<br />

<strong>2010</strong>‐20<strong>11</strong><br />

100%<br />

N=9<br />

155


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ STARLIGHT INFANT/TODDLER PROGRAM<br />

Outcome Objective: Children’s development will be assessed using the DRDP-I/T<br />

By June 30, 20<strong>11</strong>, 40 children ages 0‐3 will be assessed using the Desired Results Developmental<br />

Profile for Infants and Toddlers (DRDP‐I/T) (indicators 6, 7, 15, 16, 17, 18, 28 and 29), with a<br />

baseline assessment completed in February and the second assessment completed in June.<br />

Supports for families in specific areas of language and literacy will be tailored based on the<br />

initial assessment and a comparison will be made to see if there have been gains.<br />

Source: Starlight Infant/Toddler Program, Desired Results Developmental Profile I/T (<strong>2010</strong>), <strong>2010</strong>‐20<strong>11</strong><br />

<strong>2010</strong>‐20<strong>11</strong><br />

55 children<br />

In their first 3 years of life, children’s neural pathways are being developed and cemented as a<br />

foundation for a life full of learning. Quality early childhood experiences help to foster better<br />

language skills, higher cognitive functions, as well as improving sensory pathways, according to the<br />

Harvard University Center on the Developing Child. Therefore, literacy promotion doesn’t begin in<br />

preschool – it starts much earlier, even in daily interactions with young babies.<br />

At the Starlight Infant/Toddler program, home visitors work with parents of infants and toddlers to<br />

build the foundations for literacy. To guide their efforts with children and their families, they assess<br />

children periodically using eight indicators of the DRDP – Infant Toddler (<strong>2010</strong>).<br />

DOMAIN ITEM<br />

Social‐interpersonal skills<br />

Language<br />

Literacy<br />

(scale of 1‐5)<br />

(scale of 1‐6)<br />

(scale of 1‐5)<br />

Interactions with adults<br />

Relationships with familiar adults<br />

Language comprehension<br />

Responsiveness to language<br />

Communication of needs, feelings, and interest<br />

Reciprocal communication<br />

Interest in literacy<br />

Recognition of symbols<br />

Assessment results show that infants and toddlers in the Starlight Infant/Toddler program are being<br />

supported to develop social and interpersonal skills, and to develop a strong foundation for later<br />

literacy. As seen in the following figures:<br />

� The majority of infants increased one or more developmental levels in all measures, with the<br />

greatest increases occurring in the measures of “Reciprocal communication” (94% of children<br />

increased one or more levels), “Responsiveness to language” (72%), and “Interest in literacy”<br />

(72%).<br />

� Toddlers also made increases in one or more developmental levels in all measures, with the<br />

greatest increases occurring in the measures of “Communication of needs, feelings, and<br />

interest” (70% of children increased one or more levels), and “Reciprocal communication”<br />

(70%).<br />

156 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ STARLIGHT INFANT/TODDLER PROGRAM<br />

Figure <strong>11</strong>4: Percentage of Children Who Made Developmental Changes in Key Social<br />

and Pre-Literacy Measures<br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

100%<br />

90%<br />

80%<br />

70%<br />

60%<br />

50%<br />

40%<br />

30%<br />

20%<br />

10%<br />

0%<br />

<strong>11</strong>.8% <strong>11</strong>.8% <strong>11</strong>.1%<br />

52.9% 52.9% 50.0%<br />

29.4%<br />

35.3%<br />

27.8%<br />

Infants (0 – 17 months)<br />

16.7%<br />

55.6%<br />

27.8%<br />

52.9%<br />

41.2%<br />

83.3%<br />

5.9% <strong>11</strong>.1%<br />

5.6% 5.6%<br />

30.0%<br />

45.0%<br />

26.3%<br />

52.6%<br />

5.0% 5.3%<br />

35.0%<br />

30.0%<br />

Toddlers (18 – 36 months)<br />

40.0%<br />

25.0%<br />

44.4%<br />

22.2%<br />

44.4%<br />

27.8%<br />

<strong>11</strong>.1%<br />

Source: Starlight Infant/Toddler Program, Desired Results Developmental Profile I/T (<strong>2010</strong>), <strong>2010</strong>‐20<strong>11</strong><br />

* Only these four questions with 6 developmental levels have the ability to increase 5 levels.<br />

Notes: Only children who completed at least the first and third assessments have been included. This analysis excludes children who already scored at<br />

the highest developmental level on the 1st assessment. Ages are calculated as of the date of the 3rd assessment. “All Children” calculations include<br />

infants, toddlers, and children older than toddlers.<br />

Infant N: Interactions with Adults=17, Relationships with Familiar Adults=17, Language Comprehension=18, Responsiveness to Language=18,<br />

Communication of Needs, Feelings, and Interest=17, Reciprocal Communication=18, Interest in Literacy=18, Recognition of Symbols=18.<br />

Toddler N: Interactions with Adults=20, Relationships with Familiar Adults=19, Language Comprehension=20, Responsiveness to Language=20,<br />

Communication of Needs, Feelings, and Interest=20, Reciprocal Communication=20, Interest in Literacy=19, Recognition of Symbols=20.<br />

5.9%<br />

50.0%<br />

<strong>11</strong>.1%<br />

5.3% 5.0%<br />

5.0%<br />

20.0% 10.5% 15.0%<br />

20.0% 20.0% 10.0%<br />

55.0%<br />

15.0% 15.0%<br />

27.8%<br />

10.5%<br />

42.1%<br />

16.7%<br />

5.0%<br />

50.0%<br />

36.8% 35.0%<br />

15.0% 15.0% 15.0% 15.0% 10.5% 10.0%<br />

Increased 2 Levels<br />

Increased 1 Level<br />

No Change in Levels<br />

Decreased in Levels<br />

Increased 4 Levels<br />

Increased 3 Levels<br />

Increased 2 Levels<br />

Increased 1 Level<br />

No Change in Levels<br />

Decreased in Levels<br />

157


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ CHILD SNAPSHOT<br />

School Readiness � Steps to Success<br />

Child Snapshot<br />

Program Description<br />

<strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> has continued working with kindergarten, preschool, and family child care<br />

teachers to communicate about children who are transitioning to school. The vehicle for this<br />

communication is the Child Snapshot form. The form was developed in partnership between<br />

kindergarten teachers and early childhood educators as an easy and effective way to support<br />

children’s transition to kindergarten. The Snapshot is a three‐page form completed by both the<br />

parent and the preschool teacher in the spring prior to kindergarten, and it includes brief<br />

information about the child’s interests and abilities, language and developmental concerns,<br />

preschool experience and developmental information. They are collected and delivered by <strong>First</strong> 5<br />

staff to the schools the children will be attending, and then routed to each child’s new kindergarten<br />

teacher. As such, the form provides kindergarten teachers with family and preschool information<br />

about their new students, and helps them become more familiar with the preschool and child care<br />

programs which feed into their elementary schools.<br />

Each year, the Transition to Kindergarten Advisory group receives feedback from kindergarten<br />

teachers that the Child Snapshot form is an easy and effective way to support a child’s transition to<br />

kindergarten.<br />

Over the last few years the form has been expanded to include additional information such as family<br />

activities and community supports for parents. A measurement of kindergarten readiness was also<br />

included at the end of the Child Snapshot, using either the Desired Results Developmental Profile ‐<br />

Revised, Preschool (DRDP‐PS) or the Pre‐Kindergarten Observation Form, depending upon the type<br />

of preschool that children attended. For the purposes of this project, scores on the DRDP‐PS were<br />

“crosswalked” with the P‐KOF in order to have a common frame of measurement by which to<br />

examine children’s readiness.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Children 976<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

Program Development<br />

The number of children with Child Snapshots completed on their behalf continues to grow, and<br />

illustrates the increased communication between early childhood and elementary school settings,<br />

and the achievements being made to bridge children’s transition to kindergarten.<br />

158 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ CHILD SNAPSHOT<br />

� In Spring 20<strong>11</strong>, a total of 976 preschool children were assessed—509 boys (52%) and 467<br />

girls (48%). These children were drawn from 42 preschool programs throughout <strong>Santa</strong> <strong>Cruz</strong><br />

<strong>County</strong> and their child snapshot forms were shared with kindergarten teachers at 42<br />

elementary schools in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> and surrounding areas.<br />

Figure <strong>11</strong>5: Number of Child Snapshot Forms Collected from Participating Preschool<br />

Programs<br />

Source: Applied Survey Research, Child Snapshot Log, 2006‐<strong>2010</strong>, and Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot.<br />

Pre‐Kindergarten Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />

Child Snapshot Results<br />

The P‐KOF assesses children across 24 readiness skills. These readiness skills can be reliably sorted<br />

into four domains, or Basic Building Blocks of Readiness: 1) Self‐Care & Motor Skills, 2) Self‐<br />

Regulation Skills, 3) Social Expression Skills, 4) Kindergarten Academics. The figure below displays<br />

children’s overall mean readiness scores as well as their average scores on each of the four Basic<br />

Building Blocks.<br />

Proficient<br />

In Progress<br />

Beginning<br />

1,000<br />

800<br />

600<br />

400<br />

200<br />

0<br />

393<br />

889<br />

617<br />

2006‐07 2007‐08 2008‐09 2009‐<strong>2010</strong> <strong>2010</strong>‐<strong>11</strong><br />

Figure <strong>11</strong>6: Students’ Average School Readiness Levels Across the Basic Building<br />

Blocks of Readiness<br />

4<br />

3<br />

2<br />

Not Yet<br />

1<br />

3.54<br />

3.75<br />

Overall Readiness Self‐Care & Motor<br />

Skills<br />

Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten Observation Form<br />

and crosswalked DRDP‐PS, Spring 20<strong>11</strong>.<br />

N=900‐904.<br />

832<br />

976<br />

3.50 3.59 3.44<br />

Self‐Regulation<br />

Skills<br />

Social Expression<br />

Skills<br />

Kindergarten<br />

Academics<br />

159


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ CHILD SNAPSHOT<br />

The next two figures highlight the readiness skills for which students were rated as demonstrating<br />

the most proficiency and the greatest challenges. Readiness skill strengths were identified within<br />

the Self Care & Motor Skills, Social Expression, and Kindergarten Academics Basic Building Blocks.<br />

Figure <strong>11</strong>7: Students’ Top Five Readiness Strengths<br />

TOP FIVE STRENGTHS BASIC BUILDING BLOCK<br />

STUDENTS’ AVERAGE SCORE<br />

(OUT OF 4.00 POSSIBLE)<br />

1. General coordination on the playground Self‐Care & Motor Skills 3.84<br />

2. Uses small manipulatives Self‐Care & Motor Skills 3.76<br />

3. Recognizes basic colors Kindergarten Academics 3.75<br />

4. Relates appropriately to adults other than<br />

parent/primary caregiver<br />

5. Appropriately expresses needs and wants<br />

verbally in primary language<br />

Social Expression 3.65<br />

Social Expression 3.64<br />

Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten. Pre‐Kindergarten<br />

Observation Form and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />

Note: Means are based on 415‐899 students. Don’t know/ Not observed responses are not included. Scale points are as follows: 1=not yet, 2=<br />

beginning, 3=in progress, 4=proficient.<br />

Students were still developing the Kindergarten Academic skills involved in recognizing all letters of<br />

the alphabet and recognizing rhyming words, as well as the Self Regulation Skills involved in<br />

navigating peer relationships.<br />

Figure <strong>11</strong>8: Students’ Top Five Readiness Challenges<br />

TOP FIVE CHALLENGES BASIC BUILDING BLOCK<br />

STUDENTS’ AVERAGE SCORE<br />

(OUT OF 4.00 POSSIBLE)<br />

1. Recognizes letters of the alphabet Kindergarten Academics 3.05<br />

2. Recognizes rhyming words Kindergarten Academics 3.29<br />

3. Handles frustration well Self‐Regulation 3.38<br />

4. Negotiates with peers to resolve social<br />

conflict<br />

Self‐Regulation 3.39<br />

5. Participates successfully in circle time Self‐Regulation 3.47<br />

Source: Applied Survey Research, Portrait of School Readiness 20<strong>11</strong>: Transition to Kindergarten—Child Snapshot. Pre‐Kindergarten Observation Form<br />

and cross‐walked DRDP‐PS, Spring 20<strong>11</strong>.<br />

Note: Means are based on 415‐899 students. Don’t know/ Not observed responses are not included. Scale points are as follows: 1=not yet, 2=<br />

beginning, 3=in progress, 4=proficient.<br />

160 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Literacy Continuing Education Workshops<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ LITERACY CONTINUING EDUCATION WORKSHOPS<br />

As continuing education support for graduates of the SEEDS of Early Literacy classes, early childhood<br />

educators receive professional development and make activities and materials that will enhance<br />

their work environment and promote literacy with young children. Early Literacy Foundation (ELF)<br />

coaches conduct the trainings.<br />

Eight workshops were provided, each with a different focus:<br />

Fall, <strong>2010</strong><br />

� The first workshop focused on how to use a non‐fiction book with the Repeated Read Aloud<br />

strategy through the making of various sorting, vocabulary, and matching games.<br />

� The second workshop focused on vocabulary development through the making of vocabulary<br />

cards.<br />

� The third workshop supported phonological awareness through the use of poems, fingerplay<br />

cards, and rhyming games.<br />

� The fourth workshop focused on conversation skills through the making of a flannel board<br />

story and puppets.<br />

Spring, 20<strong>11</strong><br />

� The first workshop supported book and print rules through creating a Big Book Song book<br />

and flannel board story.<br />

� The second workshop emphasized social‐emotional development and vocabulary through<br />

the use of emotion cards and feeling words.<br />

� The third workshop focused on book and print rules<br />

through writing and counting activities.<br />

� The fourth workshop focused on a non‐fiction book<br />

using the Repeated Read Aloud strategy through the<br />

making of matching and sorting games.<br />

Population Served<br />

Fall <strong>2010</strong> Spring 20<strong>11</strong><br />

“These workshops encourage children<br />

to learn letters, words, phonological<br />

awareness. Thank you for your help in<br />

making us better educators.”<br />

-Workshop Participant,<br />

Spring 20<strong>11</strong> Workshop Survey<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Total<br />

(Unduplicated)<br />

Early Childhood Educators 23 19 35<br />

Source: (Fall) Literacy Continuing Education Workshops program data; (Spring) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

161


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ LITERACY CONTINUING EDUCATION WORKSHOPS<br />

Participants filled out an evaluation survey after the series of four workshops, to get their feedback<br />

on the usefulness of the workshops, and how frequently they used the materials and activities in<br />

their classrooms. For each survey question, participants answered “Not at all,” “Some,” or “Very<br />

Much.” Over 90% of participants reported that they found the workshops and materials very useful,<br />

and 46% ‐ 83% were currently using the tools and activities in their classrooms.<br />

Figure <strong>11</strong>9: Percentage of Participants Who Responded “Very Much” to Workshop<br />

Survey Questions<br />

<strong>First</strong> Workshop:<br />

Book and print rules - Big<br />

Book Song book & flannel<br />

board story<br />

Second Workshop:<br />

Social-emotional<br />

development and<br />

vocabulary<br />

Third Workshop:<br />

Book and print rules -<br />

Writing and counting<br />

activities<br />

Fourth Workshop:<br />

Non-fiction books -<br />

Repeated Read Aloud<br />

strategy<br />

Please tell us if you are using these name<br />

activities/games in your program? (N=<strong>11</strong>)<br />

How useful do you find this tool? (N=<strong>11</strong>)<br />

How useful was this workshop in supporting your<br />

knowledge with oral language? (N=12)<br />

Did you find the activities/games useful and<br />

appropriate? (N=12)<br />

Are you using the game board and vocabulary<br />

cards? (N=12)<br />

How useful was this workshop in supporting<br />

thinking skills? (N=13)<br />

With what frequency are you using the activities<br />

made? (N=13)<br />

How useful was this workshop in supporting writing<br />

around the room? (N=13)<br />

How many times do you read to your group of<br />

children in one day? (N=13)<br />

Source: Literacy Continuing Education Workshops survey data, Spring 20<strong>11</strong>. No survey was conducted in Fall <strong>2010</strong>.<br />

46.2%<br />

69.2%<br />

90.9%<br />

90.9%<br />

83.3%<br />

91.7%<br />

91.7%<br />

92.3%<br />

0% 20% 40% 60% 80% 100%<br />

100.0%<br />

162 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Migrant Education – Summer Pre‐K Academy<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION – SUMMER PRE‐K ACADEMY<br />

Migrant education implements a four‐week summer academy for children about to enter<br />

kindergarten at seven Pajaro Valley Unified School District (PVUSD) elementary school sites. The<br />

program is for children who do not qualify for Migrant<br />

Education and who have little or no preschool<br />

experience. The academy is geared toward exposing<br />

children to early literacy concepts and kindergarten<br />

routines, in a safe learning environment that helps to<br />

support children’s emotional and social well‐being and<br />

build bonds with other children to ease later<br />

adjustments.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Children 156<br />

Source: (Parents/Guardians) ; (Children) SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

“We are most proud of the growth our<br />

students have demonstrated after<br />

participating in the program. This growth can<br />

be seen in the pre and post data, parent<br />

feedback, and anecdotal feedback from<br />

teachers at the beginning of school.<br />

As well documented in the research literature,<br />

we are confident that these programs are<br />

changing the long term achievement and<br />

success of our students..”<br />

- Migrant Education, <strong>Annual</strong> Progress <strong>Report</strong><br />

Outcome Objective: Children will increase their recognition of letter sounds<br />

Program Objectives<br />

75% of participants who completed both the pre and post survey<br />

will increase their letter sound recognition by 5 letter sounds using<br />

the cognate alphabet in the child’s home language.<br />

All Children<br />

<strong>2010</strong>‐20<strong>11</strong><br />

90.4%<br />

Children<br />

attending at least<br />

14 sessions<br />

Source: Migrant Education – Summer Pre‐K Academy, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />

N=94<br />

92.9%<br />

As seen in the following figure, in 20<strong>11</strong>, over 90% of all students who participated in the Summer<br />

Pre‐K Academy increased their letter sound recognition by at least five letter sounds, and this rose<br />

to almost 93% for children who attended at least 14 sessions. On average, students learned to<br />

recognize 16 new letter sounds by the time they left the program.<br />

N=85<br />

163


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION – SUMMER PRE‐K ACADEMY<br />

Figure 120: Summer Pre-K Academy Letter Sound Identification Results, 20<strong>11</strong><br />

Percentage of Students who Increased Their Letter<br />

Sound Recognition By At Least 5 Letter Sounds<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

All Students<br />

90.4%<br />

92.9%<br />

Students who attended at least 14 sessions<br />

Average Number of Letter Sounds Recognized at Pre<br />

and Post Assessment<br />

17.2 17.2<br />

1.0 1.1<br />

Source: Migrant Education – Summer Pre‐K Academy, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />

All Students N=94. 14 or more sessions Students N=85.<br />

Results for the past five years show a consistent pattern of learning, with 75%‐90% of students<br />

increasing their letter sound recognition by at least 5 letter sounds, and increases in recognition of<br />

from <strong>11</strong>‐16 letter sounds.<br />

Figure 121: Percentage of Summer Pre-K Academy Students who Increased Their Letter<br />

Sound Recognition By At Least 5 Letter Sounds<br />

100% 86.9% 83.8%<br />

90.4% 92.9%<br />

82.5% 81.9% 83.0%<br />

75.4%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

Figure 122: Average Increase in the Number of Letter Sounds Recognized by Summer<br />

Pre-K Academy Students<br />

20<br />

15.4 15.5<br />

14.9<br />

16.2 16.1<br />

16<br />

13.9<br />

12.4<br />

<strong>11</strong>.1<br />

12<br />

8<br />

4<br />

0<br />

Source: Migrant Education – Summer Pre‐K Academy, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 2007 ‐ 20<strong>11</strong>.<br />

Note: Between 2006 and 2009, the Summer Pre‐K Academy was a 5‐week program. Beginning in <strong>2010</strong>, it became a 4‐week program.<br />

All Students N: 2007=84, 2008=80, 2009=<strong>11</strong>4, <strong>2010</strong>=65, 20<strong>11</strong>=94. 14 or more sessions Students N: 2009=94, <strong>2010</strong>=47, 20<strong>11</strong>=85; no data for this<br />

population are available for 2007 and 2008.<br />

164 FIRST 5 SANTA CRUZ COUNTY<br />

20<br />

15<br />

10<br />

5<br />

0<br />

All Students Students who attended at<br />

least 14 sessions<br />

Pre Post<br />

2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />

All Students Students who attended at least 14 sessions<br />

2007 2008 2009 <strong>2010</strong> 20<strong>11</strong><br />

All Students Students who attended at least 14 sessions


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Migrant Education School Readiness Program<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION SCHOOL READINESS PROGRAM<br />

The Migrant Education School Readiness Program (MESRP) offers a mechanism for ensuring that<br />

at‐risk children and families will have the support they need to prepare them for a successful<br />

transition to formal schooling, by providing a high‐quality early childhood program that includes:<br />

� An effective evidence‐based, culturally responsive curriculum grounded in empirical knowledge.<br />

� Developmentally appropriate instruction and strategies, including those specific to Dual<br />

Language Learners.<br />

� Alignment with high ECE standards as set forth by the California Preschool Learning<br />

Foundations.<br />

� High quality professional development and ongoing support through coaching for the staff.<br />

� A needs assessment to ensure that the program is responsive to the needs of the families.<br />

� An ongoing partnership between the families, the school, and community services.<br />

The MESRP program improves outcomes for both children and parents by supporting the child’s<br />

preparedness for formal schooling and strengthening the parent‐child relationship.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Children 36<br />

Source: SUN database/CCD data for July 1, <strong>2010</strong> – June 30, 20<strong>11</strong>.<br />

Outcome Objective: Children will increase their recognition of letter sounds<br />

Program Objectives<br />

75% of participants who completed both the pre and post<br />

survey and have attended consistently, will increase their letter<br />

sound recognition by 10 letter sounds in their home language.<br />

<strong>2010</strong>‐20<strong>11</strong><br />

English Assessment Home Language Assessment<br />

75.0%*<br />

Source: Migrant Education School Readiness Program: English assessment, Phonological Awareness Literacy Screening (PALS) tool, 20<strong>11</strong>; Home<br />

language assessment, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />

* English language results should be interpreted with caution due to the low number of cases.<br />

Two similar assessments were used to measure children’s recognition of letter sounds; the<br />

Phonological Awareness Literacy Screening (PALS) tool measured children’s ability to identify letter<br />

sounds in English, and the Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification<br />

tool measured children’s letter sound recognition in their home language. In 20<strong>11</strong>, 75% of students<br />

N=8<br />

80.0%<br />

N=30<br />

165


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION SCHOOL READINESS PROGRAM<br />

who participated in the Migrant Education School Readiness Program (MESRP) increased their letter<br />

sound recognition in English by at least 10 letter sounds, and this rose to almost 80% for children<br />

who took the assessment in their home language. On average, students learned to recognize 18 new<br />

letter sounds by the time they left the program.<br />

Figure 123: MESRP Letter Sound Identification Results, 20<strong>11</strong><br />

Percentage of Students who Increased Their Letter<br />

Sound Recognition By At Least 10 Letter Sounds<br />

Average Number of Letter Sounds Recognized at Pre<br />

and Post Assessment<br />

Source: Migrant Education School Readiness Program: English assessment, Phonological Awareness Literacy Screening (PALS) tool, 20<strong>11</strong>; Home<br />

language assessment, Migrant Education Even Start (MEES) Pre‐K Letter Sound Identification tool, 20<strong>11</strong>.<br />

English language N=8; Home language N=30.<br />

* English language results should be interpreted with caution due to the low number of cases.<br />

Outcome Objective: Children will demonstrate progress in early learning skills<br />

The Brigance Preschool Screen ‐ II assessment was utilized by the Migrant Education School<br />

Readiness Program (MESRP) to identify children’s present level of performance, set goals, and<br />

measure progress in domains that align to early learning standards. Through verbal questions,<br />

drawing, and physical activities, children were given a series of age‐appropriate assessments that<br />

provided a sampling of their learning, development, and skills in a broad range of areas, such as fine‐<br />

motor skills, body awareness, general knowledge, language development, and gross‐motor skills.<br />

Results show that students’ average scores on the Brigance Preschool Screen increased from 60.4 to<br />

79.3, demonstrating an overall improvement of 31% in their early learning skills.<br />

100<br />

80<br />

60<br />

40<br />

20<br />

0<br />

100%<br />

80%<br />

60%<br />

40%<br />

20%<br />

0%<br />

75.0%<br />

80.0%<br />

English Language* Home Language<br />

Figure 124: MESRP Students’ Average Scores on the Brigance Preschool Screen-II<br />

Assessment<br />

60.4<br />

Average Scores<br />

79.3<br />

Pre Post<br />

Source: Migrant Education School Readiness Program: Brigance Preschool Screen ‐ II assessment, 20<strong>11</strong>.<br />

N=24.<br />

166 FIRST 5 SANTA CRUZ COUNTY<br />

30<br />

25<br />

20<br />

15<br />

10<br />

5<br />

0<br />

8.0<br />

26.1<br />

1.7<br />

20.3<br />

English Language* Home Language<br />

Pre Post


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ MIGRANT EDUCATION SCHOOL READINESS PROGRAM<br />

Outcome Objective: Children will improve their listening comprehension for<br />

spoken words<br />

The Peabody Picture Vocabulary Test was utilized by the Migrant Education School Readiness<br />

Program (MESRP) to measure children’s listening comprehension for spoken Standard American<br />

English. The test is administered by showing a series of pictures to the child, with four pictures to a<br />

page. The examiner states a word describing one of the pictures and asks the child to indicate which<br />

picture that word describes. Raw scores are calculated and can be used for comparison in Pre/Post<br />

tests.<br />

Results show that students’ average scores on the Peabody Picture Vocabulary Test increased from<br />

73.4 to 84.4, demonstrating a 15% increase in their listening comprehension for spoken English<br />

words.<br />

100<br />

80<br />

60<br />

40<br />

20<br />

0<br />

Figure 125: MESRP Students’ Average Scores on the Peabody Picture Vocabulary Test<br />

73.4<br />

Average Scores<br />

84.4<br />

Pre Post<br />

Source: Migrant Education School Readiness Program: Peabody Picture Vocabulary Test, 20<strong>11</strong>.<br />

Note: Results should be interpreted with caution due to the low number of cases.<br />

N=7.<br />

167


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ PVUSD PARENT CONFERENCE<br />

Pajaro Valley Unified School District (PVUSD) Parent Conference<br />

Program Description<br />

In February 20<strong>11</strong>, <strong>First</strong> 5 co‐sponsored the Pajaro Valley Unified School District’s Parent Conference.<br />

The annual event brings together parents of children of all ages to learn how they can support their<br />

children’s learning. Families participated in workshops promoting transition to kindergarten<br />

practices, healthy child development, and positive discipline.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Number of families attending this Conference 318 families<br />

Percentage of families with children ages 0‐5 55% with children ages 0‐5<br />

Source: Pajaro Valley Unified School District, 20<strong>11</strong>.<br />

168 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT PARTNER PROFILES<br />

Transition to School Workshops<br />

Program Description<br />

FIRST 5 SANTA CRUZ COUNTY<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ TRANSITION TO SCHOOL WORKSHOPS<br />

Transition to School Workshops are offered to families in preschool settings. These workshops are<br />

designed to inform parents about kindergarten registration requirements, choices of language<br />

programs, how to support their child in school, and ways to ensure that their child’s entry into<br />

school is a pleasant and smooth transition.<br />

Families participated in workshops at five elementary schools (Alianza, Freedom, Landmark, Radcliff,<br />

and Starlight) and at early education sites throughout Watsonville. Parents also participated in<br />

workshops at 13 Head Start and State Preschool sites throughout Watsonville and Freedom.<br />

Population Served<br />

<strong>2010</strong>‐20<strong>11</strong><br />

Parents/Guardians 267<br />

Source: Transition to School – Workshop Schedule and Participant Data, <strong>2010</strong>‐ 20<strong>11</strong>.<br />

169


PARTNER PROFILES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

CHILDREN LEARNING AND READY FOR SCHOOL ‐ TRANSITION TO SCHOOL WORKSHOPS<br />

170 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

APPENDICES<br />

FIRST 5 SANTA CRUZ COUNTY<br />

171


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

172 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

Appendix I: <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Framework<br />

Based on the <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Strategic Plan for 2009‐2012, a strategic framework was<br />

developed for each of the three goal areas (Healthy Children, Strong Families, and Children Learning<br />

and Ready for School). The highlighted results have been chosen to receive Commission investment<br />

between 2009 and 2012. This diagram is an expanded version of that which is presented previously<br />

in this report.<br />

Focus Area<br />

Community<br />

Goals<br />

Results<br />

FIRST 5 SANTA CRUZ COUNTY<br />

Increase<br />

Prenatal<br />

Care<br />

Children are<br />

Born Healthy<br />

Healthy<br />

Children<br />

Increase<br />

Insurance<br />

Coverage Increase<br />

Medical/ Dental<br />

Homes<br />

Decrease<br />

Childhood<br />

Obesity<br />

Increase Number of<br />

Children Reaching<br />

Developmental<br />

Milestones<br />

Children Remain<br />

Healthy<br />

Decrease Family<br />

Food Insecurity<br />

Increase use of<br />

Preventive<br />

Health Care<br />

Increase Smoke<br />

Free Homes<br />

173


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Focus Area<br />

Community<br />

Goals<br />

Results<br />

Focus Area<br />

Community<br />

Goals<br />

Results<br />

Decrease Parent/<br />

Guardian<br />

Substance Abuse<br />

Increase<br />

Parental<br />

Involvement<br />

in Children’s<br />

Learning &<br />

Development<br />

Increase Access to<br />

Child Care/Preschool<br />

Children Live<br />

in Safe<br />

Environments<br />

Decrease Child Abuse<br />

& Neglect<br />

Decrease Child<br />

Exposure to Domestic<br />

Violence<br />

Children Grow Up in Environments<br />

that Support Learning<br />

Increase<br />

Participation<br />

in Quality<br />

Structured<br />

Activities<br />

Increase Use<br />

of Quality<br />

Child Care<br />

Practices<br />

Strong Families<br />

Improve Parent & Caregiver<br />

Practices that Support Social<br />

and Emotional Development<br />

Decrease Impact<br />

of Parental<br />

Mental Illness<br />

Children Learning and<br />

Ready for School<br />

Improve<br />

Pre‐<br />

Literacy<br />

Skills<br />

Decrease Family<br />

Financial<br />

Insecurity<br />

Children are Socially<br />

and Emotionally<br />

Healthy<br />

Schools are Ready for Children<br />

Increase Identification<br />

& Accommodation of<br />

Children with Special<br />

Needs<br />

Increase Use of<br />

Kindergarten<br />

Transition<br />

Practices<br />

Reduce Family<br />

Isolation<br />

174 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

Appendix II: Measurement Tools<br />

The following assessments and measurement tools were used to collect evaluation data during this<br />

funding cycle. They are listed in alphabetical order.<br />

Ages & Stages Questionnaires (ASQ)<br />

The Ages & Stages Questionnaires ® (ASQ) are used to screen infants and young children for<br />

developmental delays during the crucial first five years of life. Parents complete the 30‐item<br />

age‐appropriate questionnaires at designated intervals, assessing children in their natural<br />

environments to ensure valid results. Each questionnaire covers five key developmental<br />

areas: communication, gross motor, fine motor, problem solving, and personal‐social. 26<br />

Ages & Stages Questionnaires: Social Emotional (ASQ:SE)<br />

Ages & Stages Questionnaires ® : Social‐Emotional (ASQ:SE) focus on children’s social and<br />

emotional behavior. Professionals assess children’s social‐emotional development at<br />

different ages (at 6, 12, 18, 24, 30, 36, 48, and 60 months). ASQ:SE screening areas focus on<br />

personal‐social skills (self‐regulation, compliance, communication, adaptive functioning,<br />

autonomy, affect, and interaction with people). With the results, professionals can recognize<br />

young children at risk for social or emotional difficulties, identify behaviors of concern to<br />

caregivers, and identify any need for further assessment. 27<br />

Brigance Preschool Screen - II<br />

The Brigance Preschool Screen ‐ II (Curriculum Associates, 2005) was utilized by the PVUSD<br />

Migrant Education School Readiness Program to identify children’s present level of<br />

performance, set goals, and measure progress in domains that align to early learning<br />

standards. Through verbal questions, drawing, and physical activities, children are given a<br />

series of age‐appropriate assessments that provide a sampling of their learning,<br />

development, and skills in a broad range of areas, such as fine‐motor skills, body awareness,<br />

general knowledge, language development, and gross‐motor skills. The primary purpose of<br />

screening is to obtain a broad sampling of a child’s skills and behaviors for one or more of the<br />

following reasons:<br />

1. To identify any child who should be referred for a more comprehensive evaluation to<br />

determine the existence of a disability or the need for special placement<br />

2. To help determine the most appropriate initial placement or grouping of children<br />

3. To assist the teacher in planning a more appropriate program for the child<br />

4. To comply with mandated screening requirements<br />

The Brigance Preschool Screen ‐ II assessment is currently only available in English.<br />

26<br />

Brookes Publishing, Ages & Stages Questionnaires® (ASQ), http://www.brookespublishing.com/store/books/bricker-asq/, 2007.<br />

27<br />

Brookes Publishing, Ages & Stages Questionnaires‐Social Emotional (ASQ:SE), http://www.brookespublishing.com/store/books/squiresasqse/index.htm,<br />

2007.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

175


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Child Behavior Checklist (CBCL)<br />

The Child Behavior Checklist (CBCL; Achenbach, 1991; 2001) is part of the Achenbach System<br />

of Empirically Based Assessment. The CBCL is a screening tool which is used by parents (and<br />

in mental health settings) to assess behavioral and emotional problems in children and<br />

adolescents.<br />

The Child Behavior Checklist (CBCL) contains about 100 items that can cluster into several<br />

syndromes, competence scales, codes from the Diagnostic and Statistical Manual of Mental<br />

Disorders, 4th Edition (DSM‐IV). Children are ranked according to the severity of behavior,<br />

thus percentile rankings tell us how a child, or group of children, compare to the general<br />

population. Higher percentile rank indicates more problematic behavior. Rankings falling<br />

between the 65th and 70th percentile indicate “Borderline Clinical”; the 70th percentile rank<br />

and above denote the clinical range. Clients who score at or near the clinical range are more<br />

likely to have or develop a clinical diagnosis. Thus, the CBCL serves as an indicator of clinical<br />

risk based on the degree of similarity with other children who have received (or have not<br />

received) a diagnoses. A significant drop in percentile rank indicates a decrease in clinical risk.<br />

The CBCL has good psychometric properties and has been validated internationally. This tool<br />

is helpful in determining children who might benefit from additional assessment and mental<br />

health services.<br />

Child Snapshot<br />

The Kinder Transition Team Child Snapshot was a strategy within the Transition to School<br />

Plan and was identified by the Transition to School Advisory group in July 2005 as one that<br />

could help support children’s adjustment to kindergarten. The Snapshot was completed by<br />

parents and early care teachers for each child entering kindergarten in the fall, and was<br />

forwarded on to the child’s new kindergarten teacher. The form included brief (snapshot)<br />

information about the child’s interests and abilities, the child’s health, language or<br />

developmental concerns, preschool experience, and other developmental information. The<br />

form was expanded in 2009‐10 to include additional information such as family activities and<br />

community supports for parents. A measurement of kindergarten readiness was also<br />

included at the end of the Child Snapshot, using either the Desired Results Developmental<br />

Profile‐R Preschool or the Pre‐Kindergarten Observation Form, depending upon the child care<br />

site within <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> (both of these assessments are described below).<br />

Depression, Anxiety, Stress Scale (DASS-21)<br />

The Depression, Anxiety, and Stress Scale – Short Version (DASS‐21) was utilized by<br />

participants in levels 4 and 5 of the Triple P Program. It is a 21‐item brief version of the<br />

Depression Anxiety Stress Scales (Lovibond & Lovibond in 1995). It is a self‐report measure<br />

used to assess the levels of depression, anxiety, and tension/stress experienced, which was<br />

completed by parents in the program. Respondents indicate how much they felt each of the<br />

21 symptoms during the previous week. The scale is psychometrically sound – it has good<br />

176 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

convergent and discriminant validity. It also has high internal consistency in clinical and non‐<br />

clinical samples, and across different ethnic groups.<br />

Desired Results Developmental Profile<br />

The Desired Results Development Profile was created as a comprehensive program<br />

evaluation system designed to measure California Department of Education funded child<br />

development contractor effectiveness. Desired results reflect the positive effects of the child<br />

development system on the development and functioning of children and on the self‐<br />

sufficiency and functioning of families 28 . The DRDP is an observation‐based assessment and is<br />

organized into several domains, each representing a crucial area of learning and<br />

development. Each domain contains several measures, which focus on a specific competency<br />

within that domain. There are three DRDP assessment instruments: infant/toddler (birth to<br />

36 months), preschool (three years to kindergarten entry), and school‐age (kindergarten<br />

through 12 years); two of these assessments were used by <strong>First</strong> 5 partners:<br />

a) Desired Results Developmental Profile – Infant/Toddler (<strong>2010</strong>)<br />

The DRDP – Infant Toddler (<strong>2010</strong>) is used for children ages birth to 36 months, and measures<br />

five domains. The Starlight Infant Toddler Program chose to assess the infants and toddlers<br />

participating in their program in two domains, using a total of eight measures. In the Self and<br />

Social Development domain, two measures were used to assess interactions and<br />

relationships with adults. In the Language and Literacy Development domain, six measures<br />

were used to assess language comprehension, communication skills, interest in literacy, and<br />

recognition of symbols.<br />

b) Desired Results Developmental Profile - Revised, Preschool (DRDP-R, PS)<br />

The DRDP – Preschool Version is used for children 3 years of age to kindergarten entry. The<br />

DRDP‐PS has 10 overall indicators, containing 39 measures. This version of the DRDP<br />

instrument was used in conjunction with the Child Snapshot (see Child Snapshot, above).<br />

Early Language and Literacy Classroom Observation Pre-K Tool<br />

(ELLCO Pre-K)<br />

The first version of the ELLCO (ELLCO Toolkit) was designed to evaluate the teaching practices<br />

of early childhood educators in the areas of language and literacy, in pre‐kindergarten to<br />

third‐grade classrooms. 29 The newest version of the tool (ELLCO Pre‐K) is comparable to the<br />

ELLCO Toolkit, and has been reorganized so that it reduces the bias towards classrooms that<br />

28 California Department of Education. (2009). Introduction to desired results. Retrieved from<br />

http://www.cde.ca.gov/sp/cd/ci/desiredresults.asp<br />

29 Education Development Center, Inc., Center for Children and Families, Early Language and Literacy Classroom Observation Toolkit, 2002.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

177


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

have a lot of resources, and focuses more on the use of materials rather than just their<br />

presence in the preschool classrooms. 30<br />

The ELLCO Pre‐K was used by the Early Literacy Foundations to help identify the effectiveness<br />

of classroom teaching on children’s language and literacy development by focusing on five<br />

components: Classroom Structure, Curriculum, the Language Environment, Books and Book<br />

Reading, and Print and Early Writing.<br />

Eyberg Child Behavior Inventory Intensity Scale (ECBI)<br />

The Eyberg Child Behavior Inventory Intensity Scale (ECBI; Eyberg & Pincus, 1999) was utilized<br />

by participants in levels 4 and 5 of the Triple P Program. The ECBI is a 36‐item parent report<br />

measure of behavior problems among children. Parents indicate the frequency of common<br />

behavior problems, such as wetting the bed, whining, or having temper tantrums. Parents<br />

indicate how frequently each of the problem behaviors occur (from never to always) and<br />

whether or not they feel that the behavior is a problem (yes or no). The ECBI has good<br />

psychometric properties (reliability and validity). The ECBI is useful in determining children<br />

that may have a diagnosable disruptive behavior disorder, as well as for helping intervene to<br />

reduce early behavior problems and to reduce negative parent‐child interactions that may<br />

contribute to the development of disruptive behavior problems 31 .<br />

Family Child Care Environment Rating Scale, Revised Edition (FCCERS-R)<br />

The Family Child Care Environment Rating Scale – Revised Edition (FCCERS–R) assesses family<br />

child care programs conducted in a provider’s home, and is designed to ensure protection of<br />

children’s health and safety, appropriate stimulation through language and activities, and<br />

warm, supportive interaction. The 38 items are organized into seven subscales: Space and<br />

Furnishings, Personal Care Routines, Listening and Talking, Activities, Interaction, Program<br />

Structure, and Parents and Provider. <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is tracking four of these<br />

indicators: helping children understand language; helping children use language; using books;<br />

and staff‐child interaction. Since family child care homes frequently enroll a wide age range<br />

of children, this scale is designed to assess programs serving children from birth through<br />

school‐agers (up to 12 years of age), as well as children with special needs, and is sensitive to<br />

cultural and socioeconomic diversity. 32<br />

Healthcare Effectiveness Data and Information Set (HEDIS) Indicators<br />

<strong>First</strong> 5 uses the Healthcare Effectiveness Data and Information Set (HEDIS) data to track the<br />

quality of care that children enrolled in Healthy Kids are receiving in <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong>. A<br />

total of 10 health care quality indicators are requested annually by <strong>First</strong> 5 California and the<br />

30<br />

Review by Maria Cahill (University of Tennessee), of the User’s Guide to the Early Language & Literacy Classroom Observation Pre‐K Tool,<br />

Education Book Review website.<br />

31<br />

Berkovits, M. D., O’Brien, K. A., Carter, C. G., & Eyberg, S. M. (<strong>2010</strong>). Early identification and intervention for behavior problems in<br />

primary care: A comparison of two abbreviated versions of parent‐child interaction therapy. Behavior Therapy, 41, 375 – 387.<br />

32<br />

Environment Rating Scales – Family Child Care Environmental Rating Scale, Revised Edition: http://www.fpg.unc.edu/~ECERS/.<br />

September 18, 2009.<br />

178 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

California Endowment from every operating Healthy Kids insurance plan based on data<br />

entered into HEDIS. HEDIS is a “set of standardized performance measures designed to<br />

ensure that purchasers and consumers have the information they need to reliably compare<br />

the performance of managed health care plans.” 33<br />

Individual Growth and Development Indicators (IGDI’s)<br />

Individual Growth and Development Indicators (IGDI’s) are a set of measures designed and<br />

validated for use by early education professionals for the purpose of monitoring children’s<br />

growth and progress in early reading predictors. Unlike standardized tests that are<br />

administered infrequently, IGDI’s is designed to be used repeatedly by early childhood<br />

educators in order to estimate each child’s “rate of growth” over time. The distinctive benefit<br />

of this approach is that the information can be used to directly inform intervention design,<br />

implementation, and modification at reasonable levels of training, time, and cost. The tools<br />

provide helpful information about children’s growth in three key areas of reading predictors:<br />

picture naming (a measure of vocabulary development), rhyming, and alliteration.<br />

Infant/Toddler Environment Rating Scale, Revised Edition (ITERS-R)<br />

The Infant/Toddler Environment Rating Scale ‐ Revised Edition (ITERS‐R) is designed to assess<br />

early childhood educators working with children from birth to 30 months of age. ITERS‐R<br />

contains items to assess provision in the environment for the protection of children’s health<br />

and safety, appropriate stimulation through language and activities, and warm, supportive<br />

interaction that play an important role in improving the quality of infant/toddler care. ITERS‐<br />

R is composed of 39 items that are organized into seven subscales: Space and Furnishings,<br />

Personal Care Routines, Listening and Talking, Activities, Interaction, Program Structure, and<br />

Staff. 34 <strong>First</strong> 5 <strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> is tracking four of these indicators: helping children<br />

understand language; helping children use language; using books; and staff‐child interaction.<br />

Literacy Continuing Education Workshops: <strong>Evaluation</strong> Survey<br />

Early childhood educators who complete the SEEDS of Early Literacy classes can continue<br />

receiving professional development through the Literacy Continuing Education Workshops,<br />

where they make activities and materials that will enhance their work environment and<br />

promote literacy with young children. In this program, four workshops are provided, each<br />

with a different focus. At the end of the program, early childhood educators are asked to<br />

complete an <strong>Evaluation</strong> Survey that includes questions about each of the workshops,<br />

including how useful they were and what they liked best. Three additional open‐ended<br />

questions are asked about how the workshops support them in their work with children,<br />

what they like most about these workshops, and what recommendations they might have to<br />

improve these workshops.<br />

33 ®<br />

The Health Plan Employer Data and Information Set (HEDIS ), http://www.ncqa.org/Programs/HEDIS/index.htm, 2007.<br />

34<br />

Environment Rating Scales – Infant/Toddler Environmental Rating Scale, Revised Edition: http://www.fpg.unc.edu/~ECERS/. September<br />

18, 2009.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

179


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Migrant Education Even Start (MEES) Pre-K Letter Sound Identification<br />

Children attending the Migrant Education – Summer Pre‐K Academy and the School<br />

Readiness Program are assessed using the Pre‐K Letter Sound Identification tool, which is<br />

used to assess letter sound recognition in the child’s primary language. The MEES tool is a<br />

pre‐ and post‐program survey that allows early childhood educators to circle those letters for<br />

which the child can say the sound (not the name of the letter). Changes in children’s<br />

outcomes are evaluated by comparing the scores between their baseline and final<br />

assessments.<br />

Parent Problem Checklist<br />

The Parent Problem Checklist (Dadds & Powell, 1991) was utilized by Levels 4 and 5 of the<br />

Triple P Program. It is a 36‐item self‐assessment measure of parental and relationship<br />

conflict, completed by each parent. For each issue (e.g. disagreement over household rules),<br />

parents identify if the issue has been a problem (yes or no), and the extent to which the issue<br />

has been a problem, from not at all, to very much. It has been shown to have high internal<br />

consistency, test‐retest reliability, and convergent validity.<br />

Parenting Experience Survey<br />

The Parenting Experiences Survey (Sanders et. al., 1999) was utilized by Level 3 of the Triple P<br />

Program. It is a self‐report measure of issues related to being a parent, and was completed<br />

by parent participants. It consists of 7 items and assesses parents’ experiences related to<br />

issues such as how difficult they perceive their child to be, how stressful they feel parenting<br />

to be, and how rewarding they feel parenting to be. There are 3 items which are specific to<br />

parents that have a partner. Those items are used to assess agreement on discipline, partner<br />

support, and relationship happiness. This survey is not used as the primary measure for any<br />

of the variables that it measures, but it has been used to show changes in parental attitudes<br />

and behaviors from the beginning to the completion of the Triple P Program.<br />

Parenting Scale<br />

The Parenting Scale (Arnold, O’Leary, Wolff & Acker, 1993) was utilized by Levels 4 and 5 of<br />

the Triple P Program. It is a measure of parenting styles for handling child misbehavior,<br />

completed by parents. It consists of 30 items, which are grouped into 3 subscales: laxness,<br />

over‐reactivity, and hostility. The Parenting Scale has good test‐retest reliability, discriminant<br />

validity, and correlates with other self‐report measures of child behavior, marital discord,<br />

and child behavior.<br />

Parenting Tasks Checklist<br />

The Parenting Tasks Checklist was utilized by Levels 4 and 5 of the Triple P Program. It is a<br />

self‐report measure of confidence in parenting abilities, completed by parents. It is a 28‐item<br />

scale in which parents rate their confidence (from 0 – Certain I can’t do it to 100 – Certain I<br />

180 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

can do it), across a range of difficult child behaviors, such as managing their child when the<br />

child becomes upset, or when traveling in a car.<br />

Parent’s Attribution for Child’s Behavior Measure<br />

The Parent’s Attribution for Child’s Behavior Measure (Pigeon & Sanders, 2004) was utilized<br />

by Level 5 of the Triple P Program. It is a self‐report measure of attributions for children’s<br />

behaviors. The instrument consists of 6 hypothetical situations describing different types of<br />

difficult child behavior, with 4 questions related to each situation. The questions for each<br />

situation relate to innateness of the child’s behavior, the child’s intentionality, and the<br />

blameworthiness of the child. The total score and the 3 subscale scores for this tool have<br />

good internal consistency and discriminant validity.<br />

Peabody Picture Vocabulary Test, 4 th Edition (PPVT-4)<br />

The Peabody Picture Vocabulary Test (Dunn & Dunn, 2007) is a norm‐referenced test of<br />

receptive vocabulary, and was utilized by the PVUSD Migrant Education School Readiness<br />

Program to measure children’s listening comprehension for spoken Standard American<br />

English. It requires no reading or writing. The test is administered by showing a series of<br />

pictures to the child, with four pictures to a page. The examiner states a word describing one<br />

of the pictures and asks the child to indicate which picture that word describes. Children<br />

complete as many series of pictures as they can until a “ceiling set” is reached, based on the<br />

number of errors they are making. At that point, raw scores are calculated as the total<br />

number of items that child completed minus the total number of errors. Raw scores can be<br />

used for comparison in Pre/Post tests, or converted to standard scores, percentile ranks, or<br />

age equivalents. The PPVT‐4 assessment is currently only available in English.<br />

Phonological Awareness Literacy Screening (PALS)<br />

Migrant Education used the letter ID component of the Phonological Awareness Literacy<br />

Screening (University of Virginia, 2004) as an assessment tool in their School Readiness<br />

Program, to measure letter sound knowledge. The PALS assessment is currently only<br />

available in English, so this assessment was often combined with the MEES Pre‐K Letter<br />

Sound Identification tool, which is available in both English and Spanish.<br />

Pre-Kindergarten Observation Form (P-KOF)<br />

The Pre‐Kindergarten Observation Form (P‐KOF) was originally developed by Applied Survey<br />

Research in 2001 using guidelines from the National Education Goals Panel (NEGP)<br />

framework of readiness. Since 2001, four additional skills have been added to better capture<br />

children’s skills at negotiation, coping, empathy, and handling frustration. The Pre‐<br />

Kindergarten Observation Form is a 24‐item, observation‐based assessment used by child<br />

care providers to assess children on readiness skills pertaining to kindergarten academic<br />

skills, social expression, self‐regulation, and self‐care and motor skills. Child care providers<br />

were asked to observe and score each child according to his or her level of proficiency in<br />

FIRST 5 SANTA CRUZ COUNTY<br />

181


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

each skill, ranging from not yet to proficient (with an option of don’t know/not observed for<br />

each item). The P‐KOF has been shown to have good reliability and validity. The instrument<br />

was attached to the back of the Child Snapshot, and was utilized at certain sites within <strong>Santa</strong><br />

<strong>Cruz</strong> <strong>County</strong>.<br />

Raising A Reader: Parent Impact Survey<br />

The Parent Impact Survey was utilized by the Raising A Reader Program. It is a self‐report<br />

measure of parent and child engagement with books and library use. It consists of 29 items<br />

related to reading in the home, use of book bags, and parent‐child reading practices. Items<br />

assess current practices but there are also retrospective items which assess parent and child<br />

reading practices before program participation.<br />

Relationship Quality Index<br />

The Relationship Quality Index (Norton, 1983; also known at the Quality Marriage Index) was<br />

utilized by Levels 4 and 5 of the Triple P Program. It is a self‐report measure of relationship<br />

satisfaction, and was completed by parents. It consists of six statements related to<br />

dimensions of relationship satisfaction such as happiness, strength, and stability.<br />

Respondents indicate how much they agree or disagree with each statement, ranging from<br />

very strongly disagree, to very strongly agree.<br />

<strong>Santa</strong> <strong>Cruz</strong> <strong>County</strong> Services Unifying Network (SCC SUN) Database /<br />

CCD Data<br />

Funded partners were required to submit information on a quarterly or biannual basis on the<br />

program participants who they directly served. Client characteristic data (CCDs) were<br />

gathered in one of two ways, the SCC SUN database, and partner‐specific data collection<br />

forms. 35<br />

o The SCC SUN database was launched on January 1, 2004, and some partner agencies used<br />

this database to record their clients’ data. The database was integrated, meaning that<br />

information could be shared between agencies, if the appropriate consent was obtained.<br />

Demographic information about these clients could then be extracted for analysis, using<br />

unique IDs that maintained clients’ anonymity.<br />

o Partner agencies not using the SCC SUN database collected and submitted demographic<br />

data in partner‐specific data collection forms.<br />

In the course of evaluating these data, a “cleaning” process was performed. In this process,<br />

each program’s data were standardized to use the same response sets, reviewed for accuracy<br />

and completeness, and corrected wherever possible. These data were then migrated to a<br />

customized statistical database that aggregated them and determined the unduplicated<br />

count of individuals served by goal area, partner agency, and overall. Each client<br />

35 In this report, all client characteristic data (CCDs) collected from both the SUN database and partner‐specific data collection forms, that<br />

were then combined and comprehensively analyzed, are collectively referred to as “SUN database/CCD data.”<br />

182 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

characteristic was analyzed, with results that reported the total number of individuals with<br />

data for that variable, and the frequency and percentage of each response to that variable.<br />

o Children’s ages were determined in these ways:<br />

� For all partners except Triple P, children’s ages were calculated as of the first day of<br />

the funding cycle. This enabled all children ages 0‐5 to be included in the analyses,<br />

even if they turned six years old later in the year. Children not yet born by the first<br />

day of the funding cycle (i.e., born later in the funding cycle) were also included in<br />

the analyses and categorized as being under one year of age.<br />

� For Triple P children, their ages were calculated as of the date of their parent’s first<br />

assessments (“Pre‐assessments”), or the date of their single program session. This<br />

date was chosen since many Triple P assessments required that the child be within a<br />

certain age range for the parent to complete it. Therefore, a more exact<br />

determination of the child’s age as of the date of the assessment was needed in<br />

order to identify whether or not it was appropriate to include those data in the<br />

analysis of that assessment.<br />

o The cities where clients lived were organized into the following sub‐county areas:<br />

FIRST 5 SANTA CRUZ COUNTY<br />

SUB‐COUNTY AREA CITIES<br />

North <strong>County</strong> Bonny Doon, Capitola, Davenport, Live Oak, <strong>Santa</strong> <strong>Cruz</strong>, Scotts Valley, Soquel<br />

South <strong>County</strong> Aptos, Corralitos, Freedom, La Selva Beach, Seacliff, Watsonville<br />

San Lorenzo Valley Ben Lomond, Boulder Creek, Brookdale, Felton, Mount Hermon<br />

Structured Decision Making (SDM)<br />

The Structured Decision Making (SDM) model is a set of assessments for guiding decision‐<br />

making at each of the decision points for children in Families Together. One assessment is the<br />

SDM Family Prevention Services Screening Tool (FPSST), used to make two decisions:<br />

whether or not to offer voluntary prevention services and, if so, the frequency of ongoing<br />

case manager contact. The screening tool identifies families who have low, moderate, high,<br />

or very high probabilities of future abuse or neglect. The risk level identifies the degree of risk<br />

of future maltreatment, guides the decision to offer voluntary prevention services, and helps<br />

determine the frequency of case manager contact. 36<br />

The SDM:FPSST is also used to reassess a family in order to make two decisions: whether or<br />

not to continue voluntary prevention services past 12 months for these families receiving<br />

intensive services, and past 3 months for those receiving a brief intervention and, if so, the<br />

frequency of case manager contact. 37<br />

36 Children’s Research Center, Structured Decision Making Policy and Procedure Manual, p. 12, 2006.<br />

37 Children’s Research Center, Structured Decision Making Policy and Procedure Manual, p. 31 & 36, 2006.<br />

183


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

Triple P: Program-Specific Assessments<br />

Satisfaction Survey<br />

Multiple Sessions (Individual or Group)<br />

The Multiple Sessions Satisfaction Survey was utilized for parents who completed Levels 3, 4,<br />

and/or 5 of the Triple P Program. It consists of 16 items – 13 closed‐ended items and 3 open‐<br />

ended items. Parents assessed many different dimensions of the program including: the<br />

quality of the program, the extent to which the program met their needs and their child’s<br />

needs, how much the program helped parents deal with problems in their family or with<br />

their children, relationship improvement, child behavior improvement, and overall<br />

satisfaction.<br />

Single Sessions (Seminars & Workshops)<br />

The Single Session Satisfaction Survey was utilized for the Level 2 Seminars and Level 3<br />

Workshops of the Triple P Programs. It consists of 4 items – 3 closed‐ended questions, and 1<br />

open‐ended question. Participants filled out this short survey which assessed if they felt that<br />

the seminar or workshop addressed their questions, whether they were going to use any of<br />

the parenting strategies they learned, and if they were satisfied, overall, with the seminar or<br />

workshop. Participants could also add any additional comments they had.<br />

Follow-Up Phone Survey<br />

Parents and guardians who completed certain Triple P programs were given the option of<br />

voluntarily participating in a follow‐up phone survey six months and one year later, to help<br />

determine the long‐lasting effects of these programs on their parenting skills and<br />

experiences. This survey consisted of 18 questions, some with multiple parts, that asked<br />

about their parenting abilities and effectiveness in dealing with certain parenting problems,<br />

their confidence in their parenting skills, the Triple P strategies that they are currently using,<br />

changes in their child’s behavior, and where applicable, their relationship with and support<br />

from their partner. Participants were also given the option of commenting on their<br />

experience with the program. Participants who completed the survey were given a $25 gift<br />

certificate to Target.<br />

Effectiveness of Staff Training<br />

In addition to offering structured trainings to practitioners, Triple P America also provides<br />

measures to assess the effectiveness of such trainings. The first measure is a Parent<br />

Consultation Skills Checklist (PCSC), an instrument to gauge changes in practitioners’ ability<br />

and confidence to conduct parent consultations. The second instrument, a Workshop<br />

<strong>Evaluation</strong> Survey, is a measure of practitioners’ satisfactions with the trainings.<br />

184 FIRST 5 SANTA CRUZ COUNTY


FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT APPENDICES<br />

Parent Consultation Skills Checklist<br />

The Parent Consultation Skills Checklist (PCSC) was used to measure Triple P practitioners’<br />

self‐efficacy, or perceived competency, in core skills including assessment, active skills<br />

training, dealing with process issues, and clinical application of positive parenting strategies.<br />

Practitioners rated their proficiency on a 7‐point scale (1 = not at all confident or definitely<br />

not adequately trained, 7 = very confident or definitely adequately trained). The<br />

questionnaire was administered prior to beginning training (Pre), immediately after training<br />

(Post), and at the end of accreditation (Follow‐up).<br />

Workshop <strong>Evaluation</strong> Survey<br />

Triple P practitioners completed a Workshop <strong>Evaluation</strong> Survey at the end of each training<br />

and on completion of the accreditation process. The survey included a 7‐point scale (1 = low,<br />

7 = high) to assess the quality of the training course, whether the amount of active<br />

participation within the course was appropriate, the quality of the content of the training,<br />

whether respondents felt they had the skills to implement the program, and overall<br />

satisfaction with the training course.<br />

FIRST 5 SANTA CRUZ COUNTY<br />

185


APPENDICES FIRST 5 SANTA CRUZ COUNTY <strong>2010</strong>‐20<strong>11</strong> ANNUAL EVALUATION REPORT<br />

186 FIRST 5 SANTA CRUZ COUNTY

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!