Youth Employment Programs - Independent Evaluation Group

ment, Private Sector Development, and Agriculture that became effectivesince 2001 (including PADs, concept notes, program documents,ICRs, ICR reviews, implementation status reports, PPARs, and countrystrategies).• Reviews of project documents and studies of projects and programs undertakenby other institutions, such as bilateral donor agencies, developmentbanks, the ILO, and so on.• Reviews of research documents, AAA documents, evaluations, reportspublished in the peer-reviewed literature by the World Bank Group andother institutions. The analytical material consulted included, amongothers: youth employment reviews, poverty assessments, country educationsector reviews, country labor market reviews, public expenditurereviews, country economic memoranda, beneficiary assessments, impactevaluations, and country social protection strategies.• Interviews with key World Bank Group staff involved in youth employmentsupport to the countries (3–5 interviews per country). The countriesthat involved field missions also included extensive interviewswith clients, key stakeholders, and development partners.Analysis. The case studies used a 17-page structured questionnaire based onthe MILES framework. The survey covered: (i) issues in youth employment;(ii) government and private sector interventions to promote youthemployment; (iii) support by the World Bank Group and other developmentpartners to promote youth employment and; (iv) evaluation of World BankGroup support to youth employment. Some questions were factual whileothers required an evaluative judgment based on data and evidence tosupport the assessment.Seven IEG staff and consultants undertook the 18 case studies. At the start ofthe work, IEG organized a one-day workshop for the team to review the casestudy questionnaire, data sources, and methodology, and reach a commonunderstanding of required information and the basis for assessment. Onepanel reviewer vetted all 18 draft case studies to ensure consistency andevidence base.At the end of the process, detailed information was compiled about youthemployment issues and interventions in the 18 countries. Issue notes wereprepared related to the main evaluation questions. Analytical evidence fromthe case studies was triangulated with evidence from other evaluation inputsand incorporated into the final report.Systematic-Review of Impact EvaluationsIdentification of Impact Evaluations. The English language evaluationliterature written since 2000 was reviewed for inclusion in this systematicreview. The literature was identified with an online search using EconLit,Google Scholar, Journal Storage (JSTOR), Development Impact Evaluation(DIME), ILO, the Institute for the Study of Labor (IZA), the Abdul Latif JameelAppendix B: Evaluation Data Sources and Methods 81