PublicDisclosureAuthorized PublicDisclosureAuthorized PublicDisclosureAuthorized PublicDisclosureAuthorized ImprovingTeachersandSchoolLeadershipinIndonesia ImpactEvaluationofGuruPenggerakProgramatthePrimaryLevel NoviandriN.Khairina,NoahYarrow,JacobusCilliers,andIndahS.Z.Dini. ImprovingTeachersandSchoolLeadershipinIndonesia:ImpactEvaluationofGuruPenggerakProgramatthePrimaryLevel ThisreportwaspreparedbyNoviandriN.Khairina,NoahYarrow,JacobusCilliers,andIndahS.Z.Dini. Acknowledgement ThisworkisaproductofthestaffofTheWorldBank.FinancialsupportforthisworkwasgenerouslyprovidedbytheAustralianGovernmentthroughtheAustralia-WorldBankIndonesiaPartnership(ABIP).ThisresearchproductalsobenefitedfromadditionalfinancingthatcomesfromtheChina-WorldBankTrustFund.Thefindings,interpretations,andconclusionsexpressedinthisworkdonotnecessarilyreflecttheviewsoftheExecutiveDirectorsofTheWorldBankorthegovernmentstheyrepresent.TheWorldBankdoesnotguaranteetheaccuracyofthedataincludedinthiswork.Theboundaries,colors,denominations,andotherinformationshownonanymapinthisworkdonotimplyanyjudgmentonthepartofTheWorldBankconcerningthelegalstatusofanyterritoryortheendorsementoracceptanceofsuchboundaries. RightsandPermissions ©2023TheWorldBank 1818HStreetNW,WashingtonDC20433 Telephone:202-473-1000;Internet:www.worldbank.org Somerightsreserved Thematerialinthisworkissubjecttocopyright.BecauseTheWorldBankencouragesdisseminationofitsknowledge,thisworkmaybereproduced,inwholeorinpart,fornon-commercialpurposesaslongasfullattributiontothisworkisgiven. Allqueriesonrightsandlicenses,includingsubsidiaryrights,shouldbeaddressedtoWorldBankPublications,TheWorldBankGroup,1818HStreetNW,Washington,DC20433,USA;fax:202-522-2625;e-mail:pubrights@worldbank.org. Attribution Pleasecitetheworkasfollows:Khairina,Noviandri;Yarrow,Noah;Cilliers,Jacobus;Dini,Indah.2023.ImprovingTeachersandSchoolLeadershipinIndonesia:ImpactEvaluationofGuruPenggerakProgramatthePrimaryLevel.WorldBank,Jakarta.©WorldBank. ContactInformation Theauthorscanbecontactedatnkhairina@worldbank.org,ejc93@georgetown.edu,idini@worldbank.org. PhotoCredit: CoverandChapterOpening:Freepik,Midjourney IMPROVINGTEACHERSANDSCHOOLLEADERSHIPININDONESIA:IMPACTEVALUATIONOFGURUPENGGERAKPROGRAMATTHEPRIMARYLEVEL03 TableofContents TableofContents 4 TablesandFigures 4 Abbreviationsandacronyms 5 Acknowledgement 5 ExecutiveSummary 6 1.UnderstandingtheContext:Indonesia’sEducationSystem 10 2.NewWaveofReforms:EmancipatedLearning 12 3.TheProgram–PendidikanGuruPenggerak(PGP) 14 ProgramDesign,Delivery,andCurriculum 14 Selectionprocess 16 TheoryofChange 17 4.Methodology 18 EmpiricalApproachfortheImpactEvaluation—RegressionDiscontinuityDesign 18 SampleSelection-ExaminingtheCutoffforSelection 19 Limitations 21 5.DataandInstruments 22 ImplementationAssessment(phonesurvey) 22 SchoolVisitforImpactEvaluation 23 Instruments 23 ConstructionofIndicatorsandIndices 28 TimingofDataCollection 28 DescriptiveStatistics 28 6.Results 30 PhoneSurveyforImplementationAssessmentResults 30 ImpactEvaluationResults 33 QualityofImplementationandOtherTrainingPrograms 34 Self-reflectingandSelf-improvingTeachers 36 Student-centeredTeaching 37 Leadership:CommunitiesofLearning,Coaching,andSchoolvision 42 AdditionalFindingsfromThisEvaluation 44 7.ConclusionsandRecommendations 48 References 52 Appendix1–PendidikanGuruPenggerak 53 Appendix2–TeachClassroomObservationInstrument: 60 Appendix3–EmpiricalStrategy 64 Appendix4–AdditionalTablesandResults 65 ListofTables Table1 Comparisonof'Penggerak’programsintheMerdekaBelajarreform 12 Table2 SampleforPhoneSurveyandSchoolVisitDataCollection 22 Table3 SummaryofPhoneSurveyDataCollection 23 Table4 MappingbetweenMoECRT’sgroupingsoffinaloutcomesandourevaluationinstruments 24 Table5 DescriptionoftheTeachclassroomobservationinstrument 26 Table6 SummaryoftheMoECRTclassroomobservationinstrument 27 Table7 TeacherCharacteristics-byPGP 29 Table8 Summaryofmainresults 33 Table9 QualityofImplementationbyDistrict 34 Table10 Exposuretotraining(byselectionintoBatch5) 35 Table11 TOCI.Self-reflectionandself-development 36 Table12 Leadershipconfidenceandaspirations 46 Table13 Leadershipconfidenceandaspirations(bygender) 47 Table14 SchoolPrincipal’sperceptionoftheteacher’sleadershipability 47 Table15 TEACHResults 62 Table16 OverviewofTEACHInstrument 63 ListofFigures Figure1 PendidikanGuruPenggerak–ProgramDesign 15 Figure2 PGPActorsrolesandrelationships 16 Figure3 PGPTheoryofChange:FinalOutcome 17 Figure4 LocationofSampleDistricts 20 Figure5 Distributionofsampledteachersbyassignmenttotreatment 20 Figure6 TherelationshipbetweentherunningvariableandtheprobabilityofbeingselectedtoparticipateinPGP 21 Figure7 TimelineofDataCollection 28 Figure8 Qualityofimplementationfordifferentcomponentsoftheprogram 30 Figure9 Distributionofperceivedqualityofthefacilitators,instructors,andmentors 31 Figure10 District-levelvariationinperceivedqualityofthefacilitator,instructorandmentor 31 Figure11 MentorTrainingEffectiveness 32 Figure12 Howwork