Evaluation of prizes of the Commission

Ref.Ares(2022)8732163-15/12/2022 EvaluationofprizesoftheCommission FinalReport TetraTechInternationalDevelopmentDecember2022 EUROPEANCOMMISSION Directorate-GeneralofCommunicationDirectorateD—Resources Unit—D.1.—Planning,BudgetandEvaluation Contact:SonjaZiemer E-mail:COMM-EVALUATION@ec.europa.eu EuropeanCommissionB-1049Brussels EUROPEANCOMMISSION EvaluationofprizesoftheCommission (Ref.COMM/01/2021/Lot) FinalReport 2022 Directorate-GeneralforCommunication[EvaluationofprizesoftheCommission] LEGALNOTICE ThisdocumenthasbeenpreparedfortheEuropeanCommissionhoweveritreflectstheviewsonlyoftheauthors,andtheEuropeanCommissionisnotliableforanyconsequencestemmingfromthereuseofthispublication.MoreinformationontheEuropeanUnionisavailableontheInternet(http://www.europa.eu). ManuscriptcompletedinDecember2022 TheEuropeanCommissionisnotliableforanyconsequencestemmingfromthereuseofthispublication. ©EuropeanUnion,2022 ThereusepolicyofEuropeanCommissiondocumentsisimplementedbytheCommissionDecision2011/833/EUof12December2011onthereuseofCommissiondocuments(OJL330,14.12.2011,p.39).Exceptotherwisenoted,thereuseofthisdocumentisauthorisedunderaCreativeCommonsAttribution4.0International(CC-BY4.0)licence(https://creativecommons.org/licenses/by/4.0/).Thismeansthatreuseisallowedprovidedappropriatecreditisgivenandanychangesareindicated. ForanyuseorreproductionofelementsthatarenotownedbytheEuropeanUnion,permissionmayneedtobesoughtdirectlyfromtherespectiverightholders. Tableofcontents Listofabbreviations6 1.EXECUTIVESUMMARY7 1.1.Methodology7 1.2.OverviewofEuropeanCommissionprizes8 1.3.Conclusions9 1.4.Recommendations11 2.INTRODUCTION13 3.OVERVIEWOFTHEEVALUATION14 4.OVERVIEWOFEUROPEANCOMMISSIONPRIZES20 5.ANSWERSTOTHEEVALUATIONQUESTIONS26 5.1.Relevance26 5.2.Efficiency51 5.3.Effectiveness66 5.4.Coherence93 5.5.EUAddedValue100 6.CONCLUSIONSANDRECOMMENDATIONS107 6.1.Conclusions107 6.2.Recommendations111 6.3.Recommendationsforthecommunicationofprizes114 ANNEX1:CHECKLISTWITHCONDITIONSFORSETTINGUPAPRIZE118 ANNEX2:KEYPERFORMANCEINDICATORS(KPIS)FORPRIZES118 ANNEX3:SURVEYANALYSISREPORTS118 ANNEX4:NON-EUPRIZES:CASESTUDYREPORTS118 ANNEX5:ECPRIZES:CASESTUDYREPORTS118 ANNEX6:MAPPINGOFECPRIZES118 ANNEX7:LITERATUREREVIEW118 ANNEX8:ASSESSMENTOFCOMMISSIONWEBPAGEDEDICATEDTOPRIZES118 Listofabbreviations CN CommunicationNetwork DGAGRI Directorate-GeneralforAgricultureandRuralDevelopment DGCOMM Directorate-GeneralforCommunication DGEAC Directorate-GeneralforEducation,Youth,SportandCulture DGEMPL Directorate-GeneralforEmployment,SocialAffairsandInclusion DGENV Directorate-GeneralforEnvironment DGGROW Directorate-GeneralforInternalMarket,Industry,EntrepreneurshipandSMEs DGMOVE Directorate-GeneralforMobilityandTransport DGNEAR Directorate-GeneralforNeighbourhoodandEnlargementNegotiations DGRTD Directorate-GeneralforResearchandInnovation DGTRADE Directorate-GeneralforTrade EC EuropeanCommission EP EuropeanParliament EEN EnterpriseEuropeNetwork EEPA EuropeanEnterprisePromotionAward EIC EnergyIndustriesCouncil EITA EuropeanInnovationinTeachingAwards EISMEA EuropeanInnovationCouncilandSmallandMedium-SizedEnterprisesExecutiveAgency EQ Evaluationquestion EU EuropeanUnion FTE Full-timeequivalent GDPR GeneralDataProtectionRegulation HoC HeadofCommunication JC Judgementcriteria KPI Keyperformanceindicators MS MemberState OECD OrganisationforEconomicCo-operationandDevelopment SME Smallandmedium-sizedenterprise SWOT Strengths,weaknesses,opportunities,threats ToR TermsofReference UI Userinterface UNESCO UnitedNationsEducational,ScientificandCulturalOrganization UX Userexperience 1.ExecutiveSummary TheDirectorate-GeneralforCommunicationoftheEuropeanCommissioncontractedTetraTechInternationalDevelopmentSp.z.o.o.toundertaketheevaluationofprizesoftheCommission,withthesupportofNetcompanyIntrasoft.Theevaluationwaslaunchedon17November2021andthekickoffmeetingtookplaceon26November2021. Theobjectivesoftheevaluation,accordingtotheTermsofReference,wereto: betterunderstandthepositionoftheCommission’sprizesinthebroaderlandscapeoftheEUandinternationalprizes; evaluatethepotentialofeffectivenessandefficiencygainsbyassessingtheexistingprizes’relevance,effectiveness,efficiency,coherence,EU-addedvalue; assessthepotentialofincreasingprizes’communicationvalueandtorecommendmeasuresforrationalisationandincreasedcommunicationimpact; designamorestrategicapproachtotheirfutureusebytheCommission. 1.1.Methodology Theevaluationmethodologywasdesignedtoaddresstheobjectiveslistedaboveaswellastoanswer19evaluationquestionsunderthefiveBetterRegulationevaluationcriteriaofrelevance,effectiveness,efficiency,coherenceandEU-addedvalue).TheevaluationmethodologyallowedanassessmentofthebreadthanddepthoftheEClandscapeofprizes,aswellastheconsiderationofhowprizesaremanagedoutsidetheEU. ThestudystartedwithamappingexerciseofCommissionprizes,basedonaninitialmappingcarriedoutbytheCommissionin2018,whichidentified101prizes.Themappingwithinthisevaluationidentifiedthattherewereatleast181prizesin2018-2021period,andthatthenu