Evaluating the EBRD's work

Latest evaluation reports

Climate Initiatives Special Study

Recognition of climate change as a major global public policy challenge has grown since key concerns were raised in 1992. The G8 elevated the importance of climate change in 2005 and there have been a series of international initiatives since that time. In 2015 developed countries were urged to mobilize US$100bn annually by 2020 and a comprehensive framework was agreed in Paris based on enforceable country-level commitments to carbon targets.  Against this backdrop EBRD substantially increased the strategic priority to be given to work on sustainability and, more specifically, climate.  This evaluation reviews the main climate initiatives in terms of strategic objectives, operational focus and instruments, organization arrangements, portfolio structure, and performance. It confirms that EBRD has initiated major steps on an institution-wide basis to respond to shareholder directions.  At the same time, the evaluation also confirms opportunities to strengthen existing approaches and the pressing need to improve processes. This includes much improved clarity as to priorities and objectives, particularly with respect to results; a more systematic and transparent approach to allocating resources; and, building capacity to assess actual results in accordance with country needs. 

Delegate Authority

This study was requested by the Board Effectiveness and Efficiency Group, following the implementation by the Bank of a pilot, which increased the EBRD’s delegated authority threshold from €10 million to €25 million. On the completion of this pilot, the increased threshold became the Bank’s permanent policy. At the same time, the Evaluation Department (EvD) was asked to analyse the changes in the Bank’s approvals structure, quality of information provided to the Board on sub-projects approved by delegation, as well as quality of reporting on framework and sub-project performance.

Property Sector Strategy Evaluation

The EBRD’s 2010 Property Strategy was strongly shaped by the financial crisis of 2008, which hit the Property and Tourism sector (P&T) particularly hard. “Crisis response” was an immediate and dominant operational priority.  Longer-term, the Strategy’s objectives were limited to a demonstration of energy efficiency in buildings, “institution building” and an increased emphasis on projects in less advanced countries and secondary cities.
During the Strategy period (2010-2017) the Bank financed 65 P&T projects for €1.18 billion, broadly unchanged from under the previous strategy; sub-sectoral and country composition of operations were also similar, albeit with sharply lower post-crisis investments into property funds.

Legal Transition Programme

Since its launch in 1995 as an ad hoc technical assistance resource, the EBRD’s Legal Transition Programme has been through many transformations. Presently it is a key driver of legal reforms in the Bank’s countries of operation. 

The Evaluation Department’s (EvD) 2018 Work Programme includes a thematic evaluation of the LTP, which will focus on the impact and sustainability of activities approved and implemented over the period 2011-2018.

The evaluation team has identified several evaluation questions that will guide the analysis and shape final findings and recommendations. The emphasis of the evaluation will centre on efficiency, effectiveness, impact, and sustainability both externally (benefiting the country) and internally (benefiting the Bank’s own policies and operations).   The evaluation  will also include three or four case studies, which will be representative of various transition stages.

Credit Lines – Lending through financial intermediaries

Lending through financial intermediaries, widely known internally as “credit lines,” has been a significant part of the Bank's operations since its inception. Credit lines have allowed it to reach larger numbers of smaller borrowers than possible through direct lending, and alongside other forms of support have contributed to financial sector development and growth of strong partner intermediaries. They have also evolved significantly over time and are critical instruments for delivery by the Bank on a wide and ambitious range of new commitments.

This evaluation examines the design, targeting, execution, monitoring and effects of a large sample of recent credit lines, defined for its purposes as “term loans extended to financial intermediaries with a defined use of proceeds.” and focuses principally on the market context, strategic approach and signed operations of the period 2011-2015.

Transport Sector Strategy Review

The transport sector is a key enabler of economic growth and transition in the region and investment in the sector has been central to the Bank’s strategy and operations since its inception in 1992.   This is a review of the Bank’s 2013 Transport Sector Strategy and resulting operations; it is intended to inform Management development and Board consideration of a planned new sector strategic document in early 2019.

EvD outlined the intended focus of its review in an Approach Paper discussed and agreed with Management. Three evaluation questions were asked: whether the TSS set appropriate priorities; what results are observable while the strategic period is not ended yet and how well the Bank has implemented the strategy. EvD reviewed 82 operations approved between January 2013 and May 2017 amounting to nearly €5billion, together with data on 114 transport TC operations for €40.5 million.

The EBRD’s Investment Climate Support Activities

Mobilizing private capital has been central to the Bank’s core transition mandate since its founding, and to achieving major recent institutional commitments such as supporting the SDGs, climate resilience, and inclusion. Significantly greater private investment, both domestic and foreign, is in turn critically dependent upon a supportive investment climate, which has long been identified as a strategic and operational priority for the Bank and an area of comparative advantage.

This EvD study identifies the principal objectives and components of the Bank’s work on investment climate (IC) improvement, assesses the effectiveness of design and delivery, and presents findings and conclusions that may contribute to programmatic performance in the future. Its intended scope includes efficiency and resource deployment across multiple work streams and observable contributions toward IC improvements, including analysis of the Investment Climate and Governance Initiative (ICGI) and other initiatives, and case studies. Its principal purpose is to draw out findings relevant to existing and emerging operational and strategical priorities and provide evidence-based insights useful for future programme design and delivery and internal learning.

EBRD Country Strategies Review

The proposed study is intended to:

  1. contribute to the further development and implementation of new country strategies and the overall results architecture of the Bank;
     
  2. assess to what extent the new approach to country strategy design and implementation enables the Bank to more effectively identify and translate its mandate and medium-term priorities into country-level objectives; recognise, measure, and report on its performance, and to deliver value for shareholders and other stakeholders.

Infrastructure Project Preparation Facility – Thematic evaluation

Large infrastructure financing gaps in EBRD countries of operation have long been identified as a key challenge and opportunity for the Bank. There is an increasing recognition that traditional government funding and methods are not sufficient to close growing gaps, and increased private sector engagement is now widely understood to be essential.

The EBRD Infrastructure Project Preparation Facility (IPPF) was a high profile initiative approved by the Board in October 2014 to scale up infrastructure support. As a “delivery mechanism to improve the efficiency, quality and replicability of infrastructure projects,” the IPPF is meant to help governments build an infrastructure project pipeline using additional and improved project preparation support along with policy dialogue. 

On approval of the IPPF the Board requested a stock taking after three years and this interim review by the Evaluation Department is intended to assess IPPF’s performance against its wider objectives, identifying any early results and difficulties, and its potential to be a co-investment multi donor fund for specific countries and sectors.
 

Review of the EBRD Energy Sector Strategy

The Review of the 2013 EBRD Energy Sector Strategy investigates key issues around: what were the stated intentions and expectations of the 2013 Energy Sector Strategy; how did it reflect and integrate transition challenges and develop operational priorities; were clear and measurable goals established; were critical execution issues such as resources and cross-institutional collaboration addressed effectively; what results are observable thus far. Lastly, the Review identifies actionable recommendations for the next EBRD Energy Sector Strategy to be approved by end 2018.

Additionality in the EBRD – Review of Concept and Application

Additionality is one of EBRD’s three foundational operating mandates. It has featured centrally since 1992 in investment selection and design, in Bank representations of its role and purpose, and in Board/shareholder engagement with Management. For EBRD shareholders Additionality is the foundation of their claim for public resources and therefore has been of consistently high interest and concern.  This review seeks to fill some gaps that exist around additionality in EBRD and contribute to emerging Board and Management efforts to develop a stronger and more satisfactory institutional framework.

Read review