A key objective of the United Nations Development Programme (UNDP) is to assist its member countries in meeting the Millennium Development Goals (MDGs). UNDP pursues this objective in various ways, including through analysis and advice to governments on the progress towards the MDGs (such as support for the preparation and monitoring Poverty Reduction Strategies, or PRSs, in poor countries), assistance for capacity building, and financial and technical support for the preparation and implementation of development programs.

The challenge of achieving the MDGs remains daunting in many countries, including Tajikistan. To do so will require that all development partners, i.e., the government, civil society, private business and donors, make every effort to scale up successful development interventions. Scaling up refers to “expanding, adapting and sustaining successful policies, programs and projects on different places and over time to reach a greater number of people.” Interventions that are successful as pilots but are not scaled up will create localized benefits for a small number of beneficiaries, but they will fail to contribute significantly to close the MDG gap.

This paper aims to assess whether and how well UNDP is supporting scaling up in its development programs in Tajikistan. While the principal purpose of this assessment was to assist the UNDP country program director and his team in Tajikistan in their scaling up efforts, it also contributes to the overall growing body of evidence on the scaling up of development interventions worldwide.

Downloads

• Download Full Paper

Editor's Note: The World Bank’s Independent Evaluation Group (IEG) recently published a self-evaluation of its activities. Besides representing current thinking among evaluation experts at the World Bank, it also more broadly reflects some of the strengths and gaps in the approaches that evaluators use to assess and learn from the performance of the international institutions with which they work. The old question “Quis custodet ipsos custodes?” – loosely translated as “Who evaluates the evaluators?” – remains as relevant as ever. Johannes Linn served as an external peer reviewer of the self-evaluation and provides a bird’s-eye view on the lessons learned.

An Overview of the World Bank’s IEG Self-Evaluation Report

In 2011 the World Bank’s Independent Evaluation Group (IEG) carried out and published a self-evaluation of its activities. The self-evaluation team was led by an internal manager, but involved a respected external evaluation expert as the principal author and also an external peer reviewer.

The IEG self-evaluation follows best professional practices as codified by the Evaluation Cooperation Group (ECG). This group brings together the evaluation offices of seven major multilateral financial institutions in joint efforts designed to enhance evaluation performance and cooperation among their evaluators. One can therefore infer that the approach and focus of the IEG self-evaluation is representative of a broader set of practices that are currently used by the evaluation community of international financial organizations.

At the outset the IEG report states that “IEG is the largest evaluation department among Evaluation Capacity Group (ECG) members and is held in high regard by the international evaluation community. Independent assessments of IEG’s role as an independent evaluation function for the Bank and IFC rated it above the evaluation functions in most other ECG members, international nongovernmental organizations, and transnational corporations and found that IEG follows good practice evaluation principles.”

The self-evaluation report generally confirms this positive assessment. For four out of six areas of its mandate IEG gives itself the second highest rating (“good”) out of six possible rating categories. This includes (a) the professional quality of its evaluations, (b) its reports on how the World Bank’s management follows up on IEG recommendations, (c) cooperation with other evaluation offices, and (d) assistance to borrowing countries in improving their own evaluation capacity. In the area of appraising the World Bank’s self-evaluation and risk management practices, the report offers the third highest rating (“satisfactory”), while it gives the third lowest rating (“modest”) for IEG’s impact on the Bank’s policies, strategies and operations. In addition the self-evaluation concludes that overall the performance of IEG has been “good” and that it operates independently, effectively and efficiently.

The report makes a number of recommendations for improvement, which are likely to be helpful, but have limited impact on its activities. They cover measures to further enhance the independence of IEG and the consistency of evaluation practices as applied across the World Bank Group’s branches – the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA) –; to improve the design of evaluations and the engagement with Bank management upstream for greater impact; and monitoring the impact of recent organizational changes in IEG in terms of results achieved. The report also recommends that more be done to evaluate the Bank’s analytical work and that evaluations draw on comparative evidence.

Assessment

In terms of the parameters of self-evaluation set by the prevailing practice among the evaluators on international financial agencies, the IEG self-evaluation is accurate and helpful. From my own experience as an operational manager in the Bank whose activities were evaluated by IEG in years past, and as a user of IEG evaluations (and of evaluations of other international aid organizations) for my research on aid effectiveness, I concur that IEG is independent and effective in meeting its mandate as defined. Moreover, the self-evaluation produces useful quantitative evidence (including survey results, budget analysis, etc.) to corroborate qualitative judgments.

However, the self-evaluation suffers from a number of limitations in approach and gaps in focus, which are broadly representative of the practices prevalent among many of the evaluation offices of international aid agencies.

Approach of the IEG self-evaluation

The core of the self-evaluation report is about the evaluation process followed by IEG, with very little said about the substance of IEG’s evaluations. The following questions could have usefully been raised, but were not: do evaluations cover the right issues with the right intensity, such as growth and poverty; environmental, governance, and gender impacts; regional dimensions versus exclusive country or project focus; effectiveness in addressing the problems of fragile and conflict states; effectiveness in dealing with global public goods; sustainability and scaling up; etc. Therefore the report does not deal with the question of whether IEG effectively responds in its evaluations to the many important strategic debates and issues with which the development community is grappling.

Related to this limitation is the fact that the report assessed the quality of IEG’s mostly in terms of (a) whether its approach and processes meet certain standards established by the Evaluation Cooperation Group; and (b) how it is judged by stakeholders in response to a survey commissioned for this evaluation. Both these approaches are useful, but they do not have any basis in professional assessments of the quality of individual products. This is equivalent to IEG evaluating the World Bank’s projects on the quality of its processes (e.g., appraisal and supervision processes) and on the basis of stakeholder surveys, without evaluating individual products and their impacts.

Gaps in the Self-Evaluation and in Evaluation Practice

Careful reading of the report reveals six important gaps in the IEG self-evaluation, in the prevailing evaluation practice in the World Bank, and more generally in the way international financial organizations evaluate their own performance. The first three gaps relate to aspects of the evaluation approach used and the second three gaps relate to lack of focus in the self-evaluation on key internal organizational issues:

1. Impact Evaluations: The report notes that IEG carries out two to three impact evaluations per year, but it sidesteps the debate in the current evaluation literature and practice as to what extent the “gold standard” of randomized impact evaluation should occupy a much more central role. Given the importance of this debate and divergence of views, it would have been appropriate for the self-evaluation to assess IEG’s current practice of very limited use of randomized evaluations.

2. Evaluation of Scaling Up: The report does not address the question of to what extent current IEG practice not only assesses the performance of individual projects in terms of their outcomes and sustainability, but also in terms of whether the Bank has systematically built on its experience in specific projects to help scale up their impact through support for expansion or replication in follow-up operations or through effective hand-off to the government or other partners. In fact, currently IEG does not explicitly and systematically consider scaling up in its project and program evaluations. For example, in a recent IEG evaluation of World Bank funded municipal development projects (MDPs) , IEG found that the Bank has supported multiple MDPs in many countries over the years, but the evaluation did not address the obvious question whether the Bank systematically planned for the project sequence or built on its experience from prior projects in subsequent operations. While most other evaluation offices like IEG do not consider scaling up, some (in particular those of the International Fund for Agricultural Development and the United Nations Development Program) have started doing so in recent years.

3. Drawing on the Experience of and Benchmarking Against Other Institutions: The self-evaluation report does a good job in benchmarking IEG performance in a number of respects against that of other multilateral institutions. In the main text of the report it states that “IEG plans to develop guidelines for approach papers to ensure greater quality, in particular in drawing on comparative information from other sources and benchmarking against other institutions.” This is a welcome intention, but it is inadequately motivated in the rest of the report and not reflected in the Executive Summary. The reality is that IEG, like most multilateral evaluation offices, so far has not systematically drawn on the evaluations and relevant experience of other aid agencies in its evaluations of World Bank performance. This has severely limited the learning impact of the evaluations.

4. Bank Internal Policies, Management Processes and Incentives: IEG evaluations traditionally do not focus on how the Bank’s internal policies, management and incentives affect the quality of Bank engagement in countries. Therefore evaluations cannot offer any insights into whether and how Bank-internal operating modalities contribute to results. Two recent exceptions are notable exceptions. First, the IEG evaluation of the Bank’s approach to harmonization with other donors and alignment with country priorities assesses the incentives for staff to support harmonization and alignment. The evaluation concludes that there are insufficient incentives, a finding disputed by management. Second, is the evaluation of the Bank’s internal matrix management arrangements, which is currently under way. The self-evaluation notes that Bank management tried to quash the matrix evaluation on the grounds that it did not fall under the mandate of IEG. This is an unfortunate argument, since an assessment of the institutional reasons for the Bank’s performance is an essential component of any meaningful evaluation of Bank-supported programs. While making a good case for the specific instance of the matrix evaluation, the self-evaluation report shies away from a more general statement in support of engaging IEG on issues of Bank-internal policies, management processes and incentives. It is notable that IFAD’s Independent Office of Evaluation appears to be more aggressive in this regard: It currently is carrying out a full evaluation of IFAD’s internal efficiency and previous evaluations (e.g., an evaluation of innovation and scaling up) did not shy away from assessing internal institutional dimensions.

5. World Bank Governance: The IEG self-evaluation is even more restrictive in how it interprets its mandate regarding the evaluation of the World Bank’s governance structures and processes (including its approach to members’ voice and vote, the functioning of its board of directors, the selection of its senior management, etc.). It considers these topics beyond IEG’s mandate. This is unfortunate, since the way the Bank’s governance evolves will substantially affect its long-term legitimacy, effectiveness and viability as an international financial institution. Since IEG reports to the Bank’s board of directors, and many of the governance issues involve questions of the board’s composition, role and functioning, there is a valid question of how effectively IEG could carry out such an evaluation. However, it is notable that the IMF’s Independent Evaluation Office, which similarly reports to the IMF board of directors, published a full evaluation of the IMF’s governance in 2008, which effectively addressed many of the right questions.

6. Synergies between World Bank, IFC and MIGA: The self-evaluation report points out that the recent internal reorganization of IEG aimed to assure more effective and consistent evaluations across the three member branches of the World Bank Group. This is welcome, but the report does not assess how past evaluations addressed the question of whether the World Bank, IFC and MIGA effectively capitalized on the potential synergies among the three organizations. The recent evaluation of the World Bank Group’s response to the global economic crisis of 2008/9 provided parallel assessments of each agency’s performance, but did not address whether they work together effectively in maximizing their synergies. The reality is that the three organizations have deeply engrained institutional cultures and generally go their own ways rather than closely coordinating their activities on the ground. Future evaluations should explicitly consider whether the three effectively cooperate or not. While the World Bank is unique in the way it has organizationally separated its private sector and guarantee operations, other aid organizations also have problems of a lack of cooperation, coordination and synergy among different units within the agency. Therefore, the same comment also applies to their evaluation approaches.

Conclusions

Self-evaluations are valuable tools for performance assessment and IEG is to be congratulated for carrying out and publishing such an evaluation of its own activities. As for all self-evaluations, it should be seen as an input to an independent external evaluation, a decision that, for now, has apparently been postponed by the Bank’s board of directors.

IEG’s self-evaluation has many strengths and provides an overall positive assessment of IEG’s work. However, it does reflect some important limitations of analysis and of certain gaps in approach and coverage, which an independent external review should consider explicitly, and which IEG’s management should address. Since many of these issues also likely apply to most of the other evaluation approaches by other evaluation offices, the lessons have relevance beyond IEG and the World Bank.

Key lessons include:

• An evaluation of evaluations should focus not only on process, but also on the substantive issues that the institution is grappling with.
• An evaluation of the effectiveness of evaluations should include a professional assessment of the quality of evaluation products.
• An evaluation of evaluations should assess:
  o How effectively impact evaluations are used;
  o How scaling up of successful interventions is treated;
  o How the experience of other comparable institutions is utilized;
  o Whether and how the internal policies, management practices and incentives of the institution are effectively assessed;
  o Whether and how the governance of the institution is evaluated; and
  o Whether and how internal coordination, cooperation and synergy among units within the organizations are assessed.

Evaluations play an essential role in the accountability and learning of international aid organizations. Hence it is critical that evaluations address the right issues and use appropriate techniques. If the lessons above were reflected in the evaluation practices of the aid institutions, this would represent a significant step forward in the quality, relevance and likely impact of evaluations.

Since its 50th anniversary in 1994, the World Bank has been led by four presidents: Lewis Preston until his untimely death in 1995; then James Wolfensohn, who gave the institution new energy, purpose and legitimacy; followed by Paul Wolfowitz, whose fractious management tossed the World Bank into deep crisis; and most recently, Robert Zoellick, who will be remembered for having stabilized the bank and provided effective leadership during its remarkably swift and strong response to the global financial crisis.

Throughout these years of ups and downs in the bank’s leadership, standing and lending, the overall trend of its global role was downhill. While it remains one of the world’s largest multilateral development finance institutions, its position relative to other multilateral financing mechanisms is now much less prominent. Other multilateral institutions have taken over key roles. For example, the European Union agencies and the regional development banks have rapidly expanded their portfolios, and new “vertical funds” such as the Global Fund for AIDS, Tuberculosis and Malaria have become major funding vehicles. At the same time, according to a 2011 OECD Development Assistance Committee report multilateral aid has declined as a share of total aid. Meanwhile, non-governmental aid flows have dramatically increased, including those from major foundations like the Bill and Melinda Gates Foundation, but also from new internet-based channels bundling small individual donations, such as Global Giving. The World Bank— which 20 years ago was still the biggest and most powerful global development agency and hence a ready target for criticism— today is just one of the many institutions that offer for development to the poor and emerging market economies.

Against this backdrop, the World Bank, its members and Dr. Kim face three options in its long-term trajectory over the next 10 to 20 years: 1) the bank can continue on its current path of gradual decline; 2) it might be radically scaled back and eventually eliminated, as other aid channels take over; or 3) it can dramatically reinvent itself as a global finance institution that bundles resources for growing global needs.

There is no doubt in this author’s mind that the World Bank should remain a key part of the global governance architecture, but that requires that the new president forge an ambitious long-term vision for the bank – something that has been lacking for the last 30 years – and then reform the institution and build the authorizing environment that will make it possible to achieve the vision.

Option 1: “Business as Usual” = Continued Gradual Decline

The first option, reflecting the business-as-usual approach that characterized most of the Zoellick years of leadership will mean that the bank will gradually continue to lose in scope, funding and relevance. Its scope will be reduced since the emerging market economies find the institution insufficiently responsive to their needs. They have seen the regional development banks take on increasing importance, as reflected in the substantially greater capital increases in recent years for some of these institutions than for the World Bank in relative terms (and in the case of the Asian Development Bank, even in absolute terms). And emerging market economies have set up their own thriving regional development banks without participation of the industrial countries, such as the Caja Andina de Fomento (CAF) in Latin America and the Eurasian Development Bank in the former Soviet Union. This trend will be reinforced with the creation of a “South Bank” or “BRIC Bank”, an initiative that is currently well underway.

At the same time, the World Bank’s soft loan window, the International Development Association (IDA), will face less support from industrial countries going through deep fiscal crises, heightened competition from other concessional funds, and a perception of reduced need, as many of the large and formerly poor developing countries graduate to middle-income status. It is significant that for the last IDA replenishment much of the increase in resources was due to its growing reliance on advance repayments made by some of its members and commitments against future repayments, thus in effect mortgaging its future financial capacity. The World Bank’s status as a knowledge leader in development will also continue to be challenged with the rise of research from developing countries and growing think tank capacity, as well as a proliferation of private and official agencies doling out advice and technical assistance.

As a result, under this option, over the next 10 to 20 years the World Bank will likely become no more than a shadow of the preeminent global institution it once was. It will linger on but will not be able to contribute substantially to address any of the major global financial, economic or social challenges in the future.
 
Option 2: “The Perfect Storm” = Breaking Up the World Bank

In 1998, the U.S. Congress established a commission to review and advise on the role of the international financial institutions. In 2000, the commission, led by Professor Allan Meltzer, released its recommendations, which included far-reaching changes for the International Monetary Fund and the World Bank, most of them designed to reduce the scope and financial capacities of these institutions in line with the conservative leanings of the majority of the commission’s members. For the World Bank, the “Meltzer Report” called for much of its loan business and financial assets to be devolved to the regional development banks, in effect ending the life of the institution as we know it. The report garnered some attention when it was first issued, but did not have much impact in the way the institution was run in the following 10 years.

In 2010, the U.S. Senate Foreign Relations Committee released a report on the international financial institutions, which called on them to aim toward “succeeding in their development and economic missions and thereby putting them out of business”. However, it did not recommend a drastic restructuring of the multilateral development banks, and instead argued strongly against any dilution of the U.S. veto right, its lock on leadership selection, and its voting share at the IMF and World Bank. While not dramatic in its short-term impact, these recommendations were likely a strong factor in the subsequent decisions made by the Obama administration to oppose a substantial increase in contributions by emerging markets during the latest round of capital increase at the World Bank to push for an American to replace Robert Zoellick as World Bank president. These actions reinforced for emerging market countries that the World Bank would not change sufficiently and quickly enough to serve their interests, and thus helped create the momentum for setting up a new “South Bank.”

While there seems to be no imminent risk of a break-up of the World Bank along the lines recommended by the Meltzer Report, the combination of fiscal austerity and conservative governments in key industrial countries, compounded by a declining interest of the emerging market countries in sustaining the institution’s future, could create the perfect storm for the bank. Specifically, as governments face constrained fiscal resources, confront the increasing fragmentation of the multilateral aid architecture, and take steps to consolidate their own aid agencies, they might conclude that it would be more efficient and fiscally prudent to rationalize the international development system. There is a obvious overlap on the ground in the day-to-day business of the World Bank and that of the regional development banks. This is a reality which is being fostered by the growing decentralization of the World Bank into regional hubs; in fact, a recent evaluation by the World Bank’s Independent Evaluation Group concluded that “[r]ather than functioning as a global institution, the bank is at risk of evolving into six regional banks”. With the growing financial strength, institutional capacity and dynamism, and the apparently greater legitimacy of regional development banks among their regional members, shareholders might eventually decide that consolidation of the World Bank’s operations with those of the regional development banks, in favor of the latter, is the preferred approach.

There are lots of reasons to think that this drastic step would be difficult to take politically, financially and administratively, and therefore the inertia common to the international governance architecture will also prevail in this case. However, the new World Bank president would be well advised to be prepared for the possibility of a “perfect storm” under which the idea of eviscerating the World Bank could gain some traction,. The more the bank is seen to fade away, as postulated under Option 1 above, the greater is the likelihood that Option 2 would be given serious consideration.

Option 3: “A Different World Bank” = Creating a Stronger Global Institution for the Coming Decades

Despite all the criticism and the decline in its relative role as a development finance institution in recent decades, the World Bank is still one of the strongest and most effective development institutions in a world. According to a recent independent ranking of the principal multilateral and bilateral aid institutions by the Brookings Institution and the Center for Global Development “IDA consistently ranks among the best aid agencies in each dimension of quality”.

A third, radically different option from the first two, would build on this strength and ensure that the world has an institution 10 to 20 years from now which helps the global community and individual countries to respond effectively to the many global challenges which the world will undoubtedly face: continued poverty, hunger, conflict and fragility, major infrastructure and energy needs, education and health challenges, and global warming and environmental challenges. On top of this, global financial crises will likely recur and require institutions like the World Bank to help countries provide safety nets and the structural foundations of long-term growth, as the bank has amply demonstrated since 2008. With this as a broad mandate, how could the World Bank respond under new dynamic?

First, it would change its organizational and operating modalities to take a leaf out of the book of the vertical funds, which have been so successful in tackling major development challenges in a focused and scaled-up manner. This means substantially rebalancing the internal matrix between the regional and country departments on the one hand and the technical departments on the other hand. According to the same evaluation cited above, the World Bank has tipped too far toward short-term country priorities and has failed to adequately reflect the need for long-term, dedicated sectoral engagement. The World Bank needs to fortify its reputation as an institution that can muster the strongest technical expertise, fielding team with broad global experience and with first rate regional and country perspective. This does not imply that the World Bank would abandon its engagement at the country level, but it means that it would systematically support the pursuit of long-term sectoral and sub-sectoral strategies at the country level, linked to regional and global initiatives, and involving private-public partnership to assure that development challenges are addressed at scale and in a sustained manner.

Second, recognizing that all countries have unmet needs for which they need long-term finance and best practice in areas such as infrastructure, energy, climate change and environment, the World Bank could become a truly global development institution by opening up its funding windows to all countries, not just an arbitrarily defined subset of developing countries. This would require substantially revising the current graduation rules and possibly the financial instruments. This would mean that the World Bank becomes the global equivalent of the European Investment Bank (EIB) and of the German Kreditanstalt fuer Wiederaufbau (KfW)—development banks that have successfully supported the infrastructure development of the more advanced countries.

Third, the World Bank would focus its own knowledge management activities and support for research and development in developing countries much more on a search for effective and scalable solutions, linked closely to its operational engagement which would be specifically designed to support the scaling up of tested innovations, along the lines pioneered by the Bill and Melinda Gates Foundation.

Fourth, for those countries with strong project management capacities, the World Bank would dramatically simplify its lending processes, following the example of the EIB. This would make it a much more efficient operational institution, making it a more attractive partner to its borrowing member countries, especially the emerging market economies.

Fifth, the membership of the World Bank would fix some fundamental problems with its financial structure and governance. It would invite the emerging market economies to make significantly larger contributions to its capital base in line with their much-enhanced economic and financial capacities. It would revamp the bank’s voting and voice rules to reflect the changed global economic weights and financial contributions of emerging markets. The bank would also explore, based on the experience of the vertical funds, tapping the resources of non-official partners, such as foundations and the private sector as part of its capital and contribution base. Of course, this would bring with it further significant changes in the governance of the World Bank. And the bank would move swiftly to a transparent selection of its leadership on the basis of merit without reference to nationality.

Conclusion: The New World Bank President Needs to Work with the G-20 Leaders to Chart a Course Forward
 
The new president will have to make a choice between these three options. Undoubtedly, the easiest choice is “business-as-usual”, perhaps embellished with some marginal changes that reflect the perspective and new insights that an outsider will bring. There is no doubt that the forces of institutional and political inertia tend to prevent dramatic change. However, it is also possible that Dr. Kim, with his background in a relatively narrow sectoral area may recognize the need for a more vertical approach in the bank’s organizational and operational model. Therefore, he may be more inclined than others to explore Option 3.

If he pursues Option 3, Dr. Kim will need a lot of help. The best place to look for help might be the G-20 leadership. One could hope that at least some of the leaders of the G-20 understand that Options 1 and 2 are not in the interest of their countries and the international community. Hopefully, they would be willing to push their peers to contemplate some radical changes in the multilateral development architecture. This might involve the setting up of a high-level commission as recently recommended by this author, which would review the future of the World Bank as part of a broader approach to rationalize the multilateral system in the interest of greater efficiency and effectiveness. But in setting up such a commission, the G-20 should state a clear objective, namely that the World Bank, perhaps the strongest existing global development institution, should not be gutted or gradually starved out of existence. Instead, it needs to be remade into a focused, effective and truly global institution. If Dr. Kim embraces this vision and develops actionable ideas for the commission and the G-20 leaders to consider and support, then he may bring the right medicine for an ailing giant.

Leaders will head to the G-20 Summit in Los Cabos, Mexico, among renewed serious concern about the world economy. The turmoil that started with the U.S. subprime mortgage crisis has resulted in now almost five years of ongoing instability. The emerging market economies fared much better than the advanced economies and pulled out of the crisis already in 2009, but the slowdown we are now facing in 2012 is again global, demonstrating the interdependence in the world economy. The emerging market economies have stronger underlying trend growth rates, but they remain vulnerable to a downturn in the advanced economies. The center of concern is now squarely on Europe, with a recession threatening most European countries, even those that had reasonably good performances so far. After an encouraging start in 2012, the U.S. economy, while not close to a recession, is also showing signs of a slowdown rather than the hoped for steady acceleration of growth. And the slowdown is spreading across the globe.

At a time like this it would be desirable and necessary that the G-20 show real initiative and cohesion. The essays in this collection look at the challenge from various angles. There is concern that the G-20 is losing its sense of purpose, that cohesion is decreasing rather than increasing, and that policy initiatives are reactive to events rather than proactive. Let us hope that at this moment of great difficulty, the G-20 will succeed in giving the world economy a new sense of direction and confidence. It is much needed.

Download » (PDF)

Editor's Note: The "Scaling up in Agriculture, Rural Development and Nutrition" publication is a series of 20 briefs published by the International Food Policy Research Institute. To read the full publication, click here.

Taking successful development interventions to scale is critical if the world is to achieve the Millennium Development Goals and make essential gains in the fight for improved agricultural productivity, rural incomes, and nutrition. How to support scaling up in these three areas, however, is a major challenge. This collection of policy briefs is designed to contribute to a better understanding of the experience to date and the lessons for the future.

Scaling up means expanding, replicating, adapting, and sustaining successful policies, programs, or projects to reach a greater number of people; it is part of a broader process of innovation and learning. A new idea, model, or approach is typically embodied in a pilot project of limited impact; with monitoring and evaluation, the knowledge acquired from the pilot experience can be used to scale up the model to create larger impacts. The process generally occurs in an iterative and interactive cycle, as the experience from scaling up feeds back into new ideas and learning.

The authors of the 20 policy briefs included here explore the experience of scaling up successful interventions in agriculture, rural development, and nutrition under five broad headings: (1) the role of rural community engagement, (2) the importance of value chains, (3) the intricacies of scaling up nutrition interventions, (4) the lessons learned from institutional approaches, and (5) the experience of international aid donors.

There is no blueprint for when and how to take an intervention to scale, but the examples and experiences described in this series of policy briefs offer important insights into how to address the key global issues of agricultural productivity, food insecurity, and rural poverty.

Editor’s Note: The following piece is a chapter from the 2012 edition of Eurasian Development Bank’s Eurasian Integration Yearbook.

INTRODUCTION

For centuries Central Asia was in the backwater of global political and economic attention, tales of “Great Games” and “Silk Roads” notwithstanding. However, interest in Central Asia from outside the region has been on the rise in recent years: Central Asia’s energy resources are of great importance to its neighbours in Europe and Asia. In addition, China wants a peaceful backyard, while Russia considers Central Asia part of its historical economic and regional interests and draws heavily on Central Asia migrants. Turkey is attracted by the common Turkic heritage of the region. Iran shares language and cultural ties with the Tajik people. The Central Asia’s Islamic tradition connects it with the Middle East and other Islamic countries. And now NATO countries rely on Central Asia for transit of their nonlethal military supplies in their engagement in Afghanistan.

There is wide agreement that economic prosperity and political stability in Central Asia is critical not only for the 60-plus million inhabitants of the region, but also for Central Asia’s neighbours, since Central Asia serves as a strategically important land bridge between Europe and Asia. Since the five Central Asian countries are landlocked small economies, a critical prerequisite for long-term economic growth and political stability is successful economic integration underpinned by effective regional cooperation.

This paper therefore addresses the central question of what are the prospects for regional economic integration and regional cooperation in Central Asia. It starts by briefly reviewing the role of Central Asia in the context of the overall process of Eurasian continental economic integration. It then considers what are the benefits and obstacles of regional integration and cooperation in Central Asia against the backdrop of lessons of international experience with regional integration and cooperation, and looks at four of the most important recent regional cooperation initiatives. In closing, the paper provides an answer to the question whether regional integration and cooperation in Central Asia are for real or only a mirage.

Downloads

• Download the full paper

The challenge of rural poverty and food insecurity in the developing world remains daunting. Recent estimates show that “there are still about 1.2 billion extremely poor people in the world. In addition, about 870 million people are undernourished, and about 2 billion people suffer from micronutrient deficiency. About 70 percent of the world’s poor live in rural areas, and many have some dependency on agriculture,” (Cleaver 2012). Addressing this challenge by assisting rural small-holder farmers in developing countries is the mandate of the International Fund for Agricultural Development (IFAD), an international financial institution based in Rome.

The International Fund for Agricultural Development is a relatively small donor in the global aid architecture, accounting for approximately one-half of 1 percent of all aid paid directly to developing countries in 2010. Although more significant in its core area of agricultural and rural development, IFAD still accounts for less than 5 percent of total official development assistance in that sector.1 Confronted with the gap between its small size and the large scale of the problem it has been mandated to address, IFAD seeks ways to increase its impact for every dollar it invests in agriculture and rural development on behalf of its member states. One indicator of this intention to scale up is that it has set a goal to reach 90 million rural poor between 2012 and 2015 and lift 80 million out of poverty during that time. These numbers are roughly three times the number of poor IFAD has reached previously during a similar time span. More generally, IFAD has declared that scaling up is “mission critical,” and this scaling-up objective is now firmly embedded in its corporate strategy and planning statements. Also, increasingly, IFAD’s operational practices are geared towards helping its clients achieve scaling up on the ground with the support of its loans and grants.

This was not always the case. For many years, IFAD stressed innovation as the key to success, giving little attention to systematically replicating and building on successful innovations. In this regard, IFAD was not alone. In fact, few aid agencies have systematically pursued the scaling up of successful projects. However, in 2009, IFAD management decided to explore how it could increase its focus on scaling up. It gave a grant to the Brookings Institution to review IFAD’s experience with scaling up and to assess its operational strategies, policies and processes with a view to strengthening its approach to scaling up. Based on an extensive review of IFAD documentation, two country case studies and intensive interactions with IFAD staff and managers, the Brookings team prepared a report that it submitted to IFAD management in June 2010 and published as a Brookings Global Working Paper in early 2011 (Linn et al. 2011).

Download the paper (PDF) »

Downloads

• Download the paper

Downloads

• Sample Chapter
• Table of Contents

• {9ABF977A-E4A6-41C8-B030-0FD655E07DBF}, 978-0-8157-2419-3, $29.95 Add to Cart

Editor's Note: Johannes Linn discusses the potential of multilateral development banks in the latest G-20 Research Group briefing book on the St. Petersburg G-20 Summit. Read the full collection here.

The origins of the multilateral development banks (MDBs) lie with the creation of the World Bank at Bretton Woods in 1944. Its initial purpose, as the International Bank for Reconstruction and Development, was the reconstruction of wartorn countries after the Second World War. 

As Europe and Japan recovered in the 1950s, the World Bank turned to providing financial assistance to the developing world. Then came the foundation of the InterAmerican Development Bank (IADB) in 1959, of the African Development Bank (AfDB) in 1964 and of the Asian Development Bank (ADB) in 1966, each to assist the development of countries in their respective regions. The European Bank for Reconstruction and Development (EBRD) was set up in 1991, following the collapse of the Soviet Union, to assist with the transition of countries in the former Soviet sphere. 

The MDBs are thus rooted in two key aspects of the geopolitical reality of the postwar 20th century: the Cold War between capitalist ‘West’ and communist ‘East’, and the division of the world into the industrial ‘North’ and the developing ‘South’. The former aspect was mirrored in the MDBs for many years by the absence of countries from the Eastern Bloc. This was only remedied after the fall of the Bamboo and Iron curtains. The latter aspect remains deeply embedded even today in the mandate, financing pattern and governance structures of the MDBs. 

Changing global financial architecture 

From the 1950s to the 1990s, the international financial architecture consisted of only three pillars: the International Monetary Fund (IMF) and the MDBs represented the multilateral official pillar; the aid agencies of the industrial countries represented bilateral official pillar; and the commercial banks and investors from industrial countries made up the private pillar. 

Today, the picture is dramatically different. Private commercial flows vastly exceed official flows, except during global financial crises. New channels of development assistance have multiplied, as foundations and religious and non-governmental organisations rival the official assistance flows in size. 

The multilateral assistance architecture, previously dominated by the MDBs, is now a maze of multilateral development agencies, with a slew of sub-regional development banks, some exceeding the traditional MDBs in size. For example, the European Investment Bank lends more than the World Bank, and the Caja Andina de Fomento (CAF, the Latin American Development Bank) more than the IADB. There are also a number of large ‘vertical funds’ for specific purposes, such as the International Fund for Agricultural Development and the Global Fund to Fight AIDS, Tuberculosis and Malaria. There are  specialized trust funds, attached to MDBs, but often with their own governance structures.

End of the North-South divide 

Finally, the traditional North-South divide is breaking down, as emerging markets have started to close the development gap, as global poverty has dropped and as many developing countries have large domestic capacities. This means that the new power houses in the South need little financial and technical assistance and are now providing official financial and technical support to their less fortunate neighbors. China’s assistance to Africa outstrips that of the World Bank.

The future for MDBs 

In this changed environment is there a future for MDBs? Three options might be considered: 

1. Do away with the MDBs as a relic of the past. Some more radical market ideologues might argue that, if there ever was a justification for the MDBs, that time is now well past. In 2000, a US congressional commission recommended the less radical solution of shifting the World Bank’s loan business to the regional MDBs. Even if shutting down MDBs were the right option, it is highly unlikely to happen. No multilateral financial institution created after the Second World War has ever been closed. Indeed, recently the Nordic Development Fund was to be shut down, but its owners reversed their decision and it will carry on, albeit with a focus on climate change. 

2. Carry on with business as usual. Currently, MDBs are on a track that, if continued, would mean a weakened mandate, loss of clients, hollowed-out financial strength and diluted technical capacity. Given their tight focus on the fight against poverty, the MDBs will work themselves out of a job as global poverty, according to traditional metrics, is on a dramatic downward trend. 

Many middle-income country borrowers are drifting away from the MDBs, since they find other sources of finance and technical advice more attractive. These include the sub-regional development banks, which are more nimble in disbursing their loans and whose governance is not dominated by the industrial countries. These countries, now facing major long-term budget constraints, will be unable to continue supporting the growth of the MDBs’ capital base. But they are also unwilling to let the emerging market economies provide relatively more funding and acquire a greater voice in these institutions.

Finally, while the MDBs retain professional staff that represents a valuable global asset, their technical strength relative to other sources of advice – and by some measures, even their absolute strength – has been waning. 

If left unattended, this would mean that MDBs 10 years from now, while still limping along, are likely to have lost their ability to provide effective financial and technical services on a scale and with a quality that matter globally or regionally. 

3. Give the MDBs a new mandate, new governance and new financing. If one starts from the proposition that a globalised 21st-century world needs capable global institutions that can provide long-term finance to meet critical physical and social infrastructure needs regionally and globally, and that can serve as critical knowledge hubs in an increasingly interconnected world, then it would be folly to let the currently still considerable institutional and financial strengths of the MDBs wither away.

• The mandate of the MDBs should be adapted to move beyond preoccupation with poverty eradication to focus explicitly on global and regional public goods as a way to help sustain global economic growth and human welfare. Moreover, the MDBs should be able to provide assistance to all their members, not only developing country members. 

• The governance of the MDBs should be changed to give the South a voice commensurate with the greater global role it now plays in economic and political terms. MDB leaders should be selected on merit without consideration of nationality. 

• The financing structure should be matched to give more space to capital contributions from the South and to significantly expand the MDBs’ capital resources in the face of the current severe capital constraints.

In addition, MDB management should be guided by banks’ membership to streamline their operational practices in line with those widely used by sub-regional development banks, and they should be supported in preserving and, where possible, strengthening their professional capacity so that they can serve as international knowledge hubs. 

A new MDB agenda for the G20 

The G20 has taken on a vast development agenda. This is fine, but it risks getting bogged down in the minutiae of development policy design and implementation that go far beyond what global leaders can and should deal with. What is missing is a serious preoccupation of the G20 with that issue on which it is uniquely well equipped to lead: reform of the global financial institutional architecture. 

What better place than to start with than the MDBs? The G20 should review the trends, strengths and weaknesses of MDBs in recent decades and endeavour to create new mandates, governance and financing structures that make them serve as effective pillars of the global institutional system in the 21st century. If done correctly, this would also mean no more need for new institutions, such as the BRICS development bank currently being created by Brazil, Russia, India, China and South Africa. It would be far better to fix the existing institutions than to create new ones that mostly add to the already overwhelming fragmentation of the global institutional system.

Visiting Astana, the modernistic capital of Kazakhstan, last week, I couldn't help feeling that I was at, or at least close to, the center of the universe. 

Consider this:  On September 7, the president of Kazakhstan, Nursultan Nazarbayev, having just returned from attending the G-20 Summit in St. Petersburg at the invitation of President Putin of Russia, welcomed President Xi Jinping of China for an official visit in Astana. President Xi gave a speech that day at Nazarbayev University, in which he unabashedly borrowed a turn of phrase from former U.S. Secretary of State Hillary Clinton  by proposing a “New Silk Road” to serve as an “economic belt” of Eurasia, connecting “3 million people from the Pacific to the Baltic Sea” with Kazakhstan as a key partner along the way. 

On September 10, President Nazarbayev opened the Eurasian Emerging Markets Forum in Astana, at which he addressed some 800 participants, including high-level dignitaries and representatives from 87 countries.  In his keynote speech, he laid out his plans to catapult Kazakhstan into the ranks of the top 30 developed countries in the world by 2050.  The rest of the forum was devoted to exploring the ways in which this ambitious vision could be achieved and how economic integration of the Eurasian supercontinent—i.e., Europe plus Asia, with Kazakhstan at its center—would be a driver of regional and global prosperity. 

Finally, on September 13, President Nazarbayev joined the leaders of China, Russia and the five Central Asian republics in Bishkek for a summit of the Shanghai Cooperation Organization (SCO), which was also attended by a number of other regional leaders with observer status, including from Afghanistan, India, Iran and Pakistan.  Besides the usual pledges of good neighborly relations within the group, the leaders weighed in with a chorus of statements about current geopolitical trouble spots, including Afghanistan, Iran and Syria, many of them directed critically at the United States.

While the president and people of Kazakhstan might have felt at the center of global action this week, there is little doubt that China and Russia are the key external actors on the Central Asian stage.  Europe and the United States are far away and hardly visible, and everybody expects that, with the imminent end of NATO’s engagement in Afghanistan, their attention to Central Asia will slip even further.  In contrast, the leaders of China and Russia are clearly focused on this region.  

Central Asian leaders, while perhaps privately worried about the long-term consequences of too tight an embrace by China, welcome the low-key approach of their big neighbor...

If there had been any doubt, President Xi’s speech in Astana showed that China is now concerned with Central Asia at the highest level.  While China faces its neighbors in the Pacific region in an assertive pose designed to counter what it sees as encirclement by unfriendly countries led by the U.S., it evidently feels no threat in Central Asia and projects an image of itself as benevolent and modest senior partner.  No doubt sensing opportunities to create a stable backyard, to secure access to energy resources and to build a land bridge to European and Middle Eastern markets while also gently wresting influence away from Russia, China has a strong incentive to push westward.  The substantial energy supply deals  that President Xi signed in Kazakhstan, Turkmenistan and Uzbekistan this past week and the stress Xi placed in his Astana speech on measures to open up transport links throughout Eurasia reflect China’s growing engagement in this region.  Central Asian leaders, while perhaps privately worried about the long-term consequences of too tight an embrace by China, welcome the low-key approach of their big neighbor, which promises to strengthen their own hand economically and politically at least in the short term.

At the same time, there is also a new dynamic between Central Asia and Russia.  Since Mr. Putin resumed the Russian presidency in 2012, Russia has breathed new life into a long-dormant regional grouping, the Eurasian Economic Community (EurAsEC), by pushing hard to create a customs union  (and eventually an economic union) that, in Russia’s view, would encompass most of the republics of the former Soviet Union. Although only a fraction of the geographic space of continental Eurasia (Europe + Asia), the reference to “Eurasia” harks back to a long-standing Russian ideological vision.  Under this vision, Russia and its former Soviet neighbors are endowed with a unique combination of European and Asian values and, led by Russia, with a mission to dominate the land bridge between Europe and Asia. 

In the pursuit of establishing a unified economic “Eurasian” space, Russia has not only successfully pushed for the full implementation of the current customs union between Russia, Kazakhstan and Belorussia, but is also vigorously pursuing the expansion of the union in Ukraine, Central Asia (specifically targeting the Kyrgyz Republic and Tajikistan) and Armenia in the South Caucasus.  In the case of Armenia and Ukraine, this pursuit has taken on a decidedly anti-European Union tone, as Russia seems to spare no effort to ensure that these countries will join its own economic orbit, rather than associating with the EU.  In Central Asia, the Russian campaign of expanding the customs union has been more low key, but nonetheless persistent with the quiet support of Kazakhstan.  Interestingly, this effort to create a unified economic space has not been cast by Russia as a move to counteract the growing influence of China in Central Asia, even though it is undoubtedly one of the underlying long-term motives for Russian diplomacy in the region.  

Much more important for China will be whether the “Eurasian” economic union can create safe, low-cost and high-speed transit routes to China’s key trading partners in Europe, South Asia and the Middle East.

Indeed, for Central Asia in general and for Kazakhstan in particular, the important questions for the future will be how China and Russia shape their mutual relations overall and how they will seek to accommodate their overlapping interests in the region.  For the moment, a common geopolitical front vis-à-vis the U.S., evident in their joint positions at the U.N. Security Council and at the SCO summit last week, is an overarching priority for China and Russia.  Moreover, they share the common interest of establishing a stable and prosperous political and economic sphere in Central Asia.  For now and the foreseeable future, China’s thirst for energy is large enough to allow both Russia and Central Asian countries to pursue opportunities for major oil and gas supply deals with China without undue competition. Finally, whatever protectionist effects an expansion of the Russian-led customs union may have in limiting trade between China and Central Asia will likely be temporary and will hardly be noticed in China’s huge overall trade account.  Much more important for China will be whether the “Eurasian” economic union can create safe, low-cost and high-speed transit routes to China’s key trading partners in Europe, South Asia and the Middle East. This priority strongly resonated in President Xi’s speech, in which he not only staked out an interest in Eurasian economic integration, but also promised greater cooperation between the SCO and EurAsEC.

What does all of this mean in practical terms for Central Asia and for Kazakhstan?  As President Nazarbayev indicated in his speech at the Eurasian Emerging Markets Forum, he sees Kazakhstan as playing a key role in supporting the economic integration of larger Eurasia.  This presumably should mean: investing in regional infrastructure, such as the major East-West Highway through Kazakhstan as a link from China to Europe; assuring that the customs union pursues open, rather than protectionist, policies; and convincing the other Central Asian countries, including Uzbekistan and Turkmenistan, to participate in an effort to increase the region’s connectivity both internally and with the rest of the world. 

In addition, there are a number of institutional options for promoting these goals and for turning China’s and Russia’s engagement in Central Asia into a pragmatic partnership.  One option would be to have China join the Eurasian Development Bank (EADB), the financial arm of EurAsEC.  Another would be for Russia to join the Central Asian Regional Economic Cooperation Program (CAREC), in which China has teamed up with Central Asian countries (now also including Afghanistan, Mongolia and Pakistan) and with six international financial organizations (including the Asian Development Bank and the World Bank) with the goal of improving regional cooperation and investment in trade, transport and energy.  Either or both of these two options could then offer SCO a financial and technical institutional platform to pursue economic integration between China, Russia and Central Asia (and, ultimately, even South Asia), a goal that has eluded SCO up until now. 

Kazakhstan is a member of EurAsEc, EADB, CAREC and SCO, and is therefore in a unique position to promote institutional changes along some or all of these lines.  One place to start would be the next ministerial conference of CAREC, to be held in Astana on October 24-25.  Of course, it is by no means clear that China and Russia will see it in their interest to dilute their lead roles in EADB and CAREC, the regional organizations that they now respectively dominate.  However, establishing a strong and meaningful institutional capacity that would support the economic integration process in Central Asia and in the larger Eurasia would be of great benefit for Kazakhstan, since it would help turn the country from being “land-locked” to being “land-linked” with the world’s largest and most dynamic economies.

Event Information

The year 2015 will be a milestone year, with the adoption of the Sustainable Development Goals (SDGs) and the post-2015 development agenda by world leaders in September; the Addis Ababa Accord on financing for development in July; and the conclusion of climate negotiations at COP21 in Paris in December. The draft Addis Ababa Accord, which focuses on the actions needed to attain the SDGs, highlights the key role envisaged for the multilateral development banks (MDBs) in the post-2015 agenda. Paragraph 65 of the draft accord notes: “We call on the international finance institutions to establish a process to examine the role, scale, and functioning of the multilateral and regional development finance institutions to make them more responsive to the sustainable development agenda.”          

Against this backdrop, on April 18, 2015, the Global Economy and Development program at Brookings held a private roundtable with the leaders of the MDBs and other key stakeholders to discuss the role of the MDBs in supporting the post-2015 development agenda.

The meeting focused on four questions:

1. What does the post-2015 development agenda and the ambitions of the Addis and Paris conferences imply for the MDBs?


Given the ability of the MDBs to leverage shareholder resources, they can be efficient and effective mechanisms for scaling up development cooperation, particularly with respect to the agenda on investing in people and to the financing of sustainable infrastructure. New roles, instruments and partnerships might be needed.

2. How can MDBs best take advantage of the political attention that is being paid to the various conferences in 2015?   


The World Bank and selected regional development banks have launched a series of initiatives to optimize their balance sheets, address other constraints and enhance their catalytic role in crowding in private finance. And new institutions and mechanisms are coming to the fore. But the responses are not coordinated to best take advantage of each MDB’s comparative advantage.

3. What are the key impediments to scaling up the role and engagement of the MDBs?


Views on constraints are likely to differ but discussions should cover policy dialogue, capacity building, capital, leverage, shareholder backing on volume, instruments on leverage and risk mitigation, safeguards, and governance. 

4. How should the MDBs respond to the proposal to establish a process to examine the role, scale and functioning of the multilateral and regional development finance institutions to make them more responsive to the sustainable development agenda?   


A proactive response and engagement on the part of the MDBs would facilitate a better understanding of the contribution that the MDBs can make and greater support among shareholders for a coherent and stepped-up role.

Event Materials

• Participant List
• MDB PostEvent Summary

It certainly seems that way, judging by recent developments. Capital increases for the World Bank, for the Asian Development Bank (AsDB), for the African Development Bank (AsDB), and for the Inter-American Development Bank (IADB) are nowhere in sight, despite their constrained lending capacities. Replenishments of their soft-loan windows have been anemic. They face divisive debates about what role emerging economies should play in their governance and how their leaders should be selected. Competitors are nipping at their heels, with the Asian Infrastructure Investment Bank (AIIB) only the most recent example. News of drastic financial restructuring of the AsDB and of protracted reorganization in the World Bank add to the questions about where the traditional Multilateral Development Banks (MDBs) are headed.

So let’s unpack what are the key challenges – and the main opportunities – that the traditional MDBs face. Based on the discussion at a recent roundtable of MDB representatives organized by International Fund for Agricultural Development (IFAD) in Rome, I see seven principal challenges:

• Progress in reducing extreme poverty and the in graduation of many low-income countries to middle-income status has reduced the rationale for aid and the apparent need for MDBs.
• The rapid growth of development finance channels means increasing competition in a crowded field of financial actors (private and non-governmental financial flows, new development finance institutions and vertical funds, and non-traditional donors).
• Traditional donors face increasing domestic pressure to channel aid resources through their bilateral aid organizations, and they show a growing preference to earmark their funding, rather than support general core financing for MDBs. 
• MDBs face a dramatic growth of competing knowledge providers (international and national consulting firms, universities and think tanks).
• Inflexible governance structures limit the attractiveness of MDBs to their borrowers and to new donors. With traditional donors unwilling to give up control over vote, voice, leadership selection and lending practices, borrowers see the MDBs as unresponsive, risk averse, burdensome and costly. Emerging economy donors find MDBs unable or unwilling to absorb increased contributions with associated shifts in votes, voice and control. And since non-governmental actors cannot participate in the MDB governance structures, they do not contribute to MDB funding.
• The revival of Cold War/East-West confrontation risks politicizing the institutions’ lending practices – the World Bank and European Bank for Reconstruction and Development (EBRD) stopped lending to Russia in the wake of the sanctions imposed by the West – and reinforces incentives for setting up new institutions.
• Most MDBs find it difficult to engage directly with the private and social enterprise sectors. Due to constraints in their statutes, policies and staff capacity MDBs have not been able to provide much direct financing for private investments.

But there are also opportunities that the MDBs can capitalize on:

• Despite the challenges that MDBs face in borrowing and donor countries, overall they remain trusted partners, due to a unique combination of strengths: their traditional political neutrality, freedom from special interests and corruption, technical professionalism, long-term development perspective and hands-on program design and finance engagement. Overdue reform of MDB governance and processes and effective resistance to political pressures can increase the trust all members put in them.
• As we face increased risks of geo-political fragmentation, regionalization, and confrontation, the world will need the truly multilateral MDBs more rather than less, since they offer globally inclusive forums and instruments to help address pressing global and regional issues.
• Despite remarkable progress, poverty reduction remains a huge task. Elimination of extreme poverty ($1.25pd) by 2030 is a valid goal; but its achievement will not eliminate poverty. The billions of people living below $5pd are poor. Poverty reduction will remain a valid goal for MDBs long beyond 2030.
• The Post-2015 and climate change agendas provide a window of opportunity for MDBs to demonstrate their continued, and indeed enhanced, relevance to the global sustainable development agenda in low-income and middle-income countries. The huge role of European Investment Bank in the European Union is one demonstration of the important role MDBs can play even for the advanced countries.
• The MDBs’ unique package of services provides better value than the services offered by many competitors. Their combination of strong project preparation, supervision and finance, their attention to indebtedness constraints and sustainability requirements, their focus on policy and institutional capacity and their ability to forge multi-stakeholder partnerships provide strong and effective support. MDBs provide a steady compass in helping shift countries’ national priorities from short-term expediency to sound long-term policies and programs for sustained impact at scale.
• MDBs have shown that they play a key role in responding to economic crises, natural disasters and conflict, as demonstrated for example by their response to the global financial and economic crisis of 2008/9.
• MDBs can increase the leverage of their financial resources, as demonstrated by the recent restructuring of the AsDB, and broaden their engagement with the private sector, building on the successful experience of the International Finance Corporation and EBRD.

In sum, the creation of many copycat development banks demonstrates the remarkable strength and durability of the basic MDB model. As long as the traditional MDBs squarely face the challenges and opportunities, there’s plenty of life left in their old bones.

The replenishment process for concessional resources of the multilateral development banks is broken. We have come to this conclusion after a review of the experience with recent replenishments of multilateral development funds. We also base it on first-hand observation, since one of us was responsible for the World Bank’s International Development Association (IDA) replenishment consultations 20 years ago and recently served as the external chair for the last two replenishment consultations of the International Fund for Agricultural Development (IFAD), which closely follow the common multilateral development bank (MDB) practice. As many of the banks and their donors are preparing for midterm reviews as a first step toward the next round of replenishment consultations, this is a good time to take stock and consider what needs to be done to fix the replenishment process.

So what’s the problem?

Most of all, the replenishment process does not serve its key intended function of setting overall operational strategy for the development funds and holding the institutions accountable for effectively implementing the strategy. Instead, the replenishment consultations have turned into a time-consuming and costly process in which donor representatives from their capitals get bogged down in the minutiae of institutional management that are better left to the boards of directors and the managements of the MDBs. There are other problems, including lack of adequate engagement of recipient countries in donors’ deliberations, the lack of full participation of the donors’ representatives on the boards of the institutions in the process, and inflexible governance structures that serve as a disincentive for non-traditional donors (from emerging countries and from private foundations) to contribute.

But let’s focus on the consultation process. What does it look like? Typically, donor representatives from capitals assemble every three years (or four, in the case of the Asian Development Bank) for a year-long consultation round, consisting of four two-day meetings (including the meeting devoted to the midterm review of the ongoing replenishment and to setting the agenda for the next consultation process). For these meetings, MDB staff prepare, per consultation round, some 20 substantive documents that are intended to delve into operational and institutional performance in great detail. Each consultation round produces a long list of specific commitments (around 40 commitments is not uncommon), which management is required to implement and monitor, and report on in the midterm review. In effect, however, this review covers only half the replenishment cycle, which leads to the reporting, monitoring, and accountability being limited to the delivery of committed outputs (e.g., a specific sector strategy) with little attention paid to implementation, let alone outcomes.

The process is eerily reminiscent of the much maligned “Christmas tree” approach of the World Bank’s structural adjustment loans in the 1980s and 1990s, with their detailed matrixes of conditionality; lack of strategic selectivity and country ownership; focus on inputs rather than outcomes; and lack of consideration of the borrowers’ capacity and costs of implementing the Bank-imposed measures. Ironically, the donors successfully pushed the MDBs to give up on such conditionality (without ownership of the recipient countries) in their loans, but they impose the same kind of conditionality (without full ownership of the recipient countries and institutions) on the MDBs themselves—replenishment after replenishment.

Aside from lack of selectivity, strategic focus, and ownership of the commitments, the consultation process is also burdensome and costly in terms of the MDBs’ senior management and staff time as well as time spent by ministerial staff in donor capitals, with literally thousands of management and staff hours spent on producing and reviewing documentation. And the recent innovation of having donor representatives meet between consultation rounds as working groups dealing with long-term strategic issues, while welcome in principle, has imposed further costs on the MDBs and capitals in terms of preparing documentation and meetings.

It doesn’t have to be that way. Twenty years ago the process was much simpler and less costly. Even today, recent MDB capital increases, which mobilized resources for the non-concessional windows of the MDBs, were achieved with much simpler processes, and the replenishment consultations for special purpose funds, such as the Global Fund for HIV/AIDS, tuberculosis, and malaria and for the GAVI Alliance, are more streamlined than those of the MDBs.

So what’s to be done?

We recommend the following measures to fix the replenishment consultation process:

1. Focus on a few strategic issues and reduce the number of commitments with an explicit consideration of the costs and capacity requirements they imply. Shift the balance of monitoring and accountability from delivery of outputs to implementation and outcomes.
2. Prepare no more than five documents for the consultation process: (i) a midterm review on the implementation of the previous replenishment and key issues for the future; (ii) a corporate strategy or strategy update; (iii) the substantive report on how the replenishment resources will contribute to achieve the strategy; (iv) a financial outlook and strategy document; and (v) the legal document of the replenishment resolution.
3. Reduce the number of meetings for each replenishment round to no more than three and lengthen the replenishment period from three to four years or more.
4. Use the newly established working group meetings between replenishment consultation rounds to focus on one or two long-term, strategic issues, including how to fix the replenishment process.

The initiative for such changes lies with the donor representatives in the capitals, and from our interviews with donor representatives we understand that many of them broadly share our concerns. So this is a good time—indeed it is high time!—for them to act.

So we’ve almost reached the end of the year 2015, which could go down in the history of global sustainable development efforts as one of the more significant years, with the trifecta of the approval of the Sustainable Development Goals (SDGs), the agreement on the Addis Agenda on Financing for Development (FfD) and the (shortly to be completed) Paris COP21 Climate Summit. Yet, all will depend on how the agreements with their ambitious targets are implemented on the ground.

Effective implementation will require a theory of change—a way to think about how we are to get from “here” in 2015 to “there” in 2030. The key problem is what has very appropriately been called by some “the missing middle,” i.e., the gap between the top-down global targets on the one hand and the bottom-up development initiatives, projects, and programs that are supported by governments, aid agencies, foundations, and social entrepreneurs.

One way to begin to close this gap is to aim for scaled-up global efforts in specific areas, as is pledged in the Addis Agenda, including efforts to fight global hunger and malnutrition, international tax cooperation and international cooperation to strengthen capacities of municipalities and other local authorities, investments and international coopera­tion to allow all children to complete free, equitable, inclusive and quality early childhood, primary and secondary education, and concessional and non-concessional financing.

Another way is to develop country-specific national targets and plans consistent with the SDG, Addis, and COP21 targets, as is currently being done with the assistance of the United Nations Development Program’s MAPS program. This can provide broad guidance on policy priorities and resource mobilization strategies to be pursued at the national level and can help national and international actors to prioritize their interventions in areas where a country’s needs are greatest.

However, calling for expanded global efforts in particular priority areas and defining national targets and plans is not enough. Individual development actors have to link their specific projects and programs with the national SDG, Addis, and COP21 targets. They systematically have to pursue a scaling-up strategy in their areas of engagement, i.e., to develop and pursue pathways from individual time-bound interventions to impact at a scale in a way that will help achieve the global and national targets. A recent paper I co-authored with Larry Cooley summarizes two complementary approaches of how one might design and implement such scaling-up pathways. The main point, however, is that only the pursuit of such scaling-up pathways constitutes a meaningful theory of change that offers hope for effective implementation of the new global sustainable development targets.

Fortunately, over the last decade, development analysts and agencies have increasingly focused on the question of how to scale up impact of successful development interventions. Leading the charge, the World Bank in 2004, under its president Jim Wolfensohn, organized a high-level international conference in Shanghai in cooperation with the Chinese authorities on the topic of scaling up development impact and published the associated analytical work. However, with changes in the leadership at the World Bank, the initiative passed to others in the mid-2000s, including the Brookings Institution, ExpandNet (a group of academics working with the World Health Organization), Management Systems International (MSI), and Stanford University. They developed analytical frameworks for systematically assessing scalability of development initiatives and innovations, analyzed the experience with more or less successful scaling-up initiatives, including in fragile and conflict-affected states, and established networks that bring together development experts and practitioners to share knowledge.

By now, many international development agencies (including GIZ, JICA, USAID, African Development Bank, IFAD and UNDP), foundations (including the Bill & Melinda Gates Foundation and Rockefeller Foundation) and leading development NGOs (including Heifer International, Save the Children and the World Resources Institute), among others, have focused on how best to scale up development impact, while the OECD recently introduced a prize for the most successful scaling-up development initiatives. The International Fund for Agricultural Development (IFAD) is perhaps the most advanced among the agencies, having developed a systematic operational approach to the innovation-learning-scaling-up cycle. In a collaborative effort with the Brookings Institution, IFAD reviewed its operational practices and experience and then prepared operational design and evaluation guidelines, which can serve as a good example for other development agencies. The World Bank, while yet to develop a systematic institution-wide approach to the scaling-up agenda, is exploring in specific areas how best to pursue scaled-up impact, such as in the areas of mother and child health, social enterprise innovation, and the “science of delivery.”

Now that the international community has agreed on the SDGs and the Addis Agenda, and is closing in on an agreement in Paris on how to respond to climate change, it is the right time to bridge the “missing middle” by linking the sustainable development and climate targets with effective scaling-up methodologies and practices among the development actors. In practical terms, this requires the following steps:

• Developing shared definitions, analytical frameworks, and operational approaches to scaling up among development experts;
• Developing sectoral and sub-sectoral strategies at country level that link short- and medium-term programs and interventions through scaling-up pathways with the longer-term SDG and climate targets;
• Introducing effective operational policies and practices in the development agencies in country strategies, project design, and monitoring and evaluation;
• Developing multi-stakeholder partnerships around key development interventions with the shared goal of pursuing well-identified scaling-up pathways focused on the achievement of the SDGs and climate targets;
• Developing incentive schemes based on the growing experience with “challenge funds” that focus not only on innovation, but also on scaling up, such as the recently established Global Innovation Fund; and
• Further building up expert and institutional networks to share experience and approaches, such as the Community of Practice on Scaling Up, recently set up by MSI and the Results for Development Institute.

Event Information

In 2015, 193 countries adopted the Sustainable Development Goals (SDGs), a new global agenda that is more ambitious than the preceding Millennium Development Goals and aims to make progress on some of the most pressing issues of our time. Goal 4, "To ensure inclusive and quality education for all, with relevant and effective learning outcomes," challenges the international education community to meet universal access plus learning by 2030. We know that access to primary schooling has scaled up rapidly over previous decades, but what can be learned from places where transformational changes in learning have occurred? What can governments, civil society, and the private sector do to more actively scale up quality learning?

On April 18-19, the Center for Universal Education (CUE) at Brookings launched "Millions Learning: Scaling Up Quality Education in Developing Countries," a comprehensive study that examines where learning has improved around the world and what factors have contributed to that process. This two-day event included two sessions. Monday, April 18 focused on the role of global actors in accelerating progress to meeting the SDGs. The second session on Tuesday, April 19 included a presentation of the Millions Learning report followed by panel discussions on the role of financing and technology in scaling education in developing countries.

 Join the conversation on Twitter #MillionsLearning

Video

• Getting millions to learn: What will it take to accelerate progress on meeting the Sustainable Development Goals?
• Scaling quality education: The launch of the Millions Learning report
• Do funders help or hinder scaling in education?
• What role can technology play in scaling education?

Audio

• Getting millions to learn: What will it take to accelerate progress on meeting the Sustainable Development Goals?

Transcript

• Uncorrected Transcript - Day 1 (.pdf)
• Uncorrected Transcript - Day 2 (.pdf)

Event Materials

• 20160418_millions_learning_transcript
• 20160419_millions_learning_transcript