A key objective of the United Nations Development Programme (UNDP) is to assist its member countries in meeting the Millennium Development Goals (MDGs). UNDP pursues this objective in various ways, including through analysis and advice to governments on the progress towards the MDGs (such as support for the preparation and monitoring Poverty Reduction Strategies, or PRSs, in poor countries), assistance for capacity building, and financial and technical support for the preparation and implementation of development programs.

The challenge of achieving the MDGs remains daunting in many countries, including Tajikistan. To do so will require that all development partners, i.e., the government, civil society, private business and donors, make every effort to scale up successful development interventions. Scaling up refers to “expanding, adapting and sustaining successful policies, programs and projects on different places and over time to reach a greater number of people.” Interventions that are successful as pilots but are not scaled up will create localized benefits for a small number of beneficiaries, but they will fail to contribute significantly to close the MDG gap.

This paper aims to assess whether and how well UNDP is supporting scaling up in its development programs in Tajikistan. While the principal purpose of this assessment was to assist the UNDP country program director and his team in Tajikistan in their scaling up efforts, it also contributes to the overall growing body of evidence on the scaling up of development interventions worldwide.

Downloads

• Download Full Paper

Editor's Note: The World Bank’s Independent Evaluation Group (IEG) recently published a self-evaluation of its activities. Besides representing current thinking among evaluation experts at the World Bank, it also more broadly reflects some of the strengths and gaps in the approaches that evaluators use to assess and learn from the performance of the international institutions with which they work. The old question “Quis custodet ipsos custodes?” – loosely translated as “Who evaluates the evaluators?” – remains as relevant as ever. Johannes Linn served as an external peer reviewer of the self-evaluation and provides a bird’s-eye view on the lessons learned.

An Overview of the World Bank’s IEG Self-Evaluation Report

In 2011 the World Bank’s Independent Evaluation Group (IEG) carried out and published a self-evaluation of its activities. The self-evaluation team was led by an internal manager, but involved a respected external evaluation expert as the principal author and also an external peer reviewer.

The IEG self-evaluation follows best professional practices as codified by the Evaluation Cooperation Group (ECG). This group brings together the evaluation offices of seven major multilateral financial institutions in joint efforts designed to enhance evaluation performance and cooperation among their evaluators. One can therefore infer that the approach and focus of the IEG self-evaluation is representative of a broader set of practices that are currently used by the evaluation community of international financial organizations.

At the outset the IEG report states that “IEG is the largest evaluation department among Evaluation Capacity Group (ECG) members and is held in high regard by the international evaluation community. Independent assessments of IEG’s role as an independent evaluation function for the Bank and IFC rated it above the evaluation functions in most other ECG members, international nongovernmental organizations, and transnational corporations and found that IEG follows good practice evaluation principles.”

The self-evaluation report generally confirms this positive assessment. For four out of six areas of its mandate IEG gives itself the second highest rating (“good”) out of six possible rating categories. This includes (a) the professional quality of its evaluations, (b) its reports on how the World Bank’s management follows up on IEG recommendations, (c) cooperation with other evaluation offices, and (d) assistance to borrowing countries in improving their own evaluation capacity. In the area of appraising the World Bank’s self-evaluation and risk management practices, the report offers the third highest rating (“satisfactory”), while it gives the third lowest rating (“modest”) for IEG’s impact on the Bank’s policies, strategies and operations. In addition the self-evaluation concludes that overall the performance of IEG has been “good” and that it operates independently, effectively and efficiently.

The report makes a number of recommendations for improvement, which are likely to be helpful, but have limited impact on its activities. They cover measures to further enhance the independence of IEG and the consistency of evaluation practices as applied across the World Bank Group’s branches – the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA) –; to improve the design of evaluations and the engagement with Bank management upstream for greater impact; and monitoring the impact of recent organizational changes in IEG in terms of results achieved. The report also recommends that more be done to evaluate the Bank’s analytical work and that evaluations draw on comparative evidence.

Assessment

In terms of the parameters of self-evaluation set by the prevailing practice among the evaluators on international financial agencies, the IEG self-evaluation is accurate and helpful. From my own experience as an operational manager in the Bank whose activities were evaluated by IEG in years past, and as a user of IEG evaluations (and of evaluations of other international aid organizations) for my research on aid effectiveness, I concur that IEG is independent and effective in meeting its mandate as defined. Moreover, the self-evaluation produces useful quantitative evidence (including survey results, budget analysis, etc.) to corroborate qualitative judgments.

However, the self-evaluation suffers from a number of limitations in approach and gaps in focus, which are broadly representative of the practices prevalent among many of the evaluation offices of international aid agencies.

Approach of the IEG self-evaluation

The core of the self-evaluation report is about the evaluation process followed by IEG, with very little said about the substance of IEG’s evaluations. The following questions could have usefully been raised, but were not: do evaluations cover the right issues with the right intensity, such as growth and poverty; environmental, governance, and gender impacts; regional dimensions versus exclusive country or project focus; effectiveness in addressing the problems of fragile and conflict states; effectiveness in dealing with global public goods; sustainability and scaling up; etc. Therefore the report does not deal with the question of whether IEG effectively responds in its evaluations to the many important strategic debates and issues with which the development community is grappling.

Related to this limitation is the fact that the report assessed the quality of IEG’s mostly in terms of (a) whether its approach and processes meet certain standards established by the Evaluation Cooperation Group; and (b) how it is judged by stakeholders in response to a survey commissioned for this evaluation. Both these approaches are useful, but they do not have any basis in professional assessments of the quality of individual products. This is equivalent to IEG evaluating the World Bank’s projects on the quality of its processes (e.g., appraisal and supervision processes) and on the basis of stakeholder surveys, without evaluating individual products and their impacts.

Gaps in the Self-Evaluation and in Evaluation Practice

Careful reading of the report reveals six important gaps in the IEG self-evaluation, in the prevailing evaluation practice in the World Bank, and more generally in the way international financial organizations evaluate their own performance. The first three gaps relate to aspects of the evaluation approach used and the second three gaps relate to lack of focus in the self-evaluation on key internal organizational issues:

1. Impact Evaluations: The report notes that IEG carries out two to three impact evaluations per year, but it sidesteps the debate in the current evaluation literature and practice as to what extent the “gold standard” of randomized impact evaluation should occupy a much more central role. Given the importance of this debate and divergence of views, it would have been appropriate for the self-evaluation to assess IEG’s current practice of very limited use of randomized evaluations.

2. Evaluation of Scaling Up: The report does not address the question of to what extent current IEG practice not only assesses the performance of individual projects in terms of their outcomes and sustainability, but also in terms of whether the Bank has systematically built on its experience in specific projects to help scale up their impact through support for expansion or replication in follow-up operations or through effective hand-off to the government or other partners. In fact, currently IEG does not explicitly and systematically consider scaling up in its project and program evaluations. For example, in a recent IEG evaluation of World Bank funded municipal development projects (MDPs) , IEG found that the Bank has supported multiple MDPs in many countries over the years, but the evaluation did not address the obvious question whether the Bank systematically planned for the project sequence or built on its experience from prior projects in subsequent operations. While most other evaluation offices like IEG do not consider scaling up, some (in particular those of the International Fund for Agricultural Development and the United Nations Development Program) have started doing so in recent years.

3. Drawing on the Experience of and Benchmarking Against Other Institutions: The self-evaluation report does a good job in benchmarking IEG performance in a number of respects against that of other multilateral institutions. In the main text of the report it states that “IEG plans to develop guidelines for approach papers to ensure greater quality, in particular in drawing on comparative information from other sources and benchmarking against other institutions.” This is a welcome intention, but it is inadequately motivated in the rest of the report and not reflected in the Executive Summary. The reality is that IEG, like most multilateral evaluation offices, so far has not systematically drawn on the evaluations and relevant experience of other aid agencies in its evaluations of World Bank performance. This has severely limited the learning impact of the evaluations.

4. Bank Internal Policies, Management Processes and Incentives: IEG evaluations traditionally do not focus on how the Bank’s internal policies, management and incentives affect the quality of Bank engagement in countries. Therefore evaluations cannot offer any insights into whether and how Bank-internal operating modalities contribute to results. Two recent exceptions are notable exceptions. First, the IEG evaluation of the Bank’s approach to harmonization with other donors and alignment with country priorities assesses the incentives for staff to support harmonization and alignment. The evaluation concludes that there are insufficient incentives, a finding disputed by management. Second, is the evaluation of the Bank’s internal matrix management arrangements, which is currently under way. The self-evaluation notes that Bank management tried to quash the matrix evaluation on the grounds that it did not fall under the mandate of IEG. This is an unfortunate argument, since an assessment of the institutional reasons for the Bank’s performance is an essential component of any meaningful evaluation of Bank-supported programs. While making a good case for the specific instance of the matrix evaluation, the self-evaluation report shies away from a more general statement in support of engaging IEG on issues of Bank-internal policies, management processes and incentives. It is notable that IFAD’s Independent Office of Evaluation appears to be more aggressive in this regard: It currently is carrying out a full evaluation of IFAD’s internal efficiency and previous evaluations (e.g., an evaluation of innovation and scaling up) did not shy away from assessing internal institutional dimensions.

5. World Bank Governance: The IEG self-evaluation is even more restrictive in how it interprets its mandate regarding the evaluation of the World Bank’s governance structures and processes (including its approach to members’ voice and vote, the functioning of its board of directors, the selection of its senior management, etc.). It considers these topics beyond IEG’s mandate. This is unfortunate, since the way the Bank’s governance evolves will substantially affect its long-term legitimacy, effectiveness and viability as an international financial institution. Since IEG reports to the Bank’s board of directors, and many of the governance issues involve questions of the board’s composition, role and functioning, there is a valid question of how effectively IEG could carry out such an evaluation. However, it is notable that the IMF’s Independent Evaluation Office, which similarly reports to the IMF board of directors, published a full evaluation of the IMF’s governance in 2008, which effectively addressed many of the right questions.

6. Synergies between World Bank, IFC and MIGA: The self-evaluation report points out that the recent internal reorganization of IEG aimed to assure more effective and consistent evaluations across the three member branches of the World Bank Group. This is welcome, but the report does not assess how past evaluations addressed the question of whether the World Bank, IFC and MIGA effectively capitalized on the potential synergies among the three organizations. The recent evaluation of the World Bank Group’s response to the global economic crisis of 2008/9 provided parallel assessments of each agency’s performance, but did not address whether they work together effectively in maximizing their synergies. The reality is that the three organizations have deeply engrained institutional cultures and generally go their own ways rather than closely coordinating their activities on the ground. Future evaluations should explicitly consider whether the three effectively cooperate or not. While the World Bank is unique in the way it has organizationally separated its private sector and guarantee operations, other aid organizations also have problems of a lack of cooperation, coordination and synergy among different units within the agency. Therefore, the same comment also applies to their evaluation approaches.

Conclusions

Self-evaluations are valuable tools for performance assessment and IEG is to be congratulated for carrying out and publishing such an evaluation of its own activities. As for all self-evaluations, it should be seen as an input to an independent external evaluation, a decision that, for now, has apparently been postponed by the Bank’s board of directors.

IEG’s self-evaluation has many strengths and provides an overall positive assessment of IEG’s work. However, it does reflect some important limitations of analysis and of certain gaps in approach and coverage, which an independent external review should consider explicitly, and which IEG’s management should address. Since many of these issues also likely apply to most of the other evaluation approaches by other evaluation offices, the lessons have relevance beyond IEG and the World Bank.

Key lessons include:

• An evaluation of evaluations should focus not only on process, but also on the substantive issues that the institution is grappling with.
• An evaluation of the effectiveness of evaluations should include a professional assessment of the quality of evaluation products.
• An evaluation of evaluations should assess:
  o How effectively impact evaluations are used;
  o How scaling up of successful interventions is treated;
  o How the experience of other comparable institutions is utilized;
  o Whether and how the internal policies, management practices and incentives of the institution are effectively assessed;
  o Whether and how the governance of the institution is evaluated; and
  o Whether and how internal coordination, cooperation and synergy among units within the organizations are assessed.

Evaluations play an essential role in the accountability and learning of international aid organizations. Hence it is critical that evaluations address the right issues and use appropriate techniques. If the lessons above were reflected in the evaluation practices of the aid institutions, this would represent a significant step forward in the quality, relevance and likely impact of evaluations.

Since its 50th anniversary in 1994, the World Bank has been led by four presidents: Lewis Preston until his untimely death in 1995; then James Wolfensohn, who gave the institution new energy, purpose and legitimacy; followed by Paul Wolfowitz, whose fractious management tossed the World Bank into deep crisis; and most recently, Robert Zoellick, who will be remembered for having stabilized the bank and provided effective leadership during its remarkably swift and strong response to the global financial crisis.

Throughout these years of ups and downs in the bank’s leadership, standing and lending, the overall trend of its global role was downhill. While it remains one of the world’s largest multilateral development finance institutions, its position relative to other multilateral financing mechanisms is now much less prominent. Other multilateral institutions have taken over key roles. For example, the European Union agencies and the regional development banks have rapidly expanded their portfolios, and new “vertical funds” such as the Global Fund for AIDS, Tuberculosis and Malaria have become major funding vehicles. At the same time, according to a 2011 OECD Development Assistance Committee report multilateral aid has declined as a share of total aid. Meanwhile, non-governmental aid flows have dramatically increased, including those from major foundations like the Bill and Melinda Gates Foundation, but also from new internet-based channels bundling small individual donations, such as Global Giving. The World Bank— which 20 years ago was still the biggest and most powerful global development agency and hence a ready target for criticism— today is just one of the many institutions that offer for development to the poor and emerging market economies.

Against this backdrop, the World Bank, its members and Dr. Kim face three options in its long-term trajectory over the next 10 to 20 years: 1) the bank can continue on its current path of gradual decline; 2) it might be radically scaled back and eventually eliminated, as other aid channels take over; or 3) it can dramatically reinvent itself as a global finance institution that bundles resources for growing global needs.

There is no doubt in this author’s mind that the World Bank should remain a key part of the global governance architecture, but that requires that the new president forge an ambitious long-term vision for the bank – something that has been lacking for the last 30 years – and then reform the institution and build the authorizing environment that will make it possible to achieve the vision.

Option 1: “Business as Usual” = Continued Gradual Decline

The first option, reflecting the business-as-usual approach that characterized most of the Zoellick years of leadership will mean that the bank will gradually continue to lose in scope, funding and relevance. Its scope will be reduced since the emerging market economies find the institution insufficiently responsive to their needs. They have seen the regional development banks take on increasing importance, as reflected in the substantially greater capital increases in recent years for some of these institutions than for the World Bank in relative terms (and in the case of the Asian Development Bank, even in absolute terms). And emerging market economies have set up their own thriving regional development banks without participation of the industrial countries, such as the Caja Andina de Fomento (CAF) in Latin America and the Eurasian Development Bank in the former Soviet Union. This trend will be reinforced with the creation of a “South Bank” or “BRIC Bank”, an initiative that is currently well underway.

At the same time, the World Bank’s soft loan window, the International Development Association (IDA), will face less support from industrial countries going through deep fiscal crises, heightened competition from other concessional funds, and a perception of reduced need, as many of the large and formerly poor developing countries graduate to middle-income status. It is significant that for the last IDA replenishment much of the increase in resources was due to its growing reliance on advance repayments made by some of its members and commitments against future repayments, thus in effect mortgaging its future financial capacity. The World Bank’s status as a knowledge leader in development will also continue to be challenged with the rise of research from developing countries and growing think tank capacity, as well as a proliferation of private and official agencies doling out advice and technical assistance.

As a result, under this option, over the next 10 to 20 years the World Bank will likely become no more than a shadow of the preeminent global institution it once was. It will linger on but will not be able to contribute substantially to address any of the major global financial, economic or social challenges in the future.
 
Option 2: “The Perfect Storm” = Breaking Up the World Bank

In 1998, the U.S. Congress established a commission to review and advise on the role of the international financial institutions. In 2000, the commission, led by Professor Allan Meltzer, released its recommendations, which included far-reaching changes for the International Monetary Fund and the World Bank, most of them designed to reduce the scope and financial capacities of these institutions in line with the conservative leanings of the majority of the commission’s members. For the World Bank, the “Meltzer Report” called for much of its loan business and financial assets to be devolved to the regional development banks, in effect ending the life of the institution as we know it. The report garnered some attention when it was first issued, but did not have much impact in the way the institution was run in the following 10 years.

In 2010, the U.S. Senate Foreign Relations Committee released a report on the international financial institutions, which called on them to aim toward “succeeding in their development and economic missions and thereby putting them out of business”. However, it did not recommend a drastic restructuring of the multilateral development banks, and instead argued strongly against any dilution of the U.S. veto right, its lock on leadership selection, and its voting share at the IMF and World Bank. While not dramatic in its short-term impact, these recommendations were likely a strong factor in the subsequent decisions made by the Obama administration to oppose a substantial increase in contributions by emerging markets during the latest round of capital increase at the World Bank to push for an American to replace Robert Zoellick as World Bank president. These actions reinforced for emerging market countries that the World Bank would not change sufficiently and quickly enough to serve their interests, and thus helped create the momentum for setting up a new “South Bank.”

While there seems to be no imminent risk of a break-up of the World Bank along the lines recommended by the Meltzer Report, the combination of fiscal austerity and conservative governments in key industrial countries, compounded by a declining interest of the emerging market countries in sustaining the institution’s future, could create the perfect storm for the bank. Specifically, as governments face constrained fiscal resources, confront the increasing fragmentation of the multilateral aid architecture, and take steps to consolidate their own aid agencies, they might conclude that it would be more efficient and fiscally prudent to rationalize the international development system. There is a obvious overlap on the ground in the day-to-day business of the World Bank and that of the regional development banks. This is a reality which is being fostered by the growing decentralization of the World Bank into regional hubs; in fact, a recent evaluation by the World Bank’s Independent Evaluation Group concluded that “[r]ather than functioning as a global institution, the bank is at risk of evolving into six regional banks”. With the growing financial strength, institutional capacity and dynamism, and the apparently greater legitimacy of regional development banks among their regional members, shareholders might eventually decide that consolidation of the World Bank’s operations with those of the regional development banks, in favor of the latter, is the preferred approach.

There are lots of reasons to think that this drastic step would be difficult to take politically, financially and administratively, and therefore the inertia common to the international governance architecture will also prevail in this case. However, the new World Bank president would be well advised to be prepared for the possibility of a “perfect storm” under which the idea of eviscerating the World Bank could gain some traction,. The more the bank is seen to fade away, as postulated under Option 1 above, the greater is the likelihood that Option 2 would be given serious consideration.

Option 3: “A Different World Bank” = Creating a Stronger Global Institution for the Coming Decades

Despite all the criticism and the decline in its relative role as a development finance institution in recent decades, the World Bank is still one of the strongest and most effective development institutions in a world. According to a recent independent ranking of the principal multilateral and bilateral aid institutions by the Brookings Institution and the Center for Global Development “IDA consistently ranks among the best aid agencies in each dimension of quality”.

A third, radically different option from the first two, would build on this strength and ensure that the world has an institution 10 to 20 years from now which helps the global community and individual countries to respond effectively to the many global challenges which the world will undoubtedly face: continued poverty, hunger, conflict and fragility, major infrastructure and energy needs, education and health challenges, and global warming and environmental challenges. On top of this, global financial crises will likely recur and require institutions like the World Bank to help countries provide safety nets and the structural foundations of long-term growth, as the bank has amply demonstrated since 2008. With this as a broad mandate, how could the World Bank respond under new dynamic?

First, it would change its organizational and operating modalities to take a leaf out of the book of the vertical funds, which have been so successful in tackling major development challenges in a focused and scaled-up manner. This means substantially rebalancing the internal matrix between the regional and country departments on the one hand and the technical departments on the other hand. According to the same evaluation cited above, the World Bank has tipped too far toward short-term country priorities and has failed to adequately reflect the need for long-term, dedicated sectoral engagement. The World Bank needs to fortify its reputation as an institution that can muster the strongest technical expertise, fielding team with broad global experience and with first rate regional and country perspective. This does not imply that the World Bank would abandon its engagement at the country level, but it means that it would systematically support the pursuit of long-term sectoral and sub-sectoral strategies at the country level, linked to regional and global initiatives, and involving private-public partnership to assure that development challenges are addressed at scale and in a sustained manner.

Second, recognizing that all countries have unmet needs for which they need long-term finance and best practice in areas such as infrastructure, energy, climate change and environment, the World Bank could become a truly global development institution by opening up its funding windows to all countries, not just an arbitrarily defined subset of developing countries. This would require substantially revising the current graduation rules and possibly the financial instruments. This would mean that the World Bank becomes the global equivalent of the European Investment Bank (EIB) and of the German Kreditanstalt fuer Wiederaufbau (KfW)—development banks that have successfully supported the infrastructure development of the more advanced countries.

Third, the World Bank would focus its own knowledge management activities and support for research and development in developing countries much more on a search for effective and scalable solutions, linked closely to its operational engagement which would be specifically designed to support the scaling up of tested innovations, along the lines pioneered by the Bill and Melinda Gates Foundation.

Fourth, for those countries with strong project management capacities, the World Bank would dramatically simplify its lending processes, following the example of the EIB. This would make it a much more efficient operational institution, making it a more attractive partner to its borrowing member countries, especially the emerging market economies.

Fifth, the membership of the World Bank would fix some fundamental problems with its financial structure and governance. It would invite the emerging market economies to make significantly larger contributions to its capital base in line with their much-enhanced economic and financial capacities. It would revamp the bank’s voting and voice rules to reflect the changed global economic weights and financial contributions of emerging markets. The bank would also explore, based on the experience of the vertical funds, tapping the resources of non-official partners, such as foundations and the private sector as part of its capital and contribution base. Of course, this would bring with it further significant changes in the governance of the World Bank. And the bank would move swiftly to a transparent selection of its leadership on the basis of merit without reference to nationality.

Conclusion: The New World Bank President Needs to Work with the G-20 Leaders to Chart a Course Forward
 
The new president will have to make a choice between these three options. Undoubtedly, the easiest choice is “business-as-usual”, perhaps embellished with some marginal changes that reflect the perspective and new insights that an outsider will bring. There is no doubt that the forces of institutional and political inertia tend to prevent dramatic change. However, it is also possible that Dr. Kim, with his background in a relatively narrow sectoral area may recognize the need for a more vertical approach in the bank’s organizational and operational model. Therefore, he may be more inclined than others to explore Option 3.

If he pursues Option 3, Dr. Kim will need a lot of help. The best place to look for help might be the G-20 leadership. One could hope that at least some of the leaders of the G-20 understand that Options 1 and 2 are not in the interest of their countries and the international community. Hopefully, they would be willing to push their peers to contemplate some radical changes in the multilateral development architecture. This might involve the setting up of a high-level commission as recently recommended by this author, which would review the future of the World Bank as part of a broader approach to rationalize the multilateral system in the interest of greater efficiency and effectiveness. But in setting up such a commission, the G-20 should state a clear objective, namely that the World Bank, perhaps the strongest existing global development institution, should not be gutted or gradually starved out of existence. Instead, it needs to be remade into a focused, effective and truly global institution. If Dr. Kim embraces this vision and develops actionable ideas for the commission and the G-20 leaders to consider and support, then he may bring the right medicine for an ailing giant.

Leaders will head to the G-20 Summit in Los Cabos, Mexico, among renewed serious concern about the world economy. The turmoil that started with the U.S. subprime mortgage crisis has resulted in now almost five years of ongoing instability. The emerging market economies fared much better than the advanced economies and pulled out of the crisis already in 2009, but the slowdown we are now facing in 2012 is again global, demonstrating the interdependence in the world economy. The emerging market economies have stronger underlying trend growth rates, but they remain vulnerable to a downturn in the advanced economies. The center of concern is now squarely on Europe, with a recession threatening most European countries, even those that had reasonably good performances so far. After an encouraging start in 2012, the U.S. economy, while not close to a recession, is also showing signs of a slowdown rather than the hoped for steady acceleration of growth. And the slowdown is spreading across the globe.

At a time like this it would be desirable and necessary that the G-20 show real initiative and cohesion. The essays in this collection look at the challenge from various angles. There is concern that the G-20 is losing its sense of purpose, that cohesion is decreasing rather than increasing, and that policy initiatives are reactive to events rather than proactive. Let us hope that at this moment of great difficulty, the G-20 will succeed in giving the world economy a new sense of direction and confidence. It is much needed.

Download » (PDF)

Editor's Note: The "Scaling up in Agriculture, Rural Development and Nutrition" publication is a series of 20 briefs published by the International Food Policy Research Institute. To read the full publication, click here.

Taking successful development interventions to scale is critical if the world is to achieve the Millennium Development Goals and make essential gains in the fight for improved agricultural productivity, rural incomes, and nutrition. How to support scaling up in these three areas, however, is a major challenge. This collection of policy briefs is designed to contribute to a better understanding of the experience to date and the lessons for the future.

Scaling up means expanding, replicating, adapting, and sustaining successful policies, programs, or projects to reach a greater number of people; it is part of a broader process of innovation and learning. A new idea, model, or approach is typically embodied in a pilot project of limited impact; with monitoring and evaluation, the knowledge acquired from the pilot experience can be used to scale up the model to create larger impacts. The process generally occurs in an iterative and interactive cycle, as the experience from scaling up feeds back into new ideas and learning.

The authors of the 20 policy briefs included here explore the experience of scaling up successful interventions in agriculture, rural development, and nutrition under five broad headings: (1) the role of rural community engagement, (2) the importance of value chains, (3) the intricacies of scaling up nutrition interventions, (4) the lessons learned from institutional approaches, and (5) the experience of international aid donors.

There is no blueprint for when and how to take an intervention to scale, but the examples and experiences described in this series of policy briefs offer important insights into how to address the key global issues of agricultural productivity, food insecurity, and rural poverty.

Editor’s Note: The following piece is a chapter from the 2012 edition of Eurasian Development Bank’s Eurasian Integration Yearbook.

INTRODUCTION

For centuries Central Asia was in the backwater of global political and economic attention, tales of “Great Games” and “Silk Roads” notwithstanding. However, interest in Central Asia from outside the region has been on the rise in recent years: Central Asia’s energy resources are of great importance to its neighbours in Europe and Asia. In addition, China wants a peaceful backyard, while Russia considers Central Asia part of its historical economic and regional interests and draws heavily on Central Asia migrants. Turkey is attracted by the common Turkic heritage of the region. Iran shares language and cultural ties with the Tajik people. The Central Asia’s Islamic tradition connects it with the Middle East and other Islamic countries. And now NATO countries rely on Central Asia for transit of their nonlethal military supplies in their engagement in Afghanistan.

There is wide agreement that economic prosperity and political stability in Central Asia is critical not only for the 60-plus million inhabitants of the region, but also for Central Asia’s neighbours, since Central Asia serves as a strategically important land bridge between Europe and Asia. Since the five Central Asian countries are landlocked small economies, a critical prerequisite for long-term economic growth and political stability is successful economic integration underpinned by effective regional cooperation.

This paper therefore addresses the central question of what are the prospects for regional economic integration and regional cooperation in Central Asia. It starts by briefly reviewing the role of Central Asia in the context of the overall process of Eurasian continental economic integration. It then considers what are the benefits and obstacles of regional integration and cooperation in Central Asia against the backdrop of lessons of international experience with regional integration and cooperation, and looks at four of the most important recent regional cooperation initiatives. In closing, the paper provides an answer to the question whether regional integration and cooperation in Central Asia are for real or only a mirage.

Downloads

• Download the full paper

The challenge of rural poverty and food insecurity in the developing world remains daunting. Recent estimates show that “there are still about 1.2 billion extremely poor people in the world. In addition, about 870 million people are undernourished, and about 2 billion people suffer from micronutrient deficiency. About 70 percent of the world’s poor live in rural areas, and many have some dependency on agriculture,” (Cleaver 2012). Addressing this challenge by assisting rural small-holder farmers in developing countries is the mandate of the International Fund for Agricultural Development (IFAD), an international financial institution based in Rome.

The International Fund for Agricultural Development is a relatively small donor in the global aid architecture, accounting for approximately one-half of 1 percent of all aid paid directly to developing countries in 2010. Although more significant in its core area of agricultural and rural development, IFAD still accounts for less than 5 percent of total official development assistance in that sector.1 Confronted with the gap between its small size and the large scale of the problem it has been mandated to address, IFAD seeks ways to increase its impact for every dollar it invests in agriculture and rural development on behalf of its member states. One indicator of this intention to scale up is that it has set a goal to reach 90 million rural poor between 2012 and 2015 and lift 80 million out of poverty during that time. These numbers are roughly three times the number of poor IFAD has reached previously during a similar time span. More generally, IFAD has declared that scaling up is “mission critical,” and this scaling-up objective is now firmly embedded in its corporate strategy and planning statements. Also, increasingly, IFAD’s operational practices are geared towards helping its clients achieve scaling up on the ground with the support of its loans and grants.

This was not always the case. For many years, IFAD stressed innovation as the key to success, giving little attention to systematically replicating and building on successful innovations. In this regard, IFAD was not alone. In fact, few aid agencies have systematically pursued the scaling up of successful projects. However, in 2009, IFAD management decided to explore how it could increase its focus on scaling up. It gave a grant to the Brookings Institution to review IFAD’s experience with scaling up and to assess its operational strategies, policies and processes with a view to strengthening its approach to scaling up. Based on an extensive review of IFAD documentation, two country case studies and intensive interactions with IFAD staff and managers, the Brookings team prepared a report that it submitted to IFAD management in June 2010 and published as a Brookings Global Working Paper in early 2011 (Linn et al. 2011).

Download the paper (PDF) »

Downloads

• Download the paper

Downloads

• Sample Chapter
• Table of Contents

• {9ABF977A-E4A6-41C8-B030-0FD655E07DBF}, 978-0-8157-2419-3, $29.95 Add to Cart

Visiting Astana, the modernistic capital of Kazakhstan, last week, I couldn't help feeling that I was at, or at least close to, the center of the universe. 

Consider this:  On September 7, the president of Kazakhstan, Nursultan Nazarbayev, having just returned from attending the G-20 Summit in St. Petersburg at the invitation of President Putin of Russia, welcomed President Xi Jinping of China for an official visit in Astana. President Xi gave a speech that day at Nazarbayev University, in which he unabashedly borrowed a turn of phrase from former U.S. Secretary of State Hillary Clinton  by proposing a “New Silk Road” to serve as an “economic belt” of Eurasia, connecting “3 million people from the Pacific to the Baltic Sea” with Kazakhstan as a key partner along the way. 

On September 10, President Nazarbayev opened the Eurasian Emerging Markets Forum in Astana, at which he addressed some 800 participants, including high-level dignitaries and representatives from 87 countries.  In his keynote speech, he laid out his plans to catapult Kazakhstan into the ranks of the top 30 developed countries in the world by 2050.  The rest of the forum was devoted to exploring the ways in which this ambitious vision could be achieved and how economic integration of the Eurasian supercontinent—i.e., Europe plus Asia, with Kazakhstan at its center—would be a driver of regional and global prosperity. 

Finally, on September 13, President Nazarbayev joined the leaders of China, Russia and the five Central Asian republics in Bishkek for a summit of the Shanghai Cooperation Organization (SCO), which was also attended by a number of other regional leaders with observer status, including from Afghanistan, India, Iran and Pakistan.  Besides the usual pledges of good neighborly relations within the group, the leaders weighed in with a chorus of statements about current geopolitical trouble spots, including Afghanistan, Iran and Syria, many of them directed critically at the United States.

While the president and people of Kazakhstan might have felt at the center of global action this week, there is little doubt that China and Russia are the key external actors on the Central Asian stage.  Europe and the United States are far away and hardly visible, and everybody expects that, with the imminent end of NATO’s engagement in Afghanistan, their attention to Central Asia will slip even further.  In contrast, the leaders of China and Russia are clearly focused on this region.  

Central Asian leaders, while perhaps privately worried about the long-term consequences of too tight an embrace by China, welcome the low-key approach of their big neighbor...

If there had been any doubt, President Xi’s speech in Astana showed that China is now concerned with Central Asia at the highest level.  While China faces its neighbors in the Pacific region in an assertive pose designed to counter what it sees as encirclement by unfriendly countries led by the U.S., it evidently feels no threat in Central Asia and projects an image of itself as benevolent and modest senior partner.  No doubt sensing opportunities to create a stable backyard, to secure access to energy resources and to build a land bridge to European and Middle Eastern markets while also gently wresting influence away from Russia, China has a strong incentive to push westward.  The substantial energy supply deals  that President Xi signed in Kazakhstan, Turkmenistan and Uzbekistan this past week and the stress Xi placed in his Astana speech on measures to open up transport links throughout Eurasia reflect China’s growing engagement in this region.  Central Asian leaders, while perhaps privately worried about the long-term consequences of too tight an embrace by China, welcome the low-key approach of their big neighbor, which promises to strengthen their own hand economically and politically at least in the short term.

At the same time, there is also a new dynamic between Central Asia and Russia.  Since Mr. Putin resumed the Russian presidency in 2012, Russia has breathed new life into a long-dormant regional grouping, the Eurasian Economic Community (EurAsEC), by pushing hard to create a customs union  (and eventually an economic union) that, in Russia’s view, would encompass most of the republics of the former Soviet Union. Although only a fraction of the geographic space of continental Eurasia (Europe + Asia), the reference to “Eurasia” harks back to a long-standing Russian ideological vision.  Under this vision, Russia and its former Soviet neighbors are endowed with a unique combination of European and Asian values and, led by Russia, with a mission to dominate the land bridge between Europe and Asia. 

In the pursuit of establishing a unified economic “Eurasian” space, Russia has not only successfully pushed for the full implementation of the current customs union between Russia, Kazakhstan and Belorussia, but is also vigorously pursuing the expansion of the union in Ukraine, Central Asia (specifically targeting the Kyrgyz Republic and Tajikistan) and Armenia in the South Caucasus.  In the case of Armenia and Ukraine, this pursuit has taken on a decidedly anti-European Union tone, as Russia seems to spare no effort to ensure that these countries will join its own economic orbit, rather than associating with the EU.  In Central Asia, the Russian campaign of expanding the customs union has been more low key, but nonetheless persistent with the quiet support of Kazakhstan.  Interestingly, this effort to create a unified economic space has not been cast by Russia as a move to counteract the growing influence of China in Central Asia, even though it is undoubtedly one of the underlying long-term motives for Russian diplomacy in the region.  

Much more important for China will be whether the “Eurasian” economic union can create safe, low-cost and high-speed transit routes to China’s key trading partners in Europe, South Asia and the Middle East.

Indeed, for Central Asia in general and for Kazakhstan in particular, the important questions for the future will be how China and Russia shape their mutual relations overall and how they will seek to accommodate their overlapping interests in the region.  For the moment, a common geopolitical front vis-à-vis the U.S., evident in their joint positions at the U.N. Security Council and at the SCO summit last week, is an overarching priority for China and Russia.  Moreover, they share the common interest of establishing a stable and prosperous political and economic sphere in Central Asia.  For now and the foreseeable future, China’s thirst for energy is large enough to allow both Russia and Central Asian countries to pursue opportunities for major oil and gas supply deals with China without undue competition. Finally, whatever protectionist effects an expansion of the Russian-led customs union may have in limiting trade between China and Central Asia will likely be temporary and will hardly be noticed in China’s huge overall trade account.  Much more important for China will be whether the “Eurasian” economic union can create safe, low-cost and high-speed transit routes to China’s key trading partners in Europe, South Asia and the Middle East. This priority strongly resonated in President Xi’s speech, in which he not only staked out an interest in Eurasian economic integration, but also promised greater cooperation between the SCO and EurAsEC.

What does all of this mean in practical terms for Central Asia and for Kazakhstan?  As President Nazarbayev indicated in his speech at the Eurasian Emerging Markets Forum, he sees Kazakhstan as playing a key role in supporting the economic integration of larger Eurasia.  This presumably should mean: investing in regional infrastructure, such as the major East-West Highway through Kazakhstan as a link from China to Europe; assuring that the customs union pursues open, rather than protectionist, policies; and convincing the other Central Asian countries, including Uzbekistan and Turkmenistan, to participate in an effort to increase the region’s connectivity both internally and with the rest of the world. 

In addition, there are a number of institutional options for promoting these goals and for turning China’s and Russia’s engagement in Central Asia into a pragmatic partnership.  One option would be to have China join the Eurasian Development Bank (EADB), the financial arm of EurAsEC.  Another would be for Russia to join the Central Asian Regional Economic Cooperation Program (CAREC), in which China has teamed up with Central Asian countries (now also including Afghanistan, Mongolia and Pakistan) and with six international financial organizations (including the Asian Development Bank and the World Bank) with the goal of improving regional cooperation and investment in trade, transport and energy.  Either or both of these two options could then offer SCO a financial and technical institutional platform to pursue economic integration between China, Russia and Central Asia (and, ultimately, even South Asia), a goal that has eluded SCO up until now. 

Kazakhstan is a member of EurAsEc, EADB, CAREC and SCO, and is therefore in a unique position to promote institutional changes along some or all of these lines.  One place to start would be the next ministerial conference of CAREC, to be held in Astana on October 24-25.  Of course, it is by no means clear that China and Russia will see it in their interest to dilute their lead roles in EADB and CAREC, the regional organizations that they now respectively dominate.  However, establishing a strong and meaningful institutional capacity that would support the economic integration process in Central Asia and in the larger Eurasia would be of great benefit for Kazakhstan, since it would help turn the country from being “land-locked” to being “land-linked” with the world’s largest and most dynamic economies.

It certainly seems that way, judging by recent developments. Capital increases for the World Bank, for the Asian Development Bank (AsDB), for the African Development Bank (AsDB), and for the Inter-American Development Bank (IADB) are nowhere in sight, despite their constrained lending capacities. Replenishments of their soft-loan windows have been anemic. They face divisive debates about what role emerging economies should play in their governance and how their leaders should be selected. Competitors are nipping at their heels, with the Asian Infrastructure Investment Bank (AIIB) only the most recent example. News of drastic financial restructuring of the AsDB and of protracted reorganization in the World Bank add to the questions about where the traditional Multilateral Development Banks (MDBs) are headed.

So let’s unpack what are the key challenges – and the main opportunities – that the traditional MDBs face. Based on the discussion at a recent roundtable of MDB representatives organized by International Fund for Agricultural Development (IFAD) in Rome, I see seven principal challenges:

• Progress in reducing extreme poverty and the in graduation of many low-income countries to middle-income status has reduced the rationale for aid and the apparent need for MDBs.
• The rapid growth of development finance channels means increasing competition in a crowded field of financial actors (private and non-governmental financial flows, new development finance institutions and vertical funds, and non-traditional donors).
• Traditional donors face increasing domestic pressure to channel aid resources through their bilateral aid organizations, and they show a growing preference to earmark their funding, rather than support general core financing for MDBs. 
• MDBs face a dramatic growth of competing knowledge providers (international and national consulting firms, universities and think tanks).
• Inflexible governance structures limit the attractiveness of MDBs to their borrowers and to new donors. With traditional donors unwilling to give up control over vote, voice, leadership selection and lending practices, borrowers see the MDBs as unresponsive, risk averse, burdensome and costly. Emerging economy donors find MDBs unable or unwilling to absorb increased contributions with associated shifts in votes, voice and control. And since non-governmental actors cannot participate in the MDB governance structures, they do not contribute to MDB funding.
• The revival of Cold War/East-West confrontation risks politicizing the institutions’ lending practices – the World Bank and European Bank for Reconstruction and Development (EBRD) stopped lending to Russia in the wake of the sanctions imposed by the West – and reinforces incentives for setting up new institutions.
• Most MDBs find it difficult to engage directly with the private and social enterprise sectors. Due to constraints in their statutes, policies and staff capacity MDBs have not been able to provide much direct financing for private investments.

But there are also opportunities that the MDBs can capitalize on:

• Despite the challenges that MDBs face in borrowing and donor countries, overall they remain trusted partners, due to a unique combination of strengths: their traditional political neutrality, freedom from special interests and corruption, technical professionalism, long-term development perspective and hands-on program design and finance engagement. Overdue reform of MDB governance and processes and effective resistance to political pressures can increase the trust all members put in them.
• As we face increased risks of geo-political fragmentation, regionalization, and confrontation, the world will need the truly multilateral MDBs more rather than less, since they offer globally inclusive forums and instruments to help address pressing global and regional issues.
• Despite remarkable progress, poverty reduction remains a huge task. Elimination of extreme poverty ($1.25pd) by 2030 is a valid goal; but its achievement will not eliminate poverty. The billions of people living below $5pd are poor. Poverty reduction will remain a valid goal for MDBs long beyond 2030.
• The Post-2015 and climate change agendas provide a window of opportunity for MDBs to demonstrate their continued, and indeed enhanced, relevance to the global sustainable development agenda in low-income and middle-income countries. The huge role of European Investment Bank in the European Union is one demonstration of the important role MDBs can play even for the advanced countries.
• The MDBs’ unique package of services provides better value than the services offered by many competitors. Their combination of strong project preparation, supervision and finance, their attention to indebtedness constraints and sustainability requirements, their focus on policy and institutional capacity and their ability to forge multi-stakeholder partnerships provide strong and effective support. MDBs provide a steady compass in helping shift countries’ national priorities from short-term expediency to sound long-term policies and programs for sustained impact at scale.
• MDBs have shown that they play a key role in responding to economic crises, natural disasters and conflict, as demonstrated for example by their response to the global financial and economic crisis of 2008/9.
• MDBs can increase the leverage of their financial resources, as demonstrated by the recent restructuring of the AsDB, and broaden their engagement with the private sector, building on the successful experience of the International Finance Corporation and EBRD.

In sum, the creation of many copycat development banks demonstrates the remarkable strength and durability of the basic MDB model. As long as the traditional MDBs squarely face the challenges and opportunities, there’s plenty of life left in their old bones.

The replenishment process for concessional resources of the multilateral development banks is broken. We have come to this conclusion after a review of the experience with recent replenishments of multilateral development funds. We also base it on first-hand observation, since one of us was responsible for the World Bank’s International Development Association (IDA) replenishment consultations 20 years ago and recently served as the external chair for the last two replenishment consultations of the International Fund for Agricultural Development (IFAD), which closely follow the common multilateral development bank (MDB) practice. As many of the banks and their donors are preparing for midterm reviews as a first step toward the next round of replenishment consultations, this is a good time to take stock and consider what needs to be done to fix the replenishment process.

So what’s the problem?

Most of all, the replenishment process does not serve its key intended function of setting overall operational strategy for the development funds and holding the institutions accountable for effectively implementing the strategy. Instead, the replenishment consultations have turned into a time-consuming and costly process in which donor representatives from their capitals get bogged down in the minutiae of institutional management that are better left to the boards of directors and the managements of the MDBs. There are other problems, including lack of adequate engagement of recipient countries in donors’ deliberations, the lack of full participation of the donors’ representatives on the boards of the institutions in the process, and inflexible governance structures that serve as a disincentive for non-traditional donors (from emerging countries and from private foundations) to contribute.

But let’s focus on the consultation process. What does it look like? Typically, donor representatives from capitals assemble every three years (or four, in the case of the Asian Development Bank) for a year-long consultation round, consisting of four two-day meetings (including the meeting devoted to the midterm review of the ongoing replenishment and to setting the agenda for the next consultation process). For these meetings, MDB staff prepare, per consultation round, some 20 substantive documents that are intended to delve into operational and institutional performance in great detail. Each consultation round produces a long list of specific commitments (around 40 commitments is not uncommon), which management is required to implement and monitor, and report on in the midterm review. In effect, however, this review covers only half the replenishment cycle, which leads to the reporting, monitoring, and accountability being limited to the delivery of committed outputs (e.g., a specific sector strategy) with little attention paid to implementation, let alone outcomes.

The process is eerily reminiscent of the much maligned “Christmas tree” approach of the World Bank’s structural adjustment loans in the 1980s and 1990s, with their detailed matrixes of conditionality; lack of strategic selectivity and country ownership; focus on inputs rather than outcomes; and lack of consideration of the borrowers’ capacity and costs of implementing the Bank-imposed measures. Ironically, the donors successfully pushed the MDBs to give up on such conditionality (without ownership of the recipient countries) in their loans, but they impose the same kind of conditionality (without full ownership of the recipient countries and institutions) on the MDBs themselves—replenishment after replenishment.

Aside from lack of selectivity, strategic focus, and ownership of the commitments, the consultation process is also burdensome and costly in terms of the MDBs’ senior management and staff time as well as time spent by ministerial staff in donor capitals, with literally thousands of management and staff hours spent on producing and reviewing documentation. And the recent innovation of having donor representatives meet between consultation rounds as working groups dealing with long-term strategic issues, while welcome in principle, has imposed further costs on the MDBs and capitals in terms of preparing documentation and meetings.

It doesn’t have to be that way. Twenty years ago the process was much simpler and less costly. Even today, recent MDB capital increases, which mobilized resources for the non-concessional windows of the MDBs, were achieved with much simpler processes, and the replenishment consultations for special purpose funds, such as the Global Fund for HIV/AIDS, tuberculosis, and malaria and for the GAVI Alliance, are more streamlined than those of the MDBs.

So what’s to be done?

We recommend the following measures to fix the replenishment consultation process:

1. Focus on a few strategic issues and reduce the number of commitments with an explicit consideration of the costs and capacity requirements they imply. Shift the balance of monitoring and accountability from delivery of outputs to implementation and outcomes.
2. Prepare no more than five documents for the consultation process: (i) a midterm review on the implementation of the previous replenishment and key issues for the future; (ii) a corporate strategy or strategy update; (iii) the substantive report on how the replenishment resources will contribute to achieve the strategy; (iv) a financial outlook and strategy document; and (v) the legal document of the replenishment resolution.
3. Reduce the number of meetings for each replenishment round to no more than three and lengthen the replenishment period from three to four years or more.
4. Use the newly established working group meetings between replenishment consultation rounds to focus on one or two long-term, strategic issues, including how to fix the replenishment process.

The initiative for such changes lies with the donor representatives in the capitals, and from our interviews with donor representatives we understand that many of them broadly share our concerns. So this is a good time—indeed it is high time!—for them to act.

Event Information

In 2015, 193 countries adopted the Sustainable Development Goals (SDGs), a new global agenda that is more ambitious than the preceding Millennium Development Goals and aims to make progress on some of the most pressing issues of our time. Goal 4, "To ensure inclusive and quality education for all, with relevant and effective learning outcomes," challenges the international education community to meet universal access plus learning by 2030. We know that access to primary schooling has scaled up rapidly over previous decades, but what can be learned from places where transformational changes in learning have occurred? What can governments, civil society, and the private sector do to more actively scale up quality learning?

On April 18-19, the Center for Universal Education (CUE) at Brookings launched "Millions Learning: Scaling Up Quality Education in Developing Countries," a comprehensive study that examines where learning has improved around the world and what factors have contributed to that process. This two-day event included two sessions. Monday, April 18 focused on the role of global actors in accelerating progress to meeting the SDGs. The second session on Tuesday, April 19 included a presentation of the Millions Learning report followed by panel discussions on the role of financing and technology in scaling education in developing countries.

 Join the conversation on Twitter #MillionsLearning

Video

• Getting millions to learn: What will it take to accelerate progress on meeting the Sustainable Development Goals?
• Scaling quality education: The launch of the Millions Learning report
• Do funders help or hinder scaling in education?
• What role can technology play in scaling education?

Audio

• Getting millions to learn: What will it take to accelerate progress on meeting the Sustainable Development Goals?

Transcript

• Uncorrected Transcript - Day 1 (.pdf)
• Uncorrected Transcript - Day 2 (.pdf)

Event Materials

• 20160418_millions_learning_transcript
• 20160419_millions_learning_transcript

To achieve the desired outcomes of the Sustainable Development Goals as well as the global targets from the Paris COP21 Climate Summit by 2030, governments will have to find ways to meet the top-down objectives with bottom-up approaches. A systematic focus on scaling up successful development interventions could serve to bridge this gap, or what’s been called the “missing middle.” However, the question remains how to actually address the challenge of scaling up.

When Arna Hartmann, adjunct professor of international development, and I first looked at the scaling up agenda in development work in the mid-2000s, we concluded that development agencies were insufficiently focused on supporting the scaling up of successful development interventions. The pervasive focus on one-off projects all too often resulted in what I’ve come to refer to as “pilots to nowhere.” As a first step to fix this, we recommended that each aid organization carry out a review to be sure to focus effectively on scaling up. 

The institutional dimension is critical, given their role in developing and implementing scaling up pathways. Of course, individuals serve as champions, designers, and implementers, but experience illustrates that if individuals lack a strong link to a supportive institution, scaling up is most likely to be short-lived and unsustainable. “Institutions” include many different types of organizations, such as government ministries and departments, private firms and social enterprises, civil society organizations, and both public and private external donors and financiers.

The Brookings book “Getting to Scale: How to Bring Development Solutions to Millions of Poor People” explores the opportunities and challenges that such organizations face, on their own or, better yet, partnering with each other, in scaling up the development impact of their successful interventions.

Over the past decade I have worked with 10 foreign aid institutions—multilateral and bilateral agencies, as well as big global non-governmental organizations—helping them to focus systematically on scaling up operational work and developing approaches to do so. There are common lessons that apply across the board to these agencies, with one salutary example being the International Fund for Agricultural Development (IFAD) which has tackled the scaling up agenda systematically and persistently.

Following are eight takeaway lessons I gleaned from my work with IFAD:

1. Look into the “black box” of institutions. It is not enough to decide that an institution should focus on and support scaling up of successful development interventions. You actually need to look at how institutions function in terms of their mission statement and corporate strategy, their policies and processes, their operational instruments, their budgets, management and staff incentives, and their monitoring and evaluation practices. Check out the Brookings working paper that summarizes the results of a scaling up review of the IFAD.
2. Scaling needs to be pursued institution-wide. Tasking one unit in an organization with innovation and scaling up, or creating special outside entities (like the Global Innovation Fund set up jointly by a number of donor agencies) is a good first step. But ultimately, a comprehensive approach must be mainstreamed so that all operational activities are geared toward scaling up.
3. Scaling up must be championed from the top. The governing boards and leadership of the institutions need to commit to scaling up and persistently stay on message, since, like any fundamental institutional change, effectively scaling up takes time, perhaps a decade or more as with IFAD.
4. The scaling up process must be grown within the institution. External analysis and advice from consultants can play an important role in institutional reviews. But for lasting institutional change, the leadership must come from within and involve broad participation from managers and staff in developing operational policies and processes that are tailored to an institution’s specific culture, tasks, and organizational structure.
5. A well-articulated operational approach for scaling up needs to be put in place. For more on this, take a look at a recent paper by Larry Cooley and I that reviews two helpful operational approaches, which are also covered in Cooley’s blog. For the education sector, the Center for Universal Education at Brookings just published its report “Millions Learning,” which provides a useful scaling up approach specifically tailored to the education sector.
6. Operational staffs need to receive practical guidance and training. It is not enough to tell staff that they have to focus on scaling up and then give them a general framework. They also need practical guidance and training, ideally tailored to the specific business lines they are engaged in. IFAD, for example, developed overall operational guidelines for scaling up, as well as guidance notes for specific area of engagement, including livestock development, agricultural value chains, land tenure security, etc.  This guidance and training ideally should also be extended to consultants working with the agency on project preparation, implementation, and evaluation, as well as to the agency’s local counterpart organizations.
7. New approaches to monitoring and evaluation (M&E) have to be crafted. Typically the M&E for development projects is backward looking and focused on accountability, narrow issues of implementation, and short-term results. Scaling up requires continuous learning, structured experimentation, and innovation based on evidence, including whether the enabling conditions for scaling up are being established. And it is important to monitor and evaluate the institutional mainstreaming process of scaling up to ensure that it is effectively pursued. I’d recommend looking at how the German Agency for International Development (GIZ) carried out a corporate-wide evaluation of its scaling up experience.
8. Scaling up helps aid organizations mobilize financial resources. Scaling up leverages limited institutional resources in two ways: First, an organization can multiply the impact of its own financial capacity by linking up with public and private agencies and building multi-stakeholder coalitions in support of scaling up. Second, when an organization demonstrates that it is pursuing not only one-off results but also scaled up impact, funders or shareholders of the organization tend to be more motivated to support the organization. This certainly was one of the drivers of IFAD’s successful financial replenishment consultation rounds over the last decade.

By adopting these lessons, development organizations can actually begin to scale up to the level necessary to bridge the missing middle. The key will be to assure that a focus on scaling up is not the exception but instead becomes ingrained in the institutional DNA. Simply put, in designing and implementing development programs and projects, the question needs to be answered, “What’s next, if this intervention works?”

In 2015 the international community agreed on a set of ambitious sustainable development goals (SDGs) for the global society, to be achieved by 2030. One of the lessons that the implementation of the Millennium Development Goals (MDG s) has highlighted is the importance of a systematic approach to identify and sequence development interventions—policies, programs, and projects—to achieve such goals at a meaningful scale. The Chinese approach to development, which consists of identifying a problem and long-term goal, testing alternative solutions, and then implementing those that are promising in a sustained manner, learning and adapting as one proceeds—Deng Xiaoping’s “crossing the river by feeling the stones”—is an approach that holds promise for successful achievement of the SDGs.

Having observed the Chinese way, then World Bank Group President James Wolfensohn in 2004, together with the Chinese government, convened a major international conference in Shanghai on scaling up successful development interventions, and in 2005 the World Bank Group (WBG ) published the results of the conference, including an assessment of the Chinese approach. (Moreno-Dodson 2005). Some ten years later, the WBG once again is addressing the question of how to support scaling up of successful development interventions, at a time when the challenge and opportunity of scaling up have become a widely recognized issue for many development institutions and experts.

Since traditional private and public service providers frequently do not reach the poorest people in developing countries, social enterprises can play an important role in providing key services to those at the “base of the pyramid.”

In parallel with the recognition that scaling up matters, the development community is now also focusing on social enterprises (SEs), a new set of actors falling between the traditionally recognized public and private sectors. We adopt here the World Bank’s definition of “social enterprises” as a social-mission-led organization that provides sustainable services to Base of the Pyramid (BoP) populations. This is broadly in line with other existing definitions for the sector and reflects the World Bank’s primary interest in social enterprises as a mechanism for supporting service delivery for the poor. Although social enterprises can adopt various organizational forms—business, nongovernmental organizations (NGOs), and community-based organizations are all forms commonly adopted by social enterprises—they differ from private providers principally by combining three features: operating with a social purpose, adhering to business principles, and aiming for financial sustainability. Since traditional private and public service providers frequently do not reach the poorest people in developing countries, social enterprises can play an important role in providing key services to those at the “base of the pyramid.” (Figure 1)

Figure 1. Role of SE sector in public service provision

Social enterprises often start at the initiative of a visionary entrepreneur who sees a significant social need, whether in education, health, sanitation, or microfinance, and who responds by developing an innovative way to address the perceived need, usually by setting up an NGO, or a for-profit enterprise. Social enterprises and their innovations generally start small. When successful, they face an important challenge: how to expand their operations and innovations to meet the social need at a larger scale. 

Development partner organizations—donors, for short—have recognized the contribution that social enterprises can make to find and implement innovative ways to meet the social service needs of people at the base of the pyramid, and they have started to explore how they can support social enterprises in responding to these needs at a meaningful scale. 

The purpose of this paper is to present a menu of approaches for addressing the challenge of scaling up social enterprise innovations, based on a review of the literature on scaling up and on social enterprises. The paper does not aim to offer specific recommendations for entrepreneurs or blueprints and guidelines for the development agencies. The range of settings, problems, and solutions is too wide to permit that. Rather, the paper provides an overview of ways to think about and approach the scaling up of social enterprise innovations. Where possible, the paper also refers to specific tools that can be helpful in implementing the proposed approaches. 

Note that we talk about scaling up social enterprise innovations, not about social enterprises. This is because it is the innovations and how they are scaled up that matter. An innovation may be scaled up by the social enterprise where it originated, by handoff to a public agency for implementation at a larger scale, or by other private enterprises, small or large. 

This paper is structured in three parts: Part I presents a general approach to scaling up development interventions. This helps establish basic definitions and concepts. Part II considers approaches for the scaling up of social enterprise innovations. Part III provides a summary of the main conclusions and lessons from experience. A postscript draws out implications for external aid donors. Examples from actual practice are used to exemplify the approaches and are summarized in Annex boxes.

Downloads

• Download the full paper (PDF)

With just over six months to go until the Iowa caucuses, news organizations are already speculating about what the Bush or Clinton or Trump Sanders administrations might look like. Though it might seem premature, their impulse is the right one. After the winner of the 2016 presidential race is announced in November of that year, the new President-elect will have just under three months to build his or her new government. From choosing cabinet members and key White House staff to setting the policy agenda and dealing with unanticipated crises, the presidential transition process is a huge undertaking, and one that requires much more advance planning than it is usually given.

Acknowledging the short timetable that surrounds the presidential transition process, on July 31 the Senate passed the “Edward ‘Ted’ Kaufman and Michael Leavitt Presidential Transitions Improvements Act of 2015.” If passed by the House and signed into law, this bill would require the president to establish a “White House Transition Coordinating Council” six months prior to the presidential election. This council would work with transition representatives for both candidates to prepare for the challenges that will lie ahead.

Under the new bill, the President would also be tasked to create an “Agency Transition Director’s Council.” This council would ensure that federal agencies function effectively through the transition. Again, transition representatives for each candidate would work with a group of senior representatives from the agencies, planning leadership changes and identifying potential obstacles.

Additionally, agency directors would designate “acting officers” for all essential non-career positions. In the event that these positions become vacant during the transition, a career civil servant from the agency will take over as “acting officer” until a replacement is appointed.

The Bush to Obama transition was one of the smoothest in history, and this bill reflects the best practices learned from that experience. (Full disclosure: one of the co-authors of this blog, Eisen, was the deputy general counsel of the Obama transition.) The Bush administration was ready early to work with the transition teams for both major party candidates. It offered a model of organization and cooperation with both campaigns well before Election Day. Once the election was decided, that engagement intensified, with constant contact and seamless teamwork between President-elect and his team and President Bush and his. Indeed, even after Election Day, many Bush appointees were asked to and did stay on longer in order to give the administration more time to find suitable replacements (See, e.g. Burke, p.594).

The Obama administration will undoubtedly "pay it forward" and meet those same high standards in addressing the upcoming transition. Nevertheless, codifying recent best practices as law makes eminent sense now, while we are all paying attention to the upcoming election—and knowing a future administration may not be as cooperative unless required by law. Although Inauguration Day 2017 may seem far off, there is actually not a moment to spare for this important legislation to proceed.

Now that that the initial revelations regarding the VW scandal have sunk in it’s time to begin assessing the larger significance of those revelations. While the case and, we predict, VW, will continue for years (we are only at the end of the beginning, and far from the beginning of the end), we are far enough along to see five large questions emerging. These questions will tell us much about the economic, corporate and cultural future of VW and German enterprise. 

1) VW was an integral component of Germany's industrial reputation in Europe, across the Atlantic in the United States, and around the world. Now, that hard-won reputation is at risk. How broad will the damage be to German businesses' reputation not just for quality, but for "premium quality?"

2) Turning from the German business sector to the German economy as a whole, the VW scandal has many ironies, not least of which is that the company was a key driver (so to speak) of the famous German Wirthschaftswunder. Economic health propelled a vanquished Germany to the forefront of Europe’s post-WWII recovery and then made post-Cold War reunification a success. Does the VW scandal have the potential to slow down the overall growth of the German economy, and what are the European and global implications of that at a time when the Chinese economy is also sputtering?

3) From a corporate governance perspective, the scandal represents some of the most boneheaded thinking ever. Following disclosure of the fraud, €14bn (£10bn; $15.6bn) was wiped off VW's stock market value. Whoever knew/orchestrated the scheme thought they would get away with it, but did they really not foresee the consequences or even the likelihood of getting caught? We will long be studying the abnormal “fraud psychology" of this case.

4) Germany ranks among the top ten countries for low corruption according to Transparency International. Yet VW is not alone among German companies in making major headlines with massive ethics failures in recent years, joining Siemens, Bayer, Deutsche Bank, and many others. What does this mean for the future of Germany’s role as a force for anti-corruption at home and internationally?

5) Former VW CEO Winterkorn resigned but claimed he knew nothing about the scandal. What does this say about the structure and management culture of Germany’s largest companies? How widespread is “plausible deniability” in German business culture--and in all business culture everywhere? If so, what are the dangers of this going forward, and what should be done to address them?

Event Information

As the sixth anniversary of Citizens United v. FEC approaches on January 21, both experts and ordinary citizens believe the United States is confronting a campaign finance crisis. Citizens United and related court cases have unleashed a flood of dark money that many believe could drown our democracy. It is estimated that over $5 billion will be spent on the 2016 presidential race—more than 3 times the amount spent in 2008 (already the most expensive election cycle in history). A comprehensive poll conducted by the New York Times and CBS News in the spring of 2015 showed that 84 percent of adults—including 90 percent of Democrats and 80 percent of Republicans—believe that money has too much influence in American political campaigns. Even the richest Americans agreed: 85 percent of adults making $100,000 or more share that same belief.

There has been much handwringing about this state of affairs. But there has been too little public attention paid to finding solutions. On the sixth anniversary of Citizens United, the Governance Studies program at Brookings hosted current and former government officials, lobbyists, donors, advocates, and other experts to discuss how to resolve the campaign finance crisis. They focused on innovative reform efforts at the federal, state, and local levels which offer the hope of addressing the problem of big money in politics.

Panelists will included:

Cheri Beasley, Associate Justice, North Carolina Supreme Court
Daniel Berger, Partner, Berger & Montague, P.C.
John Bonifaz, Co-Founder and President, Free Speech for People
Norman L. Eisen, U.S. Ambassador to the Czech Republic (2011-2014); Special Assistant and Special Counsel to the President (2009-2011); Visiting Fellow, The Brookings Institution
Bruce Freed, Founder and President, Center for Political Accountability
Steve Israel, Member, U.S. House of Representatives (D-NY)
Roger Katz, Chair, Government Oversight Committee, Maine State Senate (R)
Allen Loughry, Justice, Supreme Court of Appeals of West Virginia
Chuck Merin, Executive Vice President, Prime Policy Group; Lobbyist
Connie Morella, Ambassador to OECD (2003-2007); Member, U.S. House of Representatives (R-Md., 1987-2003)
Jeffrey Peck, Principal, Peck Madigan Jones; Lobbyist
Nick Penniman, Executive Director, Issue One
Trevor Potter, Commissioner, Federal Election Commission (1991-1995; Chairman,1994)
John Pudner, Executive Director, Take Back Our Republic
Ann Ravel, Commissioner, Federal Election Commission (Chairwoman, 2015)
Timothy Roemer, Ambassador to India (2009-2011); Member, U.S. House of Representatives (D-Ind., 1991-2003); member 9/11 Commission; Senior Strategic Advisor to Issue One
John Sarbanes, Member, U.S. House of Representatives (D-Md.)
Claudine Schneider, Member, U.S. House of Representatives (R-R.I.,1981-1991)
Peter Schweizer, President, Government Accountability Institute
Zephyr Teachout, CEO, Mayday PAC
Lucas Welch, Executive Director, The Pluribus Project
Fred Wertheimer, Founder and President, Democracy 21
Tim Wirth, Member, U.S. Senate (D-Colo.,1987-1993); Member, U.S. House of Representatives (D-Colo.,1975-1987)
Dan Wolf, Chair, Committee on Steering and Policy, Massachusetts State Senate (D)

Click here for a full agenda.

Video

• The campaign finance crisis in America and how to fix it - Part 1
• The campaign finance crisis in America and how to fix it - Part 2
• The campaign finance crisis in America and how to fix it - Part 3
• The campaign finance crisis in America and how to fix it - Part 4

Audio

• The campaign finance crisis in America and how to fix it: A solutions summit (Part 1)
• The campaign finance crisis in America and how to fix it: A solutions summit (Part 2)
• The campaign finance crisis in America and how to fix it: A solutions summit (Part 3)
• The campaign finance crisis in America and how to fix it: A solutions summit (Part 4)

Transcript

• Uncorrected Transcript (.pdf)

Event Materials

• Solution Summits Agenda120
• 20160121_campaign_finance_summit_transcript

Last week, over 100 experts from across the U.S. came together at the Brookings Institution on the sixth anniversary of the Citizens United decision to analyze its disastrous consequences and how to repair them. The room was as diverse as it was packed. Two dozen current and former members of Congress, representatives of the executive and judicial branches, both state and federal, attended. They sat side-by-side with business leaders and lobbyists, activists and scholars. Conservatives and Tea Party leaders mingled with liberals and progressives. All were united by their agreement that the current system is broken—and their determination to fix it.

Several points of consensus emerged from the half day event.

First, we are facing a crisis due to the flood of money that is drowning American democracy. For example, Congressman Steve Israel expanded on his recent New York Times op-ed describing why he his quitting Congress. He related his experience of calling potential campaign donors from a small cubicle off the Capitol grounds—a practice referred to as “call time.” Invoking images from The Wolf of Wall Street, Congressman Israel compared the practice to “selling penny stocks, only it’s shares of democracy that are being traded.” The result is voter disillusionment– voters increasingly feeling like their voices are not heard because they cannot make large political contributions. Author Peter Schweizer, President of the Government Accountability Institute, argued that businesses suffer under this system as well. From his perspective, “Businesses … are targeted by politicians in the search for cash,” in a type of extortion by which politicians use their influence to benefit only those who can pay up. The Executive Director of Take Back our Republic, John Pudner, argued that the campaign finance system is the single greatest threat to national security—if domestic interests can purchase influence in our system, international interests can figure out a way to do so as well.

Ambassador Eisen with Congressman Steve Israel (D-NY 3) 

Second, there is hope for a fix. There are a wide range of innovative solutions at hand, many of which have already been successfully deployed at the state and local levels. Commissioner and outgoing Chair Ann Ravel of the Federal Election Commission laid out a reform agenda for that organization. John Bonifaz of Free Speech for People advocated for a 28^th amendment allowing for campaign spending limits, reminding the audience, “We have done this before in our nation’s history; 27 times before. Seven of those times to overturn egregious Supreme Court rulings.” Fred Wertheimer urged strategies to capitalize on the small donor revolution that technology has ushered in, as well as a renewed push for public finance. Judges and legislators from states across the union discussed how public finance and other remedies are working at the state and local levels. Still others advocated solutions including a pledge that would commit politicians to ethical fundraising standards and campaign finance reform agendas when in office; reform in the Federal Election Commission to allow greater enforcement authority; corporate governance policies that require publically held companies to openly disclose political contributions and be accountable to their shareholders; and many, many more specific solutions to tackle the problem from all sides.

Third, and perhaps the most important takeaway from the event, was that those fixes are in political reach. Expert after expert, all from vastly different backgrounds and political orientations, argued that we are much closer to achieving these solutions than we think. The entire program was evidence of that—the size, diversity, and passion of the attendees mirroring a nation of voters who are demanding their representatives do what’s necessary to fix our broken campaign finance system. In the concluding panel, Congressman John Sarbanes predicted, “I think the public is going to demand this. That’s why the time is now. The broad public has arrived at a moment where they are demanding a response to the way they feel. If they don’t get it from some of the solutions we’re proposing, because we don’t educate them that those solutions are there, they’re going to grab a pitchfork and they’re going to go somewhere else. But there’s plenty of evidence that the public will not be denied some remedy to the way they feel.”

The full audio of the event, which includes further discussion of many solutions and the reasons why they are so necessary, can be found on the event page. By clicking there, you can see all the featured speakers, and many more experts participated from the audience floor. Give a listen and you will see why it was such a remarkable day, and why change is nearer that you may think.

We have received many emails and calls in response to our blog last week about our campaign finance reform “Solutions Summit," so we thought we would share some pictures and quotes from the event. Also, Issue One’s Nick Penniman and I just co-authored an op-ed highlighting the themes of the event, which you can find here.

Ann Ravel, Commissioner of the Federal Election Commission and the outgoing Chairwoman kicked us off as our luncheon speaker. She noted that, “campaign finance issues [will] only be addressed when there is a scandal. The truth is, that campaign finance today is a scandal.”

(L-R, Ann Ravel, Trevor Potter, Peter Schweizer, Timothy Roemer)

Commenting on Ann’s remarks from a conservative perspective, Peter Schweizer, the President of the Government Accountability Institute, noted that, “increasingly today the problem is more one of extortion, that the challenge not so much from businesses that are trying to influence politicians, although that certainly happens, but that businesses feel and are targeted by politicians in the search for cash.” That’s Trevor Potter, who introduced Ann, to Peter’s left.

Kicking off the first panel, a deep dive into the elements of the campaign finance crisis, was Tim Roemer, former Ambassador to India (2009-2011), Member of the U.S. House of Representatives, (D-IN, 1991-2003) Member of the 9/11 Commission and Senior Strategic Advisor to Issue One. He explained that “This is not a red state problem. It’s not a blue state problem. Across the heartland, across America, the Left, the Right, the Democrats, the Republicans, Independents, we all need to work together to fix this.”

(L-R, Fred Wertheimer, John Bonifaz, Dan Wolf, Roger Katz, Allen Loughry, Cheri Beasley, Norman Eisen)

Our second panel addressed solutions at the federal and state level.  Here, Fred Wertheimer, the founder and President of Democracy 21 is saying that, “We are going to have major scandals again and we are going to have opportunities for major reforms. With this corrupt campaign finance system it is only a matter of time before the scandals really break out. The American people are clearly ready for a change. The largest national reform movement in decades now exists and it’s growing rapidly.”

Our third and final panel explained why the time for reform is now. John Sarbanes, Member of the U.S. House of Representatives (D-MD) argued that fixes are in political reach. He explains, “If we can build on the way people feel about [what] they’re passionate on and lead them that way to this need for reform, then we’re going to build the kind of broad, deep coalition that will achieve success ultimately.”

(L-R in each photo, John Sarbanes, Claudine Schneider, Zephyr Teachout)

Reinforcing John’s remarks, Claudine Schneider, Member of the U.S. House of Representatives (R-RI, 1981-1991) pointed out that “we need to keep pounding the media with letters to the editor, with editorial press conferences, with broad spectrum of media strategies where we can get the attention of the masses. Because once the masses rise up, I believe that’s when were really going to get the change, from the bottom up and the top down.”

Grace Abiera contributed to this post.

The European Union (EU) is confronting a series of potentially existential threats, including the refugee crisis, ISIS terror, Russian adventurism, and Brexit (the potential exit of the U.K. from the EU).  I hosted Czech Prime Minister Bohuslav Sobotka at Brookings to get his fundamentally (but carefully) optimistic take on how he and his fellow EU leaders can meet those challenges. Here are five reasons for optimism that emerged from our conversation: 

1. Take the Fight to Daesh.  The PM made clear Europe’s determination to take on the terror and refugee issues at their source in Iraq, Syria, and Libya.  Just this week, the Czech Republic upped its commitment to the international coalition, announcing that it will send a team to train Iraqis using U.S. made L-159 fighter jets (also sold to Iraq by Prague).  With transatlantic leadership, these efforts are starting to bear fruit in the decay of ISIS.
2. Never Let a Good Crisis Go to Waste. As part of addressing today’s refugee crisis, Europe is exploring multi-lateral efforts to construct a common European border service, integrate refugee populations, and promote internal security.  The process is painful, but filling these gaps will make the European Union stronger.
3. Stand Strong With Ukraine.  Some predicted that European unity against Putin’s expansionism would not hold.  Instead, the EU and the United States have maintained their resolve in enacting sanctions.  That has strengthened the EU, but as the PM pointed out, now Ukraine and its supporters must make sure that state moves towards good governance and functionality. 
4. Taking the Exit Out of Brexit.  The PM predicted that the U.K. would not exit the EU.  When I pressed him on why, he acknowledged that there were elements of wishing and hoping in that forecast, and that the vote comes at a tough moment.  But I share the PM’s hopes—the U.K. is not one to leave friends when times get tough.
5. Never Forget to Remember.  The PM and I spent a lot of time discussing the ups and downs of Central Europe’s experiment with democracy over the past century.  He and his Czech colleagues—of all mainstream political parties—are acutely aware of that history, and that too gives me hope that it will not be repeated.

Immense challenges can destabilize and divide—but they also present opportunities for new collaboration and cohesion. If addressed in partnership, Europe’s current trials can ultimately strengthen the ties that bind the EU together.  

Watch the full discussion here.

Andrew Kenealy contributed to this post. 

On June 20, I moderated a conversation on the future of the Department of Veterans Affairs with Secretary Robert McDonald. When he took office almost two years ago, Secretary McDonald inherited an organization in crisis: too many veterans faced shockingly long wait-times before they received care, VA officials had allegedly falsified records, and other allegations of mismanagement abounded.

Photo: Paul Morigi

Since he was sworn into office, Secretary McDonald has led the VA through a period of ambitious reform, anchored by the MyVA program. He and his team have embraced three core strategies that are securing meaningful change. They are important insights for all government leaders, and private sector ones as well.

1. Set bold goals

Secretary McDonald’s vision is for the VA to become the number one customer-service agency in the federal government. But he and his team know that words alone won’t make this happen. They developed twelve breakthrough priorities for 2016 that will directly improve service to veterans. These actionable short-term objectives support the VA’s longer term aim to deliver an exceptional experience for our veterans. By aiming high, and also drafting a concrete roadmap, the VA has put itself on a path to success.

2. Hybridize the best of public and private sectors

To accomplish their ambitious goal, VA leadership is applying the best practices of customer-service businesses around the nation. The Secretary and his colleagues are leveraging the goodwill, resources, and expertise of both the private and public sector. To do that, the VA has brought together diverse groups of business leaders, medical professionals, government executives, and veteran advocates under their umbrella MyVA Advisory Committee. Following the examples set by private sector leaders in service provision and innovation, the VA is developing user-friendly mobile apps for veterans, modernizing its website, and seeking to make hiring practices faster, more competitive, and more efficient. And so that no good idea is left unheard, the VA has created a "shark tank” to capture and enact suggestions and recommendations for improvement from the folks who best understand daily VA operations—VA employees themselves.

3. Data, data, data

The benefits of data-driven decision making in government are well known. As led by Secretary McDonald, the VA has continued to embrace the use of data to inform its policies and improve its performance. Already a leader in the collection and publication of data, the VA has recently taken even greater strides in sharing information between its healthcare delivery agencies. In addition to collecting administrative and health-outcomes information, the VA is gathering data from veterans about what they think . Automated kiosks allow veterans to check in for appointments, and to record their level of satisfaction with the services provided.

The results that the Secretary and his team have achieved speak for themselves:

• 5 million more appointments completed last fiscal year over the previous fiscal year
• 7 million additional hours of care for veterans in the last two years (based on an increase in the clinical workload of 11 percent over the last two years)
• 97 percent of appointments completed within 30 days of the veteran’s preferred date; 86 percent within 7 days; 22 percent the same day
• Average wait times of 5 days for primary care, 6 days for specialty care, and 2 days for mental health are
• 90 percent of veterans say they are satisfied or completely satisfied with when they got their appointment (less than 3 percent said they were dissatisfied or completely dissatisfied).
• The backlog for disability claims—once over 600,000 claims that were more than 125 days old—is down almost 90 percent.

Thanks to Secretary McDonald’s continued commitment to modernization, the VA has made significant progress. Problems, of course, remain at the VA and the Secretary has more work to do to ensure America honors the debt it owes its veterans, but the past two years of reform have moved the Department in the right direction. His strategies are instructive for managers of change everywhere.

Fred Dews and Andrew Kenealy contributed to this post.

How has the Joint Comprehensive Plan of Action (JCPOA)—signed between the P5+1 and Iran one year ago—played out in practice? Several Brookings scholars, many of whom participated prominently in debates last year surrounding official congressional review, offered their views.