Event Information

On July 20 and 21, defense ministers from several nations will gather in Washington, D.C. at the invitation of U.S. Secretary of Defense Ash Carter. The meeting will bring together representatives from countries working to confront and defeat the Islamic State (or ISIL). French Defense Minister Jean-Yves Le Drian will be among those at the summit discussing how to accelerate long-term efforts to fight ISIL in Iraq and Syria. The close relationship between France and the United States has provided a solid base for security cooperation for decades, and in recent years, France has become one of America’s strongest allies in fighting terrorism and a prominent member of the international coalition to defeat ISIL.

On July 20, the Foreign Policy program at Brookings hosted Minister Le Drian for a discussion on French and U.S. cooperation as the two countries face multiple transnational security threats. Since becoming France’s defense minister in 2012, Le Drian has had to address numerous new security crises emerging from Africa, the Middle East, and within Europe itself. France faced horrific terrorist attacks on its own soil in January and November 2015 and remains under a state of emergency with its armed forces playing an active role in maintaining security both at home and abroad. Le Drian recently authored “Qui est l’ennemi?” (“Who is the enemy?”, Editions du Cerf, May 2016), defining a comprehensive strategy to address numerous current threats.

Join the conversation on Twitter using #USFrance

Video

• Introduction and featured speaker
• Discussion
• Introduction et conférencier invité
• Débat

Transcript

• Uncorrected Transcript (.pdf)

Event Materials

• 20160720_france_defense_transcript

Event Information

The failed coup in Turkey on July 15 to 16, organized by factions within the Turkish military in an attempt to overthrow the government of President Erdoğan, represents both a victory and a new trial for Turkish democracy. Although the Turkish citizenry brought the country back from the brink of anarchy and civil war, many analysts see last week’s events as a consequence of the political instability and discord that has been mounting for years as Erdoğan has consolidated powers, marginalized the opposition, and redefined Turkey’s democracy. How will the president react in the aftermath of the coup? Will the democratic backsliding intensify, or can the thwarted coup offer new opportunity for reconciling the deeply-polarized nation?

The upheaval and political instability in Turkey also holds significant implications for Turkey’s foreign policy and the fate of a neighboring region already in turmoil from the war in Syria and insecurity in Iraq. The West desperately needs a stable, democratic, and predictable partner in its NATO-ally Turkey to address the many challenges besetting the region and to fight the Islamic State (or ISIS). How will recent events affect regional stability and Turkey’s cooperation with the West on security issues, including the resettlement of Syrian refugees? What does the failed coup mean for the coalition against ISIS engagement in Syria?

On July 20, the Foreign Policy program (FP) at Brookings hosted a panel discussion to consider these questions and other domestic and international consequences of the coup attempt in Turkey. Brookings Senior Fellow and Director of the Center on the United States and Europe Fiona Hill introduced and moderated a wide-ranging conversation featuring FP Senior Fellows Shadi Hamid, Kemal Kirişci, Michael O'Hanlon, and Ömer Taşpınar.

After the discussion, the speakers took questions from the audience.

Video

• Turkey coup attempt was a shock
• Institutional collapse of Turkey unprecedented
• Disaster averted in failed Turkey coup
• Incirlik Air Base not irreplaceable
• Turkey after the coup attempt: Implications for Turkish democracy, foreign policy, and the future of the Syrian War

Audio

• Turkey after the coup attempt: Implications for Turkish democracy, foreign policy, and the future of the Syrian War

Transcript

• Transcript (.pdf)

Event Materials

• 20160720_turkey_coup_transcript

Event Information

On August 7, the White House announced cancellation of the planned Moscow summit in early September between Presidents Obama and Putin, saying there were no prospects for significant progress on key issues at the meeting.  The White House also said cooperation with Russia remains a priority, and on August 9 Secretaries Kerry and Hagel met with their Russian counterparts, Ministers Lavrov and Shoigu.  While President Obama intends to travel to St Petersburg for the G20 summit on September 6 and 7, there has been no word on whether there will be a bilateral meeting with President Putin on the margins of the summit.  Clearly, U.S.-Russian relations have entered troubled times.

On August 28, the Center on the United States and Europe hosted a panel discussion to address these developments and future prospects for the bilateral relationship between Washington and Moscow.  Brookings Senior Fellows Clifford Gaddy, Steven Pifer and Angela Stent will take part.  Brookings Visiting Fellow Jeremy Shapiro moderated.   Following opening comments, the panelists took questions from the audience.

Watch full video from the event at C-SPAN.org »

Video

• What the U.S. Does in Syria Will Be Costly for Russia
• Russia Reluctant to Intervene in Syria
• Russia Fears Increased Instability in the Middle East

Audio

• The U.S.-Russia Relationship: What's Next?

Transcript

• Transcript (.pdf)

Event Materials

• 20130828_US_Russia_transcript

In August, the White House announced the cancellation of the Moscow summit between Presidents Barack Obama and Vladimir Putin, while still saying that U.S. relations with Russia remain a priority. By all accounts, the Snowden case appears to have further complicated already strained U.S.-Russia relations. With President Obama headed to St. Petersburg, Russia for the G20 summit on September 6 and 7, the likelihood of an Obama-Putin bilateral meeting remains unanswered and unlikely.

With an eye toward a possible bilateral meeting in St. Petersburg, Brookings experts Steven Pifer, Clifford Gaddy and Angela Stent address these developments and future prospects for the U.S.-Russia cooperation on issues like Syria and arms control.

Steven Pifer:

“I think people now see the reset as a failure. I actually think the reset succeeded, because the goal was not to get us to Nirvana with Russia, but to lift us out of the hole that we found ourselves in in 2008.”

Clifford Gaddy:

“Steve has said that the relations are not as bad, are at their worst since, you know, the fall of communism. I would probably say they probably are as bad.”

Angela Stent:

“It's not clear what the U.S.-Russian agenda is going forward. The things we would like to accomplish — more arms control, an agreement on missile defense, even, you know, more U.S. investment in Russia — the Russians don't seem to be interesting in responding. We do need to work together — and we will, still, on post-2014 Afghanistan, on Iran — but it's really unclear what an agenda would be going forward.”

Downloads

• Download the transcript

The tenth anniversary meeting of the “Valdai International Discussion Club” –a forum that brings together foreign Russia experts with top Russian officials, politicians, journalists and academics—conveyed two strong messages from the Kremlin: Russia is fully back on the world stage seeking a leadership role; and Russia offers the world an alternative value system to that of the West, which has lost its moral compass. No one made these points more vigorously than Vladimir Putin himself, who has dined with the group for the past decade. He was in top form, exuding self-confidence and decisiveness. Yet the forum itself, though Kremlin-sponsored, also had discordant voices, including several vocal critics of the way Putin’s Russia is run.

The meeting this year took place in a picturesque resort on Lake Valdai, 250 miles from Moscow. It was the largest ever, with more than 200 participants. The official theme was “Russia’s Diversity for the Modern World” and focused on how Russia should define its national identity. In some ways, every Valdai meeting—and I have attended all ten—has had as its underlying theme the “whither Russia question”, even at the session in Siberia when we were discussing whether Russia was indeed an energy superpower. But this year the question of Russia’s uniqueness and its place in the world was the main focus.

Sergei Karaganov, one of the meeting’s co-organizers, was hardly upbeat. He began the forum on a cautionary note, saying that Russia had wasted the last twenty years and that the only idea that still unites Russians is their victory in World War Two.

Unlike in previous years, both the liberal and moderate nationalist political opposition was represented. Two of the most notable interventions were by Yevgeny Roizman, the controversial newly-elected major of Yekaterinburg and Ksenia Sobchak, daughter of Anatoly Sobchak, the liberal mayor of St. Petersburg who gave Putin his post-Soviet political start in the early 1990s. Roizman gave a spirited defense of the importance of ending politics as usual in the corrupt provinces. Sobchak made an impassioned plea for her generation of urban, educated 30 –somethings. Her message: we reject the traditional Russian political patronage model, we don’t want a president who addresses us as a father talks to his children, we want to be treated as independent adults responsible for the decisions they make and we don’t want to rely on the state. And, she added, we didn’t grow up in the USSR, we have no nostalgia for the Soviet Union, we don’t care about Russia being a great power and we reject anti-Americanism. Indeed, we like the West.

One of the eternal questions about Russia’s identity—whether Russia is European, Asian or Eurasian—was addressed in a day-long session at the Iversky monastery, founded in 1653 and elegantly restored in recent years. In a panel highlighting Russia’s role as a multi-ethnic, multi-confessional state whose inhabitants have for centuries included Orthodox Christians, Jews, Moslems and Buddhists, Metropolitan Hilarion delivered a strong message. Russian Orthodox Christians, he said, are the true harbingers of traditional Christian values, while Western Protestants have embraced liberal values on issues such as abortion, homosexual rights and gay marriage that undermine Christian morality. These views were reflected in President Putin’s prepared speech, when he reiterated that Russia supports traditional Christian morality and opposes same-sex marriage. Moreover, both Putin and the Russian clergy emphasized that Orthodox Christians and Moslems share a commitment to traditional morality, highlighting their common bonds – and differentiating them on common grounds from the West.

One of Putin’s main foreign policy projects for his third term is his proposed Eurasian Union, a topic that provoked some lively discussion. Russian speakers argued that the Kremlin had “left the imperial paradigm behind”, and that this union would be an organization of equals akin to the European Union. Moldovan and Ukrainian speakers, by contrast, discussed the growing economic and political pressure that Russia is putting on them to reject the EU in the run-up to the Vilnius summit in November. Brussels is poised to offer Ukraine and Moldova Association Agreements that Russia claims would adversely impact both countries’ continuing economic ties to Moscow. Without Ukraine, the Eurasian Union will not fulfill the Kremlin’s ambition to create a grouping of post-Soviet states as a counterbalance to the European Union.

Russia’s growing global role in the wake of its Syria initiative was the main focus of discussions with the top officials who came to Valdai—Foreign Minister Sergei Lavrov, Defense Minister Sergei Shoigu and head of the Presidential Administration Sergei Ivanov. They were clearly buoyed by the fact that Russia had taken the initiative in organizing the agreement to rid Syria of its chemical weapons, and stressed that, they favor a strong, secular Syria. The Opposition, they claimed, was up to 75% controlled by Al Qaeda. There seemed to be agreement that not all of the chemical weapons would be found and destroyed, but that enough could be destroyed to accomplish Russian and American goals. And they repeated Russia’s claim that chemical weapons were used only by the Opposition and not by Assad’s own forces.

Shoigu addressed the question of military reform by quoting Russia’s pre-revolutionary Prime Minister Pyotr Stolypin who said “Give us money and time, and you won’t recognize our armed forces.” He expressed concern about the situation in Afghanistan after NATO’s withdrawal next year, and questioned who would form the next generation of leaders in Kabul. He reiterated that U.S. missile defense programs were ultimately aimed at Russia, not Iran or North Korea, but also suggested developing joint U.S-Russian ABM systems. NATO, he said, is a threat to Russia. What else was NATO enlargement, if not directed against Russia? His message to the group-no more new entrants to NATO.

In previous years, President Putin has met with foreign participants only in a private setting, but for this tenth anniversary the format of the Putin meeting changed. He sat on the stage with four discussants—former German Defense Minister Volker Ruehe, former Italian Prime Minister Romano Prodi, former French Prime Minister Francois Fillon and President of the U.S-based Center for the National Interest Dimitri Simes. They addressed foreign and Russian participants and the four-hour meeting was televised.

Putin gave a vigorous defense of Russia as the standard-bearer of traditional Christian morality, arguing that the United States and Europe had rejected the Christian roots that form the basis of Western civilization. Criticizing “excessive political correctness” he declared that the European multicultural project had failed. He also warned that attempts by un-named powers to revive the model of a unipolar world had also failed. Stressing Russia’s right to have a seat at the table on all decisions of major international importance, he invoked the times when Russia had made an important contribution to world peace—the Congress of Vienna in 1815 and the Yalta Conference in 1945. He warned that when Russia was excluded—for instance from the 1919 Treaty of Versailles—this led to war. His message on Syria was clear—Russia took the initiative and had helped the United States by proposing an agreement to rid Syria of its chemical weapons stockpiles. And it expects to continue to be respected as an indispensable global player.

For anyone who has followed the Kremlin’s fraught relationship with the Opposition since the December 2011 Bolotnaya demonstrations protesting the results of the Duma elections, Putin’s interactions with representatives of the Opposition appeared to represent a shift in policy. He answered their questions about the need for political reform and more individual freedom by suggesting that these issues will be examined in the future—without committing himself to any particular course of action. The fact that these exchanges were televised live gave the impression that the Kremlin feels confident enough that the Opposition represents no real threat that it can engage in a dialogue with its more mainstream representatives. After all, there were no extreme nationalists or hard-core socialists there. Opposition leader Alexei Navalny, who won 27% of the vote in the recent Moscow mayoral elections, was also absent, having apparently turned down an invitation to participate.

Putin was evasive about his future plans. When asked if he would run for office again in 2018, he did not rule it out. He noted approvingly that Angela Merkel was about to win a third term, as he had last year. He certainly gave the impression of being fully engaged, with ambitious—albeit undefined-- plans for Russia. The Russian economy may be experiencing low growth rates, but the main Valdai message was that Putin’s Russia is eager to engage the world, offering an alternative to a troubled West that has rejected major tenets of its own civilizational heritage.

Event Information

Russia remains a priority for the United States because of its nuclear weapons arsenal, its strategic location bordering Europe and Asia and its ability to support—or thwart—American interests on issues such as the Syrian conflict. Recent U.S. presidents have attempted repeatedly to forge a strong and productive partnership with Russia only to be held hostage to the deep mistrust born of the Cold War. Why has it been so difficult to move the relationship forward and is there any prospect for change in the future?

In her new book, The Limits of Partnership: U.S.-Russian Relations in the Twenty-First Century (Princeton University Press, 2014), Brookings Nonresident Senior Fellow and Georgetown University Professor Angela Stent calls for a fundamental reassessment of the principles and practices that drive U.S.-Russian relations and offers a path forward to meet the urgent challenges facing both countries.

On February 18, the Center on the United States and Europe (CUSE) at Brookings hosted a discussion featuring Stent that explored U.S.-Russian relations since the Soviet collapse and the challenges ahead. CUSE Director Fiona Hill, co-author of Mr. Putin: Operative in the Kremlin (Brookings Press, 2013), and Peter Baker, chief White House correspondent for The New York Times and author of Days of Fire (Doubleday, 2013), also joined the panel.

Brookings President Strobe Talbott, who previously served as U.S. deputy secretary of State and U.S. ambassador-at-large for the former Soviet Union, provided introductory remarks.

Audio

• U.S.-Russian Relations in the 21st Century

Transcript

• Uncorrected Transcript (.pdf)

Event Materials

• 20140218_us_russia_relations

Editor's Note: The World Bank’s Independent Evaluation Group (IEG) recently published a self-evaluation of its activities. Besides representing current thinking among evaluation experts at the World Bank, it also more broadly reflects some of the strengths and gaps in the approaches that evaluators use to assess and learn from the performance of the international institutions with which they work. The old question “Quis custodet ipsos custodes?” – loosely translated as “Who evaluates the evaluators?” – remains as relevant as ever. Johannes Linn served as an external peer reviewer of the self-evaluation and provides a bird’s-eye view on the lessons learned.

An Overview of the World Bank’s IEG Self-Evaluation Report

In 2011 the World Bank’s Independent Evaluation Group (IEG) carried out and published a self-evaluation of its activities. The self-evaluation team was led by an internal manager, but involved a respected external evaluation expert as the principal author and also an external peer reviewer.

The IEG self-evaluation follows best professional practices as codified by the Evaluation Cooperation Group (ECG). This group brings together the evaluation offices of seven major multilateral financial institutions in joint efforts designed to enhance evaluation performance and cooperation among their evaluators. One can therefore infer that the approach and focus of the IEG self-evaluation is representative of a broader set of practices that are currently used by the evaluation community of international financial organizations.

At the outset the IEG report states that “IEG is the largest evaluation department among Evaluation Capacity Group (ECG) members and is held in high regard by the international evaluation community. Independent assessments of IEG’s role as an independent evaluation function for the Bank and IFC rated it above the evaluation functions in most other ECG members, international nongovernmental organizations, and transnational corporations and found that IEG follows good practice evaluation principles.”

The self-evaluation report generally confirms this positive assessment. For four out of six areas of its mandate IEG gives itself the second highest rating (“good”) out of six possible rating categories. This includes (a) the professional quality of its evaluations, (b) its reports on how the World Bank’s management follows up on IEG recommendations, (c) cooperation with other evaluation offices, and (d) assistance to borrowing countries in improving their own evaluation capacity. In the area of appraising the World Bank’s self-evaluation and risk management practices, the report offers the third highest rating (“satisfactory”), while it gives the third lowest rating (“modest”) for IEG’s impact on the Bank’s policies, strategies and operations. In addition the self-evaluation concludes that overall the performance of IEG has been “good” and that it operates independently, effectively and efficiently.

The report makes a number of recommendations for improvement, which are likely to be helpful, but have limited impact on its activities. They cover measures to further enhance the independence of IEG and the consistency of evaluation practices as applied across the World Bank Group’s branches – the World Bank, the International Finance Corporation (IFC), and the Multilateral Investment Guarantee Agency (MIGA) –; to improve the design of evaluations and the engagement with Bank management upstream for greater impact; and monitoring the impact of recent organizational changes in IEG in terms of results achieved. The report also recommends that more be done to evaluate the Bank’s analytical work and that evaluations draw on comparative evidence.

Assessment

In terms of the parameters of self-evaluation set by the prevailing practice among the evaluators on international financial agencies, the IEG self-evaluation is accurate and helpful. From my own experience as an operational manager in the Bank whose activities were evaluated by IEG in years past, and as a user of IEG evaluations (and of evaluations of other international aid organizations) for my research on aid effectiveness, I concur that IEG is independent and effective in meeting its mandate as defined. Moreover, the self-evaluation produces useful quantitative evidence (including survey results, budget analysis, etc.) to corroborate qualitative judgments.

However, the self-evaluation suffers from a number of limitations in approach and gaps in focus, which are broadly representative of the practices prevalent among many of the evaluation offices of international aid agencies.

Approach of the IEG self-evaluation

The core of the self-evaluation report is about the evaluation process followed by IEG, with very little said about the substance of IEG’s evaluations. The following questions could have usefully been raised, but were not: do evaluations cover the right issues with the right intensity, such as growth and poverty; environmental, governance, and gender impacts; regional dimensions versus exclusive country or project focus; effectiveness in addressing the problems of fragile and conflict states; effectiveness in dealing with global public goods; sustainability and scaling up; etc. Therefore the report does not deal with the question of whether IEG effectively responds in its evaluations to the many important strategic debates and issues with which the development community is grappling.

Related to this limitation is the fact that the report assessed the quality of IEG’s mostly in terms of (a) whether its approach and processes meet certain standards established by the Evaluation Cooperation Group; and (b) how it is judged by stakeholders in response to a survey commissioned for this evaluation. Both these approaches are useful, but they do not have any basis in professional assessments of the quality of individual products. This is equivalent to IEG evaluating the World Bank’s projects on the quality of its processes (e.g., appraisal and supervision processes) and on the basis of stakeholder surveys, without evaluating individual products and their impacts.

Gaps in the Self-Evaluation and in Evaluation Practice

Careful reading of the report reveals six important gaps in the IEG self-evaluation, in the prevailing evaluation practice in the World Bank, and more generally in the way international financial organizations evaluate their own performance. The first three gaps relate to aspects of the evaluation approach used and the second three gaps relate to lack of focus in the self-evaluation on key internal organizational issues:

1. Impact Evaluations: The report notes that IEG carries out two to three impact evaluations per year, but it sidesteps the debate in the current evaluation literature and practice as to what extent the “gold standard” of randomized impact evaluation should occupy a much more central role. Given the importance of this debate and divergence of views, it would have been appropriate for the self-evaluation to assess IEG’s current practice of very limited use of randomized evaluations.

2. Evaluation of Scaling Up: The report does not address the question of to what extent current IEG practice not only assesses the performance of individual projects in terms of their outcomes and sustainability, but also in terms of whether the Bank has systematically built on its experience in specific projects to help scale up their impact through support for expansion or replication in follow-up operations or through effective hand-off to the government or other partners. In fact, currently IEG does not explicitly and systematically consider scaling up in its project and program evaluations. For example, in a recent IEG evaluation of World Bank funded municipal development projects (MDPs) , IEG found that the Bank has supported multiple MDPs in many countries over the years, but the evaluation did not address the obvious question whether the Bank systematically planned for the project sequence or built on its experience from prior projects in subsequent operations. While most other evaluation offices like IEG do not consider scaling up, some (in particular those of the International Fund for Agricultural Development and the United Nations Development Program) have started doing so in recent years.

3. Drawing on the Experience of and Benchmarking Against Other Institutions: The self-evaluation report does a good job in benchmarking IEG performance in a number of respects against that of other multilateral institutions. In the main text of the report it states that “IEG plans to develop guidelines for approach papers to ensure greater quality, in particular in drawing on comparative information from other sources and benchmarking against other institutions.” This is a welcome intention, but it is inadequately motivated in the rest of the report and not reflected in the Executive Summary. The reality is that IEG, like most multilateral evaluation offices, so far has not systematically drawn on the evaluations and relevant experience of other aid agencies in its evaluations of World Bank performance. This has severely limited the learning impact of the evaluations.

4. Bank Internal Policies, Management Processes and Incentives: IEG evaluations traditionally do not focus on how the Bank’s internal policies, management and incentives affect the quality of Bank engagement in countries. Therefore evaluations cannot offer any insights into whether and how Bank-internal operating modalities contribute to results. Two recent exceptions are notable exceptions. First, the IEG evaluation of the Bank’s approach to harmonization with other donors and alignment with country priorities assesses the incentives for staff to support harmonization and alignment. The evaluation concludes that there are insufficient incentives, a finding disputed by management. Second, is the evaluation of the Bank’s internal matrix management arrangements, which is currently under way. The self-evaluation notes that Bank management tried to quash the matrix evaluation on the grounds that it did not fall under the mandate of IEG. This is an unfortunate argument, since an assessment of the institutional reasons for the Bank’s performance is an essential component of any meaningful evaluation of Bank-supported programs. While making a good case for the specific instance of the matrix evaluation, the self-evaluation report shies away from a more general statement in support of engaging IEG on issues of Bank-internal policies, management processes and incentives. It is notable that IFAD’s Independent Office of Evaluation appears to be more aggressive in this regard: It currently is carrying out a full evaluation of IFAD’s internal efficiency and previous evaluations (e.g., an evaluation of innovation and scaling up) did not shy away from assessing internal institutional dimensions.

5. World Bank Governance: The IEG self-evaluation is even more restrictive in how it interprets its mandate regarding the evaluation of the World Bank’s governance structures and processes (including its approach to members’ voice and vote, the functioning of its board of directors, the selection of its senior management, etc.). It considers these topics beyond IEG’s mandate. This is unfortunate, since the way the Bank’s governance evolves will substantially affect its long-term legitimacy, effectiveness and viability as an international financial institution. Since IEG reports to the Bank’s board of directors, and many of the governance issues involve questions of the board’s composition, role and functioning, there is a valid question of how effectively IEG could carry out such an evaluation. However, it is notable that the IMF’s Independent Evaluation Office, which similarly reports to the IMF board of directors, published a full evaluation of the IMF’s governance in 2008, which effectively addressed many of the right questions.

6. Synergies between World Bank, IFC and MIGA: The self-evaluation report points out that the recent internal reorganization of IEG aimed to assure more effective and consistent evaluations across the three member branches of the World Bank Group. This is welcome, but the report does not assess how past evaluations addressed the question of whether the World Bank, IFC and MIGA effectively capitalized on the potential synergies among the three organizations. The recent evaluation of the World Bank Group’s response to the global economic crisis of 2008/9 provided parallel assessments of each agency’s performance, but did not address whether they work together effectively in maximizing their synergies. The reality is that the three organizations have deeply engrained institutional cultures and generally go their own ways rather than closely coordinating their activities on the ground. Future evaluations should explicitly consider whether the three effectively cooperate or not. While the World Bank is unique in the way it has organizationally separated its private sector and guarantee operations, other aid organizations also have problems of a lack of cooperation, coordination and synergy among different units within the agency. Therefore, the same comment also applies to their evaluation approaches.

Conclusions

Self-evaluations are valuable tools for performance assessment and IEG is to be congratulated for carrying out and publishing such an evaluation of its own activities. As for all self-evaluations, it should be seen as an input to an independent external evaluation, a decision that, for now, has apparently been postponed by the Bank’s board of directors.

IEG’s self-evaluation has many strengths and provides an overall positive assessment of IEG’s work. However, it does reflect some important limitations of analysis and of certain gaps in approach and coverage, which an independent external review should consider explicitly, and which IEG’s management should address. Since many of these issues also likely apply to most of the other evaluation approaches by other evaluation offices, the lessons have relevance beyond IEG and the World Bank.

Key lessons include:

• An evaluation of evaluations should focus not only on process, but also on the substantive issues that the institution is grappling with.
• An evaluation of the effectiveness of evaluations should include a professional assessment of the quality of evaluation products.
• An evaluation of evaluations should assess:
  o How effectively impact evaluations are used;
  o How scaling up of successful interventions is treated;
  o How the experience of other comparable institutions is utilized;
  o Whether and how the internal policies, management practices and incentives of the institution are effectively assessed;
  o Whether and how the governance of the institution is evaluated; and
  o Whether and how internal coordination, cooperation and synergy among units within the organizations are assessed.

Evaluations play an essential role in the accountability and learning of international aid organizations. Hence it is critical that evaluations address the right issues and use appropriate techniques. If the lessons above were reflected in the evaluation practices of the aid institutions, this would represent a significant step forward in the quality, relevance and likely impact of evaluations.

Since its 50th anniversary in 1994, the World Bank has been led by four presidents: Lewis Preston until his untimely death in 1995; then James Wolfensohn, who gave the institution new energy, purpose and legitimacy; followed by Paul Wolfowitz, whose fractious management tossed the World Bank into deep crisis; and most recently, Robert Zoellick, who will be remembered for having stabilized the bank and provided effective leadership during its remarkably swift and strong response to the global financial crisis.

Throughout these years of ups and downs in the bank’s leadership, standing and lending, the overall trend of its global role was downhill. While it remains one of the world’s largest multilateral development finance institutions, its position relative to other multilateral financing mechanisms is now much less prominent. Other multilateral institutions have taken over key roles. For example, the European Union agencies and the regional development banks have rapidly expanded their portfolios, and new “vertical funds” such as the Global Fund for AIDS, Tuberculosis and Malaria have become major funding vehicles. At the same time, according to a 2011 OECD Development Assistance Committee report multilateral aid has declined as a share of total aid. Meanwhile, non-governmental aid flows have dramatically increased, including those from major foundations like the Bill and Melinda Gates Foundation, but also from new internet-based channels bundling small individual donations, such as Global Giving. The World Bank— which 20 years ago was still the biggest and most powerful global development agency and hence a ready target for criticism— today is just one of the many institutions that offer for development to the poor and emerging market economies.

Against this backdrop, the World Bank, its members and Dr. Kim face three options in its long-term trajectory over the next 10 to 20 years: 1) the bank can continue on its current path of gradual decline; 2) it might be radically scaled back and eventually eliminated, as other aid channels take over; or 3) it can dramatically reinvent itself as a global finance institution that bundles resources for growing global needs.

There is no doubt in this author’s mind that the World Bank should remain a key part of the global governance architecture, but that requires that the new president forge an ambitious long-term vision for the bank – something that has been lacking for the last 30 years – and then reform the institution and build the authorizing environment that will make it possible to achieve the vision.

Option 1: “Business as Usual” = Continued Gradual Decline

The first option, reflecting the business-as-usual approach that characterized most of the Zoellick years of leadership will mean that the bank will gradually continue to lose in scope, funding and relevance. Its scope will be reduced since the emerging market economies find the institution insufficiently responsive to their needs. They have seen the regional development banks take on increasing importance, as reflected in the substantially greater capital increases in recent years for some of these institutions than for the World Bank in relative terms (and in the case of the Asian Development Bank, even in absolute terms). And emerging market economies have set up their own thriving regional development banks without participation of the industrial countries, such as the Caja Andina de Fomento (CAF) in Latin America and the Eurasian Development Bank in the former Soviet Union. This trend will be reinforced with the creation of a “South Bank” or “BRIC Bank”, an initiative that is currently well underway.

At the same time, the World Bank’s soft loan window, the International Development Association (IDA), will face less support from industrial countries going through deep fiscal crises, heightened competition from other concessional funds, and a perception of reduced need, as many of the large and formerly poor developing countries graduate to middle-income status. It is significant that for the last IDA replenishment much of the increase in resources was due to its growing reliance on advance repayments made by some of its members and commitments against future repayments, thus in effect mortgaging its future financial capacity. The World Bank’s status as a knowledge leader in development will also continue to be challenged with the rise of research from developing countries and growing think tank capacity, as well as a proliferation of private and official agencies doling out advice and technical assistance.

As a result, under this option, over the next 10 to 20 years the World Bank will likely become no more than a shadow of the preeminent global institution it once was. It will linger on but will not be able to contribute substantially to address any of the major global financial, economic or social challenges in the future.
 
Option 2: “The Perfect Storm” = Breaking Up the World Bank

In 1998, the U.S. Congress established a commission to review and advise on the role of the international financial institutions. In 2000, the commission, led by Professor Allan Meltzer, released its recommendations, which included far-reaching changes for the International Monetary Fund and the World Bank, most of them designed to reduce the scope and financial capacities of these institutions in line with the conservative leanings of the majority of the commission’s members. For the World Bank, the “Meltzer Report” called for much of its loan business and financial assets to be devolved to the regional development banks, in effect ending the life of the institution as we know it. The report garnered some attention when it was first issued, but did not have much impact in the way the institution was run in the following 10 years.

In 2010, the U.S. Senate Foreign Relations Committee released a report on the international financial institutions, which called on them to aim toward “succeeding in their development and economic missions and thereby putting them out of business”. However, it did not recommend a drastic restructuring of the multilateral development banks, and instead argued strongly against any dilution of the U.S. veto right, its lock on leadership selection, and its voting share at the IMF and World Bank. While not dramatic in its short-term impact, these recommendations were likely a strong factor in the subsequent decisions made by the Obama administration to oppose a substantial increase in contributions by emerging markets during the latest round of capital increase at the World Bank to push for an American to replace Robert Zoellick as World Bank president. These actions reinforced for emerging market countries that the World Bank would not change sufficiently and quickly enough to serve their interests, and thus helped create the momentum for setting up a new “South Bank.”

While there seems to be no imminent risk of a break-up of the World Bank along the lines recommended by the Meltzer Report, the combination of fiscal austerity and conservative governments in key industrial countries, compounded by a declining interest of the emerging market countries in sustaining the institution’s future, could create the perfect storm for the bank. Specifically, as governments face constrained fiscal resources, confront the increasing fragmentation of the multilateral aid architecture, and take steps to consolidate their own aid agencies, they might conclude that it would be more efficient and fiscally prudent to rationalize the international development system. There is a obvious overlap on the ground in the day-to-day business of the World Bank and that of the regional development banks. This is a reality which is being fostered by the growing decentralization of the World Bank into regional hubs; in fact, a recent evaluation by the World Bank’s Independent Evaluation Group concluded that “[r]ather than functioning as a global institution, the bank is at risk of evolving into six regional banks”. With the growing financial strength, institutional capacity and dynamism, and the apparently greater legitimacy of regional development banks among their regional members, shareholders might eventually decide that consolidation of the World Bank’s operations with those of the regional development banks, in favor of the latter, is the preferred approach.

There are lots of reasons to think that this drastic step would be difficult to take politically, financially and administratively, and therefore the inertia common to the international governance architecture will also prevail in this case. However, the new World Bank president would be well advised to be prepared for the possibility of a “perfect storm” under which the idea of eviscerating the World Bank could gain some traction,. The more the bank is seen to fade away, as postulated under Option 1 above, the greater is the likelihood that Option 2 would be given serious consideration.

Option 3: “A Different World Bank” = Creating a Stronger Global Institution for the Coming Decades

Despite all the criticism and the decline in its relative role as a development finance institution in recent decades, the World Bank is still one of the strongest and most effective development institutions in a world. According to a recent independent ranking of the principal multilateral and bilateral aid institutions by the Brookings Institution and the Center for Global Development “IDA consistently ranks among the best aid agencies in each dimension of quality”.

A third, radically different option from the first two, would build on this strength and ensure that the world has an institution 10 to 20 years from now which helps the global community and individual countries to respond effectively to the many global challenges which the world will undoubtedly face: continued poverty, hunger, conflict and fragility, major infrastructure and energy needs, education and health challenges, and global warming and environmental challenges. On top of this, global financial crises will likely recur and require institutions like the World Bank to help countries provide safety nets and the structural foundations of long-term growth, as the bank has amply demonstrated since 2008. With this as a broad mandate, how could the World Bank respond under new dynamic?

First, it would change its organizational and operating modalities to take a leaf out of the book of the vertical funds, which have been so successful in tackling major development challenges in a focused and scaled-up manner. This means substantially rebalancing the internal matrix between the regional and country departments on the one hand and the technical departments on the other hand. According to the same evaluation cited above, the World Bank has tipped too far toward short-term country priorities and has failed to adequately reflect the need for long-term, dedicated sectoral engagement. The World Bank needs to fortify its reputation as an institution that can muster the strongest technical expertise, fielding team with broad global experience and with first rate regional and country perspective. This does not imply that the World Bank would abandon its engagement at the country level, but it means that it would systematically support the pursuit of long-term sectoral and sub-sectoral strategies at the country level, linked to regional and global initiatives, and involving private-public partnership to assure that development challenges are addressed at scale and in a sustained manner.

Second, recognizing that all countries have unmet needs for which they need long-term finance and best practice in areas such as infrastructure, energy, climate change and environment, the World Bank could become a truly global development institution by opening up its funding windows to all countries, not just an arbitrarily defined subset of developing countries. This would require substantially revising the current graduation rules and possibly the financial instruments. This would mean that the World Bank becomes the global equivalent of the European Investment Bank (EIB) and of the German Kreditanstalt fuer Wiederaufbau (KfW)—development banks that have successfully supported the infrastructure development of the more advanced countries.

Third, the World Bank would focus its own knowledge management activities and support for research and development in developing countries much more on a search for effective and scalable solutions, linked closely to its operational engagement which would be specifically designed to support the scaling up of tested innovations, along the lines pioneered by the Bill and Melinda Gates Foundation.

Fourth, for those countries with strong project management capacities, the World Bank would dramatically simplify its lending processes, following the example of the EIB. This would make it a much more efficient operational institution, making it a more attractive partner to its borrowing member countries, especially the emerging market economies.

Fifth, the membership of the World Bank would fix some fundamental problems with its financial structure and governance. It would invite the emerging market economies to make significantly larger contributions to its capital base in line with their much-enhanced economic and financial capacities. It would revamp the bank’s voting and voice rules to reflect the changed global economic weights and financial contributions of emerging markets. The bank would also explore, based on the experience of the vertical funds, tapping the resources of non-official partners, such as foundations and the private sector as part of its capital and contribution base. Of course, this would bring with it further significant changes in the governance of the World Bank. And the bank would move swiftly to a transparent selection of its leadership on the basis of merit without reference to nationality.

Conclusion: The New World Bank President Needs to Work with the G-20 Leaders to Chart a Course Forward
 
The new president will have to make a choice between these three options. Undoubtedly, the easiest choice is “business-as-usual”, perhaps embellished with some marginal changes that reflect the perspective and new insights that an outsider will bring. There is no doubt that the forces of institutional and political inertia tend to prevent dramatic change. However, it is also possible that Dr. Kim, with his background in a relatively narrow sectoral area may recognize the need for a more vertical approach in the bank’s organizational and operational model. Therefore, he may be more inclined than others to explore Option 3.

If he pursues Option 3, Dr. Kim will need a lot of help. The best place to look for help might be the G-20 leadership. One could hope that at least some of the leaders of the G-20 understand that Options 1 and 2 are not in the interest of their countries and the international community. Hopefully, they would be willing to push their peers to contemplate some radical changes in the multilateral development architecture. This might involve the setting up of a high-level commission as recently recommended by this author, which would review the future of the World Bank as part of a broader approach to rationalize the multilateral system in the interest of greater efficiency and effectiveness. But in setting up such a commission, the G-20 should state a clear objective, namely that the World Bank, perhaps the strongest existing global development institution, should not be gutted or gradually starved out of existence. Instead, it needs to be remade into a focused, effective and truly global institution. If Dr. Kim embraces this vision and develops actionable ideas for the commission and the G-20 leaders to consider and support, then he may bring the right medicine for an ailing giant.

Leaders will head to the G-20 Summit in Los Cabos, Mexico, among renewed serious concern about the world economy. The turmoil that started with the U.S. subprime mortgage crisis has resulted in now almost five years of ongoing instability. The emerging market economies fared much better than the advanced economies and pulled out of the crisis already in 2009, but the slowdown we are now facing in 2012 is again global, demonstrating the interdependence in the world economy. The emerging market economies have stronger underlying trend growth rates, but they remain vulnerable to a downturn in the advanced economies. The center of concern is now squarely on Europe, with a recession threatening most European countries, even those that had reasonably good performances so far. After an encouraging start in 2012, the U.S. economy, while not close to a recession, is also showing signs of a slowdown rather than the hoped for steady acceleration of growth. And the slowdown is spreading across the globe.

At a time like this it would be desirable and necessary that the G-20 show real initiative and cohesion. The essays in this collection look at the challenge from various angles. There is concern that the G-20 is losing its sense of purpose, that cohesion is decreasing rather than increasing, and that policy initiatives are reactive to events rather than proactive. Let us hope that at this moment of great difficulty, the G-20 will succeed in giving the world economy a new sense of direction and confidence. It is much needed.

Download » (PDF)