Independent Evaluation Group (IEG), World Bank Group

Website:

http://ieg.worldbankgroup.org/

Headquarters:

Washington, D.C., United States of America

Type:

Members

Follow On

https://www.facebook.com/IndependentEvaluationGroup

https://twitter.com/WorldBank_IEG

Work Programme:

IEG 2016 Work Program and Budget.pdf

Independent Evaluation Group (IEG), World Bank Group

IEG is charged with evaluating the activities of the International Bank for Reconstruction and Development (IBRD) and International Development Association (the World Bank), the work of International Finance Corporation (IFC) in private sector development, and Multilateral Investment Guarantee Agency's (MIGA) guarantee projects and services.

Evaluation in the World Bank provides an objective assessment of the results of the Bank Group's work and to identify and disseminate lessons learned from experience.

The diversity of projects and programs the Bank Group employs to support public and private sector development requires IEG to use a variety of evaluation approaches. These approaches include assessing outcomes against stated objectives, benchmarks, standards, and expectations, or assessing what might have happened in the absence of the project, program, or policy (counterfactual analysis). For example, private sector investment projects and advisory services are mainly assessed against absolute economic and financial performance criteria and the extent to which they contribute to private sector development. Public sector projects are assessed in relation to their relevance and the efficacy and efficiency with which they achieve their development objectives.

To assess the Bank Group's performance and identify lessons for improving Bank Group operations, IEG conducts not only project-level evaluations, based on the review of self-evaluation reports prepared by Bank Group staff and supplemented by independent assessments, but also reviews of literature, analytical work, and project documentation; portfolio reviews; country case studies; structured interviews and surveys of staff and stakeholders; and impact evaluations.

Resource: To enhance the quality and impact of IEG evaluations, as well as strengthen accountability related to implementation of evaluation recommendations, IEG created the Management Action Record (MAR) database. This database is an online central repository of IEG findings, recommendations, management responses and progress of implementation

Last updated: November 2014

Hidden Group

Type:

1.1 Separate Evaluation Dept

Description:

Yes, Independent Evaluation Group (IEG)

Type:

1.2 Location in Organisation Chart and Budget

Description:

IEG is headed by the Director General, Evaluation, and mandated to evaluate the activities of the IBRD, IDA, IFC and MIGA. Units report to Board of Executive Directors through the DGE. Work program and budget are prepared independently, under the oversight of the DGE, for endorsement by the Board's Committee on Development Effectiveness (CODE), and approval by the Board.

Type:

1.3 Seniority of Head of Department

Description:

Director General Evaluation (DGE) is Senior VP level, one level above operational VPs, same level as Managing Directors, Chief Financial Officer, Chief Economist, General Counsel and EVP of IFC and MIGA.

Type:

1.4 Participation of the Head of the Evaluation Function in Internal Senior Management Meetings

Description:

The DGE does not participate either as member or as observer in senior management meetings.

Type:

1.5 Access to Information by Staff of the Evaluation Department

Description:

IEG's access to staff and records is unrestricted.

Type:

2.1 Staffing

Description:

Director General: 1
Directors: 3
Sr. Managers: 1
Managers: 5
Advisers: 2
Lead specialists: 12
Senior specialist: 36
Other specialists and analysts: 33
Support staff: 24

Type:

2.2 Managing the Staff of the Department

Description:

The DGE is responsible for managing IEG's personnel, budget, and work program under the oversight of CODE, and in consultation with the respective Vice Presidents responsible for Human Resource and budgets for IBRD/IDA, IFC and MIGA. IEG's functions and staff are organizationally independent from Bank, IFC and MIGA operational and policy departments and decision-making.

Type:

2.3 Selection and Average Tenure of Head of Evaluation and Other Evaluation Staff

Description:

The Boards appoint the DGE for a nonrenewable terms of six years with a rank equivalent to that of Senior Vice President. The selection process and the remuneration of the DGE are managed under the oversight of CODE with the advice of the Bank's Vice President, Human Resources. The Director-General can only be removed by the Boards and is ineligible for subsequent appointment or reappointment to the staff of the World Bank Group.

The Directors and Senior Managers are appointed by the DGE in consultation with the Chair of CODE and relevant Sr. Management (President of the World Bank, Executive VPs of IFC and MIGA). Directors are appointed for a nonrenewable term of six years and are eligible for employment in the Bank, IFC, and MIGA, on completion of assignment.

Other staff serve approximately 5-7 years, but are not time-limited.

Type:

3.1 Consultants: Proportion of Business Covered

Description:

Overall, consultant usage for the group of a whole represents about 45-50% of total full-time equivalent staffing.

Type:

3.2 Internal Secondment

Description:

Possible for all IEG departments.

Type:

4.1 Work Programme

Description:

Each year the DGE presents a consolidated three-year rolling Work Program and Budget to the Board. The document is accompanied by a memorandum from DGE laying out the strategic directions and priorities for the period. The evaluations are increasingly focusing on World Bank Group wide topics. Typically, the full Board discusses and approves the program after endorsement by CODE. CODE can request an external review of IEG's budget based on the draft work program and budget document prior to CODE discussion.

Type:

4.2 Percentage of Projects Subject to Evaluation

Description:

‚Ä¢ WB: 100% self-evaluation by operations staff through Implementation Completion and Results Reports (ICRs) . 100% of ICRs reviewed by IEG; about a quarter of completed projects evaluated by IEG will be evaluated through Project Performance Assessment Reports.
‚Ä¢ 45% stratified random sample of self-evaluation reports on investments, meeting early maturity criteria. For advisory projects, IFC staff prepares self evaluation for 100% of projects and IEG validated 51% of these self evaluations. All are desk-reviewed by IEG, and some by field visits following review of self-evaluation reports. Also, all special studies (sector, country) are based on field visits and relevant additional project reviews/evaluations by IEG staff, plus as of 2006, they are also based on Project Completion Reports (PCRs) on Advisory Services projects (AS).

‚Ä¢ MIGA: Initiated self evaluation in FY09 of mature guarantees. MIGA preparesself evaluations - Project Evaluation Reports (PERs) for 7-8 projects annually, which are subsequently validated by IEG. The remaining projects in the annual program are independently evaluated by IEG. In FY16 MIGA prepared 8 self evaluations. IEG validated 8 self evaluations and independently evaluated 6 projects.

Type:

4.3 Basis of Studies - country, project by project, sector...

Description:

In FY'12, IEG applied a selectivity framework developed from a study of IEG's influence and IEG's results framework‚Äîeach innovations in the evaluation field. The framework will be included in all new evaluations and builds on closer engagement with management and stakeholders, as well as on the areas emphasized for follow-up from the implementation of previous IEG recommendations captured in the Management Action Record.

Reviews at project, sector, country, and global levels, plus cross-cutting thematic and corporate/process reviews, including the annual Results and Performance Report for the WBG. An increasing number of large scale evaluations look at issues at World Bank Group level.

Synthesis of evaluation findings in form of quick notes and Evaluation Briefs and Cluster Evaluations.

Type:

5.1 Costs

Description:

Cost for individual studies varies, depending on nature of the study, and are estimated in approach papers.

Type:

5.2 Budget

Description:

Each of the units of the World Bank Group contributes to IEG's budget. The World Bank provides about 1. 4% of its Net Administrative Budget (NAB); IFC provides about 1. 1% of its NAB and MIGA provides over 1.1 % of its NAB.

Type:

8.1 Rating Scale Used

Description:

Public Sector: IEG uses a 6-point scale for Outcome, Bank Performance, and Borrower Performance, and it uses a 4-point scale for Risk to Development Outcome and M&E Quality

Private sector: 6 point scale for synthesis rating (development outcome), 4 point scale for sub-indicators

Type:

8.2 Numerical Values Assigned to Ratings

Description:

Type:

8.3 Criteria Aggregated into the Project Performance Rating

Description:

Public Sector: Outcome (comprising relevance, efficacy, and efficiency, with DPLs not being rated on efficiency), Risk to Development Outcome, Bank Performance, Borrower Performance, and M&E Quality.

Private sector - investments:
Development Outcome synthesis rating based on 4 sub-indicators Project Business performance, Economic Sustainability, Economic & Social Effects, Private Sector Development

Private sector ‚Äì advisory:
Development Effectiveness rating based on 5 sub-indicators: Strategic Relevance, Output, Outcome and Impact Achievement and Efficiency

Type:

8.4 "Below the Line‚Äù Criteria

Description:

Public Sector:
WB performance
Borrower performance
Risk to development outcome
Quality of M&E

Private Sector:
IFC:
Investment Outcome (Loan and Equity)
IFC's Work Quality (Screening appraisal & structuring; Supervision & administration; IFC's role and contribution)

MIGA:
MIGA's Effectiveness (Strategic relevance; MIGA's role and contribution; MIGA's assessment, underwriting & monitoring)
Projects Contribution to MIGA's Financial Results

Type:

7.1 Existence of Specific Disclosure and Comm Policy or Guidelines for Evaluation

Description:

IEG's new Access to Information Policy went into effect on 1 July 2011. This replaces separate policies for IEG-IFC, IEG-MIGA (referred to in the MIGA disclosure policy), and IEG-WB.

Type:

7.1.1 Web address of disclosure policy

Description:

http://ieg.worldbankgroup.org/content/dam/ieg/A2I.pdf

Type:

7.2 Publication

Description:

Country Program Evaluations
Thematic & Sector Evaluations
Corporate Evaluations
IEG working papers
Evaluation Brief
Quick Turnaround Notes

All IEG products, other than those specified in the IEG's Access to Information Policy, are disclosed to public. Project level evaluations on IFC and MIGA financed activities are among the exceptions.

Type:

7.2.1 Publication web address

Description:

http://ieg.worldbankgroup.org

Type:

7.3 Which final evaluation products are not disclosed?

Description:

Implementation Completion and Results Reports(ICRR) and Country Assistance Strategy Completion Report Reviews(CASCRRs) that were finalized prior to IEG's current Access to Information Policy going into effect on July 1, 2011, are only disclosed 5 years after finalization.

Type:

7.4 How long after completion are evaluations disclosed (in practice and according to disclosure policy)?

Description:

IEG documents are normally disclosable after they are discussed by CODE or a CODE subcommittee, with some exceptions.

IEG tries to disclose evaluations within 4 weeks of the CODE discussion. If IEG does not receive a summary of the CODE discussion and/or a management response within 20 working days of a CODE meeting, it can disclose without them. The policy does not stipulate how soon IEG has to disclose, but the expectation is for disclosure to be within about 20 working days.

Type:

7.5 Allocated Resources (human, financial) for Communication and Dissemination

Description:

US$1. 5 million or about 4.4% of budget, Approximately 7 staff

Type:

6.1 Types of Reports & Timing

Description:

1. Project level evaluations:
‚Ä¢ Approximately 250 public sector ICR Reviews
‚Ä¢ Approximately 200 private sector project validations (of self evaluations) and independent project evaluations; In FY13, IEG validated and evaluated 164 projects: 80 IFC investment projects, 76 IFC advisory projects, 8 MIGA guarantees.
2. Country Evaluations
‚Ä¢ Country Program Evaluations
‚Ä¢ Country Assistance Strategy Completion Report reviews
3. Thematic & Sector Evaluations
4. Corporate & Process Evaluations
5. Impact Evaluations
6. Annual Report: Results and Performance report
7. Global and Regional Partnership Program reviews
8. IEG Work Program and Budget
9. Other reports: Quick turnaround notes, Cluster Evaluations, evaluation briefs, IEG Self-Evaluation, etc.

Type:

6.2 Discussion and Clearing of Reports

Description:

Draft evaluations are discussed with appropriate operations staff before finalization. IEG reports are issued under DGE signature and approval.

Type:

6.3 Distribution of Evaluation Reports

Description:

Large scale evaluations (CPE, Sector, Thematic, Corporate evaluations) are submitted to the Board for discussion, typically by CODE, and occasionally by the Board.

CAS Completion Report Reviews are sent to the Board to be discussed together with the new Country Assistance Strategies.

Project Performance Assessment Reports are forwarded to the Board for information.

Other project level evaluations (Implementation Completion Report Reviews, activities supported by IFC and MIGA) are not forwarded to the Board but are shared with relevant operational staff.

Type:

6.4 Identity of Promoters of Projects

Description:

WB: Not applicable

IFC: Not disclosed

MIGA: Not disclosed

search-block

Main menu

Independent Evaluation Group (IEG), World Bank Group

Contents

Type:

Follow On

Hidden Group

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

search-block

Member Login

Main menu

Independent Evaluation Group (IEG), World Bank Group

Contents

Type:

Follow On

Hidden Group

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Type:

Twitter

Related Contents