3 December 2019: Learning about learning from learning about learning

Lant Pritchett
Blavatnik School of Government, University of Oxford

Organised by:
International Initiative for Impact Evaluation (3ie)

Chair:
Emmanuel Jimenez, 3ie

Discussant:
Ronald Abraham, IDinsight

Date: December 3, 2019
Time: 03:30 P.M.

Venue:
Lecture Hall 1, Annexe,
India International Centre,
New Delhi – 110001 (India)

Location:

4 April 2019: Understanding and reducing crop residue burning in North India

Max Freidrich
Swiss Federal Institute of Aquatic Science and Technology

Organised by:
International Initiative for Impact Evaluation (3ie)

Chair:
Neeta Goel, International Initiative for Impact Evaluation (3ie)

Discussant:
Sunita Narain, Centre for Science and Environment, New Delhi and Santosh Harish, Centre for Policy Research, New Delhi

Abstract:
Crop residue burning in Northern India causes severe air pollution and depletes soil fertility. According to media reports, farmers, who continue despite a ban, claim that they have no alternative. While law enforcement and a lack of mechanical alternatives have been proposed as the main reasons for crop residue burning, the mindset of farmers remains unknown.

Max Freidrich will present the results of a recent study using the risks, attitudes, norms, abilities and self-regulation psychological theory approach to determine the main drivers of and barriers to reducing crop residue burning. The discussion will focus on how they play a key role in crop residue management and how population-tailored behaviour change interventions can complement existing efforts to tackle crop residue burning.

Date: April 4, 2019
Time: 03:00 P.M.

Venue:
Lecture Hall 1, Annexe,
India International Centre,
New Delhi – 110001 (India)

Location:

22 September 2017: The role of big data to evaluate Aadhaar

Ronald Abraham and Elizabeth Bennett
IDinsight

Organised by:
International Initiative for Impact Evaluation (3ie)

Chair:
Emmanuel Jimenez, International Initiative for Impact Evaluation (3ie)

Discussant:
Ajay Shah, National Institute of Public Finance and Policy (NIPFP),

Abstract:
Aadhaar has become a seemingly ubiquitous component of a wide range of government and private sector services. However, there are significant gaps in our understanding of Aadhaar’s coverage and performance—especially when it comes to understanding the full range of impacts of the identity system.

In this seminar, IDinsight’s Ronald Abraham and Elizabeth Bennett will present excerpts from their State of Aadhaar Report 2016-17, which provides an overview of the Aadhaar landscape and highlights areas for future research. The conversation will then pivot to the role of primary research and big data in evaluating Aadhaar.

IDinsight’s State of Aadhaar initiative aims to catalyse discourse and inform decision-making in the Aadhaar ecosystem. To achieve this objective, the State of Aadhaar website provides up-to-date data, research, news, and official documentation on Aadhaar.

Date: September 22, 2017
Time: 03:00 P.M.

Venue:
Seminar Hall 3,
Kamala Devi Complex,
India International Centre,
New Delhi – 110001 (India)

Location:

13 June 2014: What can an experiment in Maharashtra tell policymakers about the impact of sanitation on child height?

Dean Spears
Centre for Development Economics, Delhi School of Economics

Abstract:
Most of the world's open defecation happens in India. Open defecation releases germs into the environment, where children come into contact with them. What is the effect of these environmental diseases? This paper discusses a specific randomised sanitation experiment, conducted by the World Bank and the Government of Maharashtra in 2004 and considers the broader applicability of this evidence.

The evidence from this study suggests that reducing open defecation helps children grow taller – which is consistent with converging experimental and quasi-experimental evidence of the effect of sanitation on child height from a variety of sources. But in this case, the experiment was not ultimately carried out in all selected districts, although data were collected. This allows for a comparison between the two, which is particularly valuable because the final sites had the highest human development indicators. This raises the question of external validity and whether we would expect a similar sanitation experiment to yield similar results in areas with a lower human development baseline.

We believe that sanitation does indeed foster child growth, a proxy of overall child health. However, this study should encourage broader reflection on the external validity of randomised evaluations. We need to ask whether the pool of experimental data we have is influenced by site selection bias, as an experiment requires a high-capacity organisation willing and able to carry out research and implementation. If so, what are the precautions that need to be taken when making policy recommendations based on experimental evidence?

Date: June 13, 2014
Time: 03:30 P.M.

Venue:
Seminar Room, Ground Floor
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map

Note:
Please register here: https://www.eventbrite.com/e/delhi-seminar-series-tickets-11852973563
Watch the seminar live at: https://www.youtube.com/watch?v=OQC6rJVd15Y

23 May 2014: Can MGNREGS buffer negative shocks in early childhood? Evidence from Andhra Pradesh

Aparajita Dasgupta
Population Council, New Delhi

Abstract:
This study examines the role of the Mahatma Gandhi National Rural Employment Guarantee Scheme (MGNREGS) in buffering the negative effects of early childhood exposure to rainfall shocks on long-term health outcomes. Exploiting the spatial and temporal variation in MGNREGS coverage, the study estimates the extent to which nutritional shocks in early childhood can be offset by access to the programme. The study employs a unique identification strategy by integrating detailed administrative records of drought shock and MGNREGS phase-wise roll-out information with a household level panel data from the Young Lives survey, which was conducted over three waves (2002, 2007 and 2009-10) in the state of Andhra Pradesh.

The study finds that while MGNREGS does not help correct long-term past health deficiencies, it is useful in buffering recent drought shocks, which varies by policy-relevant sub-groups. An increase in 22 working days per household increases height-for-age by around 0.26 standard deviations, which is bridging about half the rural-urban gap in average height-for-age score. The programme is most effective for the case of lower educated households and scheduled castes, that are presumably more vulnerable in the face of climatic variability. Hence, there is much room to reap in the indirect benefits of the programme by ensuring food security needs of these households.

Date: May 23, 2014
Time: 03:30 P.M.

Venue:
Seminar Room, Ground Floor
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map

Note:
Please register here: https://www.eventbrite.com/e/delhi-seminar-series-may-tickets-11568845729
Watch the seminar live at: https://www.youtube.com/watch?v=SPxgz9b6RB0

24 October 2013: Systematic reviews: What have we learnt so far? An overview of evidence

Howard White
3ie

Abstract:
Systematic reviews have become a fashion in international development. What are they, and what are they good for? Dr White will present an introductory insight into why reviews are necessary, focusing on why meta-analysis is needed to synthesise study findings. The talk will look at key findings from a range of reviews on clean water, agricultural extension and conditional cash transfer. Strengths and limitations of systematic reviews and their alternatives will also be discussed.

Date: October 24, 2013
Time: 03:30 P.M.

Venue:
Seminar Room, Ground Floor
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map

Note:
Please register here: https://www.eventbrite.com/event/8565396331
Watch the seminar live at: http://www.ustream.tv/channel/internation-initiative-for-impact-evaluation

14 February 2013: Shame or Subsidy: What Explains the Impact of India’s Total Sanitation Campaign?

Sumeet Patil
NEERMAN (Network for Engineering, Economics, Research, and Management), Mumbai

Abstract:
A recent study shows that social pressure and peer monitoring have a greater impact on changing sanitation behaviour of people than subsidies.

A randomized social mobilization campaign was undertaken in the state of Orissa, India, to evaluate and measure sanitation outcomes in terms of child health and household welfare. The campaign increased households’ ownership of sanitary latrines by about 24% overall – and 31% in poorer households that received subsidy as compared to 19% in households that did not receive a subsidy.

The increase in toilet coverage and use did not lead to statistically significant reductions in self-reported diarrhoea, but significant improvements in children’s nutritional status was noted. Switching from open defecation to latrine use also saved substantial amounts of time and increased satisfaction in sanitation conditions.

Mr Patil will discuss the dynamics of shame and subsidy and their relative impacts on improving sanitation in India.

Date: February 14, 2013
Time: 03:30 P.M.

Venue:
Seminar Room
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Note:
Please confirm your participation to Ms Bindu Joy (bjoy@3ieimpact.org)

Location:

View ISID Complex in a larger map

17 September 2012: Does marginal cost pricing of electricity affect groundwater pumping behaviour of farmers? Evidence from West Bengal, India

Aditi Mukherji
International Water Management Institute, New Delhi

Abstract:
As part of the power sector reforms in India, West Bengal began electric metering of agricultural consumers in 2007. Following this, tube well owners were charged on the basis of power usage instead of the prevalent flat tariff rate. An impact evaluation was undertaken to quantify the implications of the policy change. Surveys conducted in 2004 and 2007 served as a baseline. A 3ie-supported follow-up survey was undertaken in 2010, to create a panel data set for analysis.

The study found that a groundwater market had flourished where tube well owners were selling water to marginal farmers. Post-metering, tube well owners increased the price of water even though they had to pay a lower electricity cost. Metering, in effect, had disempowered small and marginal farmers and increased the leverage of tube well owners. Besides, it did not influence either cropping patterns, or the paddy output.

The researchers of this impact evaluation - A Mukherji, JV Meenakshi, A Banerji and A Gupta identified existing legislation that needed to be amended in order to empower small and marginal farmers. The evidence from the study was presented to the new state government that assumed office in 2011 which carried out the necessary policy change.

Date: September 17, 2012
Time: 03:30 P.M.

Venue:
Seminar Room
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map

1 February 2012: Addressing Attribution of Cause and Effect in Small n Impact Evaluations: Towards an Integrated Framework

Howard White
3ie

Abstract:
The drive to demonstrate results is leading to an increased focus on impact evaluation. There has been a substantial rise in the use of ‘large n’ experimental and quasi-experimental impact evaluations. But what can be done when there are insufficient units of assignment to apply statistical tests to determine the difference in outcomes between the treatment and comparison group? The need for such ‘small n’ approaches can arise when investigating one or a few cases, such as capacity building in a single organisation or a policy introduced at the national level, or possibly when an intervention has significant heterogeneity, with different recipients receiving different forms of support. This presentation will discuss some of the methodologies proposed for tackling causal inference in small n cases, including Realist Evaluation, Contribution Analysis, Outcome Mapping and Most Significant Change. Dr. White examines the possibility of drawing out common elements from these different methodologies and developing an integrated framework for small n analysis.

Date: February 1, 2012
Time: 04:00 P.M.

Venue:
Seminar Room
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map

14 December 2011: Why do People Vote the Way they do? Do People Change their Vote Based on the Information they get? Evidence from Delhi and Rajasthan

Rohini Pande
Harvard University

Abstract:
Nearly a quarter of the 543 elected members of the Indian Parliament have been charged with crimes, including rape and murder (Association for Democratic Reforms, 2009). Public services are often poor while public funds stay unutilised. The NGO Satark Nagrik Sangathan found that 53 of the 70 Members of the Delhi Legislative Assembly elected in 2008 had not fully used their local area development funds.

In this context, education campaigns for voters are being increasingly seen as a key method of empowering citizens in a democracy and demanding more effective leadership.

Date: December 14, 2011
Time: 03:30 P.M.

Venue:
Seminar Room
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map

13 October 2011: How Social Norms Matter for Development Effectiveness: Women's Autonomy and Subjective Well-Being in Orissa, India

Thomas de Hoop
3ie

Abstract:
This paper serves to go beyond the obvious but relatively vague notion that context matters for the effectiveness of development programs. We present quasi-experimental evidence that, on average, self-help group membership does not affect subjective well-being in Orissa, India. Furthermore, we present evidence indicating that self-help group membership has positive impacts on women's autonomy. Our results at the same time reveal that subjective well-being sharply declines for those members whose newly gained autonomy meets with relatively conservative gender norms among non-members. The findings demonstrate that self-help groups have a higher impact if social norms are conducive. We thus demonstrate that the heterogeneity in the impact estimates that is related to context becomes partly predictable by the measurement of social norms. This suggests that we can learn something about external validity from the derivation of heterogeneous impacts in a single setting only.

Date: October 13, 2011
Time: 03:00 P.M.

Venue:
Seminar Room
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map

6 July 2011: Evaluating Stabilization Interventions

Annette Brown
3ie

Abstract:
Many bi-lateral and multi-lateral agencies, such as the United Nations, the UK Department for International Development (DfID), and the US Department of State, fund stabilization interventions. These are interventions in stabilization and fragile state contexts that aim to either: prevent organized violence between groups in conflict; prevent individuals from participating in organized violence; or protect civilians from exposure to violence or intimidation.
Outcome measurement and attribution for such interventions is a clear challenge. The pace of such interventions and the sensitivities associated with selecting beneficiaries may seriously constrain the use of "gold standard" randomization methods.
The heavily needs-based approach to much security-related programming may seriously limit the availability of areas or individuals who could be used as comparison groups. Dr. Annette Brown will review the impact evaluations of stabilization interventions conducted over the last decade, and highlight useful innovations and classifications to design such evaluations.

Date: July 6, 2011
Time: 03:30 P.M.

Venue:
Seminar Room
ISID Complex, Plot No. 4
Vasant Kunj Institutional Area
New Delhi- 110 070(INDIA)

Location:

View ISID Complex in a larger map