View source for Impact Monitoring Guidelines

The focus of the EnDev 2&nbsp;M&amp;E Sytem has shifted from Outcome Monitoring (EnDev 1) to Outcome and Impact Monitoring (EnDev 2). Therefore the Monitoring Group are developing recommendations for a "proper" impact M&amp;E System. 

We recommend to: 

*conduct baseline studies before project intervention and impact studies after households, social infrastructure or SMEs&nbsp;got access to a form of modern energy 
*use&nbsp;a [[Mixed Methods|mix]] of quantitative (standarised household interviews) and qualitative methods (open/ semi-structured&nbsp;interviews with key persons and households or focus group discussions) 
*a [[Theory Based Approach|theory based approach]] by applying the result chain for developing the study design 
*to include [[Control Groups|control groups]] if possible (households which do not have acces to modern energy) into your baseline and impact study&nbsp;

The following table shows typical steps for baseline and impact studies, which we would recommend and support.<br>

{| cellspacing="0" cellpadding="0" width="100%" border="1"
|-
| '''Steps''' 
| '''Tasks''' 
| '''Materials/ Support''' 
| '''Library''' 
| 
|-
| Step 1: Preperation 
| <font size="2">Terms for Consultants/ Enumerators</font> 
| 
*<font size="2">[[Sample Terms for Consultant for Impact Evaluation|Sample Terms]]</font> for national / international consultants 
*Sample Terms for enumerators&nbsp;

| 
| 
|-
| 
| Selection Consultant/ Enumerators 
| 
*<font size="2">Consultants</font>

| 
| 
|-
| 
| Study of available documents and statistics on national development goals and policies, national sector goals and policies, BMZ goals and concept for the partner country 
| 
*<font size="2">Checklist on relevant development goals</font>

| 
*UNDP&nbsp;[http://www.energyandenvironment.undp.org/undp/index.cfm?module=Library&page=Document&DocumentID=5761 Energy Services for the Millennium Development Goals] 
*BMZ&nbsp;[http://www.bmz.de/en/issues/energie/energieeffizienz/index.html Sustainable Energy for Development]

| 
|-
| 
| <font size="2">Developing of Results Chains/ Indicators</font> 
| 
*[[MDGs and Result Chains|<font size="2">Sample Results Chain</font>]] 
*[[Recommendation|<font size="2">Impact Criteria and&nbsp;indicators</font>]]

| 
*Cooking&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=381 Energy Impacts, Observation Fields and Indicators] 
*IA Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=183&&Itemid=13 Result Chain] 
*IA Ethiopia: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=206&&Itemid=13 Result Chain] 
*IA Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=181&&Itemid=13 Model List of Impacts, Observation Fields and Indicators]

| 
|-
| 
| <font size="2">Developing of Questionnaires, interview guidelines, PRA tools (MAPP), observation criteria and other tools</font>&nbsp; 
| 
*<font size="2">Questionnaire</font>s for&nbsp;HH (stoves), stove producers, social institutions and restaurants using ICS 
*PRA tools for focus group discussions (MAPP) 
*Interview&nbsp;guidelines for village authorities 
*Observation criteria for stoves in use (example lists of good cooking practices and of stove conditions)&nbsp;

| 
*Questionnaires, PRA tools, Interview Guidelines, Observation Criteria:[[Examples Questionnaires|&nbsp;Country Example documents]]&nbsp;/ [http://www.endev.info/wiki/index.php/Impact_Studies_Material#General Impact Studies Material&nbsp;]

| 
|-
| 
| <font size="2">Sampling/ Selection target Group</font> 
| 
*<font size="2">[[Guidelines for Sampling/ Selection Criterias|Guidelines/ Selection Criterias]]</font> 
*Poverty criteria for selection of&nbsp;HH

| 
*Kenya:&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=185&&Itemid=13 Selection Criteria for HH, SI, PU and Producers IA]&nbsp; 
*Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=505 Local Poverty criteria (example from local village authorities)]

| 
|-
| 
| <font size="2">Training of Supervisors and Enumerators/ Pretesting</font> 
| 
*<font size="2">Training Material</font> 
*<font size="2">Training Agenda</font>

| 
*Supervisors and Enumerators&nbsp;[http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=511 Example Training Agenda]&nbsp;(french version)&nbsp; 
*Kenya: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=504 ICS Training of Enumerators]

| 
|-
| <font size="2">Step 2: Implementation</font> 
| <font size="2">Logistics</font> 
| 
*[[Checklist on how to implement HH Interviews|<font size="2">Checklist on how to implement HH Interviews</font>]]

| 
<br>

| 
|-
| 
| <font size="2">Conducting Interviews</font> 
| 
| 
*Manual [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=515 Conducting Interviews]&nbsp;(french version)&nbsp;

| 
|-
| 
| <font size="2">Data entry</font> 
| 
| 
| 
|-
| <font size="2">Step 3: Data Analysis/ Reporting</font> 
| <font size="2">Data analysis</font> 
| 
*<font size="2">Guiding Question for data analysis</font>&nbsp;

| 
*Kenya Stove HH: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=191 Guiding Question for data analysis] 
*Kenya Stove Producer: [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=192&&Itemid=13 Guiding Question for data analysis]

| 
|-
| 
| <font size="2">Data interpretation – in exchange with the project team (in a workshop)</font> 
| 
*Checklist for data interpretation

| 
| 
|-
| 
| <font size="2">Report writing</font> 
| 
*Example for [http://www.endev.info/index.php?option=com_docman&task=doc_download&gid=503 report summary] 
*Example for ICS description (Annex)

| 
| 
|}

<br>