Difference between revisions of "Indicators"

From IMSMA Wiki
Jump to: navigation, search
 
(24 intermediate revisions by 4 users not shown)
Line 1: Line 1:
−
This page summarises an initial, internal brainstorming on indicators.
+
{{TOC right}}
−
 
+
Indicators can be recorded, measured or analysed in order to provide a simple and reliable means to identify achievement measure the changes connected with an intervention
−
{{note|THIS IS WORK IN PROGRESS!}}
+
or to help assess performance.
−
{{note|Further ideas/TODOs:
+
Indicators can be
−
* For each indicator, mention appropriate display mechanisms! --> For this, define categories of display mechanisms
+
* quantitative (numeric),  
−
* For each indicator, mention if it is quantitative or qualitative, and maybe even how it could be calculated/where the data could be taken from.
+
* qualitative or  
−
* --> Define a matrix for the main indicator characteristics
+
* pseudo-quantitative in case a number is converted to a scale (e.g. 1 = poor, 5 = good).
−
* The overall goal is to come up with a reference set of indicators per mine action area (Land release, MRE, Victim assistance, etc.)
 
−
}}
 
  
 
== Principles for the development of indicators ==__NOEDITSECTION__
 
== Principles for the development of indicators ==__NOEDITSECTION__
−
=== From a presentation from DDG: ===__NOEDITSECTION__
 
 
* '''Valid''' - Does the indicator directly represent the change it is intended to measure? Is the change within the scope of the project?  
 
* '''Valid''' - Does the indicator directly represent the change it is intended to measure? Is the change within the scope of the project?  
 
* '''Objective''' - Is the definition precise, simple and unambiguous about what is to be measured?  
 
* '''Objective''' - Is the definition precise, simple and unambiguous about what is to be measured?  
Line 18: Line 15:
 
* '''Owned''' - Do the local communities and programme management agree that this indicator makes sense?
 
* '''Owned''' - Do the local communities and programme management agree that this indicator makes sense?
  
−
=== Other approaches? ===__NOEDITSECTION__
+
== SMART & SMARTER==__NOEDITSECTION__
−
SMART - SMARTER:
+
SMART is a mnemonic/acronym, giving criteria to guide in the setting of objectives/indicators.
 
* Specific
 
* Specific
 
* Measurable
 
* Measurable
Line 28: Line 25:
 
* (Reevaluate)
 
* (Reevaluate)
  
−
See [http://en.wikipedia.org/wiki/SMART_criteria]
+
See [http://en.wikipedia.org/wiki/SMART_criteria Wikipedia article]
  
 
== Categories/Levels of indicators ==__NOEDITSECTION__
 
== Categories/Levels of indicators ==__NOEDITSECTION__
−
This is just to have different sets of indicators, for different levels/purposes/areas...
+
Indicators are of different types / levels / purposes  
  
 
* Output-level indicators
 
* Output-level indicators
 
* Outcome-level indicators
 
* Outcome-level indicators
 
* Performance indicators
 
* Performance indicators
−
* Impact-level indicators?
+
* Impact-level indicators
−
* Activity-level indicators?
+
* Activity-level indicators
  
−
== Collection of indicators ==__NOEDITSECTION__
+
== Examples of indicators ==__NOEDITSECTION__
−
This is an initial collection of indicators encountered so far in the mine action context. '''It is not yet an assessment regarding their applicability/usefulness/relevance!'''
+
=== Indicators mentioned in the Copenhagen initiative output document ===__NOEDITSECTION__
−
 
 
−
=== Indicators mentioned in the Copenhagen initiative output document: ===__NOEDITSECTION__
 
  
 
{| class="wikitable"
 
{| class="wikitable"
Line 167: Line 162:
 
|}
 
|}
  
−
=== Indicators mentioned in the UN M&E framework: ===__NOEDITSECTION__
+
== References ==__NOEDITSECTION__
−
TODO
+
* UN M&E framework for mine action [[Media:20140318(v2) - Survey Instrument for Pilot.docx | UN Survey Instrument]]
−
 
+
* Feinstein International Center: [http://fic.tufts.edu/assets/PIA-guide_revised-2014-3.pdf Participatory Impact Assessment: A Design Guide]
−
=== Inspirational indicators from WHO document ===__NOEDITSECTION__
+
* World Health Organization: [http://www.who.int/healthinfo/systems/WHO_MBHSS_2010_full_web.pdf?ua=1 A Handbook of Indicators and their Measurement Strategies]
−
 
+
* Mikkel Nedergaard (DDG): [http://www.jmu.edu/cisr/journal/18.1/focus/nedergaard.shtml  Outcome Monitoring in Humanitarian Mine Action]
−
=== Indicators mentioned in a discussion about operational efficiency ===__NOEDITSECTION__
+
* Miscellaneous links/resources related to '''Outcome Mapping'''
−
From a discussion between Helen, Rana and Elisabeth:
+
** [http://www.researchtoaction.org/2012/01/outcome-mapping-a-basic-introduction/ Outcome Mapping: A Basic Introduction]
−
* % of areas worked on that had mines
+
** [http://www.idrc.ca/EN/Resources/Publications/Pages/IDRCBookDetails.aspx?PublicationID=121 Building Learning and Reflection into Development Programs]
−
* % of areas worked on that had UXOs
+
** [http://www.outcomemapping.ca/ Outcome Mapping Learning Community]
−
* Average size of cleared area
 
−
* Average size of surveyed area
 
−
 
 
  
−
[[Category:NoPublic]]
+
{{NavBox Business Intelligence}}
 +
[[Category:NAA]]

Latest revision as of 20:29, 20 February 2020

Indicators can be recorded, measured or analysed in order to provide a simple and reliable means to identify achievement measure the changes connected with an intervention or to help assess performance. Indicators can be

  • quantitative (numeric),
  • qualitative or
  • pseudo-quantitative in case a number is converted to a scale (e.g. 1 = poor, 5 = good).

Principles for the development of indicators

  • Valid - Does the indicator directly represent the change it is intended to measure? Is the change within the scope of the project?
  • Objective - Is the definition precise, simple and unambiguous about what is to be measured?
  • Reliable - Is the data needed to measure the indicator consistent or comparable over time?
  • Practical - Can data be collected easily, on a timely basis and at reasonable costs?
  • Useful - Will the indicator data be useful for programme decision-making and learning?
  • Owned - Do the local communities and programme management agree that this indicator makes sense?

SMART & SMARTER

SMART is a mnemonic/acronym, giving criteria to guide in the setting of objectives/indicators.

  • Specific
  • Measurable
  • Achievable
  • Relevant
  • Time-bound
  • (Evaluate)
  • (Reevaluate)

See Wikipedia article

Categories/Levels of indicators

Indicators are of different types / levels / purposes

  • Output-level indicators
  • Outcome-level indicators
  • Performance indicators
  • Impact-level indicators
  • Activity-level indicators

Examples of indicators

Indicators mentioned in the Copenhagen initiative output document

Outcomes Indicators
Physical and Psychological Safety
  • Reduced number of mine/ERW related accidents/incidents reported in area of operation
  • Reduced at-risk behaviours of target population at high risk of a mine/ERW accident
  • Increased feeling of safety among beneficiaries
  • Number of mine/ERW accidents/incidents
  • Number of beneficiaries at risk of a mine/ERW related death or injury
  • Number of reported instances of unsafe behaviour
  • Level of awareness about mines/ERW in at-risk communities
  • Level of concern about mines/ERW on the part of the target population
  • Level of confidence in use of released land by target population
Land Use and Livelihoods
  • Released land contributing to improved livelihoods
  • Safe access to previously contaminated land
  • Improved productive use of released land
  • Proportion of released land put into productive use
  • Number of people directly benefitting from use of released land
  • Numbers of people accessing previously blocked resources and infrastructure
National Mine Action Ownership
  • Improved national ability to oversee, manage and implement mine action activities
  • Realistic estimation of mine and ERW problem
  • Proportion of mine action activities driven by national strategy
  • Level of national implementation capacity
  • Level of compliance of database and information management system with national and international standards
  • Proportion of mine action budget funded by national contribution
  • Percentage of national staff in management and operational advisory positions

Indicators mentioned in DDG's publication on output monitoring

Objective Indicator Evidence to collect at baseline and impact assessment
Increase in productive use of released land
  • Changes in use of released land
  • Amount of released land brought into productive use e.g. housing or agriculture and grazing land
  • Number of men and women benefiting from released land
  • Describe current and former use of land
  • Estimate the percentage of different land uses (e.g. 25 % agriculture, 30 % housing, 10 % infrastructure (roads), 20 % unused etc.)
  • Estimate number of men and women benefiting from targeted land

Enable resettlement and return

  • Number of men and women resettled on released land
  • Number of refugees and / or IDPs returning to communities benefiting from mine action
  • Describe current and former population in terms of IDP, refugee and host population

Improve access to markets and natural resources

  • Changes in infrastructure
  • Meters to market, main road, cultural important buildings...
  • Time spent on collecting water
  • Number of potential users, men and women
  • Estimate meters to market, main road, cultural important buildings
  • Estimate time spent on collecting water
  • Estimate the number of potential users of infrastructure (e.g. users of roads, schools etc.)

Do no harm

  • Changes in the number of conflicts over land
  • Level of equal participation in decision making over use of released land
  • Describe the situation e.g. the number of and nature of conflicts over land in the target area
  • Describe the decision making process focusing both on men and women

Reduced violence and conflict

  • Number of people who have had a violent encounter
  • Men, women and children’s perceptions of the level of armed violence
  • Estimate the ratio of violent encounters e.g. in the past twelve months
  • Perceived level of armed violence amongst the people today

Reduced threats from explosive remnants of war

  • Number of accidents (human and domestic animals)
  • Number of people who worry about accidents with mines or remnants of war (feeling of safety)
  • Level of knowledge on mine risks among the population
  • Number of identified private owners of explosive remnants of war
  • Number of accidents, men, women, children, animals
  • Number of people who say they worry about accidents with mines or remnants of war
  • Estimate awareness of mines and UXO in the population, disaggregate by gender and age
  • Estimate number of identified private owners of explosive remnants of war

Improved security provision and conflict management

  • Level of trust in policy
  • Change in the percentage of people willing to report incidents of armed violence
  • Formation of local strategies for armed violence prevention and reduction
  • Measure community willingness to report
  • Incidents of armed violence to police
  • Number of local initiatives to counter armed violence

Reduced treats from SALW

  • Number of firearm related accidents
  • Percentage of people who say they worry about firearms

Estimate number of firearm related accidents

References

Staging Area Generator
IMSMA Staging Area
Other Reporting Tools
Indicators
Introduction to indicators
Retrieved from "http://mwiki.gichd.org:8090/mediawiki/index.php?title=Indicators&oldid=24435"