Given the multi-sectoral nature of MWASIP, it is no wonder the Project has and relies on a very robust Planning, Monitoring and Evaluation (PM&E) system. Planning, Monitoring and evaluation Unit is essential for efficient and effective use of project resources and delivery of project interventions in accordance with the project’s objectives.
Further, the PM&E process is supported by a computerized Management Information System (MIS). The PM&E system utilizes several technology solutions to complement field-level surveys and measurements, as well as simple, locally appropriate data collection measures that can often include participation by local stakeholders, depending on a given metric. The system is earmarked to capture both qualitative and quantitative aspects, integrating cutting edge, remote sensing and GIS technology.
Project Results Framework
The Project Results Framework includes a total of 21 indicators that will be used to measure the achievement of project objectives. A total of five Project Development Objective (PDO) outcome indicators and 16 intermediate results indicators are being tracked during the project implementation under this result framework. Specific time- based targets have been provided for all the indictors.
Results Monitoring and Evaluation Plan
Results Monitoring and Evaluation involves collection and analysis of data to determine if and by how much an intervention achieved its intended results/outcomes. It assesses/analyses observed change due to the project’s interventions and describes the extent of project’s outcomes that can be attributed to the intervention. It requires a rigorous design methodology and answers questions such as: Did the intervention cause the expected outcomes and what was the impact? Results monitoring assesses both the outcome and the impact of a programme intervention. For MWASIP, these are PDO and intermediate result indicators as outline in the Result M&E Plan Table. The Result Monitoring and Evaluation Plan is built on a participatory approach with clear roles identified at each level of the project implementation. The plan also provides a description of each result indicators and how or when it will be measured.
Monitoring & Evaluation Plan: PDO Indicators | |||||
Indicator Name | Definition/Description | Frequency | Datasource | Methodology for Data Collection | Responsibility for Data Collection |
Proportion of target farmers adopting sustainable landscape management practices | This indicator measures the adoption rate for sustainable landscape management practices. For purposes of this project, sustainable landscape management practices refer to a combination of at least two technologies or practices (agronomic, vegetative, structural, and management measures) applied to improve land quality and prevent degradation and/or restore already degraded landscape. The suite of technologies and practices appropriate to the Malawian context are described in the National Catchment Management Guidelines and Manual. These include physical soil and water conservation techniques (e.g. marker and contour ridges, ridge alignment, box ridges, water harvesting, infiltration ditches, gully plugs, check dams, etc); vegetative river/stream-bank restoration; agricultural technologies (i.e., agroforestry, farmer-managed natural regeneration), community forestry and woodlots and plantation forestry. Adoption refers to a change of practice or change in the use of a technology or practice promoted or introduced by the project. For purposes of this project, a farmer will be counted as an adoptor if he/she practices at least two technologies or practices on agricultural land for at least three consecutive farming seasons or any other technology on other land-use types. | Mid term and annually thereafter Mid term and annually thereafter
| Project MIS and monitoring reports
| Panel survey at mid-term and annually thereafter.
| Department of Land Resources Conservation (DLRC)
|
Land area under sustainable landscape management practices | The indicator measures, in hectares, the land area for which new and/or improved sustainable landscape management practices have been introduced. Land is the terrestrial biologically productive system comprising soil, vegetation, and the associated ecological and hydrological processes; Adoption refers to change of practice or change in the use of a technology promoted or introduced by the project; Sustainable landscape management (SLM) practices refers to a combination of at least two technologies and approaches to increase land quality and restore degraded lands for example, agronomic, vegetative, structural, and management measures that, applied as a combination, increase the connectivity between protected areas, forest land, rangeland, and agriculture land. | Annual
| Project MIS, and monitoring reports
| Data on this indicator will be collected using a multi-layered approach, involving field surveys, mobile-based reporting with geo-tagged photos, unmanned aerial vehicle (UAV) surveys, remote sensing, and satellite imagery
| DLRC and Department of Forestry (DoF)
|
Land area showing an increase in Normalized Difference Vegetation Index (NDVI) and the Land Surface Water Index (LSWI), correcting for short-term climate effects | This indicator captures the results of the adoption of SLM practices in the target watersheds by measuring the increase in vegetation cover corrected for short-term weather effects (e.g. prolonged dry period) through the NDVI and in soil water content through LSWI. The NDVI uses the visible and near-infrared bands of the electromagnetic spectrum to analyze remote sensing measurements to determine the extent to which a target contains live green vegetation. LSWI uses the shortwave infrared and near-infrared bands of the electromagnetic spectrum to analyze remote sensing measurements (based on satellite imagery data) to determine the amount of water in vegetation and soil. The increase in NDVI and LSWI for a given micro watershed to count towards the target for this indicator should be at least 10%, correcting for short-term weather effects. | Mid term and end-term
| Remotely sensed data
| This indicator will be measured using remotely sensed data. Both NDVI and LSWI for the project area will be adjusted for short-term weather effects.
| DLRC, DoF and Department of Surveys
|
Number of people gaining access to water for productive use | This indicator measures improved access to water for productive use as a result of investments in enabling watershed infrastructure. Water for productive use means using water for irrigation, livestock, fisheries, and water for small-scale processing. Access means water is either delivered at the point of production or is within 250m from the point of production for the case of water for livestock. | Annual
| Household surveys, and reports from Water-User Associations (WUAs)
| A household survey will be conducted to determine changes in access to water for productive use. Additional data will be collected from WUAs managing the water schemes
| Department of Irrigation Services (DoI), Department of Water Resources (DWR) and WUAs
|
Proportion (%) of target farmers benefiting from an increase in production sold to the markets and/or an increase in income from marketed products | This indicator tracks the share of target farmers benefiting from an increase in products (agricultural, aquaculture, forest-based) sold to the markets and/or an increase in income from marketed products, as a result of project interventions | Annual
| Sample-based value chain survey reports, supplemented with data from WUAs and Village Natural Resources Management Committees (VNRMCs)
| This indicator will be measured through sample-based value chain surveys and data from WUAs (for the case of irrigated agriculture) ad VNRMCs (for other products)
| Department of Agricultural Extension Services (DAES), DLRC, VNRMCs, and Department of Crop Development (DCD), Department of Animal Health and Livestock Development (DAHLD)
|
Monitoring & Evaluation Plan: Intermediate Results Indicators | |||||
Indicator Name | Definition/Description | Frequency | Datasource | Methodology for Data Collection | Responsibility for Data Collection |
Agricultural land area with soil and water conservation measures | This indicator tracks the area of cropland where soil and water conservations have been applied. Soil and water conservation measures include marker and contour ridges, ridge alignment, box ridges, water harvesting, infiltration ditches, gully plugs, check dams, etc | Annual
| Project M&E Reports
| Data on this indicator will be collected using a multi-layered approach, involving field surveys, mobile-based reporting with geo-tagged photos, and unmanned aerial vehicle (UAV) surveys, | VNRMCs,Catchment Management Committees (CMCs), District Agricultural Extension Development Officer (AEDO), and DLRC
|
Land area with improved agricultural technologies applied | This indicator tracks the adoption of improved agricultural technologies promoted by the project, including conservation agriculture, agro-forestry, farmer-managed natural regeneration etc. | Annual
| Project M&E reports
| Data on this indicator will be collected using a multi-layered approach, involving field surveys, mobile-based reporting with geo-tagged photos, unmanned aerial vehicle (UAV) surveys | VNRMCs, CMCs, Districts (AEDO), DLRC
|
Forest area restored, reforested or under improved management | This indicator tracks the area of natural forest restored, reforested or under improved management; and area under productive plantation forestry management | Annual
| Project MIS, and monitoring reports and remotely sensed data
| Data on this indicator will be collected using a multi-layered approach, involving field surveys, mobile-based reporting with geo-tagged photos, unmanned aerial vehicle (UAV) surveys, remote sensing, and satellite imagery
| VNRMCs/CMCs, DoF
|
Area of vegetative riparian buffer established along major rivers and streams in the targeted watersheds | This indicator tracks the area of vegetative riparian buffer established along major rivers and streams in the targeted watersheds | Annual
| Project MIS, monitoring reports
| Data on this indicator will be collected using a multi-layered approach, involving field surveys, mobile-based reporting with geo-tagged photos, and unmanned aerial vehicle (UAV) surveys | National Water Resources Authority (NWRA), and DLRC
|
Proportion of households within targeted catchments engaged in SLM practices | This indicator tracks the proportion of households within targeted catchments who are engaged in SLM practices. A household will be counted towards this indicator if it is engaged in at least two technologies or practices introduced or promoted by the project | Annual
| Project MIS, project reports
| Data on this indicator will be collected using a multi-layered approach, involving field surveys, mobile-based reporting with geo-tagged photos, unmanned aerial vehicle (UAV) surveys | VNRMC/CMC, Districts (AEDO), DLRC
|
Yields of selected agricultural commodities supported by the project | This indicator tracks the increase in agricultural productivity among farmers supported by the matching grant program. | Annual
| Project MIS reports
| Sample value chain surveys
| DAES, DCD and DLRC, DAHLD
|
Number of female farmers benefiting from an increase in production sold to the markets or an increase in income from marketed products | This indicator tracks the number of female farmers benefiting from an increase in products (agricultural, aquaculture, forest-based) sold to the markets or an increase in income from marketed products, as a result of project interventions | Annual
| Sample-based value chain survey reports, supplemented with data from WUAs and Village Natural Resources Management Committees (VNRMCs)
| This indicator will be measured through sample-based value chain surveys and data from WUAs (for the case of irrigated agriculture) ad VNRMCs (for other product
| Department of Agricultural Extension Services (DAES), DLRC, VNRMCs, and Department of Crop Development (DCD) and Department of Animal Health and Livestock Development (DAHLD)
|
Proportion of project beneficiaries that are satisfied with the services provided under the project | This indicator tracks beneficiary satisfaction with the services provided under the project | Annual
| Beneficiariary survey reports
| Beneficiary surveys
| DLRC and DAES
|
Number of female farmers gaining tenure security through land certification | This indicator tracks the number of female farmers gaining tenure security through the land registration activities supported by the project. | Annual
| Project MIS and monitoring reports, district land administration records | Data will be collected by querying the land administration records at the district level
| Land Reform Implementation Unit (LRIU) and DoS
|
Average performance score for project-supported watershed management institutions | This indicator tracks the annual average performance score for project-supported watershed institutions on their performance scorecards | Annual
| Annual performance assessment reports
| Data on this indicator will be collected through an annual performance assessment of the watershed institutions, based on their respective performance scorecards as per the performance agreements signed with MoIWD
| Independent verification agent – to be engaged by MoIWD
|
Number of farmers receiving payments under the pilot Payment for Watershed Services (PWS) scheme | This indicator tracks the number of farmers receiving payments under the pilot PWS scheme | Annual
| Project MIS, monitoring reports, PWS contracts and verification reports
| Methodology for data collection will be specified in the PWS contracts to be signed with farmers
| DLRC, NWRA, biophysical monitoring consultant
|
Percentage reduction in sediment yield in selected Shire river tributaries | This indicator tracks the reduction in sediment yield in the Shire River tributaries targeted under the PWS scheme | Mid-term and end-of-project
| Biophysical monitoring system – to be established under the project (component 3), sediment monitoring stations
| Sediment monitoring stations to be established under the project
| DLRC, NWRA (supported by a specialized biophysical monitoring consultant), PWS consultant
|
Number of multiple-use water sources developed | This indicator tracks the number of multiple-use water sources developed under the project. Multiple-use water sources include small to medium scale dams, rainwater harvesting structures, high yielding boreholes, and associated conveyance infrastructure | Annual
| Project MIS, construction progress reports,
| Data will be collected through construction progress reports
| DWR
|
Area provided with new/improved irrigation or drainage services | This indicator measures the total area of land provided with irrigation and drainage services under the project, including in (i) the area provided with new irrigation and drainage services, and (ii) the area provided with improved irrigation and drainage services, expressed in hectare (ha). | Annual
| Construction progress reports, WUA reports
| Construction progress reports
| DoI, WUAs
|
Farmers receiving agro-weather information services | This indicator tracks the number of farmers receiving agro-weather information services. | Annual
| Agro-weather product/tool developed with support from the product | The agro-weather product will have an in-built mechanism for tracking the number of farmers receiving the information | DCCMS, DAES
|
A biophysical and ecological monitoring system developed and used | This indicator tracks progress on key milestones for the establishment and use of a biophysical and ecological monitoring system.
A biophysical and ecological monitoring system is a GIS-based information system that is able to systematically capture, analyze and visualize spatially-referenced data on biophysical and ecological changes occurring in a watershed as a result of project interventions.
The system must be able to capture, analyze and visualize spatially-referenced data on the several biophysical, ecological and ecosystem parameters, including but not limited to: tree/vegetation cover, soil depth, soil fertility, soil erosion, soil moisture, sediment yields, groundwater levels, surface water quality, biodiversity, etc. The system must also be able to track key project indicators such as SLM adoption rates, land area under SLM, as well as data on improvements in watershed services supported under the project. The system will be considered implemented if at least the baseline biophysical and ecological data from the 10 sub-catchments has been entered in the system. | Annual
| Progress reports
| Progress reports
| DLRC, DNPW, DoF, LUANAR and consultants
|
We are Malawi Watershed Services Improvement Project (MWASIP).
Please feel free to contact us on any topic, we would be delighted to respond on the work we are doing