Monitoring and evaluation as evidence for retrofit

What is monitoring and evaluation? 

M&E are defined as follows:

• Monitoring: This involves the systematic collection of data related to energy performance, air quality, and building conditions throughout the lifecycle of the retrofit project
• Evaluation: The process of analysing this data to determine whether the retrofit project has achieved its desired outcomes, and to identify areas for improvement

The importance of M&E in retrofit projects 

Although M&E are a requirement under PAS 2035, its importance extends beyond compliance:

Learning from each project: M&E provide valuable feedback on what worked and what did not. This learning can be applied to future retrofit projects, enabling improvements that enhance performance and reduce costs. For example, M&E can help determine which energy efficiency measures are most effective in reducing fuel consumption across different types of housing stock.

Resident engagement and satisfaction: M&E also play a critical role in enhancing resident engagement. By capturing resident feedback, projects can be adjusted to improve comfort, indoor air quality, and overall satisfaction. Questions in M&E surveys should be simple and direct, such as, "do you feel you are benefiting from your new heat pump?" rather than using overly technical language.

Unlocking future improvements: Effective M&E can highlight lessons learned from each project that are applicable to subsequent waves of retrofitting. This might include refining strategies to reduce the risk of overheating, improving airtightness, or addressing moisture issues.

Practical application of M&E 

M&E begin from project inception and continues beyond the completion of the retrofit. In practice, it is overseen by the Retrofit Coordinator, who ensures that:

• Baseline data, such as fuel consumption and indoor temperatures, is collected before the project starts
• Ongoing monitoring tracks these variables during and after the retrofit
• A comprehensive evaluation is conducted to compare actual outcomes against projected goals

A structured approach to M&E can be implemented through sample M&E plans, which include both qualitative and quantitative metrics.

• Qualitative data could involve gathering occupant feedback on their perceived comfort and any disruptions experienced during the retrofit process
• Quantitative data would consist of precise figures, measuring factors such as energy usage, indoor temperatures, airtightness levels, and impurities in the air (a measure of indoor air quality)

Monitoring vs evaluation: What’s the difference? 

While closely linked, monitoring and evaluation serve distinct purposes:

• Monitoring is the ongoing process of collecting data before, throughout and after the retrofit project. It tracks real-time performance metrics, such as energy usage and air quality
• Evaluation involves analysing this data cyclically to assess whether the project has met its intended objectives, such as reducing energy consumption or improving indoor air quality

Effective monitoring enhances the impact of evaluation by providing a strong data foundation that reveals both successes and areas for improvement. For example, comprehensive monitoring may show that while energy consumption decreased, comfort levels did not improve as expected. This feedback loop is crucial for refining and improving future projects.

Specifics of evaluation

PAS 2035 requires various levels of evaluation depending on the project's scope and risk. Basic monitoring and evaluation are mandatory for all projects, while intermediate evaluation is required when significant differences between intended and actual outcomes arise.

Key metrics for evaluation include:

• Energy savings (e.g., reduced kWh usage)
• Improved comfort. For this, collecting resident feedback through structured surveys is essential.
• Any surveys should be clear and concise, allowing residents to provide meaningful input without
• being overwhelmed by technical jargon
• Indoor air quality (measured through sensors and surveys)

Monitoring and evaluation are vital to transparently proving the success of retrofit projects. By continuously tracking and assessing performance, M&E ensure that energy efficiency goals are met, resident satisfaction improves, and valuable lessons are carried forward to future projects. Not only are M&E requirements under PAS 2035, but it also plays a crucial role in providing evidence to learn about the effectiveness of retrofits.

Therefore, M&E can unlock improvements that enhance the quality and sustainability of future retrofits. Through the combination of technical data and resident feedback, M&E provide a comprehensive understanding of the real-world impact of retrofit measures, driving progress towards a more sustainable housing stock.