Revision history [back]

The most important ones are:

• (Normalized) Mean Bias Error, NMBE/MBE. This assess whether you globally over or under-predict the consumption.
• Coefficient of Variation of the root mean square error, CV(RMSE). This basically assess how close you are to the individual data points (such as monthly utility bills).

The materials you want to read are:

• principally the ASHRAE Guideline 14 "Measurement of Energy And Demand Savings" (2002). It details how to calculate such metrics (and quotes another one, CVSTD, for weather independent cases). For example, if you calibrate monthly (12 utility bills), CV(RMSE) shouldn't exceed 15% and NMBE shouldn't exceed 5%. Hourly: CV(RMSE) < 30% and NMBE < 10%
• Guideline 14 is one of the basis behind the International Performance Measurevement and Verification Protocol (IPMVP) which I suggest you also read (volume 1, especially appendix B)

I haven't tried it but I know that OpenStudio let's you enter utility bill data and then calculates those metrics for you after your run.

The most important ones are:

• (Normalized) Mean Bias Error, NMBE/MBE. This assess whether you globally over or under-predict the consumption.
• Coefficient of Variation of the root mean square error, CV(RMSE). This basically assess how close you are to the individual data points (such as monthly utility bills).

The materials you want to read are:

• principally the ASHRAE Guideline 14 "Measurement of Energy And Demand Savings" (2002). It details how to calculate such metrics (and quotes another one, CVSTD, for weather independent cases). For example, if you calibrate monthly (12 utility bills), CV(RMSE) shouldn't exceed 15% and NMBE shouldn't exceed 5%. Hourly: CV(RMSE) < 30% and NMBE < 10%
• Guideline 14 is one of the basis behind the International Performance Measurevement and Verification Protocol (IPMVP) which I suggest you also read (volume 1, especially appendix B)

I haven't tried it but I know that OpenStudio let's lets you enter utility bill data and then calculates those metrics for you after your run.