ESMValTool is a community diagnostics and performance metrics tool for the evaluation of ESMs that allows for routine comparison of single or multiple models, either against predecessor versions or against observations. The priority of the effort so far has been to target specific scientific themes focusing on selected Essential Climate Variables, a range of known systematic biases common to ESMs, such as coupled tropical climate variability, monsoons, Southern Ocean processes, continental dry biases and soil hydrology-climate interactions, as well as atmospheric CO2 budgets, tropospheric and stratospheric ozone, and tropospheric aerosols. ESMValTool is/was funded by several institutions and projects. The core development is carried out in DLR.
The software is open-source (see licensing).

More information and  references about ESMValTool here. Specific information, developers and related projects on the website of the Research Software Directory.

If you want to get started, the software is available on GitHub. The documentation is filed on ReadtheDocs.
There is also an online tutorial available.