Evaluation

Evaluation is broadly understood by us as the systematic collection and analysis of data about activities, projects and programmes. This can include quantitative data, such as questionnaires, registry information, tests and measurements or qualitative data such as interviews, observations or document analyses.

We distinguish between internal evaluation, i.e. the projects’ ongoing monitoring and evaluation of achieved goals and results, and external evaluation, i.e. an evaluation of a project or programme conducted by an external evaluator. The external evaluation may in some cases be carried out by the secretariat of the foundations, in other cases by evaluators outside the foundations. In addition, we work with various other types of analyses, studies and monitoring of qualitative and quantitative data.

We conduct evaluations when they add value, That is, where the evaluation can answer questions relevant to the foundation, to the activities, projects, programmes and/or applicant environments. In some cases, the projects’ own internal evaluations may be sufficient, while in other cases, larger and possibly inter-disciplinary evaluations may be required.

We actively use both internal and external evaluations for the development of our strategies, programmes and projects. Do our supported activities, programmes and projects achieve the expected goals and results? Do our programmes create the change we hope for? What factors are particularly relevant to whether we reach our goals?

The foundation’s purpose in conducting evaluations is twofold: to enhance the quality of funded activities and projects both within the foundation’s programmes and across them, and to document results and impacts. Therefore, evaluation is intended to contribute to:

• Creating a foundation of experience and knowledge for dialogue and shared learning within the foundation and the grantee environments on how the stated purposes can best be realised.
• Strengthening the foundation’s knowledge and decision-making basis for the development of strategies and programme areas, as well as the implementation of programmes and initiatives, and providing guidance to applicants and grantees.
• Enhancing the quality and analytical capacity of projects, enabling them to continually improve their efforts.
• Providing Villum Foundation, applicant environments and decision-makers with insights into which efforts are particularly promising and what framework conditions are needed to bring about changes.

1. We take an early and active stance on whether and how supported activities and projects should be evaluated. Not all funded activities and projects require external evaluation. However, in cases where a project requires external evaluation, evaluation questions, design and data collection should be considered alongside the project’s start-up.
2. The foundation, together with the projects, serves as the primary users of evaluations. Several stakeholders should benefit from evaluations, and different questions may be relevant to the board, grantees or potential applicants. Therefore, the foundation always engages in thorough dialogue with relevant grantees about which evaluation questions to address and which designs and methods are relevant, ensuring that both the foundation’s and grantees’ knowledge needs are met.
3. We aim to foster strong evaluation environments. Larger external evaluation tasks for the foundation’s programmes are typically put out for tender, providing multiple environments the opportunity to submit proposals. The foundation maintains an ongoing dialogue with evaluation environments about the development of evaluation expertise.
4. We publicly disclose relevant evaluations and studies. The foundations aspire for everyone to benefit from the knowledge produced in evaluations and studies.

The foundation’s grant areas have different purposes, target audiences strategies etc. How both internal and external evaluations are conducted and used will vary from area to area. It is crucial that the evaluation approach aligns with the characteristics, strategy, data structure and evaluation culture among the professionals working in each area.