These websites present the general scheme for the programme evaluation of the European Centre for Modern Languages of the Council of Europe. The purpose of the scheme is to establish a common institutional basis to standardise and professionalise evaluative methods and facilitate dialogue with relevant partners and stakeholders. The framework is expected to be consistent with internationally accepted evaluation norms, standards and good practices. To this end, the ECML is building on its current capacity and know-how.

The ECML needs to prove to its stakeholders that the Centre functions efficiently and effectively and that its work is relevant and of high quality. To do this requires an evaluation procedure in which stakeholder interests are established, indicators of achievement are set, outcomes are defined and confirmed and evidence and data collection instruments are implemented in a systematic way.

Thus, the framework seeks to increase transparency, coherence and efficiency in generating and using evaluative knowledge for reflective and formative practice in the programme and as such within and across all projects of its programme. Following this approach, the framework will facilitate effective results-oriented management and improve accountability.

SCHEME FOR ECML PROGRAMME EVALUATION
Key Terms The components of the framework
	EVALUATION OF PROJECTS		EVALUATION OF PUBLICATIONS	SUPPORT
	PLANNING & REPORTING TOOLS for • coordinators • participants • consultants	QUESTIONNAIRES • for teams • for participants	Editorial Board	Web based
			Reader's Feedback • Peer review • Reader's questionnaire	Materials
Please hover for more information!

As a result from the application of the introduced scheme in the medium term, improvement in the management practices and the processes, outcomes and outputs of projects and the programme as a whole is expected. Envisaged improvements are:

more systematic use of evaluation and self-evaluation;
follow-up of evaluation findings and recommendations;
synergies and knowledge-sharing;
regular feedback from project teams and the participants in the ECML’s activities;
more information on the impact of the Centre’s activities and products.

Quality assurance - ECML programme evaluation

SCHEME FOR ECML PROGRAMME EVALUATION
Key Terms The components of the framework
	EVALUATION OF PROJECTS		EVALUATION OF PUBLICATIONS	SUPPORT
	PLANNING & REPORTING TOOLS for • coordinators • participants • consultants	QUESTIONNAIRES • for teams • for participants	Editorial Board	Web based
			Reader's Feedback • Peer review • Reader's questionnaire	Materials
Please hover for more information!

more systematic use of evaluation and self-evaluation;
follow-up of evaluation findings and recommendations;
synergies and knowledge-sharing;
regular feedback from project teams and the participants in the ECML’s activities;
more information on the impact of the Centre’s activities and products.

PROGRAMME CONSULTANCY: The advisory and reporting role of consultants in the evaluation system is explained at the following site: The role of the programme consultant 2008-2011. A presentation of the programme consultants appointed for the term 2008-2011 can be accessed at: Programme consultants.

EVALUATION OF PROJECTS: The ECML evaluation scheme is providing a set of instruments in order to pacilitate project planning (planning tools) and to give focussed feedback on outcomes and output of project activities (reporting tools, questionnaires).

PLANNING AND REPORTING TOOLS: For those responsible for carrying out and monitoring the projects (project coordinators and programme consultants) as well as for national multipliers (participants in ECML workshops) templates for planning of and reporting on their activities are available.
See Reporting Procedures for the ECML programme 2008-2011 .

QUESTIONNAIRES: are for those responsible for carrying out and monitoring the projects, for national multipliers (participants in ECML workshops) as well as for end users of project publications (readers of ECML publications). ...read more

EVALUATION OF PUBLICATIONS: ECML publications are the key outputs of the Centre's programme. They are expected to contribute significantly to achieving the defined outcomes (objectives) of the programme and to the overall mission of the Centre. Under the evaluation scheme mechanicsm and tools for developing quality and monitoring impact of publications are put in place.

EDITORIAL BOARD: The editorial board is assessing the quality of proposed publications and advising on acceptance, modifications and/or production of translations.

PEER REVIEW: Questionnaire designed to collect and analyse feedback of readers having downloaded ECML publications. An example can be found here.

WEB BASED: An online communicative platform for coordinators, consultants and the ECML Secretariat to ensure coherent and efficient exchange of information and feedback related to project activities.

MATERIALS:
• Notes on good practice in running ECML workshops for project coordinators, team members and moderators of ECML activities.
• A logbook to aid participant reflection during their involvement in an ECML workshop

QUESTIONNAIRES FOR TEAMS:
ECML post event evaluation questionnaire after expert meetings (team member)
ECML post event evaluation questionnaire after network meetings, workshops and regional workshops (team member)

QUESTIONNAIRES FOR PARTICIPANTS:
ECML post event evaluation questionnaire (participant)
ECML impact survey - workshop questionnaire (participant)

PLANNING AND REPORTING TOOLS FOR COORDINATORS:
Template for the annual plan combined with the annual report
Report template on events (central or regional workshops, network meetings, national events)
Report template on expert meetings

QUESTIONNAIRE FOR READERS OF ECML PUBLICATIONS
Possibility for all readers of ECML publications to submit comments directly online on the ECML website (“Peer review/rating system for publications”);
Publication feedback form

PLANNING AND REPORTING TOOLS FOR PARTICIPANTS
Template for participants in central workshops (report to National Nominating Authorities)