en  fr  de
  1. Home
  2.  > 
    Programme
  3.  > 
    Programme 2008-2011
  4.  > 
    Quality assurance - ECML programme evaluation
ECML programme

Quality assurance - ECML programme evaluation

These pages present the general scheme for the programme evaluation of the European Centre for Modern Languages of the Council of Europe. The purpose of the scheme is to establish a common institutional basis to standardise and professionalise evaluative methods and facilitate dialogue with relevant partners and stakeholders. The framework is expected to be consistent with internationally accepted evaluation norms, standards and good practices. To this end, the ECML is building on its current capacity and know-how.

The ECML needs to prove to its stakeholders that the Centre functions efficiently and effectively and that its work is relevant and of high quality. To do this requires an evaluation procedure in which stakeholder interests are established, indicators of achievement are set, outcomes are defined and confirmed and evidence and data collection instruments are implemented in a systematic way.

Thus, the framework seeks to increase transparency, coherence and efficiency in generating and using evaluative knowledge for reflective and formative practice in the programme and as such within and across all projects of its programme. Following this approach, the framework will facilitate effective results-oriented management and improve accountability.

SCHEME FOR ECML PROGRAMME EVALUATION
Key Terms
The components of the framework

EVALUATION OF PROJECTS EVALUATION OF PUBLICATIONS SUPPORT

PLANNING & REPORTING
TOOLS for
 • coordinators
 • participants
 • consultants

QUESTIONNAIRES
 • for teams
 • for participants
 

Editorial Board

Web based
Reader's Feedback
 • Peer review
 • Reader's questionnaire
Materials  
 Please check the column to the right for detailed information!

As a result from the application of the introduced scheme in the medium term, improvement in the management practices and the processes, outcomes and outputs of projects and the programme as a whole is expected. Envisaged improvements are:

  • more systematic use of evaluation and self-evaluation;
  • follow-up of evaluation findings and recommendations;
  • synergies and knowledge-sharing;
  • regular feedback from project teams and the participants in the ECML’s activities;
  • more information on the impact of the Centre’s activities and products.

EVALUATION OF PROJECTS: The ECML evaluation scheme is providing a set of instruments in order to pacilitate project planning (planning tools) and to give focussed feedback on outcomes and output of project activities (reporting tools, questionnaires).

QUESTIONNAIRES: are for those responsible for carrying out and monitoring the projects, for national multipliers (participants in ECML workshops) as well as for end users of project publications (readers of ECML publications). ...read more

EDITORIAL BOARD: The editorial board is assessing the quality of proposed publications and advising on acceptance, modifications and/or production of translations.

WEB BASED: An online communicative platform for coordinators, consultants and the ECML Secretariat to ensure coherent and efficient exchange of information and feedback related to project activities.

QUESTIONNAIRES FOR TEAMS:
ECML post event evaluation questionnaire after expert meetings (team member)
ECML post event evaluation questionnaire after network meetings, workshops and regional workshops (team member)

PLANNING AND REPORTING TOOLS FOR COORDINATORS:
Template for the annual plan combined with the annual report
Report template on events (central or regional workshops, network meetings, national events)
Report template on expert meetings

PLANNING AND REPORTING TOOLS FOR PARTICIPANTS
Template for participants in central workshops (report to National Nominating Authorities)

PLANNING AND REPORTING TOOLS FOR CONSULTANTS
Template for programme consultants’ annual report to the ECML (in copy to project teams)
QUESTIONNAIRE FOR READERS OF ECML PUBLICATIONS
Possibility for all readers of ECML publications to submit comments directly online on the ECML website (“Peer review/rating system for publications”);
Publication feedback form
QUESTIONNAIRES FOR PARTICIPANTS:
ECML post event evaluation questionnaire (participant)
ECML impact survey - workshop questionnaire (participant)
MATERIALS:
• Notes on good practice in running ECML workshops for project coordinators, team members and moderators of ECML activities.
• A logbook to aid participant reflection during their involvement in an ECML workshop
PEER REVIEW: Questionnaire designed to collect and analyse feedback of readers having downloaded ECML publications. An example can be found here.
EVALUATION OF PUBLICATIONS: ECML publications are the key outputs of the Centre's programme. They are expected to contribute significantly to achieving the defined outcomes (objectives) of the programme and to the overall mission of the Centre. Under the evaluation scheme mechanicsm and tools for developing quality and monitoring impact of publications are put in place.

PLANNING AND REPORTING TOOLS: For those responsible for carrying out and monitoring the projects (project coordinators and programme consultants) as well as for national multipliers (participants in ECML workshops) templates for planning of and reporting on their activities are available.
See Reporting Procedures for the ECML programme 2008-2011 .

PROGRAMME CONSULTANCY: The advisory and reporting role of consultants in the evaluation system is explained at the following site: The role of the programme consultant 2008-2011. A presentation of the programme consultants appointed for the term 2008-2011 can be accessed at: Programme consultants.