WP8: Assessment and evaluation

Objectives

The purpose of this workpackage is to monitor that the scientific and technical objectives of the project are met. Specific objectives are:

• development of appropriate metrics for measurement of quality;
• delivery of reports on peer reviewed deliverables;
• recommendations for corrective actions arising from significant peer review comments and/or other technical quality deviations.
• WP8 reviews project performance, both internally as by external reviewers.

Internal reviews will be performed by people working on the aceMedia project itself, but not on the specific deliverable under review. This internal review of strategic (e.g. cross-workpackage) deliverables helps the project to identify deviations of objectives in an early stage.

External reviews will be done by members of the aceMedia Scientific Board (see below) or they will ask an independent reviewer to do so. The Scientific Board aims to alert the aceMedia partners to any possible drifting from the stated project and workpackage objectives. The external reviews will be aligned with the annual EC review cycle.

Workpackage 8 will organize the reviews, monitor other signals concerning the progress of the project, and will report to the project management and aceMedia partners about any required improvements. WP8 will start with an investigation into measures (both subjective and objective) to judge the quality of the deliverables.

Scientific Board

To assist with self-evaluation activities in WP8, an independent aceMedia Scientific Board is set up, comprising experts who are not partners in aceMedia (suitable Non-Disclosure Agreements are in place). The Scientific Board is periodically asked to review technical progress such that aceMedia remains innovative, forward looking, and ensures that aceMedia is producing work of high technical quality. Scientific Board membership reflects the composition of the aceMedia consortium, and therefore includes people such as senior industrialists, prominent academics with expertise in key aceMedia technologists, and in order to maintain ethical standards, at least one expert in ethical issues (for example from a research institute specialising in such matters).

Members of the Scientific Board

• Oscar Corcho (Information Management Group, University of Manchester)
• Elke Maria Melchior (ACit GmbH)
• Werner Haas (Institute of Information Systems & Information Management, JOANNEUM RESEARCH Forschungsgesellschaft mbH)
• Luc Van Gool (ETH Zurich, D-ITET Department)
• Joern Ostermann (Institut fur Theoretische Nachrichtentechnik und Informationsverarbeitung, Universitat Hannover)

Workplan

The workpackage delivered a report on objective and subjective metrics, to which aceMedia documents will be reviewed. Internal and external reviews will alternate. A report on an external evaluation will be delivered in month 26. We will also perform internal reviews. Thus we have a procedure to continuously check the progress to the goals of the project and provide input for redirecting the project if necessary.

• Home
Project
• Partners
• Results
• Reference

• Project Summary
• Project Objectives
• The ACE Architecture
• Work Breakdown
  • WP1: project management
  • WP2: requirements
  • WP3: content engineering
  • WP4: ontology infrastructure
  • WP5: system specification
  • WP6: ACE usage
  • WP7: exploitation and dissemination
  • WP8: assessment and evaluation

• Contact
• Sitemap
• Search