The European Defence Fund (EDF) is the Commission’s initiative to support collaborative defence research and development, and to foster an innovative and competitive defence industrial base.
Human-AI dialogue systems offer impressive results but are still prone to errors of various types. Moreover, there is no established metric to measure system performances. In order to ensure trustworthiness and steer progress, these systems should be submitted to common tests using shared data and clear metrics and protocols.
The goal of this call topic is thus to set up a testing environment and organise a technological challenge to evaluate the performances of such systems for defence use cases, including their abilities to manage classified information and to justify their answers. The challenge should be open to research teams supported through another call topic (EDF-2025-LS-RA-CHALLENGE-DIGIT-HAIDP) and possibly by other sources of funding. Representative defence users should be involved to contribute to the definition of the use cases and associated data, to test the demonstrators produced by the participating teams, and to provide feedback.
The proposals should address the organisation of a technological challenge on humanAI dialogue based on the preliminary evaluation plan provided as part of the call document. This includes the collection, annotation and distribution of data, the elaboration of evaluation plans and metrics, the measurement of system performances, and the organisation of debriefing workshops.
In order to be eligible, all applicants (beneficiaries and affiliated entities) must cumulatively:
Consortium composition – Proposals must be submitted by: minimum 3 independent applicants (beneficiaries; not affiliated entities) from 3 different eligible countries.
Ministry of Defense
Address: 172-174 Strovolos Avenue, 2048 Strovolos, Nicosia
Telephone: 22 807500
Email: defence@mod.gov.cy
Website: https://mod.gov.cy/
Department of Research and Innovation
Telephones: 22 807755, 22 807754
Email: research.innovation@mod.gov.cy
For help related to this call, please contact: DEFIS-EDF-PROPOSALS@ec.europa.eu