News
- New version of the
evaluation plan, with official calendar, version 2.2 (Feb. 16, 2012)
- Minutes of the ETAPE meeting of Feb. 6, 2012
and related presentations: status of the
project (AFCP), data
production (ELDA), scoring tools
(LNE), entity
annotation in Quaero (Quaero/LIMSI), phonetic alignments
(LPP)
- Annotations of entities in
the ESTER data by Quaero now
available for ETAPE participants! To have access to these data,
sign up the addendum
to the
ETAPE participant contract or the new version of the contract,
depending
on your situation.
Summary
ETAPE is a project targeting the organisation of evaluation campaigns
in the field of automatic speech processing. Partially funded by the
French National Research Agency (ANR), the project brings together
national experts in the organisation of such campaigns under the
scientific leadership of the AFCP, the French-speaking Speech
Communication Association, a regional branch of ISCA.
The ETAPE 2011 campaign follows the series of ESTER campaigns organized
in 2003, 2005 and 2009, targeting a wider variety of speech quality and
the more difficult challenge of spontaneous speech. While the initial
ESTER campaigns targeted radio broadcast news, the 2009 edition
introduced accented speech and non news shows with spontaneous speech.
The ETAPE 2011 evaluation will focus on TV material with various level
of spontaneous speech and multiple speaker speech. Apart from
spontaneous speech, one of the originality of the ETAPE 2011 campaign
is that it does not target any particular type of shows such as news,
thus fostering the development of general purpose transcription systems
for professional quality multimedia material. Annotations will be
enriched with phonetic alignments and syntactic trees.
Calendar
- definition of the evaluation plan: April 2011
- distribution of train and dev data: August 2011
- test phase: March-April 2012
- March 21: Distribution of test data for tasks S and T
- March 28: Submission of runs for tasks S and T
- April 2: Distribution of transcripts of task EN, start fo
adjudication of tasks S and T
- April 10: Submission of runs for task EN
- April 13 vril : Start of adjudication for task EN
- April 16 avril: End of adjudication for tasks S and T
- April 27: End of adjudication for task EN
- May 3: Release of official results
- final workshop: May 10-11, 2012
Important documents
Partners of the ETAPE project: Association
Francophone de la Communication Parlée ;
Direction
Générale pour l'Armement ; Laboratoire
National
de
Métrologie
et
d'Essais ; ELDA
S.A.
; Université Paris 3 /
Laboratoire de Phonétique et Phonologie ; Université
Paris 7, Laboratoire de Linguistique Formelle.
Contacts :
Guillaume Gravier,
Gilles Adda
 |
Projet ANR-09-CORD-009 financé par
l'Agence Nationale pour la Recherche dans le cadre du programme Contenus et Interaction 2009. |
