Proof of Concept

• In 2023, a first Proof of Concept version of the ANM annotation guidelines were developed by Marloes Oomen and Floris Roelofsen in the context of a project on question sentences in NGT. This first Proof of Concept version of the guidelines is available here .
• A paper about the development of the first Proof of Concept version of the guidelines was published in the NELS53 proceedings.
• Based on these initial guidelines, a dataset was annotated by Marloes Oomen and Tobias de Ronde in order to determine inter-annotator agreement.
• Lyke Esselink developed an R script to analyze inter-annotator agreement. Based on this analysis, recommendations for further improvement of the annotation guidelines were formulated and a new tier structure was developed by Lyke Esselink, Marloes Oomen and Floris Roelofsen. The IAA analysis, recommendations, and new tier structure were published in a technical report .

Prototype

• In 2024, based on the recommendations in the technical report, the current Prototype version of the guidelines (version 1.2024) was developed by Marloes Oomen, Cindy van Boven, Lyke Esselink, Tobias de Ronde, and Floris Roelofsen.
• In October 2024, the prototype version of the guidelines was discussed during the First ANM Meeting in Barcelona, organized by Cornelia Loos, Pilar Prieto, Annika Herrmann, and Floris Roelofsen, with an international consortium consisting of 25 researchers from different labs across Europe.

Current stage: First Product development

• The First Product version of the guidelines has been developed by the international ANM consortium.
• Current consortium members (in alphabetical order): Florence Baills, Gemma Barberà, Anastasia Bauer, Cindy van Boven, Raquel Veiga Busto, Brendan Costello, Lyke Esselink, Johannes Heim, Annika Herrmann, Serpil Karabüklü, Vadim Kimmelman, Andrea Lackner, Clara Lombart, Cornelia Loos, Nina-Kristin Meister, Liona Paulus, Alexandra Navarrete-González, Marloes Oomen, Pilar Prieto, Sophie Repp, Floris Roelofsen, Patrick Louis Rohrer, Tobias de Ronde, Rosalee Wolfe, Rebecca Woods, Giorgia Zorzi.
• The First Product version of the guidelines was released in July 2025.
• A presentation on this stage of the project was given at ISGS10 in Nijmegen on 9 July 2025 (see image below).
• The First Product version of the guidelines is currently being evaluated.