NLPExplorer

An Investigation into the Validity of Some Metrics for Automatically Evaluating Natural Language Generation Systems

Ehud Reiter | Anja Belz |

Year: 2009

Venue: CL |

Evaluating the text quality, human likeness and tailoring component of PASS: A Dutch data-to-text system for soccer
Chris van der Lee | Bart Verduijn | Emiel Krahmer | Sander Wubben |

Further Meta-Evaluation of Broad-Coverage Surface Realization
Dominic Espinosa | Rajakrishnan Rajkumar | Michael White | Shoshana Berleant |

A Comparative Evaluation Methodology for NLG in Interactive Systems
Helen Hastie | Anja Belz |

Flow Graph Corpus from Recipe Texts
Shinsuke Mori | Hirokuni Maeta | Yoko Yamakata | Tetsuro Sasada |

Generating Expressions that Refer to Visible Objects
Margaret Mitchell | Kees van Deemter | Ehud Reiter |

Correlating Human and Automatic Evaluation of a German Surface Realiser
Aoife Cahill |

Comparing Automatic Evaluation Measures for Image Description
Desmond Elliott | Frank Keller |

Probabilistic Verb Selection for Data-to-Text Generation
Dell Zhang | Jiahao Yuan | Xiaoling Wang | Adam Foster |

Textual Properties and Task-based Evaluation: Investigating the Role of Surface Properties, Structure and Content
Albert Gatt | François Portet |

Learning Preferences for Referring Expression Generation: Effects of Domain, Language and Algorithm
Ruud Koolen | Emiel Krahmer | Mariët Theune |

An eye-tracking evaluation of some parser complexity metrics
Matthew J. Green |

A language-independent method for the extraction of RDF verbalization templates
Basil Ell | Andreas Harth |

Reading Times Predict the Quality of Generated Text Above and Beyond Human Ratings
Sina Zarrieß | Sebastian Loth | David Schlangen |

A Snapshot of NLG Evaluation Practices 2005 - 2014
Dimitra Gkatzia | Saad Mahamood |

Absolute and Relative Properties in Geographic Referring Expressions
Rodrigo de Oliveira | Somayajulu Sripada | Ehud Reiter |

Treat the system like a human student: Automatic naturalness evaluation of generated text without reference texts
Isabel Groves | Ye Tian | Ioannis Douratsos |

Sequence-to-Sequence Models for Data-to-Text Natural Language Generation: Word- vs. Character-based Processing and Output Diversity
Glorianna Jagfeld | Sabrina Jenne | Ngoc Thang Vu |

Generation of Company descriptions using concept-to-text and text-to-text deep models: dataset collection and systems evaluation
Raheel Qader | Khoder Jneid | François Portet | Cyril Labbé |

Evaluation methodologies in Automatic Question Generation 2013-2018
Jacopo Amidei | Paul Piwek | Alistair Willis |

E2E NLG Challenge: Neural Models vs. Templates
Yevgeniy Puzikov | Iryna Gurevych |

Syntax

Language Generation Summarization Machine Translation

English

Cross Language Dependency Parsing using a Bilingual Lexicon

Hai Zhao | Yan Song | Chunyu Kit | Guodong Zhou |

Arne Mauser | Saša Hasan | Hermann Ney |

Integrating Graph-Based and Transition-Based Dependency Parsers

Joakim Nivre | Ryan McDonald |

A treebank-based study on the influence of Italian word order on parsing performance

Anita Alicante | Cristina Bosco | Anna Corazza | Alberto Lavelli |

Improving Arabic-Chinese Statistical Machine Translation using English as Pivot Language

Nizar Habash | Jun Hu |