NLPExplorer
Papers
Venues
Authors
Authors Timeline
Field of Study
URLs
ACL N-gram Stats
TweeNLP
API
Team
Fast, Cheap, and Creative: Evaluating Translation Quality Using Amazon’s Mechanical Turk
Chris Callison-Burch
|
Paper Details:
Month: August
Year: 2009
Location: Singapore
Venue:
EMNLP |
SIG: SIGDAT
Citations
URL
MT Error Detection for Cross-Lingual Question Answering
Kristen Parton
|
Kathleen McKeown
|
Online Gaming for Crowd-sourcing Phrase-equivalents
A. Kumaran
|
Melissa Densmore
|
Shaishav Kumar
|
Improving Translation via Targeted Paraphrasing
Philip Resnik
|
Olivia Buzek
|
Chang Hu
|
Yakov Kronrod
|
Alex Quinn
|
Benjamin B. Bederson
|
Active Learning with Amazon Mechanical Turk
Florian Laws
|
Christian Scheible
|
Hinrich Schütze
|
Detecting Subgroups in Online Discussions by Modeling Positive and Negative Relations among Participants
Ahmed Hassan
|
Amjad Abu-Jbara
|
Dragomir Radev
|
Unsupervised Induction of Contingent Event Pairs from Film Scenes
Zhichao Hu
|
Elahe Rahimtoroghi
|
Larissa Munishkina
|
Reid Swanson
|
Marilyn A. Walker
|
Finding Good Enough: A Task-Based Evaluation of Query Biased Summarization for Cross-Language Information Retrieval
Jennifer Williams
|
Sharon Tam
|
Wade Shen
|
Measuring the behavioral impact of machine translation quality improvements with A/B testing
Ben Russell
|
Duncan Gillespie
|
Towards a Better Metric for Evaluating Question Generation Systems
Preksha Nema
|
Mitesh M. Khapra
|
Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation
Samuel Läubli
|
Rico Sennrich
|
Martin Volk
|
CLex: A Lexicon for Exploring Color, Concept and Emotion Associations in Language
Svitlana Volkova
|
William B. Dolan
|
Theresa Wilson
|
Translation memory retrieval methods
Michael Bloodgood
|
Benjamin Strauss
|
Crowdsourcing Annotation of Non-Local Semantic Roles
Parvin Sadat Feizabadi
|
Sebastian Padó
|
Lexicon-Based Methods for Sentiment Analysis
Maite Taboada
|
Julian Brooke
|
Milan Tofiloski
|
Kimberly Voll
|
Manfred Stede
|
Getting Reliable Annotations for Sarcasm in Online Dialogues
Reid Swanson
|
Stephanie Lukin
|
Luke Eisenberg
|
Thomas Corcoran
|
Marilyn Walker
|
Can the Crowd be Controlled?: A Case Study on Crowd Sourcing and Automatic Validation of Completed Tasks based on User Modeling
Balamurali A.R
|
Designing and Evaluating a Reliable Corpus of Web Genres via Crowd-Sourcing
Noushin Rezapour Asheghi
|
Serge Sharoff
|
Katja Markert
|
Crowdsourcing as a preprocessing for complex semantic annotation tasks
Héctor Martínez Alonso
|
Lauren Romeo
|
Enhancing Access to Online Education: Quality Machine Translation of MOOC Content
Valia Kordoni
|
Antal van den Bosch
|
Katia Lida Kermanidis
|
Vilelmini Sosoni
|
Kostadin Cholakov
|
Iris Hendrickx
|
Matthias Huck
|
Andy Way
|
Improving Machine Translation of Educational Content via Crowdsourcing
Maximiliana Behnke
|
Antonio Valerio Miceli Barone
|
Rico Sennrich
|
Vilelmini Sosoni
|
Thanasis Naskos
|
Eirini Takoulidou
|
Maria Stasimioti
|
Menno van Zaanen
|
Sheila Castilho
|
Federico Gaspari
|
Panayota Georgakopoulou
|
Valia Kordoni
|
Markus Egg
|
Katia Lida Kermanidis
|
Cheap, Fast and Good Enough: Automatic Speech Recognition with Non-Expert Transcription
Scott Novotney
|
Chris Callison-Burch
|
Crowdsourcing the evaluation of a domain-adapted named entity recognition system
Asad B. Sayeed
|
Timothy J. Meyer
|
Hieu C. Nguyen
|
Olivia Buzek
|
Amy Weinberg
|
Predicting Human-Targeted Translation Edit Rate via Untrained Human Annotators
Omar F. Zaidan
|
Chris Callison-Burch
|
Some Empirical Evidence for Annotation Noise in a Benchmarked Dataset
Beata Beigman Klebanov
|
Eyal Beigman
|
The Best Lexical Metric for Phrase-Based Statistical MT System Optimization
Daniel Cer
|
Christopher D. Manning
|
Daniel Jurafsky
|
Estimating Summary Quality with Pairwise Preferences
Markus Zopf
|
BabelNet: Building a Very Large Multilingual Semantic Network
Roberto Navigli
|
Simone Paolo Ponzetto
|
Bridging SMT and TM with Translation Recommendation
Yifan He
|
Yanjun Ma
|
Josef van Genabith
|
Andy Way
|
Collecting Highly Parallel Data for Paraphrase Evaluation
David Chen
|
William Dolan
|
Reordering Metrics for MT
Alexandra Birch
|
Miles Osborne
|
Crowdsourcing Translation: Professional Quality from Non-Professionals
Omar F. Zaidan
|
Chris Callison-Burch
|
Towards Style Transformation from Written-Style to Audio-Style
Amjad Abu-Jbara
|
Barbara Rosario
|
Kent Lyons
|
They Can Help: Using Crowdsourcing to Improve the Evaluation of Grammatical Error Detection Systems
Nitin Madnani
|
Martin Chodorow
|
Joel Tetreault
|
Alla Rozovskaya
|
Crowd Prefers the Middle Path: A New IAA Metric for Crowdsourcing Reveals Turker Biases in Query Segmentation
Rohan Ramanath
|
Monojit Choudhury
|
Kalika Bali
|
Rishiraj Saha Roy
|
TransDoop: A Map-Reduce based Crowdsourced Translation for Complex Domain
Anoop Kunchukuttan
|
Rajen Chatterjee
|
Shourya Roy
|
Abhijit Mishra
|
Pushpak Bhattacharyya
|
Active Learning with Efficient Feature Weighting Methods for Improving Data Quality and Classification Accuracy
Justin Martineau
|
Lu Chen
|
Doreen Cheng
|
Amit Sheth
|
Are Two Heads Better than One? Crowdsourced Translation via a Two-Step Collaboration of Non-Professional Translators and Editors
Rui Yan
|
Mingkun Gao
|
Ellie Pavlick
|
Chris Callison-Burch
|
Improving social relationships in face-to-face human-agent interactions: when the agent wants to know user’s likes and dislikes
Caroline Langlet
|
Chloé Clavel
|
Understanding Discourse on Work and Job-Related Well-Being in Public Social Media
Tong Liu
|
Christopher Homan
|
Cecilia Ovesdotter Alm
|
Megan Lytle
|
Ann Marie White
|
Henry Kautz
|
Fully Character-Level Neural Machine Translation without Explicit Segmentation
Jason Lee
|
Kyunghyun Cho
|
Thomas Hofmann
|
See No Evil, Say No Evil: Description Generation from Densely Labeled Images
Mark Yatskar
|
Michel Galley
|
Lucy Vanderwende
|
Luke Zettlemoyer
|
Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon
Saif Mohammad
|
Peter Turney
|
Creating Speech and Language Data With Amazon’s Mechanical Turk
Chris Callison-Burch
|
Mark Dredze
|
Clustering dictionary definitions using Amazon Mechanical Turk
Gabriel Parent
|
Maxine Eskenazi
|
Semi-supervised Word Alignment with Mechanical Turk
Qin Gao
|
Stephan Vogel
|
Rating Computer-Generated Questions with Mechanical Turk
Michael Heilman
|
Noah A. Smith
|
Crowdsourced Accessibility: Elicitation of Wikipedia Articles
Scott Novotney
|
Chris Callison-Burch
|
Document Image Collection Using Amazon’s Mechanical Turk
Audrey Le
|
Jerome Ajot
|
Mark Przybocki
|
Stephanie Strassel
|
Using Amazon Mechanical Turk for Transcription of Non-Native Speech
Keelan Evanini
|
Derrick Higgins
|
Klaus Zechner
|
Exploring Normalization Techniques for Human Judgments of Machine Translation Adequacy Collected Using Amazon Mechanical Turk
Michael Denkowski
|
Alon Lavie
|
Can Crowds Build parallel corpora for Machine Translation Systems?
Vamshi Ambati
|
Stephan Vogel
|
Annotating Large Email Datasets for Named Entity Recognition with Mechanical Turk
Nolan Lawson
|
Kevin Eustice
|
Mike Perkowitz
|
Meliha Yetisgen-Yildiz
|
Annotating Named Entities in Twitter Data with Crowdsourcing
Tim Finin
|
William Murnane
|
Anand Karandikar
|
Nicholas Keller
|
Justin Martineau
|
Mark Dredze
|
MTurk Crowdsourcing: A Viable Method for Rapid Discovery of Arabic Nicknames?
Chiara Higgins
|
Elizabeth McGrath
|
Laila Moretto
|
Using Mechanical Turk to Annotate Lexicons for Less Commonly Used Languages
Ann Irvine
|
Alexandre Klementiev
|
Crowdsourcing and language studies: the new generation of linguistic data
Robert Munro
|
Steven Bethard
|
Victor Kuperman
|
Vicky Tzuyin Lai
|
Robin Melnick
|
Christopher Potts
|
Tyler Schnoebelen
|
Harry Tily
|
Collecting Image Annotations Using Amazon’s Mechanical Turk
Cyrus Rashtchian
|
Peter Young
|
Micah Hodosh
|
Julia Hockenmaier
|
Non-Expert Evaluation of Summarization Systems is Risky
Dan Gillick
|
Yang Liu
|
Preliminary Experiments with Amazon’s Mechanical Turk for Annotating Medical Named Entities
Meliha Yetisgen-Yildiz
|
Imre Solti
|
Fei Xia
|
Scott Halgrim
|
Amazon Mechanical Turk for Subjectivity Word Sense Disambiguation
Cem Akkaya
|
Alexander Conrad
|
Janyce Wiebe
|
Rada Mihalcea
|
Using Mechanical Turk to Build Machine Translation Evaluation Sets
Michael Bloodgood
|
Chris Callison-Burch
|
Creating a Bi-lingual Entailment Corpus through Translations with Mechanical Turk: $100 for a 10-day Rush
Matteo Negri
|
Yashar Mehdad
|
Rethinking Grammatical Error Annotation and Evaluation with the Amazon Mechanical Turk
Joel Tetreault
|
Elena Filatova
|
Martin Chodorow
|
A Semi-Supervised Word Alignment Algorithm with Partial Manual Alignments
Qin Gao
|
Nguyen Bach
|
Stephan Vogel
|
Crowdsourcing Word Sense Definition
Anna Rumshisky
|
Colourful Language: Measuring Word-Colour Associations
Saif Mohammad
|
Findings of the 2012 Workshop on Statistical Machine Translation
Chris Callison-Burch
|
Philipp Koehn
|
Christof Monz
|
Matt Post
|
Radu Soricut
|
Lucia Specia
|
Twitter Translation using Translation-Based Cross-Lingual Retrieval
Laura Jehl
|
Felix Hieber
|
Stefan Riezler
|
Extracting Signed Social Networks from Text
Ahmed Hassan
|
Amjad Abu-Jbara
|
Dragomir Radev
|
Continuous Measurement Scales in Human Evaluation of Machine Translation
Yvette Graham
|
Timothy Baldwin
|
Alistair Moffat
|
Justin Zobel
|
MultiLing 2015: Multilingual Summarization of Single and Multi-Documents, On-line Fora, and Call-center Conversations
George Giannakopoulos
|
Jeff Kubina
|
John Conroy
|
Josef Steinberger
|
Benoit Favre
|
Mijail Kabadjov
|
Udo Kruschwitz
|
Massimo Poesio
|
An Improved Crowdsourcing Based Evaluation Technique for Word Embedding Methods
Farhana Ferdousi Liza
|
Marek Grześ
|
Evaluating Natural Language Understanding Services for Conversational Question Answering Systems
Daniel Braun
|
Adrian Hernandez Mendez
|
Florian Matthes
|
Manfred Langen
|
Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation
Antonio Toral
|
Sheila Castilho
|
Ke Hu
|
Andy Way
|
http://www.mturk.com/
Field Of Study
Task
Machine Translation
Language
Chinese
English
Hindi
Urdu
Spanish
French
Arabic
Dataset
News
Similar Papers
Neural Morphological Tagging of Lemma Sequences for Machine Translation
Costanza Conforti
|
Matthias Huck
|
Alexander Fraser
|
Enriching Word Vectors with Subword Information
Piotr Bojanowski
|
Edouard Grave
|
Armand Joulin
|
Tomas Mikolov
|
Creating a Large Multi-Layered Representational Repository of Linguistic Code Switched Arabic Data
Mona Diab
|
Mahmoud Ghoneim
|
Abdelati Hawwari
|
Fahad AlGhamdi
|
Nada AlMarwani
|
Mohamed Al-Badrashiny
|
Semi-supervised Structured Prediction with Neural CRF Autoencoder
Xiao Zhang
|
Yong Jiang
|
Hao Peng
|
Kewei Tu
|
Dan Goldwasser
|
A Survey of Arabic Named Entity Recognition and Classification
Khaled Shaalan
|