NLPExplorer

Contrastive Estimation: Training Log-Linear Models on Unlabeled Data

Noah A. Smith | Jason Eisner |

Paper Details:

Month: June
Year: 2005
Location: Ann Arbor, Michigan
Venue: ACL |

Citations

URL

Evaluating Unsupervised Part-of-Speech Tagging for Grammar Induction
William P. Headden III | David McClosky | Eugene Charniak |

Fast, Greedy Model Minimization for Unsupervised Tagging
Sujith Ravi | Ashish Vaswani | Kevin Knight | David Chiang |

Unsupervised Discriminative Language Model Training for Machine Translation using Simulated Confusion Sets
Zhifei Li | Ziyuan Wang | Sanjeev Khudanpur | Jason Eisner |

Unsupervised Part of Speech Tagging Using Unambiguous Substitutes from a Statistical Language Model
Mehmet Ali Yatbaz | Deniz Yuret |

Modeling Newswire Events using Neural Networks for Anomaly Detection
Pradeep Dasigi | Eduard Hovy |

Probabilistic Models of Nonprojective Dependency Trees
David A. Smith | Noah A. Smith |

Structured Prediction Models via the Matrix-Tree Theorem
Terry Koo | Amir Globerson | Xavier Carreras | Michael Collins |

Unsupervised Part-of-Speech Acquisition for Resource-Scarce Languages
Sajib Dasgupta | Vincent Ng |

Why Doesn’t EM Find Good HMM POS-Taggers?
Mark Johnson |

Refining Generative Language Models using Discriminative Learning
Ben Sandbank |

Discriminative Learning of Selectional Preference from Unlabeled Text
Shane Bergsma | Dekang Lin | Randy Goebel |

Unsupervised Multilingual Learning for POS Tagging
Benjamin Snyder | Tahira Naseem | Jacob Eisenstein | Regina Barzilay |

A Simple Unsupervised Learner for POS Disambiguation Rules Given Only a Minimal Lexicon
Qiuye Zhao | Mitch Marcus |

Crouching Dirichlet, Hidden Markov Model: Unsupervised POS Tagging with Context Local Tag Generation
Taesun Moon | Katrin Erk | Jason Baldridge |

Two Decades of Unsupervised POS Induction: How Far Have We Come?
Christos Christodoulopoulos | Sharon Goldwater | Mark Steedman |

Latent-Descriptor Clustering for Unsupervised POS Induction
Michael Lamar | Yariv Maron | Elie Bienenstock |

Simple Type-Level Unsupervised POS Tagging
Yoong Keok Lee | Aria Haghighi | Regina Barzilay |

Unsupervised Structure Prediction with Non-Parallel Multilingual Guidance
Shay B. Cohen | Dipanjan Das | Noah A. Smith |

Multi-Source Transfer of Delexicalized Dependency Parsers
Ryan McDonald | Slav Petrov | Keith Hall |

A Bayesian Mixture Model for PoS Induction Using Multiple Features
Christos Christodoulopoulos | Sharon Goldwater | Mark Steedman |

Fast Generation of Translation Forest for Large-Scale SMT Discriminative Training
Xinyan Xiao | Yang Liu | Qun Liu | Shouxun Lin |

Lateen EM: Unsupervised Training with Multiple Objectives, Applied to Dependency Grammar Induction
Valentin I. Spitkovsky | Hiyan Alshawi | Daniel Jurafsky |

Wiki-ly Supervised Part-of-Speech Tagging
Shen Li | João Graça | Ben Taskar |

Exploring the Utility of Joint Morphological and Syntactic Learning from Child-directed Speech
Stella Frank | Frank Keller | Sharon Goldwater |

A Log-Linear Model for Unsupervised Text Normalization
Yi Yang | Jacob Eisenstein |

Modeling and Learning Semantic Co-Compositionality through Prototype Projections and Neural Networks
Masashi Tsubaki | Kevin Duh | Masashi Shimbo | Yuji Matsumoto |

Weakly-Supervised Learning with Cost-Augmented Contrastive Estimation
Kevin Gimpel | Mohit Bansal |

Word Translation Prediction for Morphologically Rich Languages with Bilingual Neural Networks
Ke M. Tran | Arianna Bisazza | Christof Monz |

A Model of Coherence Based on Distributed Sentence Representation
Jiwei Li | Eduard Hovy |

Semi-Supervised Learning of Sequence Models with Method of Moments
Zita Marinho | André F. T. Martins | Shay B. Cohen | Noah A. Smith |

Reasoning about Pragmatics with Neural Listeners and Speakers
Jacob Andreas | Dan Klein |

Weakly Supervised Part-of-Speech Tagging for Morphologically-Rich, Resource-Scarce Languages
Kazi Saidul Hasan | Vincent Ng |

From Segmentation to Analyses: a Probabilistic Model for Unsupervised Morphology Induction
Toms Bergmanis | Sharon Goldwater |

Robust Training under Linguistic Adversity
Yitong Li | Trevor Cohn | Timothy Baldwin |

Compiling Comp Ling: Weighted Dynamic Programming and the Dyna Language
Jason Eisner | Eric Goldlust | Noah A. Smith |

Part-of-Speech Tagging using Virtual Evidence and Negative Training
Sheila M. Reynolds | Jeff A. Bilmes |

Weighted and Probabilistic Context-Free Grammars Are Equally Expressive
Noah A. Smith | Mark Johnson |

Learning Entailment Relations by Global Graph Structure Optimization
Jonathan Berant | Ido Dagan | Jacob Goldberger |

Model Selection for Type-Supervised Learning with Application to POS Tagging
Kristina Toutanova | Waleed Ammar | Pallavi Choudhury | Hoifung Poon |

Feature Selection as Causal Inference: Experiments with Text Classification
Michael J. Paul |

Prototype-Driven Learning for Sequence Models
Aria Haghighi | Dan Klein |

Unsupervised Morphological Segmentation with Log-Linear Models
Hoifung Poon | Colin Cherry | Kristina Toutanova |

Painless Unsupervised Learning with Features
Taylor Berg-Kirkpatrick | Alexandre Bouchard-Côté | John DeNero | Dan Klein |

Unsupervised Learning on an Approximate Corpus
Jason Smith | Jason Eisner |

Labeling the Languages of Words in Mixed-Language Documents using Weakly Supervised Methods
Ben King | Steven Abney |

A Joint Model of Orthography and Morphological Segmentation
Ryan Cotterell | Tim Vieira | Hinrich Schütze |

Annealing Structural Bias in Multilingual Weighted Grammar Induction
Noah A. Smith | Jason Eisner |

A discriminative language model with pseudo-negative samples
Daisuke Okanohara | Jun’ichi Tsujii |

The Infinite Tree
Jenny Rose Finkel | Trond Grenager | Christopher D. Manning |

Guiding Semi-Supervision with Constraint-Driven Learning
Ming-Wei Chang | Lev Ratinov | Dan Roth |

Learning to Extract Relations from the Web using Minimal Supervision
Razvan Bunescu | Raymond Mooney |

A fully Bayesian approach to unsupervised part-of-speech tagging
Sharon Goldwater | Tom Griffiths |

Semi-Supervised Convex Training for Dependency Parsing
Qin Iris Wang | Dale Schuurmans | Dekang Lin |

EM Can Find Pretty Good HMM POS-Taggers (When Given a Good Start)
Yoav Goldberg | Meni Adler | Michael Elhadad |

Generalized Expectation Criteria for Semi-Supervised Learning of Conditional Random Fields
Gideon S. Mann | Andrew McCallum |

Analyzing the Errors of Unsupervised Learning
Percy Liang | Dan Klein |

Adapting a WSJ-Trained Parser to Grammatically Noisy Text
Jennifer Foster | Joachim Wagner | Josef van Genabith |

Semi-supervised Learning of Dependency Parsers using Generalized Expectation Criteria
Gregory Druck | Gideon Mann | Andrew McCallum |

Distributional Representations for Handling Sparsity in Supervised Sequence-Labeling
Fei Huang | Alexander Yates |

Minimized Models for Unsupervised Part-of-Speech Tagging
Sujith Ravi | Kevin Knight |

Joint Decoding with Multiple Translation Models
Yang Liu | Haitao Mi | Yang Feng | Qun Liu |

Global Learning of Focused Entailment Graphs
Jonathan Berant | Ido Dagan | Jacob Goldberger |

Improved Unsupervised POS Induction through Prototype Discovery
Omri Abend | Roi Reichart | Ari Rappoport |

Efficient Optimization of an MDL-Inspired Objective Function for Unsupervised Part-Of-Speech Tagging
Ashish Vaswani | Adam Pauls | David Chiang |

SVD and Clustering for Unsupervised POS Tagging
Michael Lamar | Yariv Maron | Mark Johnson | Elie Bienenstock |

Unsupervised Word Alignment with Arbitrary Features
Chris Dyer | Jonathan H. Clark | Alon Lavie | Noah A. Smith |

A Hierarchical Pitman-Yor Process HMM for Unsupervised Part of Speech Induction
Phil Blunsom | Trevor Cohn |

A Probabilistic Model for Canonicalizing Named Entity Mentions
Dani Yogatama | Yanchuan Sim | Noah A. Smith |

Automatic Event Extraction with Structured Preference Modeling
Wei Lu | Dan Roth |

Using Supervised Bigram-based ILP for Extractive Summarization
Chen Li | Xian Qian | Yang Liu |

Bilingually-Guided Monolingual Dependency Grammar Induction
Kai Liu | Yajuan Lü | Wenbin Jiang | Qun Liu |

Spectral Unsupervised Parsing with Additive Tree Metrics
Ankur P. Parikh | Shay B. Cohen | Eric P. Xing |

Unsupervised Dependency Parsing with Transferring Distribution via Parallel Guidance and Entropy Regularization
Xuezhe Ma | Fei Xia |

Recurrent Neural Networks for Word Alignment Model
Akihiro Tamura | Taro Watanabe | Eiichiro Sumita |

Observational Initialization of Type-Supervised Taggers
Hui Zhang | John DeNero |

Hubness and Pollution: Delving into Cross-Space Mapping for Zero-Shot Learning
Angeliki Lazaridou | Georgiana Dinu | Marco Baroni |

Transferring Coreference Resolvers with Posterior Regularization
André F. T. Martins |

CFO: Conditional Focused Neural Question Answering with Large-scale Knowledge Bases
Zihang Dai | Lei Li | Wei Xu |

Adversarial Contrastive Estimation
Avishek Joey Bose | Huan Ling | Yanshuai Cao |

An Unsupervised Method for Uncovering Morphological Chains
Karthik Narasimhan | Regina Barzilay | Tommi Jaakkola |

Unsupervised Part-Of-Speech Tagging with Anchor Hidden Markov Models
Karl Stratos | Michael Collins | Daniel Hsu |

Unsupervised Learning of Morphological Forests
Jiaming Luo | Karthik Narasimhan | Regina Barzilay |

Corrective Modeling for Non-Projective Dependency Parsing
Keith Hall | Václav Novák |

Learning Auxiliary Fronting with Grammatical Inference
Alexander Clark | Rémi Eyraud |

Computational Challenges in Parsing by Classification
Joseph Turian | I. Dan Melamed |

Categorizing Local Contexts as a Step in Grammatical Category Induction
Markus Dickinson | Charles Jochim |

Data-Driven Dependency Parsing of New Languages Using Incomplete and Noisy Training Data
Kathrin Spreyer | Jonas Kuhn |

GenERRate: Generating Errors for Use in Grammatical Error Detection
Jennifer Foster | Oistein Andersen |

Exploring Representation-Learning Approaches to Domain Adaptation
Fei Huang | Alexander Yates |

Improved Unsupervised POS Induction Using Intrinsic Clustering Quality and a Zipfian Constraint
Roi Reichart | Raanan Fattal | Ari Rappoport |

Improved Natural Language Learning via Variance-Regularization Support Vector Machines
Shane Bergsma | Dekang Lin | Dale Schuurmans |

Language Models as Representations for Weakly Supervised NLP Tasks
Fei Huang | Alexander Yates | Arun Ahuja | Doug Downey |

From ranked words to dependency trees: two-stage unsupervised non-projective dependency parsing
Anders Søgaard |

Unsupervised Bilingual POS Tagging with Markov Random Fields
Desai Chen | Chris Dyer | Shay Cohen | Noah Smith |

Classification-based Contextual Preferences
Shachar Mirkin | Ido Dagan | Lili Kotlerman | Idan Szpektor |

Unsupervised Part-of-Speech Tagging in Noisy and Esoteric Domains With a Syntactic-Semantic Bayesian HMM
William M. Darling | Michael J. Paul | Fei Song |

Clustered Word Classes for Preordering in Statistical Machine Translation
Sara Stymne |

Exploiting Partial Annotations with EM Training
Dirk Hovy | Eduard Hovy |

Better Word Representations with Recursive Neural Networks for Morphology
Thang Luong | Richard Socher | Christopher Manning |

Weakly-Supervised Bayesian Learning of a CCG Supertagger
Dan Garrette | Chris Dyer | Jason Baldridge | Noah A. Smith |

Simple Semi-Supervised POS Tagging
Karl Stratos | Michael Collins |

Syntactic Category Learning as Iterative Prototype-Driven Clustering
Jordan Kodner |

Robust Word Vectors: Context-Informed Embeddings for Noisy Texts
Valentin Malykh | Varvara Logacheva | Taras Khakhulin |

No URLs Found

Field Of Study

Linguistic Trends

Syntax

Task

Tagging Spelling Correction

Approach

Generative Model Unsupervised Learning

Language

English

Similar Papers

RECSA: Resource for Evaluating Cross-lingual Semantic Annotation

Sequencing in a Connectionist Model of Language Processing

Michael GASSER | Michael G. DYER |

Exploiting Lexical Regularities in Designing Natural Language Systems

Boris Katz | Beth Levin |

DATR: A Language for Lexical Knowledge Representation

Roger Evans | Gerald Gazdar |

Book Reviews: Speaking: From Intention to Articulation

M. Martin Taylor | Insup Taylor |