1. Articles from arxiv.org

  2. 1-24 of 1235 1 2 3 4 ... 50 51 52 »
    1. Tie-breaker: Using language models to quantify gender bias in sports journalism. (arXiv:1607.03895v1 [cs.CL])

      Gender bias is an increasingly important issue in sports journalism. In this work, we propose a language-model-based approach to quantify differences in questions posed to female vs. male athletes, and apply it to tennis post-match interviews. We find that journalists ask male players questions that are generally more focused on the game when compared with the questions they ask their female counterparts.

      Read Full Article
    2. Using Recurrent Neural Network for Learning Expressive Ontologies. (arXiv:1607.04110v1 [cs.CL])

      Recently, Neural Networks have been proven extremely effective in many natural language processing tasks such as sentiment analysis, question answering, or machine translation. Aiming to exploit such advantages in the Ontology Learning process, in this technical report we present a detailed description of a Recurrent Neural Network based system to be used to pursue such goal.

      Read Full Article
      Mentions: Neural Networks
    3. AudioSentibank: Large-scale Semantic Ontology of Acoustic Concepts for Audio Content Analysis. (arXiv:1607.03766v1 [cs.SD])

      Audio carries substantial information about the content of our surroundings. The content has been explored at the semantic level using acoustic concepts, but rarely on concept pairs such as happy crowd and angry crowd. Concept pairs convey unique information and complement other audio and multimedia applications. Hence, in this work we explored for the first time the classification's performance of acoustic concepts pairs.

      Read Full Article
    4. A Vector Space for Distributional Semantics for Entailment. (arXiv:1607.03780v1 [cs.CL])

      Distributional semantics creates vector-space representations that capture many forms of semantic similarity, but their relation to semantic entailment has been less clear. We propose a vector-space model which provides a formal foundation for a distributional semantics of entailment. Using a mean-field approximation, we develop approximate inference procedures and entailment operators over vectors of probabilities of features being known (versus unknown).

      Read Full Article
    5. Separating Answers from Queries for Neural Reading Comprehension. (arXiv:1607.03316v1 [cs.CL])

      We present a novel neural architecture for answering queries, designed to optimally leverage explicit support in the form of query-answer memories. Our model is able to refine and update a given query while separately accumulating evidence for predicting the answer. Its architecture reflects this separation with dedicated embedding matrices and loosely connected information pathways (modules) for updating the query and accumulating evidence.

      Read Full Article
    6. The benefits of word embeddings features for active learning in clinical information extraction. (arXiv:1607.02810v1 [cs.CL])

      Objective This study investigates the use of word embeddings and sequence features for sample representation in an active learning framework built to extract clinical concepts from clinical free text. The objective is to further reduce the manual annotation effort while achieving higher effectiveness compared to a set of baseline features.

      Read Full Article
    7. Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural Networks. (arXiv:1607.01426v1 [cs.CL])

      Our goal is to combine the rich multi-step inference of symbolic logical reasoning together with the generalization capabilities of vector embeddings and neural networks. We are particularly interested in complex reasoning about the entities and relations in knowledge bases. Recently Neelakantan et al. (2015) presented a compelling methodology using recurrent neural networks (RNNs) to compose the meaning of relations in a Horn clause consisting of a connected chain.

      Read Full Article
    8. Extracting Formal Models from Normative Texts. (arXiv:1607.01485v1 [cs.CL])

      Normative texts are documents based on the deontic notions of obligation, permission, and prohibition. Our goal is to model such texts using the C-O Diagram formalism, making them amenable to formal analysis, in particular verifying that a text satisfies properties concerning causality of actions and timing constraints. We present an experimental, semi-automatic aid to bridge the gap between a normative text and its formal representation.

      Read Full Article
    9. Bag of Tricks for Efficient Text Classification. (arXiv:1607.01759v1 [cs.CL])

      This paper proposes a simple and efficient approach for text classification and representation learning. Our experiments show that our fast text classifier fastText is often on par with deep learning classifiers in terms of accuracy, and many orders of magnitude faster for training and evaluation. We can train fastText on more than one billion words in less than ten minutes using a standard multicore CPU, and classify half a million sentences among 312K classes in less than a minute.

      Read Full Article
    10. Towards Abstraction from Extraction: Multiple Timescale Gated Recurrent Unit for Summarization. (arXiv:1607.00718v1 [cs.CL])

      In this work, we introduce temporal hierarchies to the sequence to sequence (seq2seq) model to tackle the problem of abstractive summarization of scientific articles. The proposed Multiple Timescale model of the Gated Recurrent Unit (MTGRU) is implemented in the encoder-decoder setting to better deal with the presence of multiple compositionalities in larger texts.

      Read Full Article
    11. Learning Relational Dependency Networks for Relation Extraction. (arXiv:1607.00424v1 [cs.AI])

      We consider the task of KBP slot filling -- extracting relation information from newswire documents for knowledge base construction. We present our pipeline, which employs Relational Dependency Networks (RDNs) to learn linguistic patterns for relation extraction. Additionally, we demonstrate how several components such as weak supervision, word2vec features, joint learning and the use of human advice, can be incorporated in this relational framework.

      Read Full Article
      Mentions: KBP
    12. Visualizing Natural Language Descriptions: A Survey. (arXiv:1607.00623v1 [cs.CL])

      A natural language interface exploits the conceptual simplicity and naturalness of the language to create a high-level user-friendly communication channel between humans and machines. One of the promising applications of such interfaces is generating visual interpretations of semantic content of a given natural language that can be then visualized either as a static scene or a dynamic animation.

      Read Full Article
    13. Throwing fuel on the embers: Probability or Dichotomy, Cognitive or Linguistic?. (arXiv:1607.00186v1 [cs.CL])

      Prof. Robert Berwick's abstract for his forthcoming invited talk at the ACL2016 workshop on Cognitive Aspects of Computational Language Learning revives an ancient debate. Entitled "Why take a chance?", Berwick seems to refer implicitly to Chomsky's critique of the statistical approach of Harris as well as the currently dominant paradigms in CoNLL.

      Read Full Article
      Mentions: Berwick
    14. Recurrent neural network models for disease name recognition using domain invariant features. (arXiv:1606.09371v1 [cs.CL])

      Hand-crafted features based on linguistic and domain-knowledge play crucial role in determining the performance of disease name recognition systems. Such methods are further limited by the scope of these features or in other words, their ability to cover the contexts or word dependencies within a sentence. In this work, we focus on reducing such dependencies and propose a domain-invariant framework for the disease name recognition task.

      Read Full Article
    15. Learning Crosslingual Word Embeddings without Bilingual Corpora. (arXiv:1606.09403v1 [cs.CL])

      Crosslingual word embeddings represent lexical items from different languages in the same vector space, enabling transfer of NLP tools. However, previous attempts had expensive resource requirements, difficulty incorporating monolingual data or were unable to handle polysemy. We address these drawbacks in our method which takes advantage of a high coverage dictionary in an EM style training algorithm over monolingual corpora in two languages.

      Read Full Article
      Mentions: NLP
    16. The rotating normal form is regular. (arXiv:1606.08970v1 [math.GR])

      Defined on Birman--Ko--Lee monoids, the rotating normal form has strong connections with the Dehornoy's braid ordering. It can be seen as a process for selecting between all the representative words of a Birman--Ko--Lee braid a particular one, called rotating word. In this paper we construct, for all n \textgreater{} 1, a finite state automata which recognize the rotating words on n strands.

      Read Full Article
    17. A Distributional Semantics Approach to Implicit Language Learning. (arXiv:1606.09058v1 [cs.CL])

      In the present paper we show that distributional information is particularly important when considering concept availability under implicit language learning conditions. Based on results from different behavioural experiments we argue that the implicit learnability of semantic regularities depends on the degree to which the relevant concept is reflected in language use.

      Read Full Article
    18. Optimising The Input Window Alignment in CD-DNN Based Phoneme Recognition for Low Latency Processing. (arXiv:1606.09163v1 [cs.CL])

      We present a systematic analysis on the performance of a phonetic recogniser when the window of input features is not symmetric with respect to the current frame. The recogniser is based on Context Dependent Deep Neural Networks (CD-DNNs) and Hidden Markov Models (HMMs). The objective is to reduce the latency of the system by reducing the number of future feature frames required to estimate the current output.

      Read Full Article
      Mentions: Hidden Markov
    19. Hierarchical Neural Language Models for Joint Representation of Streaming Documents and their Content. (arXiv:1606.08689v1 [cs.CL])

      We consider the problem of learning distributed representations for documents in data streams. The documents are represented as low-dimensional vectors and are jointly learned with distributed vector representations of word tokens using a hierarchical framework with two embedded neural language models. In particular, we exploit the context of documents in streams and use one of the language models to model the document sequences, and the other to model word sequences within them.

      Read Full Article
    20. Unsupervised Topic Modeling Approaches to Decision Summarization in Spoken Meetings. (arXiv:1606.07829v1 [cs.CL])

      We present a token-level decision summarization framework that utilizes the latent topic structures of utterances to identify "summary-worthy" words. Concretely, a series of unsupervised topic models is explored and experimental results show that fine-grained topic models, which discover topics at the utterance-level rather than the document-level, can better identify the gist of the decision-making process.

      Read Full Article
    21. Stochastic Multiple Choice Learning for Training Diverse Deep Ensembles. (arXiv:1606.07839v1 [cs.CV])

      Many practical perception systems exist within larger processes which often include interactions with users or additional components that are capable of evaluating the quality of predicted solutions. In these contexts, it is beneficial to provide these oracle mechanisms with multiple highly likely hypotheses rather than a single prediction.

      Read Full Article
    22. Focused Meeting Summarization via Unsupervised Relation Extraction. (arXiv:1606.07849v1 [cs.CL])

      We present a novel unsupervised framework for focused meeting summarization that views the problem as an instance of relation extraction. We adapt an existing in-domain relation learner (Chen et al., 2011) by exploiting a set of task-specific constraints and features. We evaluate the approach on a decision summarization task and show that it outperforms unsupervised utterance-level extractive summarization baselines as well as an existing generic relation-extraction-based summarization method.

      Read Full Article
    23. Sequence-Level Knowledge Distillation. (arXiv:1606.07947v1 [cs.CL])

      Neural machine translation (NMT) offers a novel alternative formulation of translation that is potentially simpler than statistical approaches. However to reach competitive performance, NMT models need to be exceedingly large. In this paper we consider applying knowledge distillation approaches (Bucila et al, 2006; Hinton et al., 2015) that have proven successful for reducing the size of neural models in other domains to the problem of NMT.

      Read Full Article
    24. Leveraging Semantic Web Search and Browse Sessions for Multi-Turn Spoken Dialog Systems. (arXiv:1606.07967v1 [cs.CL])

      Training statistical dialog models in spoken dialog systems (SDS) requires large amounts of annotated data. The lack of scalable methods for data mining and annotation poses a significant hurdle for state-of-the-art statistical dialog managers. This paper presents an approach that directly leverage billions of web search and browse sessions to overcome this hurdle.

      Read Full Article
    1-24 of 1235 1 2 3 4 ... 50 51 52 »
  1. Categories

    1. Default:

      Discourse, Entailment, Machine Translation, NER, Parsing, Segmentation, Semantic, Sentiment, Summarization, WSD