B4: Modeling and Measuring Information Density

Classical language models predict a word given a sequence of predecessor words. We will extend this to condition on knowledge from the environment that is to condition not only on the linguistics context but also one context from the real world. In one branch of the project, we will consider language models that also condition on an image. Knowledge of the image in whose context the text was produced should help to predict the next word. In a second branch of the project we will consider, knowledge bases, question-answer data sets and states of a game as additional context. The surprisal and the predictability of an utterance like “Pawn from E2 to E4” depends on the present state of a chess game.



Adelani*, David Ifeoluwa; Hedderich*, Michael A; Zhu*, Dawei; van den Berg, Esther; Klakow, Dietrich

Distant Supervision and Noisy Label Learning for Low Resource Named Entity Recognition: A Study on Hausa and Yorùbá Miscellaneous

https://arxiv.org/abs/2003.08370, 2020, (* equal contribution).

Abstract | Links | BibTeX


Lange, Lukas; Hedderich, Michael A; Klakow, Dietrich

Feature-Dependent Confusion Matrices for Low-Resource NER Labeling with Noisy Labels Inproceedings

Inui, Kentaro; Jiang, Jing; Ng, Vincent; Wan, Xiaojun (Ed.): Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp. 3552-3557, Association for Computational Linguistics, Hong Kong, China, 2019.

Abstract | Links | BibTeX

Mosbach, Marius; Stenger, Irina; Avgustinova, Tania; Klakow, Dietrich

incom.py - A Toolbox for Calculating Linguistic Distances and Asymmetries between Related Languages Inproceedings

Angelova, Galia; Mitkov, Ruslan; Nikolova, Ivelina; Temnikova, Irina (Ed.): Proceedings of Recent Advances in Natural Language Processing, RANLP 2019, Varna, Bulgaria, 2-4 September 2019, pp. 811-819, Varna, Bulgaria, 2019.

Links | BibTeX

Grosse, Kathrin; Trost, Thomas A; Mosbach, Marius; Backes, Michael; Klakow, Dietrich

Adversarial Initialization -- when your network performs the way I want Journal Article

arXiv, Cornell University, 2019.

Links | BibTeX

Biswas, Rajarshi; Mogadala, Aditya; Barz, Michael; Sonntag, Daniel; Klakow, Dietrich

Automatic Judgement of Neural Network-Generated Image Captions Inproceedings

7th International Conference on Statistical Language and Speech Processing (SLSP2019), Ljubljana, Slovenia, 2019.



Dietrich, Klakow; Trost, Thomas

Parameter Free Hierarchical Graph-Based Clustering for Analyzing Continuous Word Embeddings. Inproceedings

In Workshop Proceedings of TextGraphs-11: Graph-based Methods for Natural Language Processing (Workshop at ACL 2017), 2017.


Oualil, Youssef; Klakow, Dietrich

A batch noise contrastive estimation approach for training large vocabulary language models Inproceedings

18th Annual Conference of the International Speech Communication Association (INTERSPEECH), 2017.


Singh, Mittul; Oualil, Youssef; Klakow, Dietrich

Approximated and domain-adapted LSTM language models for first-pass decoding in speech recognition Inproceedings

18th Annual Conference of the International Speech Communication Association (INTERSPEECH), Stockholm, Sweden, 2017.


Oualil, Youssef; Klakow, Dietrich

A neuronal network approach for mixing language models Inproceedings

ICASSP 2017 2017.



Singh, Mittul; Greenberg, Clayton; Oualil, Youssef; Klakow, Dietrich

Sub-Word Similarity based Search for Embeddings: Inducing Rare-Word Embeddings for Word Similarity Tasks and Language Modelling Inproceedings

Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 2061-2070, The COLING 2016 Organizing Committee, Osaka, Japan, 2016.

Abstract | Links | BibTeX

Varjokallio, Matti; Klakow, Dietrich

Unsupervised morph segmentation and statistical language models for vocabulary expansion Inproceedings

Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pp. 175-180, Association for Computational Linguistics, Berlin, Germany, 2016.

Links | BibTeX

Sayeed, Asad; Greenberg, Clayton; Demberg, Vera

Thematic fit evaluation: an aspect of selectional preferences Journal Article

Proceedings of the 1st Workshop on Evaluating Vector Space Representations for NLP, pp. 99-105, 2016, ISBN: 9781945626142.


Schneegass, Stefan; Oualil, Youssef; Bulling, Andreas

SkullConduct: Biometric User Identification on Eyewear Computers Using Bone Conduction Through the Skull Inproceedings

Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 1379-1384, ACM, New York, NY, USA, 2016, ISBN: 978-1-4503-3362-7.

Links | BibTeX

Oualil, Youssef; Greenberg, Clayton; Singh, Mittul; Klakow, Dietrich

Sequential recurrent neural networks for language modeling Journal Article

Interspeech 2016, pp. 3509-3513, 2016.


Singh, Mittul; Greenberg, Clayton; Klakow, Dietrich

The Custom Decay Language Model for Long Range Dependencies Book Chapter

Sojka, Petr; á, Ale{š} Hor; č, Ivan Kope; Pala, Karel (Ed.): Text, Speech, and Dialogue: 19th International Conference, TSD 2016, Brno , Czech Republic, September 12-16, 2016, Proceedings, pp. 343-351, Springer International Publishing, Cham, 2016, ISBN: 978-3-319-45510-5.

Links | BibTeX

Oualil, Youssef; Singh, Mittul; Greenberg, Clayton; Klakow, Dietrich

Long-short range context neural networks for language models Inproceedings

EMLP 2016 2016.



Greenberg, Clayton; Demberg, Vera; Sayeed, Asad

Verb Polysemy and Frequency Effects in Thematic Fit Modeling Inproceedings

Proceedings of the 6th Workshop on Cognitive Modeling and Computational Linguistics, pp. 48-57, Association for Computational Linguistics, Denver, Colorado, 2015.

Links | BibTeX

Greenberg, Clayton; Sayeed, Asad; Demberg, Vera

Improving Unsupervised Vector-Space Thematic Fit Evaluation via Role-Filler Prototype Clustering Inproceedings

Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 21-31, Association for Computational Linguistics, Denver, Colorado, 2015.

Links | BibTeX

Oualil, Youssef; Schulder, Marc; Helmke, Hartmut; Schmidt, Anna; Klakow, Dietrich

Real-Time Integration of Dynamic Context Information for Improving Automatic Speech Recognition Inproceedings

INTERSPEECH 2015, 16th Annual Conference of the International Speech Communication Association, Dresden, Germany, 2015.

Links | BibTeX

Dietrich Klakow



Clayton Greenberg



Aditya Mogadala



Marius Mosbach



Michael Hedderich