Nikolay Bogoychev

About me

I am a PhD student at The University of Edinburgh Institute for Languages, Cognition and Computation, affiliate of the Pervasive Parallelism CDT. My supervisors are Adam Lopez and Kenneth Heafield.

I like languages, logographic writing systems, game theory and GPUs. I (try to) make things run faster and enjoy (premature) optimization. In my spare time I learn languages and play football. Please check out my blog where I post random things about characters and life.

LinkedIN Github StackOverflow CV Scholar

PhD work

I am exploring opportunities for exploiting the raw computational power of GPUs in the domain of NLP, currently focussing on Machine translation.

In general I explore algorithms (as of late usually neural networks related to NLP) and modify them in way to take better advantage of massively parallel and multi-node hardware. I work both on improving implementation and changing the model in order to extract the best performance from the availbale hardware and improve translation quality. I have worked on improving a number of aspects of machine translation, among those improved inference performance on statistical models and improved multinode training of neural models.


2014: Graduated from The University of Edinburgh with a First class Bachelor's degree in Artificial Intelligence & Computer science.

2015: Started a PhD in The University of Edinburgh ILCC.


Nikolay Bogoychev, Marcin Junczys-Dowmunt, Kenneth Heafield, Alham Fikri Aji (2018) Accelerating Asynchronous Stochastic Gradient Descent for Neural Machine Translation. In Proceedings of EMNLP, Brussels, Belgium. [pdf] [bib]

Barry Haddow, Nikolay Bogoychev, Denis Emelin, Ulrich Germann, Roman Grundkiewicz, Kenneth Heafield, Antonio Valerio Miceli Barone, Rico Sennrich (2018) The University of Edinburghs Submissions to the WMT18 News Translation Task In Proceedings of the Third Conference on Machine Translation, Brussels, Belgium. [pdf] [bib]

Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, André F. T. Martins, Alexandra Birch (2018). Marian: Fast Neural Machine Translation in C++. Proceedings of ACL, Sydney, Australia, System Demonstrations. [pdf] [bib]

Nikolay Bogoychev and Adam Lopez (2016). N-gram language models for massively parallel devices. In Proceedings of ACL, Berlin, Germany. [pdf] [bib]

Nikolay Bogoychev and Hieu Hoang (2016). Fast and highly parallelizable phrase table for statistical machine translation. In Proceedings of WMT, Berlin, Germany. [pdf] [bib]

Hieu Hoang, Nikolay Bogoychev, Lane Schwartz and Marcin Junczys-Dowmunt (2016). Fast, Scalable Phrase-Based SMT Decoding. In Proceedings of AMTA 2016, Austin, Texas [pdf] [bib]

Barry Haddow, Matthias Huck, Alexandra Birch, Nikolay Bogoychev, Philipp Koehn (2015). The Edinburgh/JHU Phrase-based Machine Translation Systems for WMT 2015. In Proceedings of WMT, Lisboa, Portugal. [pdf] [bib]

Alexandra Birch, Matthias Huck, Nadir Durrani, Nikolay Bogoychev, Philipp Koehn (2014). Edinburgh SLT and MT System Description for the IWSLT 2014 Evaluation. In Proceedings of IWSLT, Lake Tahoe, USA. [pdf] [bib]

The University of Edinburgh
School of Informatics
Institute for Languages, Cognition and Computation