Table Of Contents
Table Of Contents

Text Tutorials

These tutorials will help you learn how to create and use models that work with text and other natural language processing tasks.

Word Embedding

Pre-trained Word Embeddingshttp://gluon-nlp.mxnet.io/examples/word_embedding/word_embedding.html

Basics on how to use word embedding with vocab in GluonNLP and apply it on word similarity and analogy problems.

Word Embeddings Training and Evaluationhttp://gluon-nlp.mxnet.io/examples/word_embedding/word_embedding_training.html

Learn how to train fastText and word2vec embeddings on your own dataset, and determine embedding quality through intrinsic evaluation.

Language Model

LSTM-based Language Modelshttp://gluon-nlp.mxnet.io/examples/language_model/language_model.html

Learn what a language model is, what it can do, and how to train a word-level language model with truncated back-propagation-through-time (BPTT).

Machine Translation

Google Neural Machine Translationhttp://gluon-nlp.mxnet.io/examples/machine_translation/gnmt.html

Learn how to train Google Neural Machine Translation, a seq2seq with attention model.

Machine Translation with Transformerhttp://gluon-nlp.mxnet.io/examples/machine_translation/transformer.html

Learn how to use a pre-trained transformer translation model for English to German translation.

Sentence Embedding

ELMo: Deep Contextualized Word Representationshttp://gluon-nlp.mxnet.io/examples/sentence_embedding/elmo_sentence_representation.html

See how to use GluonNLP’s model API to automatically download the pre-trained ELMo model from NAACL2018 best paper, and extract features with it.

A Structured Self-attentive Sentence Embeddinghttp://gluon-nlp.mxnet.io/examples/sentence_embedding/self_attentive_sentence_embedding.html

See how to use GluonNLP to build more advanced model structure for extracting sentence embeddings to predict Yelp review rating.

BERT: Bidirectional Encoder Representations from Transformershttp://gluon-nlp.mxnet.io/examples/sentence_embedding/bert.html

See how to use GluonNLP to fine-tune a sentence pair classification model with pre-trained BERT parameters.

Sentiment Analysis

Sentiment Analysis by Fine-tuning Word Language Modelhttp://gluon-nlp.mxnet.io/examples/sentiment_analysis/sentiment_analysis.html

See how to fine-tune a pre-trained language model to perform sentiment analysis on movie reviews.

Sequence Sampling