Recurrent Neural Network (RNN) encoders and decoders

Recurrent Neural Network (RNN) encoders and decoders

Recurrent Neural Network (RNN) encoders

Final output is the encoding.

The end of the sequence is identified through an End-Of-Sequence token.

seq2seq

Recurrent Neural Network (RNN) decoders

Introduction

We take the encoded vector and pass this through to the decoder. This spits out decoded output.

As we output a word, the word (and previous words) are sent as inputs to the following RNN cells.

Encoding the outputs

As we create outputs, we can pass this as an encoded vector in the target language.