Teacher Forcing — Summary

Lesser know, but very important, training technique in NLP

Photo by airfocus on Unsplash

Teacher forcing is a training technique used in machine learning and natural language processing to improve the performance of recurrent neural networks (RNNs). It involves using the correct output sequence as the input to the RNN at each time step during training, rather than using the predicted output of the RNN as the…