This video explains the Evolved Transformer model! The Evolved Transformer has been applied to the Meena bot, one of the most impressive chatbots to date. This paper explores this study on Neural Architecture Search for transformer models and presents their interesting encoding strategy of these models.
Paper Link:
https://arxiv.org/pdf/1901.11117.pdf
Thanks for watching! Please Subscribe!