Question Classification using Self-Attention Transformer — Part 2

Vatsal Saglani
6 min readJan 1, 2021

In this blog, we will go through one of how we can use Self-Attention Transformer models to classify a piece of text (question in our case) into two different categories each category containing some number of classes.

We will look at a Self-Attention Transformer with multiple heads for classifying classes in different categories. Without any further…

--

--

Vatsal Saglani

GenAI Developer, Software Engineer, Programmer & Deep Learning professional. https://vatsalsaglani.vercel.app