Encoder VS Decoder Bert VS GPT

A new article explains that encoder and decoder models like BERT and GPT share the same underlying architecture, with the key difference being which tokens each model is allowed to attend to during processing.

They share the same architecture. The only real difference is which tokens each one is allowed to look at. Continue reading on Towards AI »