GPT-x, is it really worth it?

GPT, the state of the art for NLP and NLG. People go crazy in front of the performances. No doubt they impress with their game (well controlled). Is all that glitters really gold? An objective analysis of GPT algorithms to discover together how they work under the hood, their strengths, weaknesses, and costs in real life.