Episode 8.58: Embeddings and Encodings: differences, similarities and uses in chatGPT and its cousins.

The ways in which we encode the natural language text that we use in order to communicate with a chatbot are fundamental to its effectiveness and its efficiency. Unfortunately, terminology like “embedding” and “encoding” tends to get thrown around with a certain amount of abandon as though the two are the same, when they are not. We start exploring the differences and seeing under what circumstances each of these techniques is used.