What's a Vector?
So, computers are good at math right?
Numbers are logical and easier to compute. Language is not.
In math, a vector is a list of numbers. Sort of like latitude and longitude - which is a list of numbers that point to coordinates on a map.
Because computers are good at math and LLMs use huge amounts of data - it’s easier & faster for LLMs to “think” in vectors.
That’s kinda confusing, right?
Well, hold onto the thought of vectors for a bit. We’ll get to how they work in LLMs as we continue.