Keys, queries, and values are all vectors from the LLMs. RoPE [66] requires the rotation of your question and key representations at an angle proportional to their absolute positions in the tokens inside the enter sequence.Occasionally, ‘I’ might refer to this precise instance of ChatGPT you are interacting with, although in other conditions,