Nvidia researchers have unveiled AI technology that could revolutionize how large language models handle massive amounts of information while maintaining real-time responsiveness.