New Algorithm Compresses Large Language Models for Local Device Use

Engineers from Princeton and Stanford develop a technique to run LLMs on phones and laptops, enhancing privacy and efficiency.