Skeleton of Thought: Make an LLM Answer 2–3 Faster
LLMs write answers one token at a time, strictly left to right. Token 500 can't start until token 499 exists, so a thorough answer feels slow no matter how fast your hardware is. Skeleton of Thought…