Decoding Looped Transformers Better for Almost Free
Article URL: https://arxiv.org/abs/2610.02185 Comments URL: https://news.ycombinator.com/item?id=49950139 Points: 1 # Comments: 0
Posting here as I haven't found the answer anywhere.I know that GPT Astra uses looping instead of reasoning tokens. My specific question is this: reasoning tokens pollute the context and makes compaction kick in quickly. Does this also happen to looped transformers like Astra?
Comments URL: https://news.ycombinator.com/item?id=49947046
Points: 1
# Comments: 0
Discussion (0)
No comments yet. Start the conversation!