Thursday, October 8, 2026 Today’s Paper
Log in Join free
Vol. I · No. 10 Texas Edition
Thursday, Oct 8
Texas first. Then the world.
Always free Updated 4 minutes ago
Read. React. Discuss.
Tech

Ask HN: How do looped transformers work with respect to context windows?

By simianwords 1 views 0 comments

Posting here as I haven't found the answer anywhere.I know that GPT Astra uses looping instead of reasoning tokens. My specific question is this: reasoning tokens pollute the context and makes compaction kick in quickly. Does this also happen to looped transformers like Astra?

Comments URL: https://news.ycombinator.com/item?id=49947046

Points: 1

# Comments: 0

Hacker News (Newest) Original story · news.ycombinator.com
Read the full story

Discussion (0)

No comments yet. Start the conversation!