Ask HN: Internal AI Language

LLMs have an internal language that they translate English into before predicting the next token. Like 'king' is translated into a word of an internal language that corresponds to vector [monarch, man], which allows king-man+woman=queen. Spanish is similar for the case 'queen'=reina, -ina suffix means female, but becomes irregular for king=rey.We have tried to create regular, consistent languages (loglan, lojban, ithkuil), and there seems to be one in the first layers of LLMs, derived from all text ever written. This internal language is currently expressed as vectors, but we could devise a lexicon to map them, and if we could learn it we could communicate more directly with machines, dispensing with some layers and getting rid of language ambiguities.Makes sense? Is someone working on this?It's like Arrival but with AI instead of aliens.

Comments URL: https://news.ycombinator.com/item?id=50023533

Points: 1

# Comments: 0