Archive

More than a year ago, Armen asked me "What's the next challenge for LLMs?" My answer was: 'Things that can't be specified in a few sentences.' This is still my answer, but it's a bad answer. Describing something negatively is

I'm infuriated by the use of AI today. Have you ever been reading some historical account and thought 'They have all the tools to concoct the solution we use today, why don't they just use it solve their Very Big Problem?' This is how

I spend most of my time thinking about how to conceptualize LLMs, understand their behavioral dynamics, and measure what they are capable of. I want to find clear ways of thinking about LLMs: do instruction-tuned LLMs just have low-diversity or are they really more consistent than base LLMs. I want

Give an AI a story about a father teaching his daughter to ride a bicycle. It will extract themes: coming-of-age, trust, the transfer of knowledge through generations. Give it those themes, it will generate new stories: a master chef's first lesson with an apprentice, a grandmother teaching card