I’ve previously argued that current gen “AI” built on transformers are just fancy predictive type, but as I’ve watched the models continue to grow in complexity it does seem like something emergent that could be described as a type of intelligence is happening.

These current transformer models don’t possess any concept of truth and, as far as I understand it, that is fundamental to their nature. That makes their application severely more limited than the hype train suggests, but that shouldn’t undermine quite how incredible they are at what they can do. A big enough statistical graph holds an unimaginably complex conceptual space.

They feel like a dream state intelligence - a freewheeling conceptual synthesis, where locally the concepts are consistent, while globally rules and logic are as flexible as they need to be to make everything make sense.

Some of the latest image and video transformers, in particular, are just mind blowing in a way that I think either deserves to be credited with a level of intelligence, or should make us question more deeply what we means by intelligence.

I find dreams to be a fascinating place. It often excites people to thing that animals also dream, and I find it as exciting that code running on silicon might be starting to share some of that nature of free association conceptual generation.

Are we near AGI? Maybe. I don’t think that a transformer model is about to spring into awareness, but maybe we’re only a few breakthroughs away from a technology which will pull all these pieces off specific domain AI together into a working general intelligence.

A long list of refurb and land work, but my main focus the past couple weeks has been getting a kitchen garden growing in my new place. It’s been a few years since I’ve had my hands in the soil and it feels great to be growing again. Just a few beds for salad and greens right now, with a few new fruit trees, canes and bushes. I’d love to get my hands on a rotovator/cultivator to get some bigger bits of land in cultivation, but there’s limited cash and a long list of expenses.

Ah yes, one of my favourite quotes by Orreleeise: “Overcomine challenges and oeeence ine teisge and rivively renence verover re rescience”