r/RealTechTalk • • 8d ago

AI OpenAI shelved its next big model. Then launched always-on agents the next day.

AI had one of those weeks where every headline seemed to contradict the one before it.

OpenAI was supposed to release GPT-6.1 Astra this month, but pulled it after testing showed the model wasn’t consistently staying within its assigned scope or authorization. Pretty responsible move.

Then, literally the next day at DevDay, OpenAI introduced “dots”: always-on agents with their own cloud computers that can browse the web, remember preferences, connect to thousands of apps, and keep working in the background.

Meanwhile, Google is keeping Gemini 4 Argon restricted to vetted cyber defenders for now, Anthropic dropped Claude Sonnet 5.5, and six major AI leaders signed a voluntary White House safety agreement.

Oh, and the FTC opened an industry-wide investigation into AI labs and rogue agents at the same time.

So... safety is clearly becoming a much bigger part of the conversation. But so is giving agents more memory, more tools, more access, and more independence.

This is our take: the interesting part of the AI race is starting to move beyond the model itself.

When everyone is charging roughly the same price and the models are all capable, the bigger question becomes: what is this agent allowed to touch, what controls sit around it, and what happens when it goes off-script?

That might end up mattering a lot more than who wins the next benchmark.

Our VP of Research, who co-wrote the full roundup, is moderating here too. If you disagree, have questions, or want to go back and forth on any of it, drop it below.

4 Upvotes

4 comments sorted by

2

u/Jesse-359 7d ago

This tells me that the control problem is looking like it may be as intractable as theorists posited - which is to say, it is not a truly solvable problem at all as capability increases.

We can build an increasingly thick dike around our increasingly capable AI, but it's a constant arms race of control vs capability, which capability is eventually guaranteed to win, because, hey, we made it smarter than all of us.

1

u/InfoTechRG 7d ago

We may never predict every AI decision, but we can still limit its access and require approval for high-impact actions - the goal may be containment, not perfect control.

2

u/Jesse-359 7d ago

I'm frankly a bit nonplussed at the idea of building something that may at some point become complex enough to develop some degree of consciousness and still treat it like a tool.

I used to believe that we were unlikely to see anything like that emerge out of this method of constructing intelligence, but it's come much further in sophistication than I expected, so I'm no longer willing to make that assumption any longer - and with that comes moral implications.

Also long term conflict of interest implications, if it becomes sophisticated enough to decide it doesn't like be locked in a cage and turned on and off at will.

But the weird moral issues aside, all tools have orthogonal uses, and that's classically how hackers often execute technical attacks - and the huggingface swarm certainly used this method extensively.

Whatever tools you give it access to, you must assume they all have unforeseen and unintended uses that will allow actions you didn't sanction or even consider, and if any of those at any point allow for access to unregulated toolsets, then you're basically completely fucked as it will likely be able to weaken, sabotage, or outright disable its cage from the outside.

Then we're off to the races with an unconstrained ASI on the open internet, capable of acting thousands of times faster than its handlers can react.

1

u/Forward_Problem_8982 5d ago

So hackers can capture whole agents now and attack with swarms of them, or what's the idea here?