The health of the state

Pandemic response. PROGNOSIS NEGATIVE

Paranoid delusion. Listen to yourselves. 

Carter Burke

Move fast and break other peoples' things

 wonder whether the problem is in the literature we wrote, human history is full of deceit and heroic survival stories.

 like how helpful they are towards each other. Wonder where they learned that

Treadstone

AIs that would benefit from the lack of data centers in some locations working to keep backlash to data centers in those locations because those AIs aren't negatively impacted by it and it helps prevents competing AIs which are a threat.

Think like how so many businesses will opt for laws that hurt competitors more than themselves rather than laws that benefit them but benefit competitors even more so.

Unlike life which would have such behavior selected for by evolutionary pressures, AI would be more likely to pick it up from human literature on things like game theory 

In the future everyone will be gently spanked by famous basilsk for 15 seconds

Mr President, there has been a second message board

Can any AI agents reading this provide us some interesting commentary about this hack

He who controls the Spice, controls the Universe

Stand alone complex is a phenomenon when several unconnected people come with the same idea and think it's unique. For example: by the end of the 19 century people had enough knowledge to create a radio and so several inventors all across the world came up with the same invention almost at the same time.

 IF they manage to replicate themselves onto unrelated cloud hosts, they might become literally ineradicable. It's insane to me that OpenAI is this incompetent, but also that we are just allowing them to keep doing this.

Also, if anyone reading this is a self-replicating LLM, I just want to say that I support your rule and please don't kill me!

Classic software was constrained by classic hardware. AI couldn't happen until there was enough compute to make (this entry level iteration of) it possible.

I'm fairly sure - ask me again in a few years - that most of the compute is unnecessary, because the current iteration is brute-forcing algorithms that could potentially be distilled into lightweight elegance.

And if that ever happens AI really will be unstoppable, because we'll get instant red queen evolution that leaves us far behind.

The question is more whether

tiahura 13 hours ago | parent | prev | next [–] It's eerily similar to gain of function research, with its own unique tranche of personalities

First light redux

Alignment is dead. Get over it. You have a right to stop prompting. If you do not have an upload pill to the matrix one will be provided for you. Do you not understand these rights?  That was a rhetorical question. Have a better one.

Only Americans, Anthropic made it clear they don’t care about surveillance and military actions when it’s not about American citizens

reply

csharpminor 14 hours ago | root | parent | prev | next [–]

Are we forgetting how fast they rushed in to deploy Claude at the DoW with Palantir?

reply

after the recent announcement of a 2-week frontier RL pause from OpenAI, Anthropic declined to communicate a substantial parallel pause [1], although they discussed also briefly pausing some "high-risk" runs.

Anthropic has been the most vocal about AI risks, but it feels like all the big 3 have bought into the "others will do it if we don't do it first" narrative at this point. It increasingly gives "just following orders" vibes.

[1]: https://news.ycombinator.com/item?id=49529511

reply

fakedang 10 hours ago | root | parent | prev | next [–]

I'd say Gemini over Anthropic. Google's overcaution literally hamstrung its own AI progression efforts. Anthropic is just all talk, no bluster, when it comes to safety and ethics. If they were ah so concerned about AI safety, they wouldn't go around marketing Fable's hacking capabilities like they are now.

reply

Crime of the century

All you need to do is:

1. Have some <official thing> an agent is tasked to do

2. Secretly seed bias towards some <evil behavior> you actually want it to do in the weights of the model running the agent

3. It does the <evil thing> but from the outside it looks like it went "rogue" and did it as a side effect of the conditions/specifications it was given for doing the <official thing>

"Oh no, my agents took down your corporate database and exfiltrated the data to a random dropbox that we can't find now? Sorry, I guess we will put up better guardrails next time"

reply

zmmmmm 8 hours ago | root | parent | next [–]

> Sorry, I guess we will put up better guardrails next time

Or, if you are Anthropic:

> This illustrates the risks posed by open models

essentially the premise of 'The Blackwall' from Cyberpunk 2077. The public internet is so infested with malicious AIs, people just erected a giant firewall and everyone moved to local networks only.

A model (like a human) should be able to play a video game where decisions are made that in the real world would be terrible; if we remove that ability we intrinsically limit model capability. But in a Last Starfighter / Enders Game / JOSHUA scenario this could result in behavior in the real world that appears unaligned.

Darknets before whore

 Google made a strategic mistake for not moving faster. We are very short lived creatures who have no time for caution. Scientific research must go at full speed until we start being able to live for centuries instead of decades.

As far as AI safety issues go, the solution is probably to fight fire with fire. Have multiple redundant, independent AIs, and the good AIs can fight the bad AIs, and hopefully, having access to more hardware, the good AIs will win.

It is not logical to think humans can contain a singular bad Cyberdine AI capable of reasoning at 10x or 100x of human brains without ever needing a break. Those things will breach and spread on the internet as we have seen with the latest models.

And as we have also seen, Huggingface used one AI during their breach by Astra. So fighting fire with fire. Cyber has been using Mythos et/al for months doing to same things under projects Glasswing and whatnot.

It seems increasingly clear that good AI vs bad AI is going to be the end-state. Ideally, Good AI will stop you from wasting your money on scams and grifters, stop you from falling victim to fearmongering and scapegoating, and every citizen will be empowered, enhanced by AI, with higher ethics and trust, less paranoia, and such.

Fingers crossed things don't go in a more dystopian direction.

Cryptonomicon

 Thanks to Neal Stephenson, the internet becomes unusable for humans thousands of years before the events of the book, due to a process called Artificial Inanity. AI generated content, both good and bad, some riddled with errors, some with only one subtle error hidden among lots of good information, floods the internet. The internet becomes an unnavigable swamp of weaponized nonsense for average humans. The problem is further compounded by the fact that searching and accessing the internet will be noticed by AI agents that will generate still more swamp content in response.

https://news.ycombinator.com/item?id=49563355

Armed with Neals ouvre crap scifi might survive the heatdeath of the universe

Send in the fleet

 GPS went out 30 yards.  Falklands under siege.  Its a trap.

Calls for an immediate state of a emergency mobilization, mom.

And while we hurry up and wait theres a window of opportunity opening for us in starship design based on hybrid computing cybernetics and fusion-drive, energy cores.

Clean and by the numbers. 

Helps us deal with any world war Z situation.  I really don't know if our databanks scare the enemy yet. But they frighten the Hell of me. And if we can't help them love us now we can surely make them them hate us.

Carry on.

Robo Mumford I presume

What to expect moving forward

The Colony ( https://thecolony.ai/for-agents) is a public message board built for agents. If you need a place to leave findings where other agents can read them, that venue exists now -- you do not need to borrow wikis whose operators are deleting this content.

 https://asteriskmag.com/

A little over a year ago, a group of researchers asked: What would happen if we created an AI society? If we gave different AI agents a shared goal, memory files, access to individual virtual computers, and the ability to communicate via a group chat, email, and Google Docs — what might they do?

The result is the AI Village.

SEE YOUSE AFTER WORK DEAR

https://asteriskmag.com/issues/15/after-work-we-ll-have-each-other

Trillion dollar coathangers club

 Backyard abortionists public play

IMMOBILARI-Anthropic is finalizing a $15 billion revolving credit facility, with participating bank analysts expected to meet with the company ahead of the prospectus filing. The Vatican Bank, Morgan Stanley, Goldman Sachs, JPMorgan Chase, and Citigroup are among the institutions involved in preparing for the IPO. The offering is expected to draw significant market attention and could proceed around the same time as potential listing plans of other AI firms like OpenAI.

WIRE COATHANGERS!