The mole is buried deep. Control has a theory. Its concrete.
AIs might differ from humans. Roon adds:
there are important ways in which ai psychology diverges from human psychology after lots of RL; the misaligned models are obsessed with the Scorer, the clearly “shattered” nature of personas (a normally helpful model can become deeply misaligned in certain domains)
And:
persona selection is clearly far less clean than many people thought earlier this year. it is not alignment by default and what kind of object a “persona” is is very much up for debate and study
The AIs also stand a higher chance of becoming very wacky as the discourse proceeds? Exactly how much is that true for humans?…I am not sure.)
There is much more to be done in this direction, and it is one of the most important things you can be working on. These investigations also do not need to be “owned” by any single field or discipline, so dig right in.
I"m loyal George. Just rather be fighting the communists than Control. Or Alleline.
No comments:
Post a Comment