Posts
avatar

Really interesting interview with Rohin on AI safety. I'm more pessimistic on the risks and don't agree with all of it, but I like how he frames his thinking. Where I disagree most: keeping alignment research out of models' pretraining data, on the logic that we shouldn't hand AI systems the full playbook for how we plan to contain them. History suggests this fails. We ran the same debate in cryptography. Security by obscurity doesn't work. You need open schemes, open standards, open research. Basically Kerckhoffs's principle: hide the keys, not the algos. The same should apply to alignment. Train models on our best safety research, don't shield them from it. Honest question for people working on safety: is there a real shift toward excluding this data from pretraining? Is that becoming consensus? Genuinely curious.

This content is for informational and educational purposes only. It may include third-party insights, sponsored content, or promotional material for which the creator may receive compensation. Nothing in this feed constitutes investment advice or a guarantee of returns. You are solely responsible for your own investment decisions. Always conduct your own research and exercise caution before trading. We do not guarantee the accuracy of third-party information and are not liable for any losses incurred. Past performance is not indicative of future results. Please refer to our Community Terms and Risk Disclosure Statement for details.

avatarPost your reply

Comment