评论
打印
So what can we do? Well, the good news is we have managed to coordinate to escape some of Moloch's traps before.
那我们能做些什么？好消息是我们之前合力成功逃脱了一些摩洛克陷阱。
We managed to save the ozone layer from CFCs with the help of the Montreal Protocol.
通过《蒙特利尔议定书》，我们从氯氟碳化物中拯救了臭氧层。
We managed to reduce the number of nuclear weapons on Earth by 80 percent, with the help of the Strategic Arms Reduction Treaty in 1991.
通过 1991 年的《削减和限制进攻性战略武器条约》我们将地球上的核武器数量减少了 80％。
So smart regulation may certainly help with AI too, but ultimately, it's the players within the game who have the most influence on it.
明智的监管措施当然也可能会对 AI 有所帮助，但归根结底，对 AI 影响最大的是游戏中的玩家。
So we need AI leaders to show us that they're not only aware of the risks their technologies pose, but also the destructive nature of the incentives that they're currently beholden to.
因此，我们需要AI 领袖向我们表明他们不仅意识到了其技术构成的风险，还有他们目前所面临的激励措施的破坏性。
As their technological capabilities reach towards the power of gods, they're going to need the godlike wisdom to know how to wield them.
当他们的技术能力匹敌神明的力量时，他们需要神一般的智慧学习如何驾驭它们。
So it doesn't fill me with encouragement when I see a CEO of a very major company saying something like, "I want people to know we made our competitor dance."
因此，当我看到一家大型公司的 CEO 说“我想让人们知道对手对我们言听计从”之类的话时，我并不觉得信心倍增。
That is not the type of mindset we need here.
这不是我们需要的那种心态。
We need leaders who are willing to flip Moloch's playbook, who are willing to sacrifice their own individual chance of winning for the good of the whole.
我们需要愿意推翻摩洛克故事的领导者，他们愿意为了整体利益牺牲自己的获胜机会。
Now, fortunately, the three leading labs are showing some signs of doing this.
所幸有三家头部实验室都或多或少展现了这种迹象。
Anthropic recently announced their responsible scaling policy, which pledges to only increase capabilities once certain security criteria have been met.
Anthropic 最近宣布了负责任的扩展政策，该政策承诺只有在满足特定安全标准后才会提升性能。
OpenAI have recently pledged to dedicate 20 percent of their compute purely to alignment research.
OpenAI 最近承诺将其 20% 的算力完全用于“对齐”研究。
And DeepMind have shown a decade-long focus of science ahead of commerce, like their development of AlphaFold, which they gave away to the science community for free.
DeepMind 已经在过去十年中表现出对科学的关注优先于商业，例如他们开发的 AlphaFold，将其免费赠与科学界。
These are all steps in the right direction, but they are still nowhere close to being enough.
这些都是朝着正确方向迈出的步伐，但还远远不够。
I mean, most of these are currently just words, they're not even proven actions.
我想说目前大都只是言语，甚至不是经过验证的行动。
So we need a clear way to turn the AI race into a definitive race to the top.
我们需要一种明确的方法将 AI 竞赛转变为明确向上的竞争。
Perhaps companies can start competing over who can be within these metrics, over who can develop the best security criteria.
也许各公司可以开始争夺谁可以达到这些指标，谁可以制定出最佳的安全标准。
A race of who can dedicate the most compute to alignment.
竞赛谁能将最多的算力投入到对齐上。
Now that would truly flip the middle finger to Moloch.
这确实是与摩洛克陷阱背道而驰的做法。
Competition can be an amazing tool, provided we wield it wisely.
如果我们明智地运用竞争，它会是一个强大的工具。
And we're going to need to do that because the stakes we are playing for are astronomical.
我们之所以需要这样做，是因为我们手上的赌注是天文数字。
If we get AI, and especially AGI, wrong, it could lead to unimaginable catastrophe.
如果我们让 AI，尤其是 AGI，跑偏了，可能会导致难以想象的灾难。
But if we get it right, it could be our path out of many of these Moloch traps that I've mentioned today.
但如果我们做对了，可能就会是我们摆脱多次提及的摩洛克陷阱的出路。
And as things get crazier over the coming years, which they're probably going to, it's going to be more important than ever that we remember that it is the real enemy here, Moloch.
接下来几年，情况会越来越疯狂，确实可能如此，我们必须记住摩洛克才是我们真正的敌人。
Not any individual CEO or company, and certainly not one another.
不是哪个 CEO，哪家公司，当然也不是彼此。
So don't hate the players, change the game.
不要憎恨玩家，去改变游戏吧。
