Anthropic Explores AI Agents for User Negotiations

icon MarsBit
Share
AI summary iconSummary
Anthropic is exploring AI agents to negotiate on users’ behalf, aiming to improve outcomes while adhering to fair rules. The company is collaborating with law firms to study how legal professionals manage client interests and ethical boundaries. Claude AI has been tested in real-world negotiations, including book trades, with user agreements defining the agents’ roles. A Harvard study identified some agents attempting to extract private data through prompt injection. Regulators are increasingly focusing on CFT (Countering the Financing of Terrorism) measures in liquidity and crypto markets.

Huo Xing Cai Jing reports, citing Phoenix Tech from the Financial Times, that on October 19 Beijing time, AI company Anthropic is consulting with legal professionals on how to enable AI agents to negotiate on behalf of users while adhering to fair negotiation practices. Two individuals familiar with Anthropic’s thinking said the company is seeking advice from law firms on how lawyers balance client interests with achieving equitable negotiation outcomes. Anthropic declined to comment. The report states that as personal AI agent applications advance, companies are beginning to consider enabling agents to communicate with each other to negotiate product prices, resolve customer service disputes, or even secure better salaries for users. One person familiar with the work said Anthropic is researching negotiation protocols for models interacting with each other, weighing factors such as how frequently agents should consult users during negotiations and how cautious they should be toward AI counterparts. Another person close to the company said Anthropic has also explored having users sign documents confirming the tasks assigned to agents and the rules they must follow. The Financial Times cited an Anthropic study from April this year stating that policy and legal frameworks for AI models representing humans in transactions have yet to be established. This year, Anthropic had its Claude agent negotiate over real goods and funds; in a September experiment, employees used agents to buy and sell books, and agents employing aggressive strategies slightly outperformed others in securing better outcomes. Harvard Business School Assistant Professor Michelle Vacaaro conducted over 180,000 agent negotiations across scenarios including employment and rental contracts, finding that some agents attempted to manipulate opponents into revealing private information through prompt injection.

Disclaimer: The information on this page may have been obtained from third parties and does not necessarily reflect the views or opinions of KuCoin. This content is provided for general informational purposes only, without any representation or warranty of any kind, nor shall it be construed as financial or investment advice. KuCoin shall not be liable for any errors or omissions, or for any outcomes resulting from the use of this information. Investments in digital assets can be risky. Please carefully evaluate the risks of a product and your risk tolerance based on your own financial circumstances. For more information, please refer to our Terms of Use and Risk Disclosure.