Risk Alignment in Agentic AI Systems

Agentic AIs are systems that are capable of undertaking complex actions with little supervision. An agent’s actions are influenced by its attitudes toward risk. What risk attitudes should guide an agentic AI’s decision-making in order to achieve alignment with users, developers, and society? In this series of reports, the Worldview Investigations Team considers ethical and technical aspects of risk alignment and recommend strategies for achieving it.