• FR
CONTACT

AI agents in production: 7 questions for managers

Chronicle of

Share with a friend

Who is responsible for an AI agent in production?

Key points

  • Often, no one: the agent is deployed by the business, hosted by IT, and validated by no one.
  • Three areas escape usual controls: the system prompt, connected tools, and the agent’s behavior itself.
  • Seven questions, without jargon, help identify weaknesses before the next deployment.
  • DORA, NIS2, and the AI Act make these questions mandatory for some organizations, including insurers.

Why does the agent not have an owner? The business thinks IT has audited. IT thinks compliance has validated. Compliance treats it as an ordinary tool.

What questions to ask internally?

  1. Who can modify an agent’s system prompt, and who is notified?
  2. Is there an up-to-date list of systems accessible to each agent?
  3. Has the editor documented the model’s behavior in your real conditions?
  4. Who is informed of a change that could alter an agent’s behavior, and what do they do with the information?

What questions to ask your editor?

  1. How will you be notified of a model change, and what happens if a validated behavior changes?
  2. Do their tests cover your environment or just theirs?
  3. In case of unforeseen effects on your systems or on third parties, who is responsible, and under what regulation?

What does the regulation say?

DORA applies to banks and insurers from January 2025. The AI Act classifies certain uses, such as risk assessment and pricing in life and health insurance, as high risk. In case of an incident, you will be asked what you had verified yourself, not what your publisher had certified.

→ Read the complete chronicle by our expert Khaled Ben Driss on the Journal du Net

→ To go further, discover our expertise in Artificial Intelligence and in Cybersecurity

InsightsThese contents may interest you…

/ Banking & Finance /
Artificial Intelligence
/ Banking & Finance, Industry, Retail & Logistics, Insurance, Public Sector, Technology & Software Providers /
Artificial Intelligence
/ Banking & Finance, Industry, Retail & Logistics, Insurance, Public Sector, Technology & Software Providers /
Artificial Intelligence
/ Banking & Finance, Insurance /
Artificial Intelligence