Urgent.News

What's breaking now, across thousands of outlets.

AI

I’m building **Cerbère-AG**, a security evidence layer for AI agents.

I’m building Cerbère-AG , a security evidence layer for AI agents. Most AI security tools focus on what goes into the model: prompt injection, malicious inputs, jailbreaks, etc. I’m focusing on what happens after the model decides to act . Cerbère-AG observes and controls agent actions across tool calls, including: tool-call monitoring and traces policy enforcement sensitive-action detection…

I am reporting on the development of Cerbère-AG, a security evidence layer designed for AI agents. While many AI security tools focus on the input side, such as prompt injection, malicious inputs, and jailbreaks, Cerbère-AG concentrates on the actions an AI model takes once it has decided to act. This layer monitors and controls agent actions across tool calls, implementing policy enforcement, sensitive-action detection, argument and capability checks, budgets, execution limits, trajectory-level risk detection, human approval for sensitive actions, and security evidence for AI agent activity.

The core concept behind Cerbère-AG is to evaluate not just the safety of an agent in conversation, but its safety in action. The developer behind Cerbère-AG is actively seeking developers and teams who are running AI agents in real or realistic environments to test the system and provide feedback on its performance. They are particularly interested in partnerships with those who can offer insights into agent workflows, policies, approvals, and failure cases.

For developers and teams building AI agents, security tooling, MCP integrations, or autonomous workflows, the project invites feedback on what a production-grade agent security layer should detect that Cerbère-AG currently does not. Any constructive criticism or discovery of weaknesses in the project is appreciated, with a particular emphasis on breaking the system to uncover its vulnerabilities rather than simply offering compliments.

Developers are encouraged to share any AI agents they believe could expose a real failure mode for testing.

The project is currently hosted on GitHub and can be accessed for further information and contributions.

Written by urgent.news from Dev.to's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.

Read the original at dev.to →

More in AI

Day 4 - LLM - Tool Calling

Tool Calling Asking some query to the LLM. LLM is like a phone book , it can't call on its own. With some tools only it will. Tools are nothing but FUNCTIONS.

  • Tool calling enables LLMs to interact with external tools like APIs and databases.
  • Langchain framework uses @tool decorator to mark methods callable by the LLM.
  • Groq platform provides access to large language models for Langchain integration.

AI Agents Push Humans Out of the Loop

Abstract: AI agents pose significant risks as they are granted increasing autonomy. A commonly proposed solution is human oversight and keeping a ''human in the loop'', but this is not a simple…

  • AI agents gaining autonomy raises concerns about replacing human oversight entirely
  • Current AI designs hinder effective human oversight, eroding required skills
  • Proposed design-level features and protocols support overseers' goals and cognitive needs

AI Safety Is a Zero Trust Problem, Not a Philosophy Debate

The reaction to Jacob Coxon leaving Anthropic centers on existential risk. That debate matters. But existential risk is not an infrastructure strategy.

  • AI systems expose limitations of static IAM roles and traditional network perimeters.
  • Zero Trust principles must be applied directly to AI runtime.
  • Infrastructure security addresses AI safety, not just model alignment.

Agent memory that tells you when it couldn't check

An on-call agent that answers "no prior incidents" might be telling you the archive is empty. It might also be telling you the embedding call timed out, and most memory stores return both as the same…

  • Throughline agent has memory layer for audit
  • Primary memory db-7 with 14-day half-life
  • UNKNOWN verdict reported when search fails

More from Saturday 26 September →