Can Complipath list our Azure AI services and count their calls and errors in Datadog?

What it reads from Azure

• The same app registration the Azure Monitor connection uses, with the built-in Reader role added on the subscriptions to read: up to 20 subscriptions and 100 AI services.
• For each Azure AI service: its name, its type (Azure OpenAI, AI services, Speech, Language and others), its region and each deployed model with its version.
• Every call is a GET to Azure Resource Manager and nothing is changed. Without the Reader role, one sentence says what is missing and the log reading carries on.
• The list is read again when a read runs and the last one is more than six hours old.

What it reads from Datadog

• An API key and an application key with the logs_read_data scope only, for the Datadog site you choose. Both keys are checked before they are kept.
• One aggregate query over the last 30 days: how many logs each service has, by status. It covers the services you named, or, if you named none, logs that mention a known AI address such as api.openai.com or api.anthropic.com.
• Errors are logs with the status error, critical, alert or emergency. The error rate is errors over all the logs counted for that service. Up to 50 services are listed, and a log with no service is counted as (no service).
• Neither connection reads by itself after you connect it. Press Check now.

Where you see it

• Link a Datadog service to a system, and that system's page says: Last 30 days in Datadog: support-bot, 1,204 calls · 2.1% errors.
• Under an audit question the page shows What your connected tools say: Azure's services and models for a question about vendors, models or where data sits, and Datadog's counts for one about monitoring or errors.
• If the register says a system's data stays in the EU and Azure runs its model in a region outside it, the page says one thing differs from your register. A person settles it; nothing is changed for you.
• The Azure list as a table, with Datadog's counts beside it, is on the Live page, part of Growth, which is not available yet.

What it does not do

• It does not call, test or change your AI services. It reads a list and a count.
• Calls are the logs the query matches. With a service named, that is every log line of the service, not only its AI calls. With none named, it is the log lines that mention a known AI address.
• Neither list adds anything to your register.
• Only Azure AI services are listed. Other Azure resources and other clouds are not.

Which plan

Starter and up. The trial includes it; the free plan does not.

On Starter, a read runs when you press Check now, once a day per connection. Reading every hour is watching, part of Growth, which is not available yet.

Where it sits in the law

• It is not an EU AI Act duty. Article 12(1) says high-risk AI systems shall technically allow for the automatic recording of events (logs) over the lifetime of the system. A count of calls and errors is not that recording, and Complipath does not say it satisfies it.
• The region is what Azure reports for the service. Whether personal data may go there is a separate question that this list does not answer.