A new survey of security leaders shows that while artificial intelligence (AI) adoption is accelerating, proper security measures are not being undertaken much of the time, according to HiddenLayer, security provider for AI models and assets.

The inaugural “AI Threat Landscape Report” highlights the increasing use of AI along with the risks involved in its deployment.

Nearly all surveyed companies (98 percent) consider at least some of their AI models crucial to their business success, with 77 percent identifying breaches to their AI in the past year. Yet only 14 percent of IT leaders said their respective companies are planning and testing for adversarial attacks on AI models, the data found.

The report seeks to shed light on the biggest vulnerabilities impacting AI today, their implications on commercial and federal organizations, and cutting-edge advancements in security controls for AI in all its forms.

The survey of 50 IT security and data science leaders uncovered AI’s widespread utilization by businesses today, with an average of 1,689 AI models in production.

Security for AI has become a priority, with 94 percent of IT leaders allocating budgets to secure their AI in 2024, the survey found.

Only 61 percent reported being highly confident in their allocation, and 92 percent are still developing a comprehensive plan for this emerging threat.

The findings reveal the need for support in implementing security for AI, the report noted.

“AI is the most vulnerable technology ever to be deployed in production systems,” said Chris “Tito” Sestito, co-founder and CEO of HiddenLayer. “The rapid emergence of AI has resulted in an unprecedented technological revolution, of which every organization in the world is affected. Our first-ever AI Threat Landscape Report reveals the breadth of risks to the world’s most important technology. HiddenLayer is proud to be on the front lines of research and guidance around these threats to help organizations navigate the security for AI landscape.”

Risks Involved With AI Use

Adversaries can leverage a variety of methods to utilize AI to their advantage, the company said.

The most common risks of AI usage include:

• Manipulation to give biased, inaccurate or harmful information.
• Creation of harmful content, such as malware, phishing and propaganda.
• Development of deep fake images, audio and video.

Common Types of Attacks on AI

There are three major types of attacks on AI:

• Adversarial machine learning attacks target AI algorithms, aimed to alter AI’s behavior, evade AI-based detection or steal the underlying technology.
• Generative AI system attacks threaten AI’s filters and restrictions, intended to generate content deemed harmful or illegal.
• Supply chain attacks target ML artifacts and platforms with the intention of arbitrary code execution and delivery of traditional malware.

Challenges to Securing AI

• Shadow IT: 61 percent of IT leaders acknowledge shadow AI, solutions that are not officially known or under the control of the IT department, as a problem within their organizations.
• Third-Party AIs: 89 percent express concern about security vulnerabilities associated with integrating third-party AIs, and 75 percent believe third-party AI integrations pose a greater risk than existing threats.

HiddenLayer outlined best practices for organizations to begin securing their AI, including:

1. Discovery and Asset Management: Begin by identifying where AI is already used in your organization. What applications has your organization already purchased that use AI or have AI-enabled features?
2. Risk Assessment and Threat Modeling: Perform threat modeling to understand the potential vulnerabilities and attack vectors that could be exploited by malicious actors to complete your understanding of your organization’s AI risk exposure.
3. Data Security and Privacy: Go beyond the typical implementation of encryption, access controls, and secure data storage practices to protect your AI model data. Evaluate and implement security solutions that are purpose-built to provide runtime protection for AI models.
4. Model Robustness and Validation: Regularly assess the robustness of AI models against adversarial attacks. This involves pen-testing the model’s response to various attacks, such as intentionally manipulated inputs.
5. Secure Development Practices: Incorporate security into your AI development lifecycle. Train your data scientists, data engineers, and developers on the various attack vectors associated with AI.
6. Continuous Monitoring and Incident Response: Implement continuous monitoring mechanisms to detect anomalies and potential security incidents in real-time for your AI, and develop a robust AI incident response plan to quickly and effectively address security breaches or anomalies.