Artificial intelligence is shaking up certainties in cybersecurity. This technology promises to automate threat detection and improve user training. But it also provides cybercriminals with weapons of unprecedented sophistication. For security managers, the challenge is to navigate between innovation and risk control.
When cybercriminals take hold of AI
Attackers quickly grasped the potential of generative AI. They use it to sophisticate their social engineering campaigns with formidable efficiency. ENISA, in its Threat Landscape 2024, points out that AI-powered threats are growing at an unprecedented rate. Traditional phishing is evolving into hyper-personalised attacks that exploit public data to create strikingly realistic decoys.
New-generation CEO fraud illustrates this trend. Cybercriminals use AI to mimic the voice and communication style of executives, fooling even the most vigilant employees. One telling statistic shows the scale of the problem: 89% of technology managers admit they are willing to bypass cybersecurity rules if they hinder their business objectives.
As Gartner observes: ‘Upcoming regulations pose a latent threat to companies that use (and develop) AI applications.’ The real catch? Companies are adopting generative AI faster than the market can develop secure solutions.
Detection, training, automation: AI on the defensive side
Fortunately, this double-edged sword can be used for defence. AI is transforming three key areas of cybersecurity.The first advantage is anomaly detection. Where a SOC analyst might miss a weak signal buried among thousands of alerts, the algorithm identifies suspicious patterns in real time.
Second advantage: personalised training. AI generates training scenarios tailored to risk profiles. An accountant will practise on CEO fraud simulations, while a developer will learn to identify malicious injection attempts.
The third benefit is the automation of repetitive tasks. By taking care of first-level analyses, AI frees up your teams for strategic tasks. But keep in mind the hierarchy outlined by Gartner: ‘First human resources, then processes, and finally technology.’
The regulatory framework is becoming clearer
Fortunately, this double-edged sword can be used for defence. AI is transforming three key areas of cybersecurity.For a CISO, the arrival of the European AI Act in August 2024 is a game changer. This regulation imposes a strict framework with three pillars: transparency, accountability and security. In practical terms, you must document every use of AI, map data flows and put control mechanisms in place. The GDPR remains relevant for applications that process personal data.
Gartner recommends subjecting all your AI systems to the impact assessments required by the GDPR and the AI Act. The winning strategy? ‘Test the new features offered by your usual cybersecurity providers and start using them in targeted, well-defined cases.’
Humans remain the weak link
Fortunately, this double-edged sword can be used for defence. AI is transforming three key areas of cybersecurity.Despite all these automated processes, humans remain at the centre of the issue. Social engineering attacks exploit our cognitive biases and our natural trust. AI exacerbates this vulnerability by making attacks more convincing. According to ENISA, nearly 40% of cyber incidents reported in Europe in 2024 were related to phishing, proving that the human factor remains the preferred target of attackers.
Gartner highlights the real challenge: ‘Focus first and foremost on threat vectors that are linked to the influence that can be exerted on human interpretation, content generated for which there is no technological control.’
Your training programmes need to evolve. Integrate these new threats. Develop a proactive security culture that is constantly adapting. The balance remains delicate: AI must remain an assistant, not a decision-maker.
Four fronts of transformation
Gartner identifies four areas where generative AI is disrupting cybersecurity: consumption, defence, attack and system construction. This transformation requires constant vigilance.
Harness the defensive potential of AI without falling into its traps. Automate without losing control. Innovate without compromising fundamental security. The most successful organisations will be those that strike the right balance between innovation and caution.
The challenge: harnessing the revolution
Artificial intelligence is redefining modern cybersecurity. It intensifies threats while offering unprecedented defensive capabilities.
This duality requires a nuanced approach. Ignoring AI would mean falling behind attackers, but adopting it indiscriminately exposes you to new vulnerabilities. Success will depend on your ability to combine innovation and rigour, integrating AI without neglecting governance, compliance and, above all, the human factor.
As AI evolves at a dizzying pace, your strategies must constantly adapt to remain effective. The real question is no longer whether it will transform cybersecurity, but how you can harness it without compromising your security. To learn more about these issues and explore concrete approaches to awareness in the age of AI, visit sosafe-awareness.com.