In February 2026, a financial services firm in Singapore received a spoofed video call from what appeared to be their CFO, requesting an urgent wire transfer of $4.3 million to a new supplier account. The voice was indistinguishable from the real CFO. The face matched perfectly.
The finance team approved the transfer. The CFO had never made the call. The attacker had generated a real-time deepfake using publicly available video footage from a conference appearance and a voice cloning model trained on three minutes of audio from an earnings call. Total attack preparation time: under four hours.
This was not science fiction, and it was not an isolated case. 2026 represents an inflection point in the history of cyberattacks: artificial intelligence has removed the skill ceiling from offensive operations. Tasks that previously required months of reconnaissance, skilled social engineers, experienced malware developers, and coordinated criminal infrastructure can now be partially or fully automated using large language models, diffusion models, and reinforcement learning systems. The barrier to sophisticated attack has never been lower. The volume and personalisation of attacks have never been higher.
This guide explains precisely how threat actors are using machine learning and AI in 2026: the specific techniques, real documented case studies, the attack categories where AI provides the most significant advantage to attackers, and the defensive controls that security teams must implement to counter AI-assisted attacks. Understanding the technology being weaponised against you is the first step to defending against it.
- How AI changed the cyberattack landscape
- AI-powered phishing and social engineering
- Deepfake attacks -- voice, video, and identity fraud
- AI-assisted malware development and evasion
- Automated reconnaissance and target profiling
- AI-driven vulnerability discovery and exploitation
- AI-powered password and credential attacks
- Real-world AI attack case studies 2025-2026
- Defending against AI-powered attacks
- Frequently asked questions
To understand why AI represents a qualitative shift in the threat landscape rather than a quantitative one, it helps to understand what previously limited cyberattack effectiveness.
Historically, the most damaging attacks required rare, expensive human skills: a skilled social engineer who could convincingly impersonate someone in a phone call; a malware developer who could write code that evaded modern endpoint protection; a vulnerability researcher who could find and exploit a zero-day; an analyst who could spend weeks processing reconnaissance data to identify the highest-value targets. These skills were scarce, expensive, and did not scale.
AI does not replace those skills -- it democratises and scales them. An LLM can write a grammatically perfect, contextually accurate spear phishing email for any target given 10 minutes of LinkedIn research. A voice cloning model can replicate any person's voice from three seconds of audio.
A code generation model can produce functional malware with evasion techniques on request. A vulnerability analysis model can scan thousands of lines of code for exploitable patterns in seconds. None of these require the original rare human expertise -- they require a computer, an internet connection, and the knowledge to prompt the model correctly.
The three capabilities that have most fundamentally changed offensive operations are: language models that remove the skill and language barrier from social engineering at scale; voice and video synthesis that defeats identity verification based on biometrics; and code generation that accelerates exploit development and malware creation. Each is examined in detail below.
Phishing is the most common initial access technique in cyberattacks, responsible for over 68% of data breaches. AI has transformed it from a volume game (send millions of generic emails) to a precision game (send a small number of highly personalised emails to high-value targets, each one constructed from OSINT gathered and synthesised by an LLM in seconds).
A modern AI-assisted spear phishing pipeline operates in four automated stages. The attacker defines the target organisation and a list of individuals. The pipeline then:
WormGPT -- a jailbroken LLM fine-tuned on malware and cybercrime data and sold on dark web forums from mid-2023 -- demonstrated that the criminal ecosystem rapidly commoditises AI capabilities.
By 2025, multiple successors existed: FraudGPT (optimised for financial fraud and phishing), DarkBARD, EvilGPT, and custom fine-tuned models trained on leaked datasets of successful phishing emails and malware code. These tools do not represent fundamentally novel capability beyond what legitimate LLMs can produce with prompt engineering -- but they remove the need for prompt engineering and jailbreaking, making offensive AI accessible to low-skill threat actors.
Historically, phishing emails targeting non-English speakers often contained obvious grammatical errors that trained users could spot. LLMs are fluent in over 100 languages with native-level accuracy.
An attacker targeting a Japanese financial institution, a French healthcare provider, or a German manufacturer can generate perfectly constructed, culturally appropriate phishing emails in the target's native language with zero additional effort. This removes one of the last reliable tells that trained non-English-speaking employees could use to identify phishing.
Synthetic media -- AI-generated audio and video that realistically portrays real people saying or doing things they never said or did -- has moved from a laboratory curiosity to a financially devastating fraud vector in under five years. The barrier to creating convincing deepfakes has collapsed: tools that required a research lab in 2020 are now available as free mobile applications and APIs in 2026.
AI voice cloning models (ElevenLabs, Resemble AI, and numerous open-source alternatives) can replicate a specific person's voice from as little as three seconds of publicly available audio -- a YouTube video, a podcast appearance, an earnings call recording, a conference talk. The cloned voice is indistinguishable from the original in most conditions. Documented financial fraud using voice cloning:
- 2019 -- First documented CEO voice fraud (UK energy firm): Criminals cloned the voice of the CEO of a German parent company and called the UK subsidiary's finance director, instructing him to transfer €220,000 to a Hungarian supplier. The finance director described the voice as identical to his CEO's, including his German accent and speech pattern. The transfer was made.
- 2024 -- Hong Kong deepfake video call ($25.6M): A finance employee attended a video conference call with who appeared to be their company's CFO and several colleagues. All other participants were real-time deepfakes. The employee was instructed to make 15 transfers totalling HK$200 million ($25.6M). He had initially suspected a phishing email but the video call reassured him.
- 2025 -- Singapore C-suite deepfake ($4.3M): The case described in the opening paragraph. Deepfake generated from conference video footage; voice cloned from an earnings call recording.
Real-time face-swapping -- replacing a person's face with a target's face in a live video call -- reached sufficient quality for fraud purposes by late 2024. Tools like DeepFaceLive, Roop, and commercial API services can swap faces in real time with latency under 50ms, within the normal variation users experience in video calls. In 2026, detection of real-time deepfakes requires either technical analysis tools or specific verification challenges that the deepfake pipeline cannot resolve.
- Safe word protocol: Establish a pre-agreed safe word between executives and finance teams for any payment or sensitive access request made via an unusual channel. A deepfake cannot know the safe word. Document and rotate quarterly. This is the single most reliable deepfake defence -- it does not depend on detection technology.
- Out-of-band callback verification: Any payment instruction above a defined threshold requires a callback to an independently verified phone number (from your existing contacts, not from the requesting email or call). The callback must be initiated by the recipient, not the requester. A deepfake caller cannot receive a call back on the CFO's real verified number.
- Physical verification challenges: In a video call suspected to be a deepfake, ask the caller to: turn sideways to the camera (real-time deepfakes degrade in profile view), write a specific word on paper and hold it up, or move to a different location. These challenges are trivial for a real person and difficult for most real-time deepfake pipelines.
- AI detection tools: Reality Defender, Intel FakeCatcher, Microsoft Video Authenticator, Pindrop (audio deepfake detection) analyse media for deepfake artefacts. These tools catch the majority of current deepfakes but are in an arms race with generation technology -- treat as one layer of defence, not a complete solution.
- Multi-person authorisation for large transfers: Require physical in-person co-authorisation for any wire transfer above a high threshold. An attacker cannot deepfake multiple people simultaneously in the same physical location.
Code generation AI (GPT-4o, Claude, Gemini, Codex, and specialised coding models) significantly accelerates malware development for threat actors with limited programming skills. The assistance does not only involve writing malicious functionality -- it includes generating polymorphic variants that evade signature detection, translating malware from one language to another, and suggesting evasion techniques for specific security products.
- Polymorphic code generation: Automatically generate functionally equivalent variants of a malware payload with different code structures, variable names, and obfuscation patterns -- each variant presents a different signature to AV engines. What previously required skilled malware authors can now be automated at scale, producing hundreds of unique variants from a single original.
- Evasion technique suggestion: LLMs trained on security research can suggest specific evasion techniques for named security products. An attacker can describe the target environment (CrowdStrike Falcon, Windows Defender, specific EDR version) and receive suggested techniques to evade detection: syscall unhooking, PPID spoofing, ETW patching, indirect syscalls.
- Payload adaptation: Rewrite an existing public proof-of-concept exploit into a production-quality payload with error handling, C2 communication, and persistence. PoC to weaponised exploit in hours rather than weeks.
- Script kiddie uplift: The most significant impact: attackers with limited programming skill can now produce moderately sophisticated malware. The expertise gap between nation-state threat actors and opportunistic criminals has narrowed significantly.
AI-generated polymorphic malware renders signature-based detection increasingly unreliable as the primary defence. The defensive shift required: behavioural detection (what the malware does, not what it looks like), memory scanning (detect shellcode execution patterns in memory), and EDR telemetry (process behaviour, network connections, file system activity).
An EDR that detects CreateRemoteThread called from a suspicious parent process catches the polymorphic variant because the behaviour is the same even when the code looks completely different. YARA rules targeting behaviour patterns and memory artefacts rather than code strings are more resilient to AI-generated polymorphism.
Reconnaissance -- gathering intelligence about a target before an attack -- was historically constrained by human analyst time. Processing hundreds of employee LinkedIn profiles, identifying the organisational hierarchy, mapping technology stack from job postings and GitHub, correlating breach data with current email formats, and building a target dossier sufficient to plan a convincing attack required hours or days of skilled analyst work per target. LLMs and AI automation pipelines have reduced this to minutes.
- Organisational mapping: LLMs process LinkedIn data to construct a complete organisational chart including reporting relationships, tenure, technology focus areas, and recent career changes (a new CFO unfamiliar with existing procedures is a higher-value BEC target than a 10-year incumbent).
- Technology stack identification: Job postings (require experience with Splunk, AWS, Palo Alto) reveal the security toolset. GitHub repositories reveal coding languages and frameworks. Shodan and Censys reveal internet-facing infrastructure. An LLM synthesises all sources into a technology profile in seconds.
- Breach data correlation: AI tools cross-reference known breach datasets (credentials from previous breaches) against identified targets. Employees who use the same password across services are identified as credential-stuffing targets.
- Supply chain mapping: Identify the target organisation's key suppliers, software vendors, and managed service providers from public sources. Suppliers become attack vectors -- a breach of a trusted supplier provides a path to the original target with legitimate credentials and access.
- Optimal attack timing: Analyse public sources for events that create optimal attack windows: CFO changes (transition period), mergers and acquisitions (confusion and new relationships), large IT projects (change management creates access), earnings periods (finance teams under pressure).
AI is accelerating the vulnerability discovery and exploitation cycle at both ends: helping defenders find vulnerabilities in their own code faster, and simultaneously helping attackers find and exploit those same vulnerabilities before patches are applied. The net effect depends on which side deploys AI tools more effectively and quickly.
Most vulnerability scanners (Nessus, Qualys) match software versions against CVE databases. AI-augmented scanning goes further: static analysis of code (SAST) to find vulnerabilities that have no CVE yet; fuzzing guided by machine learning to find memory corruption bugs faster than traditional random fuzzing; and analysis of patch diffs to identify the vulnerability class and write exploit code before the vendor's patch has deployed widely.
Given a CVE description and the affected code, LLMs can suggest exploit approaches, generate proof-of-concept code, and identify the memory layout required for exploitation. Security researcher research in 2025 demonstrated that GPT-4 class models could successfully exploit one-day vulnerabilities (patched but not yet widely deployed) from only the CVE description and a copy of the vulnerable binary, without prior knowledge of the specific exploit. The time from CVE publication to working exploit -- which historically took skilled researchers days to weeks -- is compressing toward hours for certain vulnerability classes.
CISA's Known Exploited Vulnerabilities catalogue shows that the median time from CVE publication to exploitation in the wild dropped from 44 days in 2021 to 12 days in 2025. AI-assisted exploit development is a significant contributor. For organisations with 30-day critical patch SLAs (already aggressive by industry standards), a 12-day median exploitation window means patches must be applied faster, or compensating controls (WAF rules, IPS signatures, network segmentation) must be deployed within days of CVE publication while the patch is prepared and tested.
Traditional password cracking uses wordlists and rule-based mutations (adding numbers, replacing letters with symbols). AI-powered password cracking goes further: machine learning models trained on large breach datasets learn statistical patterns in how humans construct passwords. Given partial information about a target (their name, birthday, interests, employer, previous passwords from breaches), the model generates a targeted password candidate list that is significantly more likely to contain the actual password than a generic wordlist.
PassGAN (2023) demonstrated that a GAN trained on breach datasets could crack 51% of passwords in under a minute -- not because it was faster than GPU-based Hashcat, but because it generated better candidates. Subsequent work in 2025 showed that when combined with personal OSINT (name, interests, known password fragments from previous breaches), AI-assisted password guessing outperforms traditional approaches by 3-5x for targeted attacks.
AI assists credential stuffing (using username/password combinations from data breaches against other services) by: prioritising which credentials to test first based on account value estimation; generating realistic browser fingerprints and behaviour patterns to evade bot detection; rotating through proxy networks and timing attacks to avoid rate limiting; and automatically detecting successful logins and prioritising accounts for manual follow-up based on what the account contains.
- Phishing-resistant MFA (FIDO2): Renders stolen passwords useless without the second factor. Even AI-optimised password cracking is irrelevant if credentials cannot be used without a FIDO2 key that is cryptographically bound to the legitimate site.
- Breached password detection: Microsoft Entra ID Password Protection, HaveIBeenPwned integration -- block passwords known to be in breach datasets before attackers try them.
- Behavioural anomaly detection: Logins from new devices, unusual locations, or at unusual times trigger step-up authentication or alerts regardless of credential validity.
A European energy company's finance team received a wave of spear phishing emails targeting 40 employees over three days. Each email was uniquely personalised: it referenced the recipient's specific job responsibilities (gathered from LinkedIn), named their direct manager, and referenced a real ongoing project (identified from a press release). The emails appeared to come from the company's IT department requesting credential re-validation for a new cloud system rollout. 23 of 40 recipients clicked the link -- a 57% click rate compared to the 8% average for simulated phishing at the same organisation. Investigation found the email content was LLM-generated using scraped OSINT. The attacker invested approximately 2 hours of setup time for an attack that compromised 12 user accounts.
An accounts payable team member received a WhatsApp voice message from what sounded exactly like their company's managing director, followed by an email with payment instructions. The voice message said to process the payment urgently before close of business and not to discuss it with others (a standard isolation tactic). The voice had been cloned from the managing director's LinkedIn video posts. The payment of £340,000 was processed. The fraud was discovered when the real managing director called to ask about an unrelated matter the following morning. The attacker had never spoken to anyone at the company directly.
A threat intelligence report from CrowdStrike in Q1 2026 documented a campaign by a criminal group using LLM-generated polymorphic loaders. Each victim received a unique binary with a different code structure, string encryption key, and API resolution mechanism -- no two binaries shared the same static signature. The campaign successfully evaded signature-based detection at 6 of 11 targeted organisations and was only detected at the remaining 5 through behavioural EDR rules (detecting lsass.exe memory access, not the specific loader code). The group was assessed to have moderate technical capability -- the AI tooling provided capability uplift that would previously have required skilled malware developers.
Security researchers at Recorded Future discovered and documented an automated attack pipeline being sold on dark web forums that scraped LinkedIn for target companies, generated personalised phishing emails using an LLM API, registered typosquat domains, set up Evilginx AiTM proxies, and sent campaigns -- all with minimal human intervention. The tool was being sold for $2,500 per month and had been used in attacks against financial services, healthcare, and technology firms across North America and Europe. The full pipeline from company name input to live phishing campaign took under 30 minutes.
Defending against AI-assisted attacks does not require AI-specific silver-bullet solutions -- most of the effective controls are hardened versions of existing security fundamentals. AI makes attacks faster and more convincing, not fundamentally different in mechanism. The key insight: AI-powered phishing still delivers credentials to a phishing proxy; phishing-resistant MFA still stops credential theft regardless of how convincing the phishing email was.
| Attack type | What AI enables | Primary defence | Secondary defence |
|---|---|---|---|
| AI phishing | Perfect grammar, personalisation at scale, multilingual | Phishing-resistant MFA (FIDO2) -- stolen credentials become useless | Email gateway with AI detection, security awareness training on process not grammar |
| Deepfake voice | Perfect voice clone from 3 seconds of audio | Safe word protocol + out-of-band callback verification | Voice deepfake detection tools (Pindrop), multi-person payment authorisation |
| Deepfake video | Real-time face swap in video calls | Safe word + physical verification challenges | Reality Defender, Intel FakeCatcher, require in-person for high-value decisions |
| AI malware (polymorphic) | Unique binary per victim, evades signature AV | Behavioural EDR (detect what it does, not what it looks like) | Memory scanning, application allowlisting, network segmentation to limit blast radius |
| AI-assisted exploitation | Faster PoC to exploit, CVE exploitation within hours | Aggressive patch SLAs (24h for KEV, 48h for CRITICAL) | WAF/IPS virtual patching, CISA KEV monitoring, threat intel for emerging exploits |
| AI credential attacks | Targeted password generation from OSINT | FIDO2 passkeys (eliminate passwords entirely) | Breached password detection, behavioural anomaly detection on logins |
| AI OSINT/recon | Full target dossier in minutes not hours | Limit public OSINT exposure (LinkedIn privacy settings, minimal tech stack disclosure) | Canary tokens to detect reconnaissance, honeypot credentials |
Security vendors are deploying AI detection on the defensive side: AI-generated phishing email detection (Proofpoint, Abnormal Security) that identifies statistical patterns in LLM-generated text; deepfake audio detection in call centres (Pindrop) that analyses spectral characteristics of AI-synthesised voice; anomaly detection in user behaviour (UEBA) that identifies AI-automated credential stuffing from the velocity and pattern regularity of login attempts.
The arms race between AI-generated attacks and AI-powered detection is ongoing, with neither side achieving a stable advantage. Organisations should deploy AI detection tools as a layer while maintaining robust procedural controls (safe words, callback policies, dual authorisation) that do not depend on technology to function.
The deepfake finance director who wired $25.6M and the accounts payable clerk who sent £340,000 were not foolish or untrained -- they were operating in environments where AI-generated fraud was indistinguishable from legitimate communications by any technical means available to them at the time.
The control that would have prevented both losses requires no technology: a simple policy that any payment request made via an unusual channel (WhatsApp, a new email address, a video call not scheduled through normal channels) requires a callback to a verified number before processing. This policy costs nothing to implement, requires no AI tools, and would have stopped both attacks completely.
⚡ What to do in your organisation -- four actions this week
- Deploy phishing-resistant MFA (FIDO2/passkeys) for all executives and finance team members this month. AI-powered phishing is more convincing than ever but still captures credentials that are useless without the second factor. Standard push-notification MFA is not sufficient -- AiTM proxies capture the session cookie alongside the credential. FIDO2 hardware keys (YubiKey, Google Titan) are cryptographically bound to the legitimate domain and cannot be phished by any proxy.
- Establish a safe word protocol for your finance team and executives this week. Write a one-paragraph policy: any payment instruction or sensitive access request made through an unusual channel (WhatsApp, unexpected call, unexpected video call) must include a pre-agreed safe word before action is taken. If the safe word is not provided, the request is declined and the real person is called on their verified number. This takes 30 minutes to implement and costs nothing.
- Update your security awareness training to focus on process, not grammar. Training that teaches employees to spot "bad grammar" or "suspicious links" is now inadequate -- AI-generated phishing has perfect grammar and legitimate-looking links. Retrain on process: verify unusual requests out-of-band regardless of how convincing they appear; report anything that creates urgency or requests secrecy; the most convincing request is the one most worth verifying.
- Deploy behavioural EDR and move from signature-based to behaviour-based malware detection. AI-generated polymorphic malware defeats signature AV. EDR platforms (CrowdStrike Falcon, Microsoft Defender for Endpoint, SentinelOne) detect behaviour -- what a process does in memory, what it connects to, what registry keys it modifies -- regardless of how the code looks. If you are still relying primarily on antivirus signatures, upgrade to behavioural EDR before a polymorphic malware campaign reaches your environment. SIEM for AI attack detection | MFA guide | Social engineering prevention | Incident response planning
Hackers use AI across every phase of the attack lifecycle. In reconnaissance, LLMs process OSINT from LinkedIn, GitHub, and public websites to build detailed target profiles in minutes. In social engineering, LLMs generate grammatically perfect, contextually personalised phishing emails that achieve 3x higher click rates than manual campaigns. Voice cloning models replicate executives' voices from publicly available audio for fraud calls. Real-time deepfake video enables impersonation in live calls. In exploitation, AI accelerates malware development, generates polymorphic variants that evade signature detection, and helps identify exploitable vulnerabilities in code. In credential attacks, AI models trained on breach datasets generate targeted password candidates more effectively than traditional wordlists.
Traditional phishing sends the same generic email to millions of addresses, relying on volume to find victims. AI-powered phishing generates unique, personalised emails for each target using OSINT gathered from LinkedIn, company websites, and social media. Each email references the target's real job title, their manager's real name, current projects, and uses vocabulary matching the impersonated sender's known writing style. Grammar is perfect. Context is accurate. The result is emails that are far harder to distinguish from legitimate communications -- achieving click rates of 40-60% compared to 3-8% for mass phishing. AI also enables multilingual phishing without the grammatical errors that previously helped non-English speakers identify attacks.
A deepfake cyberattack uses AI-synthesised audio or video to impersonate a real person -- typically an executive, colleague, or authority figure -- to manipulate the victim into taking a harmful action: transferring funds, revealing credentials, or approving access requests. Voice deepfakes can clone any person's voice from as little as three seconds of publicly available audio. Video deepfakes can replace a person's face in real time during a video call. The most significant documented case was a $25.6 million loss from a Hong Kong company whose finance employee attended a video conference where all other participants (including the apparent CFO) were real-time deepfakes.
Yes -- AI code generation models can assist in writing malware, generating evasion techniques, and creating polymorphic variants that evade signature-based detection. Legitimate LLMs have safety filters that limit direct malware generation, but jailbroken and fine-tuned criminal alternatives (WormGPT, FraudGPT) remove these restrictions. More practically, threat actors use AI to accelerate malware development: generating polymorphic code variants, suggesting evasion techniques for specific security products, converting public proof-of-concept exploits into weaponised payloads, and adapting existing malware to new targets. The result is that moderate-skill threat actors can now produce malware of significantly higher quality than their skill level would previously have allowed.
Defending against AI-powered attacks requires strengthened versions of existing controls, not entirely new technology. Key defences: deploy phishing-resistant FIDO2 MFA (stolen credentials are useless without the physical key, even after AI-generated phishing); establish safe word and callback verification protocols for payment requests (defeats deepfake voice and video fraud without technology); update security awareness training to focus on process-based verification rather than spotting bad grammar (AI phishing has perfect grammar); deploy behavioural EDR instead of relying on signature AV (detects AI-generated polymorphic malware by what it does, not what it looks like); and accelerate patch SLAs to match the AI-accelerated exploitation timeline (CRITICAL CVEs in 24-48 hours, not 30 days).
WormGPT was a jailbroken large language model fine-tuned on malware and cybercrime data, sold on dark web forums from mid-2023 for approximately $60-100 per month. It was designed to generate phishing emails, malware code, and fraud scripts without the safety filters that legitimate LLMs apply. The original WormGPT was shut down by its creator in August 2023 following media coverage, but multiple successors emerged immediately: FraudGPT, DarkBARD, EvilGPT, and numerous unnamed alternatives. In 2026 the criminal AI ecosystem includes both specialised jailbroken models and prompt-engineering guides that extract similar capability from legitimate commercial models. The availability of these tools has lowered the technical barrier to sophisticated social engineering attacks significantly.