What is a deepfake?

Security and identity

A deepfake is image, audio, or video content that has been generated or manipulated by AI so that it appears authentic, truthful, or tied to a real person or event when it is not. In practical terms, it is synthetic media with high persuasive realism. Deepfakes can be malicious, but they can also be creative, assistive, or commercial. The key issue is not only how they are made, but whether people are clearly told what they are seeing or hearing.

What this means

Most people think of deepfakes as fake celebrity videos. That is too narrow. A deepfake can be a cloned voice that sounds like a finance director, a manipulated video of a spokesperson, a face-swapped training clip, or an AI-generated image designed to look like documentary evidence. The common feature is realism with a false impression of authenticity.

A useful plain-English definition is this: a deepfake is media that uses AI to create or alter the appearance, voice, or apparent behaviour of something in a way that can persuade viewers it is real. Sometimes the media is fully synthetic. Sometimes it is an edited version of real source material. Sometimes it is a blend.

That means deepfake is best understood as a class of synthetic or manipulated media, not as one single technique. Face swapping, voice cloning, lip synchronisation, synthetic avatars, and generated still images can all sit within the same broad concern if they create a misleading impression.

It is also important not to treat all deepfakes as inherently malicious. There are harmless and useful cases. A training video might use a synthetic presenter. A film may use digitally altered imagery. A marketing team may localise video with AI-generated voiceover. The real dividing line is usually disclosure, intent, and context. If people know it is synthetic and the use is legitimate, the risk is much lower. If the point is to impersonate, deceive, or fabricate evidence, the risk rises sharply.

The reason deepfakes now matter more is simple. The cost of creating persuasive synthetic media has fallen, the speed has increased, and the tools are easier to access. That changes the burden on organisations. The question is no longer only "Can this be faked?" It is "How do we verify media, protect decisions, and respond when authenticity is challenged?"

Why it matters

Deepfakes matter because they attack trust at the point where organisations often rely on human perception. If a call sounds like the chief executive, if a video appears to show a real meeting, or if an image looks like genuine evidence, many normal controls can be bypassed by urgency and plausibility.

For leaders, the first concern is impersonation and fraud. Voice cloning can be used to pressure teams into releasing payments, resetting credentials, approving urgent exceptions, or disclosing information. Visual manipulation can support social engineering, brand attacks, or false public claims.

The second concern is governance. As synthetic media becomes easier to produce, teams need clearer rules for what can be used externally, what must be disclosed, and how authenticity is checked in sensitive processes. This is not only a communications issue. It affects HR, procurement, finance, security, customer operations, and legal review.

The third concern is evidential confidence. Organisations increasingly work through recorded calls, screenshots, remote meetings, digital identity checks, and social content. Deepfakes raise the cost of trusting raw media by default. Even genuine media can be challenged more easily once people know that convincing fakes exist.

This is why deepfakes are not just a media trend. They force a broader shift from "seeing is believing" to "seeing requires verification". That is a meaningful operational change.

How it works

At a high level, deepfakes are produced by generative or editing systems that learn patterns from large datasets of images, audio, or video. Instead of merely cutting and pasting media in the old manual sense, these systems can synthesise new content or manipulate existing content so the result looks coherent.

For voice cloning, the system learns how a person's voice sounds, then generates new speech that resembles that voice. For face or video manipulation, the system learns patterns of facial structure, motion, lighting, and expression, then reconstructs or edits frames to match the target effect. For image generation, the system can produce a wholly synthetic scene that resembles a photograph.

Modern deepfake pipelines do not all use the same architecture, and the term itself is broader than the older technical origin of "deep fake". For business readers, the exact model family matters less than the practical result: AI can now create persuasive media that may be mistaken for real origin footage or authentic speech.

Detection is possible, but it is not a silver bullet. Some detectors look for visual or audio artefacts. Others compare biometric or acoustic traits. Others rely on provenance signals rather than artefact hunting. All approaches have limits. Quality is improving, formats change, content gets edited, and adversaries adapt.

That is why provenance has become important. Instead of asking only, "Can I detect the fake?", organisations increasingly ask, "Can I verify where this file came from, how it was made, and whether its edit history is intact?" Standards such as C2PA, often surfaced to users as content credentials, are designed to attach signed provenance information to media. This can show creation details, edit history, and signer identity in a tamper-evident way where the ecosystem supports it.

Even then, provenance is not the same as truth. Provenance can help establish the origin and history of a file. It cannot, by itself, prove that the event shown happened as the audience infers, nor can it guarantee that a piece of media carries all relevant context. It is a trust signal, not a universal proof engine.

Regulation is also evolving. In the EU, the AI Act defines a deep fake as AI-generated or AI-manipulated image, audio, or video content that resembles existing persons, objects, places, entities, or events and would falsely appear authentic or truthful. Article 50 requires disclosure for deployers using deepfake content and also imposes machine-readable marking duties on providers of certain synthetic media systems. The deployer disclosure duties are due to apply from 2 August 2026, while a provisional political agreement reached in May 2026 under the Digital Omnibus would move the provider marking duty for synthetic content to 2 December 2026. As at mid-2026 that agreement takes legal effect only on formal adoption and publication, so verify the current position before relying on a specific date. That matters because it shifts deepfake handling from a voluntary ethics issue toward a formal compliance issue in relevant contexts.

In everyday organisational practice, however, the most useful lesson is simpler than the law. Deepfake defence is not just a detector purchase. It is a layered authenticity strategy. That includes governance over synthetic media use, stronger verification steps for sensitive approvals, provenance where feasible, crisis handling for impersonation incidents, and staff training so suspicious media is treated with procedural caution rather than immediate belief.

The broader point is that deepfakes are changing both creation and verification. The creation side is getting easier and cheaper. The verification side must become more deliberate. Organisations that adapt early will not be impossible to deceive, but they will be far harder to pressure with synthetic urgency and fake evidence.

Examples

A finance team receives an urgent voice note that sounds like the chief executive asking for an immediate transfer tied to a confidential deal. If the organisation relies on voice familiarity and urgency rather than independent approval checks, a cloned voice can become a fraud tool.

A communications team sees a short video clip circulating online that appears to show a senior leader making a damaging statement. Even before authenticity is settled, the organisation may face pressure to respond, correct, or reassure customers and staff.

A training function may use synthetic presenters or cloned voiceover to localise educational material quickly. This is a lower risk use if it is disclosed clearly and governed properly.

A marketing team may generate product imagery or spokesperson avatars for campaign testing. Again, the issue is not only whether the media is synthetic, but whether claims, consent, and disclosure are managed properly.

A people operations or security team may face remote identity verification problems where submitted media, interview footage, or evidence clips cannot be treated as self-authenticating. Deepfake risk therefore touches hiring, onboarding, fraud checks, and incident investigation.

Common misunderstandings

One misunderstanding is that deepfakes are only videos. Audio and still images can be just as persuasive and often easier to deploy in fraud and impersonation attempts.

Another is that all AI-edited media is a deepfake. Ordinary editing and assistive enhancement are not automatically the same thing. Context, degree of manipulation, and the false appearance of authenticity matter.

A third mistake is to assume detectors will always catch fakes. Detection can help, but it is an arms race and should not be the only control.

People also assume deepfakes mainly threaten famous individuals or public politics. In practice, ordinary organisations can be targeted through voice fraud, brand impersonation, doctored evidence, and internal trust abuse.

Finally, some teams think the answer is to ban synthetic media outright. That is usually too blunt. Many legitimate uses exist. The better approach is controlled use, clear disclosure, and stronger authenticity checks where the stakes are high.

Risks and boundaries

The first boundary is that no organisation can restore universal trust in digital media by policy alone. As synthetic media quality improves, evidence handling has to become more procedural.

The second boundary is adoption. Provenance standards and content credentials are promising, but their value depends on ecosystem support across tools, platforms, and publishing chains. They help most where the content remains inside systems that preserve the metadata and signatures.

The third boundary is legal context. Rules vary by jurisdiction, sector, and use case. Some uses of synthetic media are plainly legitimate if disclosed properly. Others may raise privacy, consent, fraud, employment, copyright, platform, or election law issues. This article is not legal advice.

The practical risk boundary is therefore clear. Use extra verification wherever media could trigger money movement, security change, reputational crisis, or formal evidence handling. Treat raw realism as insufficient proof.

What to do next

Start with your approval processes, not your comms policy. Identify where voice, video, or image evidence can influence payment, account change, access reset, public response, or disciplinary action. Add independent verification to those steps.

Then define a synthetic media policy. State what your organisation may create, who may approve it, how disclosure should work, and which uses are prohibited. Include external agencies and suppliers if they create media on your behalf.

Next, adopt provenance and authenticity practices where feasible. If your teams create official media, look at tools that preserve content credentials or other signed provenance signals. Keep original files and audit trails for significant content.

After that, prepare for incident response. Decide who investigates suspected impersonation media, who speaks publicly, and how evidence is verified before action is taken. Deepfake incidents move quickly because doubt spreads quickly.

Finally, train staff on one simple principle: urgency plus realism is not proof. In a deepfake era, verification must travel faster than authority pressure.

FAQs

Is a deepfake always made with video?

No. Deepfakes can involve audio, still images, or video. Voice cloning is especially important for business fraud risk.

Are all AI-generated images deepfakes?

Not automatically. The term is most useful when synthetic or manipulated media creates a misleading impression of authenticity or of a real person, event, or source.

Can provenance prove a file is true?

Not fully. Provenance can help show origin, edit history, and signer identity, but it does not settle every question about context, interpretation, or whether all relevant content is present.

Is this mainly a public relations problem?

No. It is also a finance, security, identity, and governance issue because synthetic media can influence approvals and evidence handling.

Do detectors solve the problem?

They help, but should be treated as one signal among several. Process controls and verification steps are still essential.

Do we need to disclose all synthetic media we publish?

The answer depends on jurisdiction, sector, audience, and use case. Many organisations should assume clear disclosure is good practice even where the legal rule is still developing.

What is the most important immediate control?

Strengthen verification for any process where a believable voice, image, or video could trigger money movement, access change, or rapid public response.

Sources

  • Regulation (EU) 2024/1689, Artificial Intelligence Act (EUR-Lex). Primary. Formal deepfake definition, Article 50 transparency duties, provider marking requirements, and date of general application from 2 August 2026.

  • Content Credentials: C2PA Technical Specification (C2PA). Primary. Provenance and authenticity model, digitally signed claims, tamper-evident history, and the important limitation that provenance is a trust signal rather than a judgement of truth.

  • What constitutes a Deep Fake? The blurry line between legitimate processing and manipulation under the EU AI Act (arXiv). Secondary. Context on the definitional edge cases around manipulation, disclosure, and the difficulty of drawing clean boundaries around deepfake content.

  • Transparency as Architecture: Structural Compliance Gaps in EU AI Act Article 50 II (arXiv). Secondary. Support for the practical significance of Article 50, the August 2026 application date, and the gap between legal transparency duties and technical implementation.