ARMOR++: Agent-Orchestration Framework for Cross-Domain Adversarial Attacks on Deepfake Detection

This paper addresses the reliability degradation of deepfake detectors in black-box adversarial transfer by introducing ARMOR++, a novel framework that leverages multi-agent orchestration. Existing methods lack semantic awareness and struggle to maintain effectiveness under strict zero-query constraints, especially when transferring from convolutional surrogate models to Transformer-based target models. ARMOR++ employs Qwen2.5-VL to provide spatial semantic priors, while a Qwen3 large language model orchestrates primitive selection, adaptive hyperparameter reparameterization, and entropy-regularized perturbation mixing. The framework integrates five complementary attack primitives—dense optimization, saliency-based methods, spatial transformations, frequency-domain perturbations, and block structure modifications—targeting heterogeneous inductive biases. Experiments on the AADD-2025 benchmark demonstrate that ARMOR++ significantly outperforms both agent-based and non-agent baselines in both low-quality and high-quality image regimes, achieving remarkable improvements in blind target attack success rates and exposing critical reliability gaps in current detection deployments.

Background and Context

The rapid evolution of generative artificial intelligence has precipitated a severe crisis in digital content integrity, with deepfake technology posing an unprecedented threat to information security and social trust. As synthetic media becomes increasingly indistinguishable from authentic footage, the role of automated deepfake detection systems has become critical for maintaining the veracity of online information ecosystems. However, the operational robustness of these detection models is frequently compromised when subjected to adversarial attacks in black-box environments. The fundamental vulnerability lies in the fact that many current detection architectures rely heavily on fragile, architecture-specific forensic cues, such as subtle texture inconsistencies or compression artifacts, which are easily disrupted by targeted perturbations. Consequently, when faced with adversarial examples generated from different sources or using different synthesis methods, these detectors often fail to generalize, leading to significant drops in reliability.

Traditional adversarial transfer attacks, which aim to generate perturbations effective against unknown target models using only surrogate models, have struggled to maintain high efficacy under strict zero-query constraints. This limitation is particularly pronounced when attempting to transfer attacks from convolutional neural network (CNN) surrogates to transformer-based target models. The heterogeneous inductive biases between these two architectural families mean that perturbations optimized for CNNs often fail to trigger misclassifications in transformers, resulting in a steep performance decay during transfer. Existing methods largely lack semantic awareness, treating images as mere grids of pixels rather than complex structures with meaningful spatial relationships. This absence of high-level understanding prevents the generation of perturbations that are both imperceptible to human observers and robust across diverse model architectures, leaving a critical gap in the evaluation of real-world detection security.

To address these systemic weaknesses, the ARMOR++ framework has been introduced as a novel, robust multi-agent orchestration system designed specifically for high-transferability deepfake evasion. Unlike previous approaches that rely on static optimization procedures, ARMOR++ leverages the reasoning capabilities of large language models (LLMs) and the perceptual strengths of vision-language models (VLMs) to dynamically construct and refine adversarial attacks. By integrating semantic priors with adaptive optimization strategies, the framework aims to overcome the limitations of semantic blindness and poor transfer efficiency inherent in prior methods. This approach not only provides a more rigorous benchmark for evaluating the true robustness of detection systems but also highlights the urgent need for defense mechanisms that can withstand sophisticated, multi-domain adversarial strategies.

Deep Analysis

At its core, ARMOR++ operates as a协同 multi-agent system that maximizes attack transferability through the synergistic combination of diverse attack primitives. The process begins with the extraction of spatial semantic priors using the Qwen2.5-VL vision-language model. This step is pivotal, as it provides a high-level understanding of the image content, ensuring that the generated adversarial noise respects the natural attributes and semantic structure of the input. By grounding the perturbation process in semantic context, the framework avoids generating artifacts that might be easily filtered out by detectors trained on natural image distributions. This semantic guidance serves as a foundational layer upon which more complex adversarial strategies are built, allowing the system to distinguish between meaningful content and noise that can be safely manipulated.

Following the semantic extraction phase, the Qwen3 large language model acts as the central orchestrator, coordinating the actions of various sub-agents to optimize the attack strategy. The LLM is responsible for primitive selection, adaptive hyperparameter reparameterization, and entropy-regularized perturbation mixing. This dynamic adjustment mechanism allows the system to flexibly tune the intensity and direction of the attack based on the specific characteristics of the current sample. For instance, if a particular perturbation type begins to degrade image quality without improving attack success, the LLM can reparameterize the hyperparameters to shift the focus to a more effective primitive. This intelligent coordination ensures that the attack remains efficient and effective, adapting in real-time to the feedback from the surrogate models.

The framework integrates five complementary attack primitives, each targeting different aspects of the detection model's decision-making process. These include dense optimization for fine-grained pixel-level adjustments, saliency-based methods to focus on regions most influential to the detector, spatial transformations to disrupt geometric consistency, frequency-domain perturbations to exploit spectral vulnerabilities, and block structure modifications to alter global image properties. By combining these diverse techniques, ARMOR++ creates a comprehensive attack surface that challenges the heterogeneous inductive biases of various detector architectures. This multi-pronged approach ensures that even if a detector is robust against one type of perturbation, it is likely to be vulnerable to another, thereby significantly enhancing the overall transferability of the attack.

Industry Impact

The empirical validation of ARMOR++ was conducted on the AADD-2025 benchmark, a comprehensive dataset designed to test deepfake detection systems under varying conditions of image quality and complexity. The results demonstrate that ARMOR++ significantly outperforms both agent-based and non-agent baselines in both low-quality and high-quality image regimes. Notably, the framework achieved remarkable improvements in blind target attack success rates (ASR), indicating its ability to effectively bypass detectors without any prior knowledge of their internal parameters. This substantial gain in performance underscores the inadequacy of current detection deployments when faced with advanced, multi-agent-driven adversarial attacks. The findings suggest that many widely used detection systems may offer a false sense of security, as their reported robustness in controlled, white-box settings does not translate to resilience in real-world, black-box scenarios.

Ablation studies further elucidate the specific contributions of each component within the ARMOR++ framework. The removal of the semantic prior extraction module or the LLM coordination mechanism leads to a marked decline in attack effectiveness, confirming that both semantic awareness and intelligent orchestration are critical for high-transferability attacks. Statistical analysis reveals that ARMOR++ not only achieves higher average performance but also exhibits lower variance across different detector types, indicating a high degree of stability and generalization. This consistency is particularly concerning for industry stakeholders, as it implies that the framework can reliably compromise a wide range of detection systems, regardless of their underlying architecture or training data.

These findings have profound implications for the deployment of deepfake detection technologies in industrial settings. The vulnerability exposed by ARMOR++ highlights the urgent need for more comprehensive robustness evaluations that go beyond traditional white-box or simple black-box tests. Industry leaders must recognize that static defenses are insufficient against dynamic, adaptive attacks. The framework serves as a wake-up call for organizations relying on AI-driven content moderation, emphasizing the necessity of integrating multi-domain, multi-primitive defense mechanisms into their security architectures. Failure to address these vulnerabilities could result in significant reputational damage and legal liabilities, particularly in sectors where content integrity is paramount, such as finance, journalism, and national security.

Outlook

The development of ARMOR++ marks a significant shift in the paradigm of adversarial machine learning, moving from static, single-primitive attacks to dynamic, multi-agent orchestration. This advancement encourages the research community to explore deeper connections between semantic features and model robustness. Future research should focus on developing detection architectures that are inherently resistant to semantic-aware perturbations, rather than relying on post-hoc defenses that can be easily circumvented. This may involve integrating semantic consistency checks into the detection pipeline or employing self-supervised learning techniques to capture more robust representations of authentic content. Additionally, the use of large language models for defense orchestration could be explored, potentially creating a counter-play where defenders also leverage AI-driven reasoning to detect and mitigate adversarial patterns.

For the open-source community, ARMOR++ provides a new paradigm for multi-agent collaboration, demonstrating how the reasoning capabilities of LLMs can be harnessed to optimize complex adversarial generation processes. This approach offers valuable insights for other security domains, such as network intrusion detection or malware analysis, where automated, adaptive attack generation could be used to stress-test defensive systems. By providing a transparent and reproducible framework, ARMOR++ facilitates the development of more rigorous evaluation standards, pushing the industry toward a more proactive stance on security. Researchers are encouraged to build upon this work by investigating the limits of LLM-driven adversarial strategies and exploring hybrid approaches that combine multiple AI modalities for enhanced robustness.

Ultimately, the implications of ARMOR++ extend beyond technical metrics, influencing the broader discourse on AI safety and trustworthiness. The framework underscores the critical importance of designing AI systems with security as a foundational principle, rather than an afterthought. As deepfake technology continues to evolve, so too must the defenses against it. The transition from passive detection to active robustness design is essential for building a credible AI content ecosystem. Stakeholders must collaborate to establish industry-wide standards for adversarial robustness, ensuring that detection systems can withstand the sophisticated attacks of tomorrow. Only through such proactive and comprehensive efforts can the integrity of digital information be preserved in the face of advancing generative technologies.

Sources