Current Issue Cover
AIGC视觉内容生成与溯源研究进展

刘安安1, 苏育挺1, 王岚君1, 李斌2, 钱振兴3, 张卫明4, 周琳娜5, 张新鹏3, 张勇东4, 黄继武2, 俞能海6(1.天津大学电气自动化与信息工程学院, 天津 300072;2.深圳大学电子信息与工程学院, 深圳 518060;3.复旦大学计算机科学技术学院, 上海 200438;4.中国科学技术大学信息科学技术学院, 合肥 230026;5.北京邮电大学网络空间安全学院, 北京 100876;6.中国科学技术大学网络空间安全学院, 合肥 230027)

摘 要
随着数字媒体与创意产业的快速发展,人工智能生成内容(artificial intelligence generated content,AIGC)技术以其在视觉内容生成中的创新应用而逐渐受到关注。本文旨在围绕 AIGC 视觉内容生成与溯源研究进展深入研讨。首先,针对图像生成技术进行探讨,从基于生成式对抗网络的传统方法出发,系统地分析了基于生成式对抗网络、自回归模型和扩散概率模型的最新进展。接着,深入探讨可控图像生成技术,突出了通过布局、线稿等附加信息以及基于视觉参考的方法来为创作者提供精确控制的技术现状。随着图像生成技术的革新和应用,生成图像的安全性问题逐渐浮现。而预先审核和过滤的技术手段已难以满足实际需求,故亟需实现生成内容的溯源来进行监管。因此,本文进而对生成图像溯源技术进行研讨,并聚焦水印技术在确保生成内容可靠性和安全性方面的应用。依据水印嵌入的流程节点,首先将现有的水印相关的生成图像溯源方法归为无水印嵌入的生成图像溯源、水印前置嵌入的生成图像溯源、水印后置嵌入的生成图像溯源以及联合生成的生成图像溯源并进行详细分析,然后介绍针对生成图像的水印攻击研究现状,最后对生成图像溯源技术进行总结和展望。鉴于视觉内容生成在质量和安全上的挑战,旨在为研究者提供一个视觉内容生成与溯源的系统研究视角,以促进数字媒体创作环境的安全与可信,并引导未来相关技术的发展方向。
关键词
Review on the progress of the AIGC visual content generation and traceability

Liu Anan1, Su Yuting1, Wang Lanjun1, Li Bin2, Qian Zhenxing3, Zhang Weiming4, Zhou Linna5, Zhang Xinpeng3, Zhang Yongdong4, Huang Jiwu2, Yu Nenghai6(1.School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China;2.College of Electronics and Information Engineering, Shenzhen University, Shenzhen 518060, China;3.School of Computer Science, Fudan University, Shanghai 200438, China;4.School of Information Science and Technology, University of Science and Technology of China, Hefei 230026, China;5.School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing 100876, China;6.School of Cyber Science and Technology, University of Science and Technology of China, Hefei 230027, China)

Abstract
In the contemporary digital era,which is characterized by rapid technological advancements,multimedia content creation,particularly in visual content generation,has become an integral part of modern societal development. The exponential growth of digital media and the creative industry has attracted attention to artificial intelligence generated content(AIGC)technology. The groundbreaking applications of AIGC in visual content generation not only have equipped multimedia creators with novel tools and capabilities but also have delivered substantial benefits across diverse domains, which span from the realms of cinema and gaming to the immersive landscapes of virtual reality. This review comprehensive introduces the profound advancements within AIGC technology. Our particular emphasis is on the domain of visual content generation and its critical facet of traceability. Initially,our discussions trace the evolutionary path of image generation technology,from its inception within generative adversarial networks(GANs)to the latest advancements in Transformer auto-regressive models and diffusion probability models. This progression unveils a remarkable leap in the quality and capability of image generation,which underscores the rapid evolution of this field. This evolution has transitioned from its nascent stages to an era characterized by explosive growth. First,we delve into the development of GANs,encompassing their evolution from text-conditioned methods to sophisticated techniques for style control and the development of largescale models. This type of technology pioneered the text-to-image generation. GANs can further improve their performance by expanding network parameters and dataset size due to their strong scalability. Furthermore,we explore the emergence of Transformer-based auto-regressive models,such as DALL·E and CogView,which have heralded a new epoch in the domain of image generation. The basic strategy of autoregressive models is to first use the Transformer structure to predict the feature sequence of images based on other conditional feature sequences such as text and sketches. Then,it uses a specially trained decoding network to decode these feature sequences into a complete image. They can generate realistic images based on the large-scale parameters. In addition,our discourse delves into the burgeoning interest surrounding diffusion probability models,which are renowned for their stable training methods and their ability to yield high-quality outputs. The diffusion models first adopt an iterative and random process to simulate the gradual transformation of the observed data into a known noise distribution. Then,they reconstruct the original data in the opposite direction from the noise distribution. This random process based on stochastic approach provides a more stable training process,while it also demonstrates impressive results in terms of generated quality and diversity. As the development of AIGC technology continues to advance,it encounters challenges,such as the enhancement in content quality and the need of precise control to align with specific requisites. Within this context,this review conducts a thorough exploration of controllable image generation technology,which is a pivotal research domain that strives to furnish meticulous control over the generated content. This achievement is facilitated through the integration of supplementary elements,such as intricate layouts,detailed sketches, and precise visual references. This approach empowers creators to preserve their artistic autonomy while upholding exacting standards of quality. One notable facet that has garnered considerable academic attention is the utilization of visual references as a mechanism to enable the generation of diverse styles and personalized outcomes by incorporating user-provided visual elements. This review underscores the profound potential inherent in these methodologies,which illustrates their transformative role across domains such as digital art and interactive media. The development of these technologies introduces new horizons in digital creativity. However,it presents profound challenges,particularly in the domain of image authenticity and the potential for malevolent misuse. These risks are exemplified by the creation of deep fakes or the proliferation of fake news. These challenges extend far beyond mere technical intricacies;they encompass substantial risks pertaining to individual privacy,security,and the broader societal implications of eroding public trust and social stability. In response to these formidable challenges,watermark-related image traceability technology has emerged as an indispensable solution. This technology harnesses the power of watermarking techniques to authenticate and verify AI-generated images, which safeguards their integrity. Within the pages of this review,we meticulously categorize these watermarking techniques into distinct types:watermark-free embedding,watermark pre-embedding,watermark post-embedding,and joint generation methods. First,we introduce the watermark-free embedding methods,which treat the generated traces left during model generation as fingerprints. The inherent fingerprint information is used to achieve model attribution of generated images and achieve traceability purposes. Second,the watermark pre-embedding methods aim to embed the watermark into input training data such as noise and image. Another aim is to use the embedded watermark data to train the generation model,which can also introduce traceability information in the generated image. Third,the watermark post-embedding methods divide the process of generating watermark images into two stages:image generation and watermark embedding. Watermark embedding is performed after image generation. Finally,the joint generation methods aim to achieve adaptive embedding of watermark information during the image generation process,minimize damage to the image generation process when fusing with image features,and ultimately generate images carrying watermarks. Each of these approaches plays a pivotal role in the verification of traceability across diverse scenarios,which offers a robust defense against potential misuses of AI-generated imagery. In conclusion,while AIGC technology offers promising new opportunities in visual content creation,it simultaneously causes significant challenges regarding the security and integrity of generated content. This comprehensive review covers the breadth of AIGC technology,which starts from an overview of existing image generation technologies,such as GANs,auto-regressive models,and diffusion probability models. It then categorizes and analyzes controllable image generation technology from the perspectives of additional conditions and visual examples. In addition,the review focuses on watermark-related image traceability technology,discusses various watermark embedding techniques and the current state of watermark attacks on generated images,and provides an extensive overview and future outlook of generation image traceability technology. The aim is to offer researchers a detailed,systematic,and comprehensive perspective on the advancements in AIGC visual content generation and traceability. This study deepens the understanding of current research trends,challenges,and future directions in this rapidly evolving field.
Keywords

订阅号|日报