| Image Processing Algorithms |
|
|
|
|
| Robust image watermarking network algorithm based on effective neural architecture search |
| WANG Xiaochao1, ZHANG Lei1, YU Yuanqiang2, HU Kun3, HU Jianpiang4 |
1.School of Mathematical Science,Tiangong University, Tianjin 300387, China
2.College of Intelligence and Computing, Tianjin University, Tianjin 300350, China
3.University of Chinese Academy of Science, Beijing 100049, China
4.School of Science, Northeast Electric Power University, Jilin 132012, Jilin Province, China |
|
|
|
Abstract In order to solve the problem of large computation and model redundancy when applying deep learning to image watermarking,and to improve the robustness of image watermarking algorithm against noise,rotation,and cropping attacks,this paper adopts the robust image neural architecture search (NAS). Multinomial distribution learning for effective the neural architecture search watermarking network algorithm based on algorithm to find the optimal network structure in the preset search space,and performs efficient embed-ding and robust extraction of image watermarks. Firstly,the linearly connected fully convolutional layers in the sub-network are changed to independent neural unit structure,then we parameterize the connection of nodes in the structural unit,and set the search space for each neuron operation in the structural unit. Secondly,after completing a batch of data set training each time,the probabilities of being selected for the next operation are dynamically updated according to the number of samples and the average loss function value.Finally,the network structure after the search is retrained,which reduces the model parameters by more than 92% comparing with original model as well as the model training time. Since the obtained network structure is more compact,the proposed algorithm can achieve higher performance and better experimental results.Compared to the original network,the newly-developed network relies less on spatial information when hiding images.A larger number of experiments are performed to illustrate the advantages of the proposed algorithm including resisting salt and pepper noise,rotation and flipping,and removing pixel rows (columns) and other attacks on the CIFAR-10 data set; and has significant advantages against attacks of median filtering,Gaussian filtering,JPEG compression,and cropping on ImageNet,especially for the random removal of rows (columns) and salt and pepper noise.
|
|
Received: 11 September 2020
Published: 20 May 2021
|
|
|
|
Cite this article:
WANG Xiaochao, ZHANG Lei, YU Yuanqiang, HU Kun, HU Jianpiang. Robust image watermarking network algorithm based on effective neural architecture search. Journal of Zhejiang University (Science Edition), 2021, 48(3): 261-269.
URL:
https://www.zjujournals.com/sci/EN/Y2021/V48/I3/261
|
基于快速神经网络架构搜索的鲁棒图像水印网络算法
为解决深度学习在图像水印算法中计算量大且模型冗余的问题，提高图像水印算法在抵抗噪声、旋转和剪裁等攻击时的鲁棒性，提出基于快速神经网络架构搜索（neural architecture search，NAS）的鲁棒图像水印网络算法。通过多项式分布学习快速神经网络架构搜索算法，在预设的搜索空间中搜索最优网络结构，进行图像水印的高效嵌入与鲁棒提取。首先，将子网络中线性连接的全卷积层设置为独立的神经单元结构，并参数化表示结构单元内节点的连接，预先设定结构单元内每个神经元操作的搜索空间；其次，在完成一个批次的数据集训练后，依据神经元操作中的被采样次数和平均损失函数值动态更新概率；最后，重新训练搜索完成的网络。水印网络模型的参数量较原始网络模型缩减了92%以上，大大缩短了模型训练时间。由于搜索得到的网络结构更为紧凑，本文算法具有较高的时间性能和较好的实验效果，在隐藏图像时，对空域信息的依赖比原始网络更少。对改进前后的2个网络进行了大量鲁棒性实验，对比发现，本文算法在CIFAR-10数据集上对抵抗椒盐噪声和旋转、移除像素行（列）等攻击优势显著；在ImageNet数据集上对抵抗椒盐高斯噪声、旋转、中值滤波、高斯滤波、JPEG压缩、裁剪等攻击优势显著，特别是对随机移除行（列）和椒盐噪声有较强的鲁棒性。
关键词：
图像水印,
多项式分布学习,
神经网络架构搜索（NAS）
|
|
1 顾宇鑫，马小虎. 采用稀疏变换和拉普拉斯金字塔的数字水印算法［J］. 计算机辅助设计与图形学学报，2018，30（5）：901-910. GU Y X，MA X H. Digital watermarking algorithm using sparse transform and Laplace pyramid［J］.Journal of Computer Aided Design & Computer Graphics，2018，30（5）：901-910.
2 丁玮，闫伟齐，齐东旭. 基于Arnold变换的数字图像置乱技术［J］. 计算机辅助设计与图形学学报，2001，13（4）：338-341. DING W，YAN W Q，QI D X.Digital image scrambling technology based on Arnold transformation［J］.Journal of Computer-Aided Design & Computer Graphics，2001，13（4）：338-341.
3 VERMA V S，BHARDWAJ A，JHA R K. A new scheme for watermark extraction using combined noise-induced resonance and support vector machine with PCA based feature reduction［J］. Multimedia Tools and Applications，2019，78（16）：23203-23224. DOI：10.1007/s11042-019-7599-z
4 SUN L，XU J，LIU S，et al. A robust image watermarking scheme using Arnold transform and BP neural network［J］.Neural Computing and Applications，2018，30（8）：2425-2440. DOI：10.1007/s00521-016-2788-4
5 CHEN J，KANG X，LIU Y，et al. Median filtering forensics based on convolutional neural networks［J］.IEEE Signal Processing Letters，2015，22（11）：1849-1853. DOI：10.1109/lsp.2015.2438008
6 MUN S M，NAM S H，JANG H，et al. Finding robust domain from attacks：A learning framework for blind watermarking［J］. Neurocomputing，2019，337：191-202. DOI：10.1016/j.neucom.2019.01.067
7 BALUJA S. Hiding images within images［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence，2020，42（7）：1685-1697. DOI：10.1109/tpami.2019.2901877
8 ELSKEN T，METZEN J H，HUTTER F. Neural architecture search：A survey［J］. Journal of Machine Learning Research，2019，20：1-21.
9 ZOPH B，VASUDEVAN V，SHLENS J，et al.Learning transferable architectures for scalable image recognition［C］//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City：IEEE，2018：8697-8710. DOI：10.1109/cvpr.2018.00907
10 PHAM H，GUAN M，ZOPH B，et al. Efficient neural architecture search via parameters sharing［C］//International Conference on Machine Learning.Stockholm：IMLS，2018：4095-4104.
11 CAI H，YANG J，ZHANG W，et al.Path-level network transformation for efficient architecture search［C］//International Conference on Machine Learning. Stockholm：IMLS，2018：678-687.
12 XIE L，YUILLE A. Genetic cnn［C］//Proceedings of the IEEE International Conference on Computer Vision.Venice：IEEE，2017：1379-1388. DOI：10.1109/iccv.2017.154
13 REAL E，AGGARWAL A，HUANG Y，et al.Regularized evolution for image classifier architecture search［C］//Proceedings of the AAAI Conference on Artificial Intelligence.Hawaiian：AAAI，2019：4780-4789. DOI：10.1609/aaai.v33i01.33014780
14 LIU H X，KAREN S，YIMING Y.Darts：Differentiable architecture search［C］//International Conference on Learning Representations.New Orleans：ICLR，2019：1-13.
15 ZHENG X W，JI R R，TANG L，et al. Multinomial distribution learning for effective neural architecture search［C］//The IEEE International Conference on Computer Vision，Los Angeles：IEEE，2019：1304-1313. DOI：10.1109/ICCV.2019.00139
16 HUANG G，LI Y X，PLEISS G，et al. Snapshot ensembles：Train 1，get M for free［C］// International Conference on Learning Representations. Toulon：ICLR，2017：1-14. DOI：10.1109/robio.2017.8324553
17 LI X，CAI J. Robust transmission of JPEG2000 encoded images over packet loss channels［C］//2007 IEEE International Conference on Multimedia and Expo. Beijing：IEEE，2007：947-950.
18 THOMOS N，BOULGOURIS N V，STRINTZIS M G. Optimized transmission of JPEG2000 streams over wireless channels［J］. IEEE Transactions on Image Processing，2005，15（1）：54-67.
19 WANG Z，BOVIK A C，SHEIKH H R，et al. Image quality assessment：from error visibility to structural similarity［J］.IEEE Transactions on Image Processing，2004，13（4）：600-612. DOI：10.1109/tip.2003.819861
20 ZHANG K，ZUO W，ZHANG L. FFDNet：Toward a fast and flexible solution for CNN-based image denoising［J］.IEEE Transactions on Image Processing，2018，27（9）：4608-4622. DOI：10.1109/tip.2018.2839891
21 GUO S，YAN Z，ZHANG K，et al.Toward convolutional blind denoising of real photographs［C］//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Long Beach：IEEE，2019：1712-172. DOI： 10.1109/cvpr.2019.00181 |
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
