对抗一致性约束的无监督域自适应绝缘子检测
李梅玉1, 李仕林1, 赵明1, 方正云2, 张亚飞3,4, 余正涛3,4(1.云南电网有限责任公司电力科学研究院, 昆明 650217;2.昆明理工大学国土资源工程学院, 昆明 650500;3.昆明理工大学信息工程与自动化学院, 昆明 650500;4.昆明理工大学云南省人工智能重点实验室, 昆明 650500) 摘 要
目的 绝缘子检测是输电线路智能巡维工作的重要组成部分,然而大多数情况仅能获得单一类型的绝缘子样本。将单一类型的绝缘子样本训练得到的模型直接用于其他类型的绝缘子检测,会由于训练数据与目标数据之间存在的域偏移导致其检测性能急剧下降。因此,提高模型的泛化能力以保持良好的检测性能显得尤为必要。为此,提出一种新颖的对抗一致性约束的无监督域自适应绝缘子检测算法。方法 对源域样本与目标域样本分别设计了两个不同的分类器,并将网络的预测结果与对应的绝缘子进行类别约束,使模型能够提取到不同类型绝缘子独有的特征。此外,在对抗学习过程中引入一个额外的分类器用于将源域中绝缘子特征与从目标域中预测到的目标物特征分到同一类别下,从而使模型能提取不同类型绝缘子共有的鲁棒性特征。结果 实验表明本文方法显著提高了模型的跨域检测性能。在glass→composite和composite→glass任务上的平均精度均值(mean average precision, mAP)分别达到55.1%和23.4%,优于主流的无监督域自适应目标检测方法。在公开数据集COCO(common objects in context)上的实验结果也较为优异,平均精度均值(mean average precision,mAP)达到61.5%。消融实验中,在glass→composite和composite→glass任务上,本文方法在基准性能上分别提升了11.5%和6.4%,表明了所提方法的有效性。结论 本文方法减少了不同类型绝缘子间的差异带来的域偏移,提升了模型在跨域绝缘子检测任务中的泛化能力,提高了输电线路巡维工作的绝缘子检测效率。同时,在COCO数据集上的普适性实验表明本文方法同样适用于其他不同类物体的检测并且性能优异。
关键词
Unsupervised domain adaptation insulator detection based on adversarial consistency constraints
Li Meiyu1, Li Shilin1, Zhao Ming1, Fang Zhengyun2, Zhang Yafei3,4, Yu Zhengtao3,4(1.Electric Power Research Institute of Yunnan Power Grid Co., Ltd., Kunming 650217, China;2.College of Land Resource Engineering, Kunming University of Science and Technology, Kunming 650500, China;3.College of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China;4.Yunnan Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology, Kunming 650500, China) Abstract
Objective Insulator is widely used in overhead transmission line nowadays. It is a unique insulation device which can withstand voltage and mechanical stress. In order to reduce the potential safety hazards caused by insulator failures, overhead transmission lines need to be inspected regularly. It is necessary to detect insulators from the inspection images quickly and effectively in order to locate and analyze the defects. The electrical grid insulators applications are mainly divided into two categories: glass insulators and composite insulators. The color and shape are quite different for the two types of insulators, which results in a severe domain bias in the feature space. In most cases, we can only obtain the data for a single type of insulator and train the model by them. The detection of other types of insulators will cause the performance of the trained model to drop sharply due to the domain bias between the source data and the target data. Hence, it is required to improve the generalization ability of the model to maintain good detection performance. Unsupervised domain adaptation is a widely used method for cross-domain detection and recognition. This method uses labeled samples in the source domain and unlabeled samples in the target domain in the training process. A domain-invariant (or domain-aligned) feature representation learning method can effectively release the performance degradation caused by domain bias. Our demonstration illustrates an unsupervised domain adaptation insulator detection method to improve the efficiency of transmission line intelligent inspection and maintenance. Method In order to improve the model’s generalization ability for insulators in the target domain in complicated transmission line images without the target domain labels, an unsupervised domain adaptation insulator detection algorithm is harnessed based on adversarial consistency constraint. The proposed algorithm is divided into two stages including pre-training and adversarial learning. In the pre-training stage, the labeled source domain samples and unlabeled target domain samples are fed into the network to extract features. The extracted two sets of features are input into two classification networks. The unique feature representation of two different types of insulators is obtained based on constraining the two classifiers with binary cross-entropy loss. The feature encoder and two classifiers are trained as well. In the process of adversarial consistency learning, an extra classifier is involved to obtain robustness feature representation. The features obtained by the source domain and target domain samples through the network are sent to a new initialized classification network, and the classifier is trained separately through binary cross-entropy to make the backbone unable to correctly classify the two features. The classifier is then fixed to train the backbone network, and the classification results of the two groups of features are limited to the same label. The network can extract the consistent and robust features of different types of insulators. Result This demonstration illustrates that our method significantly improves the cross-domain insulator detection performance, and the mean average precision (mAP) reaches 55.1% and 23.4% on the two tasks of glass→composite and composite → glass, respectively. The analyzed result of our method is qualified on the public dataset common objects in context (COCO). The mAP reaches 61.5%, which verifies our illustrated generality and extensibility. In the ablation study, the proposed mAP achieves 11.5% and 6.4% in benchmark performance improvement on the two tasks of glass →c omposite and composite → glass, respectively. Conclusion This method reduces the discrepancy-derived domain bias amongst various types of insulators. The generalization of the model is improved in cross-domain insulator detection tasks. Our method can improve the efficiency of the insulator detection in the transmission line inspection. The demonstrated results indicate that our method optimized unsupervised domain adaptation object detection methods. Both of the proposed loss functions can significantly improve the performance of the benchmark, which illustrates that the model is capable of learning a robustness feature representation. The COCO dataset is demonstrated for further verification.
Keywords
unsupervised domain adaptation domain bias insulator detection adversarial consistency robust feature
|