Semi-supervised learning based Gaussian processes for
hyperspectral image classification
YAO Fu-tian1,2, QIAN Yun-tao1, LI Ji-ming1
1.College of Computer Science and Technology, Zhejiang University, Hangzhou 310029, China;
2. Department of Computer Science and Technology, China Jiliang University, Hangzhou 310018, China
A new classification method based on spatial semi-supervised Gaussian processes (SSGP) was proposed to address the problem of low hyperspectral imagery classification performance caused by a small number of labeled training samples. As the feature space of a hyperspectral imagery satisfies the assumption of manifold distribution, a lot of unlabeled samples will make the feature space denser so that the local spatial character can be exploited more precisely and the classification accuracy and generality can be improved. In SSGP, the constraint of spatial neighborhood was imposed into the kernel function of Gaussian process, so the spatial correlations of labeled and unlabeled samples can be embedded in the kernel function. SSGP not only raises the classification performance, but also is easy to build and realize. Experimental results show that SSGP method is very good at classification of hyperspectral images in terms of classification accuracy and stability in the case of small size of labeled training samples.
YAO Fu-tian, QIAN Yun-tao, LI Ji-ming. Semi-supervised learning based Gaussian processes for
hyperspectral image classification. J4, 2012, 46(7): 1295-1300.
[1] VATSAVAI R, SHEKHAR S, BURK T. A semisupervised learning method for remote sensing data mining [C]∥17th IEEE International Conference on Tools with Artificial Intelligence. Hongkong: IEEE, 2005: 5-211.
[2] GOMEZCHOVA L, CALPE J, CAMPSVALLS G, et al. Semisupervised classification method for hyperspectral remote sensing images [C]∥International Geoscience and Remote Sensing Symposium. Touluse, France: [s. n.],2003: 1776-1778.
[3] BLUM A, MITCHELL T. Combining labeled and unlabeled data with cotraining [C]∥Proceedings of the 11th Annual Conference on Computational Learning Theory. Madison, USA: [s. n.], 1998: 92-100.
[4] 赵鹏飞, 钱沄涛, 郑文斌, 等. 基于图像与文本特征的在线生物文献MRI图像库构建[J]. 中国生物医学工程学报, 2010, 29(5):697-703.
ZHAO Pengfei, QIAN Yuntao, ZHENG Wenbin, et al. MRI database construction using image and text features extracted from online biological literature [J]. Chinese Journal of Biomedical Engineering, 2010, 29(5): 697-703.
[5] SHAHSHAHANI B, LANDGREBE D. The effect of unlabeled samples in reducing the small sample size problem and mitigating the Hughes phenomenon [J]. IEEE Transactions on Geoscience and Remote Sensing, 1994, 32(5): 1087-1095.
[6] SINDHWANI V, CHU W, KEERTHI S. Semisupervised Gaussian process classifiers [C] ∥ Proceedings of the 20th International Joint Conference on Artificial Intelligence. Hyderabad, India: [s. n.], 2007: 1059-1064.
[7] MELGANI F, BRUZZONE L. Classification of hyperspectral remote sensing images with support vector machines [J]. IEEE Transactions on Geoscience and Remote Sensing, 2004, 42(8): 1778-1790.
[8] 姚伏天, 钱沄涛. 用于高光谱遥感图像分类的空间约束高斯过程方法[J]. 南京大学学报:自然科学版, 2009, 45(5): 665-670.
YAO Futian, QIAN Yuntao. A spatial Gaussian process method for hyperspectral remote sensing imagery classification [J]. Journal of Nanjing University: Natural Sciences, 2009, 45(5): 665-670.
[9] CHAPELLE O, SCHOLKOPF B, ZIEN A. Semisupervised learning [M]. Cambridge: MIT, 2006: 229-231.
[10] RASMUSSEN C, WILLIAMS I. Gaussian processes for machine learning [M]. Cambridge: MIT, 2006: 20-26.
[11] SINDHWANI V, NIYOGI P, BELKIN M. Beyond the point cloud: from transductive to semisupervised learning [C]∥Proceedings of the 22nd International Conference on Machine Learning. Bonn, Germany: [s. n.], 2005: 824-831.
[12] BELKIN M, NIYOGI P, SINDHWANI V. Manifold regularization: a geometric framework for learning from labeled and unlabeled examples [J]. Journal of Machine Learning Research, 2006, 7(7): 2339-2434.