上海交通大学学报(英文版) ›› 2017, Vol. 22 ›› Issue (3): 291-302.doi: 10.1007/s12204-017-1835-3

• • 上一篇    下一篇

Semi-Supervised Learning in Large Scale Text Categorization

XU Zewen1,2 (许泽文), LI Jianqiang1,2,3,4* (李建强), LIU Bo1 (刘博),BI Jing1 (毕敬), LI Rong1 (李蓉), MAO Rui3,4 (毛睿)   

  1. (1. School of Software Engineering, Beijing University of Technology, Beijing 100124, China; 2. Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing 100124, China; 3. Guangdong Key Laboratory of Popular High Performance Computers, Shenzhen University, Shenzhen 518060, Guangdong, China; 4. Shenzhen Key Laboratory of Service Computing and Applications, Shenzhen University, Shenzhen 518060, Guangdong, China)
  • 出版日期:2017-06-02 发布日期:2017-06-04
  • 通讯作者: LI Jianqiang(李建强) E-mail:lijianqiang@bjut.edu.cn

Semi-Supervised Learning in Large Scale Text Categorization

XU Zewen1,2 (许泽文), LI Jianqiang1,2,3,4* (李建强), LIU Bo1 (刘博),BI Jing1 (毕敬), LI Rong1 (李蓉), MAO Rui3,4 (毛睿)   

  1. (1. School of Software Engineering, Beijing University of Technology, Beijing 100124, China; 2. Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing 100124, China; 3. Guangdong Key Laboratory of Popular High Performance Computers, Shenzhen University, Shenzhen 518060, Guangdong, China; 4. Shenzhen Key Laboratory of Service Computing and Applications, Shenzhen University, Shenzhen 518060, Guangdong, China)
  • Online:2017-06-02 Published:2017-06-04
  • Contact: LI Jianqiang(李建强) E-mail:lijianqiang@bjut.edu.cn

摘要: The rapid development of the Internet brings a variety of original information including text information, audio information, etc. However, it is difficult to find the most useful knowledge rapidly and accurately because of its huge number. Automatic text classification technology based on machine learning can classify a large number of natural language documents into the corresponding subject categories according to its correct semantics. It is helpful to grasp the text information directly. By learning from a set of hand-labeled documents, we obtain the traditional supervised classifier for text categorization (TC). However, labeling all data by human is labor intensive and time consuming. To solve this problem, some scholars proposed a semi-supervised learning method to train classifier, but it is unfeasible for various kinds and great number of Web data since it still needs a part of hand-labeled data. In 2012, Li et al. invented a fully automatic categorization approach for text (FACT) based on supervised learning, where no manual labeling efforts are required. But automatically labeling all data can bring noise into experiment and cause the fact that the result cannot meet the accuracy requirement. We put forward a new idea that part of data with high accuracy can be automatically tagged based on the semantic of category name, then a semi-supervised way is taken to train classifier with both labeled and unlabeled data, and ultimately a precise classification of massive text data can be achieved. The empirical experiments show that the method outperforms the supervised support vector machine (SVM) in terms of both F1 performance and classification accuracy in most cases. It proves the effectiveness of the semi-supervised algorithm in automatic TC.

关键词: text data mining, semi-supervised, automatic tagging, classifier

Abstract: The rapid development of the Internet brings a variety of original information including text information, audio information, etc. However, it is difficult to find the most useful knowledge rapidly and accurately because of its huge number. Automatic text classification technology based on machine learning can classify a large number of natural language documents into the corresponding subject categories according to its correct semantics. It is helpful to grasp the text information directly. By learning from a set of hand-labeled documents, we obtain the traditional supervised classifier for text categorization (TC). However, labeling all data by human is labor intensive and time consuming. To solve this problem, some scholars proposed a semi-supervised learning method to train classifier, but it is unfeasible for various kinds and great number of Web data since it still needs a part of hand-labeled data. In 2012, Li et al. invented a fully automatic categorization approach for text (FACT) based on supervised learning, where no manual labeling efforts are required. But automatically labeling all data can bring noise into experiment and cause the fact that the result cannot meet the accuracy requirement. We put forward a new idea that part of data with high accuracy can be automatically tagged based on the semantic of category name, then a semi-supervised way is taken to train classifier with both labeled and unlabeled data, and ultimately a precise classification of massive text data can be achieved. The empirical experiments show that the method outperforms the supervised support vector machine (SVM) in terms of both F1 performance and classification accuracy in most cases. It proves the effectiveness of the semi-supervised algorithm in automatic TC.

Key words: text data mining, semi-supervised, automatic tagging, classifier

中图分类号: