Semantic Entity Recognition and Relation Construction Method for Assembly Process Document

doi:10.1007/s12204-022-2474-x

Abstract

Abstract: Assembly process documents record the designers’ intention or knowledge. However, common knowledge extraction methods are not well suitable fo assembly process documents, because of its tabular form and unstructured natural language texts. In this paper, an assembly semantic entity recognition and relation construction method oriented to assembly process documents is proposed. First, the assembly process sentences are extracted from the table through concerned region recognition and cell division, and they will be stored as a key-value object file. Then, the semantic entities in the sentence are identified through the sequence tagging model based on the specific attention mechanism for assembly operation type. The syntactic rules are designed for realizing automatic construction of relation between entities. Finally, by using the self-constructed corpus, it is proved that the sequence tagging model in the proposed method performs better than the mainstream named entity recognition model when handling assembly process design language. The effectiveness of the proposed method is also analyzed through the simulation experiment in the small-scale real scene, compared with manual method. The results show that the proposed method can help designers accumulate knowledge automatically and efficiently.

Key words: assembly process design, knowledge extraction, named entity recognition, text extraction in table, dependency syntactic parsing, attention mechanism

摘要： 装配工艺文档记录了工艺设计者的意图或知识。然而，由于其表格形式和非结构化的自然语言文本，普通知识抽取方法不适合于处理装配工艺文档。本文提出了一种面向装配工艺文档的装配语义实体识别与关系构建方法。首先，通过有效区域识别和单元格划分，从表格中提取装配工艺语句，并将其存储为键-值对象文件。然后，面向装配操作类型，通过基于注意力机制的序列标注模型识别语句中的语义实体，并设计句法规则实现实体间关系的自动构建。最后，通过使用自建的语料库，证明了该方法提出的序列标注模型在处理装配工艺设计语言时比主流的命名实体识别模型表现更好。并且，通过小规模真实场景下的仿真实验与人工方法进行比较，证明了该方法的有效性。结果表明，该方法可以帮助设计者自动、有效地积累知识。

关键词: 装配工艺设计，知识抽取，命名实体识别，表格文本抽取，依存句法分析，注意力机制

CLC Number:

TP391

GU Xinghai顾星海）,HUA Bao（花豹），LIU Yahui（刘亚辉）,SUN Xuemin（孙学民）,BAO Jinsong^∗（鲍劲松）. Semantic Entity Recognition and Relation Construction Method for Assembly Process Document[J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 537-556.

References

[1] CHEN J H, JIA X L. An approach for assembly process case discovery using multimedia information source [J]. Computers in Industry, 2020, 115: 103176.
[2] ZHANG S Y, GE W Q, WANG Z L, et al. A heuristic configuration solving process planning method for mechanical product configuration by imitating the crystal crystallization process [J]. The International Journal of Advanced Manufacturing Technology, 2021, 116(1/2): 611-628.
[3] KRETSCHMER R, PFOUGA A, RULHOFF S, et al. Knowledge-based design for assembly in agile manufacturing by using Data Mining methods [J]. Advanced Engineering Informatics, 2017, 33: 285-299.
[4] KUTIN A, DOLGOV V, SEDYKH M, et al. Integration of different computer-aided systems in product designing and process planning on digital manufacturing [J]. Procedia CIRP, 2018, 67: 476-481.
[5] OTTER D W, MEDINA J R, KALITA J K. A survey of the usages of deep learning for natural language processing [J]. IEEE Transactions on Neural Networks and Learning Systems, 2021, 32(2): 604-624.
[6] JI S X, PAN S R, CAMBRIA E, et al. A survey on knowledge graphs: Representation, acquisition, and applications [J]. IEEE Transactions on Neural Networks and Learning Systems, 2022, 33(2): 494-514.
[7] ZHAO M X, WANG H, GUO J, et al. Construction of an industrial knowledge graph for unstructured Chinese text learning [J]. Applied Sciences, 2019, 9(13): 2720.
[8] CHEN Z Y, BAO J S, ZHENG X H, et al. Semantic recognition method of assembly process based on LSTM [J]. Computer Integrated Manufacturing Systems, 2021(6): 1582-1593 (in Chinese).
[9] LAMPLE G, BALLESTEROS M, SUBRAMANIAN S, et al. Neural architectures for named entity recognition [C]//2016 Conference of the North American Chapter of the Association for Computational Linguistics. San Diego, CA: ACL, 2016: 260-270.
[10] DEVLIN J, CHANG M W, LEE K, et al. Bert: Pre-training of deep bidirectional transformers for language understanding [DB/OL]. (2019-05-24). https://arxiv.org/abs/1810.04805.
[11] DAI Z J, WANG X T, NI P, et al. Named entity recognition using BERT BiLSTM CRF for Chinese electronic health records [C]//2019 12th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics. Suzhou: IEEE, 2019: 1-5.
[12] JIA C, SHI Y F, YANG Q R, et al. Entity enhanced BERT pre-training for Chinese NER [C]//Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA: ACL, 2020: 6384-6396.
[13] SYED M H, CHUNG S T. MenuNER: domain-adapted BERT based NER approach for a domain with limited dataset and its application to food menu domain [J]. Applied Sciences, 2021, 11(13): 6007.
[14] ZHANG J Y, HE G H, DAI Z, et al. Named entity recognition of enterprise annual report integrated with BERT [J]. Journal of Shanghai Jiao Tong University, 2021, 55(2): 117-123 (in Chinese).
[15] CHEN L, XU S, ZHU L J, et al. A deep learning based method for extracting semantic information from patent documents [J]. Scientometrics, 2020，125(1): 289-312.
[16] GIORGI J, WANG X D, SAHAR N, et al. End-toend named entity recognition and relation extraction using pre-trained language models [DB/OL]. (2019-12-20). https://arxiv.org/abs/1912.13415.
[17] ZHENG S C, WANG F, BAO H Y, et al. Joint extraction of entities and relations based on a novel tagging scheme [C]//55th Annual Meeting of the Association for Computational Linguistics. Vancouver: ACL, 2017: 1227-1236.
[18] WEI Z P, SU J L, WANG Y, et al. A novel cascade binary tagging framework for relational triple extraction [C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA: ACL, 2020: 1476-1488.
[19] LI J, SUN A X, HAN J L, et al. A survey on deep learning for named entity recognition [J]. IEEE Transactions on Knowledge and Data Engineering, 2022, 34(1): 50-70.
[20] ZHANG N N, WANG P Y, ZHANG G P. Named entity deep learning recognition method for process operation description text [J]. Computer Applications and Software, 2019, 36(11): 188-195 (in Chinese).
[21] IMPEDOVO S, OTTAVIANO L, OCCHINEGRO S. Optical character recognition — a survey [J]. International Journal of Pattern Recognition and Artificial Intelligence, 1991, 5(1n02): 1-24.
[22] BOUKHAROUBA A. A new algorithm for skew correction and baseline detection based on the randomized Hough Transform [J]. Journal of King Saud University-Computer and Information Sciences, 2017, 29(1): 29-38.