Consumer policy awareness analysis method and system based on big data text mining

Abstract

The invention discloses a consumer policy awareness mining method and system based on big data text mining. The method comprises the steps that policy text data of a specific field and consumer comment text data are collected on related government websites and social platforms; preprocessing the collected text data, wherein the preprocessing comprises duplicate removal, noise reduction and short sentence processing; performing deep mining on professional vocabularies based on machine recognition and an expert knowledge corpus, and constructing a policy corpus; and carrying out policy awareness mining analysis on the consumers based on the consumer comments and in combination with the policy corpus. According to the method, network public opinion information is fully utilized, consumer comment texts are mined from the perspective of consumer policy awareness, and an expert knowledge corpus for consumer policy awareness mining is established, so that the text word segmentation effect is improved to a greater extent, and the text word segmentation efficiency is improved by combining natural language processing and other technologies. The policy perception state of the consumer is more systematically and accurately mined and analyzed, and suggestions are provided for policy supply optimization and policy accuracy and benefit improvement.

Description

technical field [0001] The present invention relates to the technical field of data mining, in particular to consumer policy perception mining based on big data text mining, and specifically to a consumer policy perception analysis method and system based on big data text mining. Background technique [0002] It is of great practical significance to study consumers' perception of policies. Research on consumers' policy perception is to study consumers' attention to policies, their degree of attention, their evaluation of policy rationality and necessity, and their emotional attitudes. [0003] With the popularization of Internet technology, more and more consumers post their own comments online, forming a large amount of consumer-generated content (UGC). These large amounts of text data generated on social media platforms largely reflect consumption Analyzing consumers' true inner thoughts can grasp consumers' hot spots and emotional attitudes. At the same time, the ever-i...

AI Technical Summary

Problems solved by technology

[0010] Existing word segmentation tools lack a policy corpus based on expert knowledge corpus to identify consumer comments, the accuracy of policy text word segmentation needs to be improved, and manual labeling is generally used, so building a policy corpus requires a lot of manpower

Images