61results about How to "Achieve desensitization" patented technology

The invention discloses a desensitization system used for big data. The desensitization system comprises a database type management module, a system management module, a data source management module, a sensitive data discovery module, a desensitization task management module, a desensitization configuration management module, a multi-stage management module, a big data desensitization analysis module and a sensitive data classification module, wherein the database type management module manages the type of desensitization data; the system management module constructs a role for a desensitization system and carries out function authorization and management on the role; the data source management module provides data source management for the desensitization system; the sensitive data discovery module automatically discovers the sensitive data in the data source and submits the sensitive data to the user for regulation and confirmation; the desensitization task management module configures and manages the desensitization task of a big data desensitization system; the desensitization configuration management module manages and defines the sensitive data and carries out desensitization algorithm and desensitization strategy management; the multi-stage management module realizes the state monitoring, the strategy issuing and the data synchronization of multi-stage desensitization equipment; the big data desensitization analysis module carries out real-time analysis on collected desensitization log data to guarantee the security of the desensitization system; and the sensitive data classification module carries out characteristic analysis on the sensitive data to classify the sensitive data. The invention also discloses a desensitization method used for the big data.

The invention relates to a high-security desensitization method based on a big data information system. The method is characterized by comprising the first step of conducting preprocessing before conducting desensitization use on sensitive data; the second steps of using a compound layering type desensitization algorithm model to conduct encryption on the sensitive data; the third step of conducting source tracing and auditing after conducting desensitization use on the sensitive data. According to the high-security desensitization method based on the big data information system, the compound layering type desensitization algorithm is adopted as a core, and the method is used for realizing protection of the visited sensitive information under the situation that an information system is invaded illegally and authority is utilized to break loopholes of a traditional desensitization algorithm. The high-security desensitization method based on the big data information system has the advantages that on the one hand, the danger coefficient of the sensitive data is effectively reduced, the security of the sensitive data is sharply improved, the breaking difficulty coefficient is sharply increased, and desensitization protection of the sensitive data is realized; on the other hand, efficiency characteristics of each arithmetic unit in the desensitization model can be given full play through the model algorithm.

The invention provides a big data processing method and system. The method is applied in a database agent system which includes a database agent module, a data detection module and a data desensitization module; the method includes the steps that the database agent module receives the data access request of the application client, and determines target data in a target source database and the operation type of the target data according to the data access request; the database agent module conducts operation on the target data according to the operation type, and obtained the operation result returned by the target source database; the data detection module detects the sensitive data of the operation result according to a target detection strategy and determines the sensitive data in the operation result; the data desensitization module desensitizes the sensitive data in the operation result according to the preset desensitization strategy and obtains response data after desensitization; the database agent module returns the response data to the application client. The big data processing method and system can enable the database agent system to conduct data transmission, and achieve the data desensitization of transmitted data at the same time.

The invention relates to the technical field of computers, in particular to a data query method and device, and the method comprises the steps: receiving a first query request sent by a client, the first query request at least comprising a previous preset number of bits of a first Hash value obtained after the client performs Hash operation on target query data, and calling a preset k-anonymous algorithm for obtaining hash values of the query results conforming to the previous preset number of bits on the basis of pre-stored mapping relationships between the data and the hash values; and according to the obtained Hash values, performing query from a preset database, and returning k query results to the client, so that the client obtains a query result corresponding to the first Hash valuefrom the k query results. In this way, data query desensitization protection is realized based on the k-anonymous algorithm, and a server cannot determine a target query result in k query results, sothat the target query data cannot be leaked even if the target query data does not exist in a database, and the security is improved.

The invention discloses a cloud resource pool data security detection method comprising the steps of acquiring established sensitive data; acquiring export data drained from a cloud resource pool; scanning and recognizing the sensitive data in the export data; building a sensitive data life cycle, and hierarchically managing the sensitive data; capturing a host virtual machine of the sensitive data in a cloud resource environment, and monitoring traffic of the virtual machine; and analyzing the sensitive data and abnormal operation behaviors of the host virtual machine of the sensitive data, and giving an alarm. In addition, the invention also provides a cloud resource pool sensitive data security detection system comprising a control module, a collection module, a processing module, a supervising module and an auditing module. By using the method provided by the invention, a full life cycle security control on links such as building, generation, utilization and destroying of various kinds of sensitive data during business data calling and transmission, and business interaction and migration processes under the cloud computing environment is achieved, and thus abnormal and illegal behaviors can be found.

The invention discloses a data processing method. The method comprises the following steps: obtaining to-be-processed data needing to be subjected to data desensitization; scanning the to-be-processeddata, and identifying the data type of the to-be-processed data; inquiring a preset desensitization rule corresponding to the data type from a preset first corresponding relation between the preset data type and the desensitization rule; and desensitizing the to-be-processed data by using the preset desensitization rule to obtain desensitized data. The invention further provides a data processingdevice, a server and a storage medium. The problem of data desensitization is solved, the data desensitization efficiency is improved, and meanwhile based on the intelligent desensitization configuration platform, all-around sensitive data management can be achieved.

The invention discloses a desensitization platform for structured data, which comprises an offline data desensitization system and an online data desensitization system.A desensitization task in the offline data desensitization system can be carried out for a target database system or an unstructured file; through the desensitization task, a product is connected with a service system for providingoriginal data and a system using desensitized data, and a user can select a desensitized data source, a desensitized data destination and a most suitable data desensitization scheme in the task. Thedesensitization platform can effectively solve the problems that the data quality of the information system is not high and the data sharing degree between the information systems is low, meets the requirements of research and application of sensitive data anti-leakage technologies and data safety protection technologies of marketing clients, power grid GIS, production and operation and the like,improves the data quality of the information system, and promotes data sharing and fusion.

The invention aims at providing a data processing method and system. A RDP protocol is introduced, and the RDP protocol serves as an agency service device. The data processing method comprises the steps of obtaining operation data of a user device by a user from the user device terminal through the RDP protocol and forwarding the operation data to a network device; receiving RDP data returned by the network device based on the operation data, parsing and identifying the RDP data, and obtaining text data corresponding to the RDP data; and determining whether the text data belong to preset sensitive data, if so, performing corresponding masking operation on the text data, and obtaining the masking data corresponding to the text data. Masking of the RDP data is achieved through the RDP protocol, safety control of data transmission is solved, the user can operate, maintain and manage the device conveniently, and furthermore management efficiency of data masking management is improved.

The invention discloses a method for removing sensitivity of sensitive data, and the method is used for improving efficiency of removing the sensitivity of the sensitive data and for reducing required additional storage expenses. The method includes the steps of selecting N data records from M data records, recording data positions of the N data records, storing sensitive data contained in the N data records into a set linear memory cache, exchanging sensitive data contained in each unselected data record of the M data records with sensitive data contained in a random data record in the linear memory cache, enabling sensitive data contained in N data records in the linear memory cache to replace the sensitive data contained in the original N data records in the recorded data positions after exchange is conducted, wherein both N and M are integers larger than 0, and N is smaller than M. The invention further discloses a device for removing the sensitivity of the sensitive data.

The invention provides a message reminding method and device and a scene type recognition method and device, and relates to the technical field of communications. The message reminding method comprises the steps: performing word segmentation on a to-be-processed message to obtain a plurality of segmented words, and determining a weight value and a hash value of each segmented word; determining index information of the to-be-processed message based on the weight value and the hash value of each segmented word; identifying a scene type by using a model based on the index information of the to-be-processed message so as to determine the scene type of the to-be-processed message; and executing a reminding action according to the scene type identification result of the to-be-processed message.According to the invention, leakage of the message plaintext can be avoided while the message concerned by the user is identified.

The invention discloses a data desensitization method and device, a storage medium and a terminal, and the method comprises the steps: obtaining to-be-desensitized data, the to-be-desensitized data being a mobile phone number; splitting the mobile phone number into first character data and second character data, the first character data being characters indicating an operator and a home location of the mobile phone number, and the second character data being remaining characters of the mobile phone number; determining an operator and a home location of the mobile phone number according to thefirst character data; and splicing the operator and the attribution of the mobile phone number with the second character data to form a desensitized mobile phone number. According to the technical scheme, data desensitization is achieved, and meanwhile the statistical characteristics of the data are reserved.

The invention relates to information communication and aims at providing a formatted data desensitization high-security coding and decoding method. The formatted data desensitization high-security coding and decoding method comprises a coding process and a decoding process. The coding process comprises the steps of packaging input data, generating a coding matrix, importing a bias term as a key and generating a coding output array. The decoding process comprises the steps of obtaining the number of samples in an input data group, obtaining coded data and key, exporting the coding matrix and restoring the input data. According to the method, a method of randomly generating the key is imported into traditional formatted data coding and decoding processes, the desensitization of formatted data is realized, and the randomness and security of the coding and decoding processes are improved. According to the method, a random key mechanism is employed, moreover, the traceability of the data isensured, and the method can be applied to the formatted data desensitization coding and decoding processes in the fields such as an ICT.

The invention discloses a public security view desensitization test data generation method and system and a storage medium, and the method comprises the steps: employing a non-sensitive human face view sample to desensitize a sensitive object human face view through a deep learning-based sample camouflage method, reserving the recognition features of a real view, and camouflaging the real view asa non-sensitive human face view; different from traditional encryption, content removal and other desensitization technologies, the scheme provided by the invention has the advantages that recognitionfeatures of partial attention in the original (human) face image are reserved, and the face data of the non-attention area is replaced with the face data of the public sample by utilizing the deep neural network, so that high-simulation view data desensitization is realized. By utilizing the scheme, the desensitization test data can be quickly generated in batches, the data can be shared and transmitted in batches on the premise of not losing the application value, and the leakage of key sensitive data can be effectively prevented. The invention can be widely applied to public safety test data generation and police artificial intelligence remote auxiliary systems.

The invention discloses a data desensitization method and device, a storage medium and a terminal, and is applied to a server, the method comprises the following steps: when a to-be-distributed target data text is received, obtaining a plurality of fields of the target data text; identifying sensitive fields and non-sensitive fields in the plurality of fields, and generating a sensitive field set and a non-sensitive field set; performing desensitization processing on the data of each sensitive field in the sensitive field set to generate desensitized data; and combining the desensitized data with the data of the non-sensitive fields, and distributing the combined data to a client. According to the data distribution method and device, the sensitive fields existing in the target data text are automatically recognized at the server side for automatic desensitization processing, so that automatic recognition, desensitization and distribution of the data can be realized, the data leakage risk caused by data circulation is reduced, and the data distribution efficiency is improved.

The invention relates to the technical field of data processing, and provides a data desensitization method, a data desensitization device, a computer readable storage medium and electronic equipment.The method comprises the following steps: determining a plurality of to-be-desensitized data from source data; for any target to-be-desensitized data, obtaining a target character corresponding to the desensitized target to-be-desensitized data; matching the target to-be-desensitized data with the source data to obtain the positions of the to-be-desensitized data in the source data in parallel toobtain a target position set corresponding to the target to-be-desensitized data; and replacing data corresponding to the target position set in the source data with the target character to desensitize the target to-be-desensitized data. According to the scheme, the problem of long marking desensitization time under a large data volume can be effectively solved, the data desensitization throughput is improved, and the data desensitization efficiency is further improved.

The invention discloses a data desensitization system based on a data simulation algorithm, belongs to the technical field of data security, and aims to solve the technical problem of how to realize reversible desensitization and irreversible desensitization of data while ensuring original characteristics of the data and avoid the risk of data leakage. According to the technical scheme, the system comprises a desensitization algorithm management module, a desensitization task management module, a desensitization task execution module and a desensitization task recording module; the desensitization algorithm management module is used for adding, modifying, deleting and searching desensitization algorithms and providing a visual maintenance interface of the desensitization algorithms; the desensitization task management module is used for specifying an original data source and a target data source, selecting a desensitization algorithm for a sensitive field in the original data source, and configuring a simulation desensitization rule, an encryption desensitization rule and a covering desensitization rule; and the desensitization task execution module is used for executing the desensitization task defined by the desensitization task management module and transferring the desensitized data of the sensitive fields and the desensitized data of the non-sensitive fields to a target data source.

The invention discloses a financial big data system based on online deep learning and market operation value quantification. The system includes a person flow stay perception module, a shopping mall BIM space module, a shopping mall value super index evaluation module, a shopping mall value super index evaluation data set storage and instant training module, and a financial big data and shopping mall BIM visualization module. A subjective operation value quantized value is fitted through passenger flow data and business volume personalized data, an optimized convolutional neural network is trained in real time for processing a large amount of data sampled during operation, and real-time quantification of the operation value of a shopping mall is realized. According to the invention, fairness from objective data to subjective rating is ensured, data desensitization is realized, network training is convenient, and real-time monitoring and evaluation of managers are facilitated.

The invention provides a data processing method, device and system. The method comprises the steps: obtaining a first log file corresponding to a production database, the first log file being used forrecording the change condition of data in the production database; the first log file is sent to a backup database, so that the backup database determines incremental data in a production database according to the first log file, desensitization processing is conducted on the incremental data, and desensitized data corresponding to the incremental data is generated and stored in the backup database; and acquiring desensitized data, and storing the desensitized data into a development database and / or a test database. According to the invention, real-time automatic data desensitization is realized; real-time synchronization from production environment data to a test environment is realized; according to the bug checking method and device, software developers can conveniently inquire the data to quickly locate the bug, the timeliness of bug checking is guaranteed, and the technical problem that in the related art, the software developers cannot check the bug in time due to the fact thatdesensitization processing is manually conducted on sensitive data, time consumption is long, and efficiency is low is solved.

The invention discloses a dynamic desensitization method based on a database drive agent. The method comprises the following steps: obtaining an SQL request of a user; acquiring a WEB user name, a user IP, a corresponding database IP and a corresponding database name according to the SQL request of the user; according to the WEB user name, the user IP and the corresponding database IP and databasename, obtaining SQL content in the corresponding database; analyzing the SQL content to obtain a table and a field; setting a desensitization rule; and according to the desensitization rule, recombining the WEB user name, the user IP, the database IP, the database name, the table and the field, and generating and sending a new SQL statement. The invention further discloses a dynamic desensitization system based on the database drive agent. On the premise of ensuring that the user uses the transparent application program, no extra equipment needs to be added, and the effects of database user desensitization and application program user desensitization can be achieved according to different configuration desensitization rules.

The invention discloses a voice data processing method. The method comprises the following steps: performing biological characteristic processing on voice data to obtain first desensitized voice data; performing voice recognition processing on the first desensitized voice data to obtain first desensitized recognition text content; determining sensitive text content in the first desensitized recognition text content according to a preset desensitization rule; performing desensitization processing on the sensitive text content; and generating second desensitized voice data at least according to the desensitization processing result. According to the embodiment of the invention, biological characteristic processing is carried out on the voice data, so that the biological characteristic privacy of the speaker is desensitized. First desensitized voice data is recognized as first desensitized recognition text content, then sensitive text content is detected according to a preset desensitization rule for desensitization processing, and finally desensitized voice data is generated based on a desensitization processing result. Therefore, the personal private information of the speaker is not exposed when the desensitized voice data is utilized, and the information security of the speaker is realized.

The invention discloses a method and system for generating Flink SQL field consanguinity, and the method comprises the steps: firstly obtaining a complete SQL statement, and obtaining a library name, a table name and a field name through the analysis of the SQL statement and the self-definition of DDL and DML analysis processes for the Flink SQL; the method comprises the following steps of: obtaining a ListTable array containing all tables in an SQL (Structured Query Language), sequentially traversing the array according to the obtained ListTable array containing all the tables in the SQL to obtain a blood relationship between fields, and finally, displaying a final field result according to a layered field display mode to obtain the FlinkSQL field blood relationship. The invention discloses a method and a system for generating FlinkSQL field consanguinity, which can be used for conveniently carrying out influence range analysis on a table and realizing automatic pulling of task dependence and field-level desensitization for sensitive data.

The embodiment of the invention discloses a method and device for desensitizing a document image, electronic equipment and a computer readable storage medium, and relates to the technical field of computer vision, deep learning and cloud computing. A specific embodiment of the method comprises the steps of obtaining a to-be-processed document image; determining a regional image with text featuresin the to-be-processed document image by utilizing a LOMO algorithm, and identifying text contents corresponding to the text features in the regional image by utilizing a CRNN model; and performing desensitization processing on the target sensitive information corresponding to the preset desensitization requirement in the text content to obtain a desensitized document image. According to the embodiment, the data representation form which can be processed by the desensitization processing is expanded, so that the document image which does not directly contain the text information can be desensitized well, and the LOMO algorithm and the CRNN model are used, so that the recognition accuracy is also improved.

The invention provides honey and pollen cream and a preparation process thereof, and belongs to the technical field of health-care foods. The honey pollen cream is prepared by mixing pollen and honeyaccording to a ratio of 1: 1.3, and carrying out reduced pressure distillation and concentration, wherein the pollen is desensitized with edible alcohol after being subjected to wall-breaking grinding. The preparation process of the honey pollen cream comprises the following steps of removing impurities from the pollen, performing wall-breaking grinding on the pollen by using a colloid mill to form the powder, and soaking the treated pollen in the edible alcohol; carrying out reduced pressure distillation operation, and recovering the edible alcohol; mixing the pollen after recovery of the edible alcohol and the honey according to the ratio of 1: 1.3 until the pollen and the honey are uniformly dissolved; carrying out reduced pressure distillation on a semi-finished product again, and performing concentration operation to obtain a finished product with the water content of 10-15%; and packaging the finished product. According to the honey and pollen cream prepared by the method, the nutritional values of the honey and the pollen are fully extracted, so that the nutritional value is high; and the pollen is desensitized, so that the edible safety is greatly improved and the storage time is long.

The invention provides a data desensitization method and device, a storage medium and an electronic device, and the method comprises the steps of disorganizing a first watermark identifier by using a first random number, and obtaining a second watermark identifier; performing first operation on a first numerical value in the second watermark identifier and an (m-n) th numerical value in the first data to obtain a processed (m-n + 1) th numerical value corresponding to the first data; sequentially performing first operation on the ith numerical value in the second watermark identifier and the processed (m-n + i-1) th numerical value corresponding to the first data to obtain the processed (m-n + i) th numerical value corresponding to the first data; combining the first numerical value to the (m-n) th numerical value in the first data and the processed (m-n + 1) th numerical value to the mth numerical value corresponding to the first data to obtain second data; and performing second operation on the second random number and the second data to obtain desensitized data. Through the invention, the technical problem of relatively low data security in related technologies is solved.

The invention discloses a log setting and printing method, log setting and printing equipment and a log system. The log setting method comprises the steps that source files developed for log recordingequipment are acquired; log field information of logs in the source files is extracted; the log field information is encrypted to obtain ciphertext information; according to the mapping relation between the log field information and the ciphertext information, a decrypted file is formed for the log printing equipment to decrypt the ciphertext information; the log field information in the source files is replaced to the ciphertext information to obtain encrypted source files; and the encrypted source files are compiled to obtain executable files for burning in the log recording equipment.

The invention relates to a data desensitization method and system based on power grid data acquisition. The method comprises the following steps: acquiring multi-dimensional power data and identifying sensitive data in the multi-dimensional power data; drawing a frequency histogram according to the frequency of each data item of each sensitive data, and fitting a first distribution curve according to the frequency histogram; using the trained generative adversarial neural network to generate a second distribution curve, wherein the distribution distance between the second distribution curve and the first distribution curve is less than a threshold value; and returning sensitive data in an external request of the multi-dimensional data according to the second distribution curve and Laplacian noise. According to the method, approximate distribution of sensitive data is dynamically generated through the generative adversarial neural network, desensitization of data with different sensitivities is realized in combination with Laplacian noise, and the requirements of different data application scenes are met.

The invention discloses a computer vision processing server structure based on a neural network, comprising a parent server and a plurality of child servers. Each child server is attached to the parent server at the same time. Each sub-server is provided with a neural network, and each sub-server performs preprocessing through its own neural network at the same time. The parent server further processes the preprocessed image data to form the computer vision processing data. The invention discloses a computer vision processing server structure based on a neural network. Firstly, a sub-server preprocesses pictures or videos requiring computer vision processing, thereby extracting image features, realizing data desensitization and avoiding privacy leakage problem. Then the parent server processes the pre-processed image data in depth, so that the server architecture can achieve load balance as far as possible, reach the balance point, and realize the maximum utilization of each server 'sresources.

The invention discloses a desensitization tool for a technological parameter curve graph, and relates to the technical field of information. The invention is composed of a picture input module, an image denoising module, an image binary matrix conversion module, a curve scanning module, a threshold setting module, a curve slicing module, a curve center scanner, a curve correction module and an image merging module. According to the invention, the problem that the original trend of the process parameter curve cannot be effectively reserved by adopting cutting, shielding, smearing and other desensitization methods in the past can be solved, and the service requirement of curve sensitive information desensitization can be met. The tool well adapts to desensitization of various industrial curve sample pictures through the threshold value setting module, the semi-automatic adjustment desensitization effect of the module can be achieved through threshold value setting parameters, and desensitization processing of continuous process curve pictures is achieved under the condition that a process parameter generation system is not changed.

A data desensitization method and system. The method comprises: reading a structured query language (101); when it is judged that the structured query language satisfies a preset desensitization rule, rewriting the structured query language according to the desensitization rule (102); and executing the rewritten structured query language, and outputting a query result (103). The present method can realize dynamic data desensitization, flexibly output a query result after desensitization, and guarantee the security of data.