269 results about "Full text search" patented technology

A real-time system incorporating speech recognition and linguistic processing for recognizing a spoken query by a user and distributed between client and server, is disclosed. The system accepts user's queries in the form of speech at the client where minimal processing extracts a sufficient number of acoustic speech vectors representing the utterance. These vectors are sent via a communications channel to the server where additional acoustic vectors are derived. Using Hidden Markov Models (HMMs), and appropriate grammars and dictionaries conditioned by the selections made by the user, the speech representing the user's query is fully decoded into text (or some other suitable form) at the server. This text corresponding to the user's query is then simultaneously sent to a natural language engine and a database processor where optimized SQL statements are constructed for a full-text search from a database for a recordset of several stored questions that best matches the user's query. Further processing in the natural language engine narrows the search to a single stored question. The answer corresponding to this single stored question is next retrieved from the file path and sent to the client in compressed form. At the client, the answer to the user's query is articulated to the user using a text-to-speech engine in his or her native natural language. The system requires no training and can operate in several natural languages.

The invention discloses a threat early warning and monitoring system and method based on big data analysis and a deployment architecture. The system comprises a data acquisition system module, which is used for carrying out real-time data acquisition on original network traffic; a data storage system module, which is used for carrying out data merging and data cleaning on the data collected by the data acquisition system module, and then, carrying out storage management; a real-time threat intelligent analysis system module, which is used for carrying out deep analysis and mining on security data through data mining, text analysis, traffic analysis, full-text search engine and real-time processing, and identifying unknown security threats in real time by combining an intrusion detection module, a network abnormal behavior module and a device abnormal behavior module; and a situation awareness display system module, which is used for carrying out comprehensive display on security threat situations stereoscopically in real time through a data visualization tool library. The threat early warning and monitoring system and method based on big data analysis and the deployment architecture are used for network security threat situation awareness and deep analysis under a plurality of service scenarios, and realize comprehensive abilities from attack early warning, attack identification to analysis and evidence obtaining.

In response to characters entered within a Find dialog box, a minifind window is dynamically updated to provide corresponding search strategies and quick matches from content search data that are being searched. The search strategies and quick matches that are listed are dynamically updated as the user inputs additional characters in the Find dialog box. At any time, the user can initiate a full text search to populate a search results pane, based upon the characters input, by selecting a Go control or pressing the Enter key. Alternatively, the user can select one of the quick matches or search strategies, to populate the search results pane with corresponding items obtained from the content search data, which are most likely to relate to the information desired by the user. This approach is applicable to finding information in almost any data accessed locally, or over a network.

A system and method for storing IM text in a repository where it can be searched by topic or participant based filters is disclosed. The repository may be a centralized database on the server side or it may be distributed in the client environment. The system comprises an IM Topic (IMT) program, an IM Filter (IMF) program, an IM save program (IMS), and an IM automatic alert (IMAL) program. The IMT program assigns topic tags to turns and topic shifts in the IM conversation. The IMF program searches the repository based on user selection of filters as well as full text search. There may be any number of topic tags. The IMS program automatically scans IM transcripts for topic tags and identifiers and saves transcripts or transcript segments that match pre-selected topic tags or identifiers to the repository. The IMAL program sends notifications and / or exports transcripts or transcript segments to pre-designated addresses when a match is made between a topic or identifier in a transcript and a pre-selected topic or identifier.

Disclosed herein is a method and system for integrating an enterprise's structured and unstructured data to provide users and enterprise applications with efficient and intelligent access to that data. Queries can be directed toward both an enterprise's structured and unstructured data using standardized database query formats such as SQL commands. A coprocessor can be used to hardware-accelerate data processing tasks (such as full-text searching) on unstructured data as necessary to handle a query. Furthermore, traditional relational database techniques can be used to access structured data stored by a relational database to determine which portions of the enterprise's unstructured data should be delivered to the coprocessor for hardware-accelerated data processing.

A system and method for storing IM text in a repository where it can be searched by topic or participant based filters is disclosed. The repository may be a centralized database on the server side or it may be distributed in the client environment. The system comprises an IM Topic (IMT) program, an IM Filter (IMF) program, an IM save program (IMS), and an IM automatic alert (IMAL) program. The IMT program assigns topic tags to turns and topic shifts in the IM conversation. The IMF program searches the repository based on user selection of filters as well as full text search. There may be any number of topic tags. The IMS program automatically scans IM transcripts for topic tags and identifiers and saves transcripts or transcript segments that match pre-selected topic tags or identifiers to the repository. The IMAL program sends notifications and / or exports transcripts or transcript segments to pre-designated addresses when a match is made between a topic or identifier in a transcript and a pre-selected topic or identifier.

A system and method for searching recorded speech is disclosed. The system and method comprises converting the recorded speech into text using a voice recognition system. As the speech is being converted, naturally occurring breaks in the languages will be used to take time indexes from the recording. The system and method includes creating a full text index of the recorded speech utilizing an information extender. The full text index contains a plurality of time stamps that point to the occurrence of words in the recorded speech. Finally, the text is searched by a full text search server that has linguistic search capabilities using the full text index. Finally, the searched text, the text index and the recorded speech are stored in the database. The recorded speech is searched by locating relevant phrases or words, and then mapping the time stamps associated with the relevant phrases words back to the recorded speech in the database.

A system and method for preparing and searching a user-personalized library of content includes preparing a general library comprised of images of pages of content and electronically-searchable text corresponding to the text in the page images, which is then personalized by receiving from the user a selection of the content to include in the user's personalized library. User selection of content for a personalized library may be accomplished manually or automatically as a result of user actions, such as user review or purchase of content. Preferably, full text searching of the content in the user's personalized library is enabled. Page images in the personalized library containing text that match the user's search terms are provided to the user for display. Highlighting of search terms in page images by a user device and access rules that act to limit the viewing of content are further provided.

Full text searching may be made available for resources stored in a database according to a database schema. A method for conducting a search on structured data using a text search engine includes the steps of: modeling a resource stored in a relational data store as a web page; providing a locator to the resource; and providing the resource in a consumable format to the text search engine. The method may include the additional steps of: receiving a search on the resource; converting the search into a converted query consumable by the search engine; and providing the converted query to the search engine.

A hierarchical distributed search mechanism is integrated into a distributed file system. Traditional file system APIs (create, open, close, read, write, link, rename, delete, . . . ) and the over-the-wire protocols employed to project these APIs into remote client sites (CIFS, NFS, DDS, Appletalk) are extended to enable the dynamic creation of temporary directories containing links to objects identified by search engines (executing at sites “close” to “their” data) as meeting the search criteria specified by the first parameter of a search function call. The search function, derived from the standard file system API function create, is added to the file system API.

A full-text search index system and method is generated by creating instances of a database index from an in-memory inverted list of keywords associated with a text identifier and the occurrences of the keyword in the text. Instances of the index are placed in a priority queue. A merge scheduling process determines when a merge should be initiated, selects instances of the index to be merged and selects a type of merge to perform.

Disclosed herein is a method and system for integrating an enterprise's structured and unstructured data to provide users and enterprise applications with efficient and intelligent access to that data. Queries can be directed toward both an enterprise's structured and unstructured data using standardized database query formats such as SQL commands. A coprocessor can be used to hardware-accelerate data processing tasks (such as full-text searching) on unstructured data as necessary to handle a query. Furthermore, traditional relational database techniques can be used to access structured data stored by a relational database to determine which portions of the enterprise's unstructured data should be delivered to the coprocessor for hardware-accelerated data processing.

The present invention employs an instruction button for inputting an instruction to simultaneously executing registration, in a full-text-search database, of a document scanned by one scanning operation and subjected to OCR processing, and registration of the document in a designated folder contained in a database of a folder tree structure. This single instruction button enables the user to simultaneously register read images in a folder, and text data resulting from OCR processing executed on the read images.

The present invention relates to a storage system including a de-duplicate function and a full-text search function or the like, and reduces an amount of index information about full-test search to save storage resource. In this system, a storage apparatus includes a processing unit for de-duplicating a plurality of files having the same content regarding a file group of data inputted / outputted through a host apparatus. A full-text search processing server performs a full-text search processing to the file group and includes a processing unit for causing the full-text search processing to correspond to de-duplicate. An index information creation processing performed to a plurality of target files having the same content by the full-text search processing unit is inhibited according to a status of de-duplicate to the file group by the processing unit. Thereby, the amount of index information can be reduced.

The invention provides a method and a system for searching geographic information. The method can comprise: receiving inquiry request information, segmenting the inquiry request information, obtaining an effective address and key words, inquiring a prearranged database, obtaining spatial geometric information of the effective address, determining spatial regions which need searching according to the spatial geometric information, searching according to the key words in the spatial regions which need searching, and outputting a searching result. The invention organically combines spatial index and full-text searching, and can effectively improve the accuracy and the rich degree of geographic information searching.

A search method, a search system, and a natural language comprehension system are provided. The search system includes a structured database and a search engine. The structured database stores a plurality of records, each of which has a title field and a content field. The title field includes at least one sub-field, and each sub-field includes an indication field and a value field. The indication field stores indication data, the value field stores value data, and the content field stores detailed content data. The search engine conducts a full-text search to the records in the structured database according to a keyword derived from a user's request formation, and a search result is transmitted to a knowledge comprehension assistance module, so as to recognize the user's intention. After the user's intention is recognized, information associated with the recognized user's intention is transmitted back to the user.

Techniques are provided for managing the creation, storage, search and delivery of rich media optimized for e-commerce in a distributed information network, e.g., the Internet. In an illustrative embodiment, a content creation phase generates rich media content in a single multimedia file in the format of a HotMedia file for delivery to a Rich Media Build Engine (RMBE). Rich media content is extracted from the file using pluggable and modular extractors providing an input to a commerce-based search engine and a full-text search engine. The outputs of the search engine are combined as a search result from which a searchable database directory is created. The output is stored in a conventional database, e.g., DB2. A web client is coupled to the search system through a web server providing a search query to the rich media database and receiving an output from the search engine.

The present invention provides employees and / or associates the opportunity to share corporate knowledge via the storage of electronic message (email) with user awareness and consent features. In various embodiments of the invention, awareness and consent over email sharing is provided via automated message modification and message generation. In one embodiment of the invention, the granted sharing permissions are communicated to all original message recipients and authors to enhance awareness of sharing decisions made by individual employees. All employees who are allowed to access the shared content according to the sharing privileges can subsequently find or discover content via full-text searches or other means, such as content-based recommendations.

The invention discloses a keyword based evaluation expert intelligent search and recommendation method. The keyword based evaluation expert intelligent search and recommendation method specifically comprises step 1, segmenting an expert information main text into substring sequences, performing ICTCLAS word segmentation of Chinese academy of sciences and performing stop word filtering on the result of the word segmentation to obtain the word collection; step 2, extracting feature words of the expert information according to fields; step 3, building an expert knowledge representation model based on the fields and the weight of the feature words and establishing an expert information index database; step 4, performing automatic prompting according to a search term thesaurus when a user inputs keywords and meanwhile performing real-time update on the search term thesaurus through a search term counter; step 5, calculating the search relevance between the keywords and the expert information based on the semantic information and the like; step 6, listing relevant experts from high to low according to the matching degree. According to the keyword based evaluation expert intelligent search and recommendation method, the intelligent full-text search and recommendation of the expert information can be achieved through the keyword input and accordingly the experts which are matched with a pended science and technology project can be searched out accurately.

Described system makes it possible to charge copy fees related to the amount of copyrighted material being copied and to provide those fees to the appropriate copyright holder. The scanned information is passed through an OCR filter that produces a stream of text, which is then passed to a full-text search service that identifies matching passages in its index. Sufficiently long passages found in the copied document that match previously indexed documents held by the service constitute copyrighted materials. In addition, the scanned image may be processed to identify instances of copyrighted images present in the scan.

The invention discloses a method and device for full-text retrieval of a document database, comprising: querying attachments in documents and performing document conversion on the attachments obtained from the query according to a preset policy; library; establish a full-text index catalog for the generated document data sub-library, and store it in a preset relational database; receive the search keywords input by the user, match the full-text index catalog in the relational database, and obtain the matching full-text index catalog corresponding A document in a document database. By applying the invention, the query efficiency of the full-text search can be improved.

The present invention relates to an integrated full-text search architecture that integrates full text search with database server applications in a tight manner so that it becomes part of the server in all aspects including storage, metadata, query processing, back / up restore and resource management. This provides improved performance with respect to queries as well as improved manageability. Furthermore, the subject architecture is open and schema directed unlike other conventional full-text search architectures. Accordingly, the full-text search architecture enables expert users (e.g., search providers) to define their own index structures as well as ranking algorithms.

The invention provides a method and a system for updating the index of distributed full-text search in real time. The method comprises the following steps: sending update requests comprising data of index classified information by an information issue server to a notification server when index information updates; distributing the update requests to corresponding message theme queues by the notification server, and sending the update requests to a request distributor which subscribes corresponding message themes; sending the update requests to an index server which corresponds to index classification by the request distributor according to a routing information list which records the relation of the index classification and the index server; receiving the index update requests sent by therequest distributor by the index server, and reading index update information and operation types; standardizing the fields of the read index update information according to an index structure, and increasing the quantity of the standardized index update information according to the operation types. The invention ensures that the update operation of index information can be reflected in the indexin real time.

The invention discloses a system for intelligently searching and treating information and relative method. Wherein, said system comprises a data intelligent treating subsystem, a processing database, an issue and manage module, a search database, and an intelligent search server subsystem, while the issue and manage module comprises a data issue and synchronize module, a data develop manage module; the inventive system can treat the data to divide the data into 12 kinds. Said method comprises: inputting search condition; pretreatment; dividing the search request into simple direct search, advanced integrated search, classified browse search, full-text search, and intelligent logic search, while the first three methods directly use the relationship search engine to search; the full-text search uses full search engine; the intelligent logic search uses logic relationship to recombine the inquire condition to search with the relationship search engine; after obtaining result, feeding back the search result.

The invention discloses an intelligent urban construction examining and approving method based on a case-based reasoning technology. The intelligent urban construction examining and approving method based on the case-based reasoning technology comprises the following steps of constructing an examining and approving case library; inputting new examining and approving case and model parameter information; submitting jogs to a Hadoop cluster to search KNN (k-nearest neighbor algorithm) Map Reduce cases; statistically analyzing a searching result on the basis of a 'weighted integral model'; evaluating and correcting the cases; and performing distributed full-text searching on examining and approving data. The intelligent urban construction examining and approving method has the advantages that by the method, the circumstance of manual examination and approval application at present can be changed, the work efficiency is improved, the basis on examining and approving is increased, and an examining and approving process is intelligent. Distributed searching can be carried out by using a Hadoop frame and a MapReduce frame through a cloud computing center, and a distributed case searching model based on the case-based reasoning technology is established. The 'weighted integral model' is creatively raised to statistically analyzing searched similar cases, and a guidance which is beneficial to new examining and approving cases is obtained.

The invention provides a full-text searching method and device based on HBase. The method comprises the steps of connecting the HBase with a Solr engine, extending a Solr EndPoint object, and storing index content aimed by a KeyValue to be searched in the HBase to the Solr engine in advance; receiving a query request sent by a client-side through a server-side, wherein the search request carries query conditions; calling the Solr EndPoint object through the server-side, and transmitting the query request to the Solr engine through the Solr EndPoint object so that the Solr engine can carry out full-text search on the index content according to the query request; receiving a search result returned by the Solr engine through the Solr EndPoint object and sending the search result to the client-side. According to the scheme, the search efficiency is improved.

This invention discloses an index method with the combination of the relation data base and whole paper index, and it overcomes the disadvantage of the combination of SQL search in the relation data base and the whole paper search and the efficient is low. It includes the above data base, founds the index base of the data base to the needed property field in every data base, and founds the whole paper search base by the whole paper searching engine. It can divide the searching requirement into data base search and whole paper search on need during search, and it can separately form the corresponding inquire word. The index search condition is accord with the SQL criterion, the whole paper search condition is accord with the whole paper expression criterion. Then the first submits to the relation data base to do data base search, the latter submits to the whole paper searching engine to search. This can realize the parallel execution of two searches, improves the ability of the search greatly, and can provide the special whole paper search scheme.

The invention discloses a method and a device for searching an information object. The information object is information content with semantic structure, comprising a plurality of information properties with semantic correlative relation, wherein the information properties are units of different semantic aspect content of information objects; and the semantic structure is collection of semantic metadata. Target webpage URI can be utilized to query correlative library to obtain semantic structure by establishing semantic structure and network resource URI or correlative library of prefix of network resource URI; webpage information is formatted and indexes are established with the guidance of semantic structure; user request is responded, searching results are provided according to correlation order, and simultaneously layering semantic navigation trees are provided; and refine searching results are provided to a user when the user clicks the node of the semantic navigation tree. The invention belongs to the technical field of computer science, is applicable to the application fields of network information extraction, full text search, semantic search, mobile phone search and the like.

A full-text search index system and method is generated by creating instances of a database index from an in-memory inverted list of keywords associated with a text identifier and the occurrences of the keyword in the text. Instances of the index are placed in a priority queue. A merge scheduling process determines when a merge should be initiated, selects instances of the index to be merged and selects a type of merge to perform. Instances of an index are assigned a temporal indicator (timestamp). A set of instances is selected to be merged. The set of instances is validated and merged.

A system and method for preparing and searching a user-personalized library of content includes preparing a general library comprised of images of pages of content and electronically-searchable text corresponding to the text in the page images, which is then personalized by receiving from the user a selection of the content to include in the user's personalized library. User selection of content for a personalized library may be accomplished manually or automatically as a result of user actions, such as user review or purchase of content. Preferably, full text searching of the content in the user's personalized library is enabled. Page images in the personalized library containing text that match the user's search terms are provided to the user for display. Highlighting of search terms in page images by a user device and access rules that act to limit the viewing of content are further provided.