163results about How to "Eliminate duplication" patented technology

A method, system, and computer program product to make query processing more robust in the face of optimization errors. The invention validates the statistics and assumptions used for compiling a query as the query is executed and, when necessary, progressively re-optimizes the query in mid-execution based on the knowledge learned during its partial execution. The invention selectively places a number of CHECK operators in a query execution plan to validate the optimizer's cardinality estimates against actual cardinalities. Errors beyond a threshold trigger re-optimization, and the optimizer decides whether the old plan is still optimal and whether to re-use previously computed results. The invention addresses arbitrary SQL queries whose plans can contain sub-queries, updates, trigger checking, and view maintenance operations. The invention can handle concurrent update transactions or updates of common sub-expressions in a query execution plan without compromising consistency and isolation as locking information is tied to the record ID.

A procedure for clustering documents that operates in high dimensions, processes tens of thousands of documents and groups them into several thousand clusters or, by varying a single parameter, into a few dozen clusters. The procedure is specified in two parts: computing a similarity score representing the k most similar documents (typically the top ten) for each document in the collection, and grouping the documents into clusters using the similarly scores.

An automated data management system and method for logging, processing, and reporting a large volume of data having different file types, using different versions, stored on different media, and / or run by different operating systems, includes a first processor for restoring a plurality of received data files, the data files being capable of being different file types; a file organizing / categorizing processor for organizing the received data files into data slices, each data slice including an identification number and a descriptor that describes characteristics of the received data file; a file logging processor for logging the received data files into a first database based on the data slices; a data uploading processor for uploading the first database to a second database; a de-duplicate processor for calculating a SHA value of the received data files to determine whether the received data files have duplicates and flagging duplicated data files in the second database; an image conversion processor for converting at least a portion of the received data files into image files; and a second processor for exporting the image files.

As part of the normal crawling process, a crawler parses a page and computes a de-tagged hash, called a fingerprint, of the page content. A lookup structure consisting of the host hash (hash of the host portion of the URL) and the fingerprint of the page is maintained. Before the crawler writes a page to a store, this lookup structure is consulted. If the lookup structure already contains the tuple (i.e., host hash and fingerprint), then the page is not written to the store. Thus, a lot of duplicates are eliminated at the crawler itself, saving CPU and disk cycles which would otherwise be needed during current duplicate elimination processes.

An automated data management system and method for logging, processing, and reporting a large volume of data having different file types, stored on different media, and / or run by different operating systems, includes a first server processor for restoring a plurality of received data files, the data files being capable of being different file types; a file organizing / categorizing processor for organizing the received data files, based on a predetermined user list, into a source directory structure and a destination directory structure; a file logging processor for logging the received data files into a database formed by the source and destination directory structures and identifying a file type of the received data files; a de-duplicate processor for calculating a SHA value of the received data files to determine whether the received data files have duplicates and flagging duplicated data files in the database; an image conversion processor for converting the remaining data files into image files, respectively; and a second server processor for exporting the image files.

A user interface which is easier to operate in that, when a user performs printing setting, a plurality of setting items divided into a plurality of sheets can be set together in one package with no need of setting the setting items separately. In an information processing apparatus for producing printing data, which is interpretable by a printer, based on document data produced by an application, when printing setting is performed to produce the printing data by using the plurality of setting sheets, a plurality of setting items separated into the plurality of setting sheets are combined into a combined setting, and the combined setting is registered in a combined setting list. When one of the combined settings registered in the combined setting list is selected, all the setting items of the one combined setting are set and displayed in a plurality of setting sheets.

An integrative analysis system and method of network vulnerability utilizing multiple heterogeneous vulnerability scanners to enhance the accuracy of the network vulnerability analysis are provided. The method comprises a scanning policy setting-up step of setting-up a common scanning policy able to be adapted to the multiple heterogeneous vulnerability scanners and specifying the policy for the respective vulnerability scanners, a vulnerability scanning and result collecting step of performing for the multiple heterogeneous vulnerability scanners to scan, to collect a result thereof, and to store the same in a database and a scanning result integrative analysis step of performing a relevance analysis and an integrative analysis on the scanning results collected, thereby obtaining a complementary vulnerability scanning utilizing multiple heterogeneous vulnerability scanners, enhancing the accuracy and the comprehension of the scanning results, and obtaining a comprehensive vulnerability analysis on a network.

In the automation of project risk identification, various qualitative and quantitative measures are combined to report a project's risk level, areas, and mitigation in an automatic and objective manner. The software package includes a risk assessment and report framework and a risk engine, a portfolio analysis, a project plan validator, an integrated project management office toolkit and process asset library, and an integrated skills tracking, locating and availability module with a skills engine.

A display method and apparatus for navigation system enables a user to quickly view zoomed images by using a radial scaling method. The display method includes the steps of: reading out map data from a map data storage for displaying a map image on a screen of a navigation system; converting the map data to screen coordinates so that an intended map image is displayed on a correct position on the screen; zooming the map image by enlarging or shrinking distances of points on the map image relative to a center of the screen; and storing the map data converted to the screen coordinates in a memory for use with a further operation of changing the map scale.

Empirically derived models are used to relate user perception to objectively measurable characteristics, under a criterion of nearly perfect co-variance between predicted MOS values and the variations in the values of the objectively measurable characteristics. In the example context of evaluating packet switched telephony service, the present invention eliminates the need to perform subjective tests to characterize each combination of codec type and transmission protocol.

A controlling apparatus of a variable capacity type fuel pump, for avoiding noises caused due to drive of the fuel pump and noises caused due to drive of injectors from overlapping or duplicating with each other in the timing thereof, wherein signals for driving the pump reduced, or the timing thereof is shifted forward / backward, within a specific timing where the o overlapping can be prospected, or a specific timing where they are determined to overlap or duplicate with each other.

Unit design according to the present invention makes it possible for accumulated results of past design examples to be reflected in forming new designs, thereby preventing repetitive of designs and thereby reducing the time required for development. In the unit designing apparatus (1), the CPU (3) includes a basic structure designing section (21) for designing a basic structure in accordance with a given design target, and a function block searching section (23) for searching a design example of a function block for application to the engine concerned. The function block layout section (25) lays out a retrieved outer shape of a function block in a basic structural view to design a raw material shape. The CPU (3) further includes a production machining information searching section (29) for searching production machining information for application to each function block. The machining shape layout section (31) lays out a machining shape of each function block obtained from the searched production machining information in a raw material shape design drawing to design the product shape.

The invention discloses a measuring method and device for transmittance of an optical element. The method comprises the steps of splitting a laser beam with a specific wavelength to obtain two beams of laser, enabling the two beams of laser to pass through a reference light path and a measuring light path respectively, not placing the optical element on the measuring light path, and obtaining energy E1 of the laser beam passing through the reference light path and energy E2 of the laser passing through the measuring light path by measurement; placing the optical element on the measuring light path, and obtaining energy E1' of the laser beam passing through the reference light path and energy E3 of the laser passing through the measuring light path by measurement; and calculating the transmittance T of the optical element according to an equation T=(E1*E3) / (E1'*E2). According to the measuring method and device, Dual light path aplanatism measurement is adopted, the aim of real-time on-line measurement is achieved, influence of light source energy shake on repeatability of measuring results and measurement of the transmittance of a light-transmission lens can be effectively eliminated, and the transmittance of the optical element used for any ultraviolet pulse laser can be measured accurately and conveniently.

In some embodiments, network traffic information is captured at network information sources. These sources provide detailed information about the network communications transactions at a network device. Importantly, different types of sources can provide different types of information. Gatherer devices gather the detailed information from the various information source devices and convert the information into standardized information. The gatherer devices can correlate the gathered information with account information for network transaction accounting. Manager devices manage the gatherer devices and store the gathered standardized information. The manager devices eliminate duplicate network information that may exist in the standardized information. The manager devices also consolidate the information. Importantly, the information stored by the manager devices represents the consolidated, account correlated, network transaction information that can be used for billing or network accounting. The system thereby provides a distributed network accounting and billing system.

A system and a method for decompression-free inspection of compressed data are provided herein. The method includes the following stages: obtaining a dictionary file comprising a string of symbols, each associated with a respective index; obtaining at least one delta file associated with said dictionary file, wherein said delta file comprises a sequence of instructions that include at least one copy instruction pointing to an index within said dictionary and a length of a copy substring to be copied; scanning said dictionary using a pattern matching algorithm associated with a plurality of patterns and implemented as a Deterministic Finite Automaton (DFA), to yield DFA execution data; scanning said at least one delta file, using said pattern matching algorithm, wherein said DFA execution data is used to skip at least part of the scanning of the copy substrings for at least one of the copy instructions.

The present invention provides a method, apparatus and system for managing subscriber data in a telecommunications system. The present invention receives one or more messages from a mobile station. The one or more messages received may be a routing area update request signal. Subsequently, the present invention requests the subscriber data from a home location register. The subscriber data contains circuit switching data, packet switching data, or circuit switching data and packet switching data. Then, the subscriber data is stored in the new universal visitor location register. The present invention may request the subscriber data from the home location register by sending an update location signal to the home location register.

The sample stage of an array microscope is tilted in the scanning direction such that the best-focus plane of the array microscope intersects the surface of the sample during the scan. As a result of the tilt, the distance from the sample surface of each miniaturized microscope spanning the array varies from point to point on the surface. Accordingly, the best focal distance for each such point on the sample surface is identified by tracking the quality of its focus as the sample surface travels across the rows of microscopes in the array. Best focus may be detected using any known technique, such as by measuring spatial frequency content and recording the scan position corresponding to maximum mid-range frequency content. This information is used to develop a best-focus axial-position map for use while performing a subsequent measurement scan.

The invention relates to a system for providing and pricing travel product inventory contained in external databases not under the control of the operator and additionally comprises ghost databases which are a mirror of the external databases. The system further comprises an information manager adapted to receive search criteria from a user and to apply pricing rules to the search results which determine the final display price quoted to the user. The information manager thereafter filters the priced search results by a productmaster UID to group the same actual travel product inventory as supplied by different suppliers, into a single search result, and then provides the grouped results to the user connected to the system via the communications module.

The present invention relates to a method and system for managing a plurality of multi-field classification rules. The method includes providing a first table that includes a plurality of entries corresponding to a plurality of rules relating to an ingress context and providing a second table that includes a plurality of entries corresponding to a plurality of rules relating to an egress context. The method also includes utilizing the first table and the second table to identify any rules relating to the ingress context and any rules relating to the egress context that match a search key.

When setting by means of a UI working conditions for a multiplicity of peripherals connected to a computer to control working of said peripherals, working environment data that identifies the working environment of the peripherals and dependency relationship data that indicates dependency relationships among said working conditions are stored in advance in a predetermined storage medium, the settable range data is referred to in order to acquire settable ranges for working conditions of the multiplicity of peripherals, settable ranges within which said multiplicity of peripherals are settable in the current working environment are all made decision branches without duplication, and peripherals are driven with settings made on the basis of this display.

A controlling apparatus of a variable capacity type fuel pump, for avoiding noises caused due to drive of the fuel pump and noises caused due to drive of injectors from overlapping or duplicating with each other in the timing thereof, wherein signals for driving the pump reduced, or the timing thereof is shifted forward / backward, within a specific timing where the o overlapping can be prospected, or a specific timing where they are determined to overlap or duplicate with each other.

There is provided an image reproduction device for reproducing a concatenated stream obtained by concatenating a plurality of streams of different codec methods, in a seamless way. The image reproduction device (100) reproduces a concatenated stream obtained by concatenating a plurality of streams of different codec methods such as the MPEG-2 method and the MPEG-4 AVC method. The image reproduction device (100) includes a stream buffer (102) for accumulating the concatenated stream Bst and a plurality of decoders (Dd1 to Ddn) corresponding to various codec methods. A decoder for decoding each stream in the concatenated stream Bst outputted from the stream buffer (102) is selected from the plurality of decoders according to the codec method of each stream.

A header-to-bit conversion table is provided that includes a list of address headers for registered endpoints. Assigned to each address header within the list is a bit placement within a string of bits. As messages are received, select headers within a message are compared with the address headers within the list. Each intersection or match for headers sets a bit true within a bit array for the message corresponding to the bit assignment for the header within the header-to-bit conversion table. Such array may then be compared with bit masks for each endpoint, wherein those bits set true within the bit masks represent those headers needed to satisfy the criteria for a particular endpoint. If a match is found, the message (or portion(s) thereof) may be sent to the particular endpoint for processing.

An ink jet apparatus where a filter is provided in an ink inflow channel connecting an ink tank with the inside of an ink jet head to discharge ink from nozzles, and in an ink outflow channel connecting the inside of the ink jet head with the ink inflow channel. The ink passes through the inside of the ink jet head, and bubbles existing inside the ink jet head move with the ink to the outside. Further, as foreign materials are repeatedly removed from the ink, bubbles in the ink jet head can be removed with a simple construction and the occurrence of ink discharge failure can be reliably suppressed.