Data organization and access for mixed media document system

Abstract

A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and / or web link as a second medium). In one particular embodiment, the MMR system includes a content-based retrieval database configured with an index table to represent two-dimensional geometric relationships between objects extracted from a printed document in a way that allows look-up using a text-based index. A ranked set of document, page and location hypotheses can be computed given data from the index table. The techniques effectively transform features detected in an image patch into textual terms (or other searchable features) that represent both the features themselves and the geometric relationship between them. A storage facility can be used to store additional characteristics about each document image patch.

Description

technical field [0001] The present invention relates to techniques for producing mixed media documents formed from at least two media types, and more particularly, to a Mixed Media Reality (MMR) system for producing mixed media documents using print media combined with electronic media. Background technique [0002] Document printing and duplication technologies have been used in many environments for many years. For example, printers and copiers are used in both private and commercial office environments, in home environments with personal computers, and in document printing and publishing service environments. However, printing and reproduction technologies have not previously been considered to be a "virtual world" that connects static print media (i.e., paper documents) with interactions including digital communication systems, networks, information provision, advertising, entertainment, and electronic commerce. A means of bridging the gap between. [0003] Print media...

AI Technical Summary

Problems solved by technology

For example, although nearly everyone in the developed world has access to printed media and electronic information on a daily basis, users of printed media and personal electronic devices do not possess the necessary tools and techniques

[0005] In addition, traditional print media offer particularly favorable attributes, such as tactility, no power required, and durable organization and storage, which are not offered in virtual or digital media

Images