System and method for visual annotation and knowledge representation

Abstract

A method and system for visually annotating an image. Annotations and notes to images, such as digital medical and healthcare images, may be stored in a structured vector representation alongside image information in a single, non-volatile and portable file or in a separate file from the image. The annotations may be composed of point, line and polygon drawings and text symbols, labels or definitions and captions or descriptions. The annotations may be structured in a manner that facilitates grouping and manipulation as user defined groups. The annotations may be related to an image but not inextricably bound such that the original image is completely preserved. Annotations may further be selectively displayed on the image for context appropriate viewing. The annotations may be retrieved for purposes such as editing, printing, display, indexing and reporting for example, and may be displayed on an image for interactive use with an embedded self-contained user interface.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]This application is a divisional application of U.S. application Ser. No. 10 / 516,554, filed Nov. 30, 2004, which claims the benefit of PCT / US03 / 17138, filed May 31, 2003, which claims the benefit of U.S. Provisional Application No. 60 / 384,703, filed on May 31, 2002, which applications are hereby incorporated by reference herein in their entireties, including but not limited to those portions that specifically appear hereinafter.STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT[0002]Not Applicable.REFERENCE TO A COMPUTER PROGRAM LISTING APPENDIX[0003]A Computer Program Listing Appendix is submitted herewith on one compact disc and one duplicate compact disc. The total number of compact discs including duplicates is two. The files saved on the compact disc is an ASCII text file. Their names, dates of creation, directory locations, and sizes in bytes are:File NameDate CreatedSizeAppendix_1.txt10 Dec. 20079.01KBAppendix_2.txt10 ...

AI Technical Summary

Problems solved by technology

Authors of digital material are finding that creating, presenting, and cataloging digital images is a difficult task despite the technologic improvements.

Annotating visual media has evolved from scratch-on LETRASET® dry transfer labeling to using expensive, sophisticated and complicated image manipulation computer software like ADOBE® PHOTOSHOP® or MACROMEDIA® FREEHAND® software.

While rub-on labels certainly have large drawbacks, i.e., they cannot be used for annotating digital images, they embody the simplicity of annotating an image quickly with the necessary information.

Moreover, the previously available systems and methods do not promote interactivity with a user, neither in their output nor in their presentation.

Thus, simplicity, interactivity and low cost continue as unsatisfied objectives for the process of effectively annotating visual digital material despite technologic improvements.

Not only is most image manipulation software functional overkill for creating simple annotations, this software flattens images where the annotations are “fixed” to the image much like rub-on labels.

The flattening of image annotations causes several problems that also existed with rub-on labels: editing difficulties, poor image quality, lack of interactivity and information loss.

Annotations are not easily edited in a flattened image.

As the raster annotations are re-scaled (zoom in or out) their appearance often become incomprehensible.

Flattening of annotations to an image means not only that the annotations cannot be scaled accordingly, it means that the annotations cannot be manipulated in other ways, such as, creating interactive presentations for the purpose of communicating a visual relationship or integrating the annotations into a learning assessment tool.

Additionally, If these images are being viewed on the Internet it would mean three times longer wait in addition to the labor and disk space utilized in producing three images.

The fourth and possibly the most significant problem arising from flattened annotations is the loss of information.

However, annotations that are flattened to the image are not available for cataloging.

This de-coupling of content from the image and re-entry of the annotations into a separate storage system which is required when using the previously available systems and methods results in a more labor intensive, complex and disjoint procedure.

Another disadvantage to using a flattened image is the inability to allow multispecialty authoring.

Using a flattened image, this would be extremely difficult.

Another drawback to flattened images is that it is difficult to modify annotated images to make them context appropriate.

Annotated images often contain annotations that are not appropriate for the persons viewing the image for a variety of reasons.

Removing or hiding from view the annotations from a flattened image is not efficient due to the fact that the annotations are embedded in the image.

Still another drawback to the use of flattened images is the difficulty in reusing the annotated image.

Images