Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

3D Pointing Method, 3D Display Control Method, 3D Pointing Device, 3D Display Control Device, 3D Pointing Program, and 3D Display Control Program

a technology of pointing method and pointing program, which is applied in the direction of instruments, computing, electric digital data processing, etc., can solve the problems of affecting the accuracy of pointing operation, and complicated operation, so as to achieve the effect of reducing fatigue from pointing operation for a long time, improving convenience of operator, and easy pointing operation

Inactive Publication Date: 2008-09-18
NIPPON TELEGRAPH & TELEPHONE CORP
View PDF5 Cites 235 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The present invention relates to a technology for performing three-dimensional pointing and object operation using a pen-shaped input device in a three-dimensional space represented by a display apparatus. The technology aims to provide a more efficient and intuitive way of operating in the three-dimensional space compared to existing technologies. The invention addresses the problem of discomfort and exhaustion for operators who must hold the input device at a distance from the object being operated on, and the difficulty of performing detailed operation for objects using the existing technologies. The invention proposes a solution for allowing operators to perform pointing and object operation in the same feeling as in the real world using a three-dimensional GUI that is nearer to the real world than the two-dimensional GUI.

Problems solved by technology

Thus, there are many cases where efficient operation is hindered by the complexity as a fetter when an operator operates the computer to perform objective operation.
Pointing at objects that exist in various depth positions is one problem for operating the three-dimensional GUI.
However, when using these input devices, since the space in which the operator performs operation with the input device is different from the space where the pointer is actually displayed, there are disadvantages in that it is necessary for the operator to perform additional operation for associating the spaces with each other intentionally, and that the operation itself becomes complicated due to addition of the function for depth movement.
Another problem for operating the three-dimensional GUI exists in operation of objects in the three-dimensional space.
However, like the above-mentioned problem for pointing, since the space in which the operator performs operation using the input device is different from the space in which the pointer is actually displayed, it is necessary for the operator to perform additional operation for intentionally associating the spaces with each other.
In addition to that, the space in which the operator can perform operation is limited since an arm and a fixing wire exist.
Further, the device is not generally widespread and it cannot be said that the device is familiar to people.
However, there are not many examples in which the pen tablet (pen-shaped input device) that is widely used as the two dimensional input device is used as a three-dimensional input device.
However, since the operator must hold the pen-shaped input device with the hand in the air, this technology does not applicable for pointing work for a long time from the viewpoint of exhaustion.
In addition, since the hand is in the air, it is hard that the position of the hand stays at one point, so that there is a remarkable disadvantage that the operator cannot hold the pen tip at a target position.
Thus, it is substantially difficult to perform detailed operation for objects using this system.
Thus, even though the pointer is displayed on the display apparatus, there are many cases in which the operator cannot perceive (recognize) the depth position of the pointer so that the operator cannot recognize where the pointer points.
However, since the reference appears on the display plane so that the operator's view is blocked, there may be a case in which working efficiency is lowered.
Therefore, the method for displaying the reference is not an optimal method from the viewpoint of operating the GUI with a feeling the same as that in the real world.
In pointing work using a pointer in the conventional three-dimensional GUI, there is a problem in that it is difficult for the operator to intuitively and accurately recognize the depth position of the pointer and recognize where the pointer is pointing.
However, even though the desktop is three-dimensionalized, pointing using the pointer is still limited to two-dimensional movement.
Therefore, it is difficult to fully utilize the degree of freedom in the depth direction.
However, when the pointer moves three-dimensionally in the space where the object is placed in the three-dimensional space, the pointer is hidden behind the object that is in front of the pointer so that there is a problem in that the operator loses sight of the pointer.
But, when a color of an object at the back of the pointer is the same as a color of the pointer, it becomes difficult to differentiate the pointer from the object, so that it becomes difficult to recognize where the pointer is pointing.
However, in the nature of the three-dimensional space, when the pointer is moved to a position that is in the back (rear side) of an object as seen from the operator, the pointer is hidden behind the object so that there is a problem that the operator loses sight of the position of the pointer.
Therefore, it is difficult to recognize where the pointer is pointing, as a result, a fatal problem in the desktop interface in that selection of an object cannot be performed occurs.
As mentioned above, even though the desktop is three-dimensionalized, it is difficult to three-dimensionalize the movement of the pointer, so that there is a problem that the merit obtained by three-dimensionalizing the desktop cannot be fully utilized in the three-dimensional desktop.
That is, in the three-dimensional space represented on the display apparatus such as the conventional three-dimensional desktop and the like, there is a problem in that, when a pointer is moved in the three-dimensional space, the pointer is hidden behind the object so that the operator cannot recognize the position of the pointer.
In addition, like the problem that the pointer is hidden behind the object so that the pointer cannot be recognized, in the three-dimensional space represented on the display apparatus such as the conventional three-dimensional desktop and the like, when there is another object (back object) exists in the back of an object (front object), the back object cannot be directly recognized.
Therefore, there is a problem in that the convenience of the operator is bad.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D Pointing Method, 3D Display Control Method, 3D Pointing Device, 3D Display Control Device, 3D Pointing Program, and 3D Display Control Program
  • 3D Pointing Method, 3D Display Control Method, 3D Pointing Device, 3D Display Control Device, 3D Pointing Program, and 3D Display Control Program
  • 3D Pointing Method, 3D Display Control Method, 3D Pointing Device, 3D Display Control Device, 3D Pointing Program, and 3D Display Control Program

Examples

Experimental program
Comparison scheme
Effect test

first embodiment

[0366]First, the first embodiment of the present invention is described. The first embodiment corresponds to the first object.

[0367]The three-dimensional pointing method of the first embodiment of the present invention is a method for pointing at an object and operating the object that is pointed at, with a pen-shaped input apparatus, in a three-dimensional space represented by a display apparatus that can perform three-dimensional display. The pen-shaped input apparatus (to be referred to as “input pen” hereinafter) includes a pen-shaped operation means for performing operation, by an operator who holds the operation means, to point at the object and to perform operation for the object, and a detection means for detecting information of the input pen such as a position of the pen tip, pen pressure, orientation of the axis and the like. Then, in the three-dimensional pointing method in the first embodiment, based on the information detected by the detection means, the position, shap...

embodiment 1-1

[0381]FIGS. 4A-7 are schematic diagrams for explaining the three-dimensional pointing method of the embodiment 1-1 of the present invention. FIG. 4A shows a front view, a right side view and a bottom view showing an example of a three-dimensional space represented on the display apparatus, FIG. 4B shows a bird's-eye view of an example of the three-dimensional space represented on the display apparatus, each of FIGS. 5A, 5B and 5c shows a bird's-eye view showing situations in the three-dimensional space when operating with an input pen, each of FIGS. 6A, 6B and 6c shows a front view and a right side view showing situations in the three-dimensional space when operating with an input pen, and FIG. 7 shows a flowchart showing the process procedure of the three-dimensional pointing method in the embodiment 1-1. FIGS. 6A, 6B and 6C correspond to FIGS. 5A, 5B and 5C respectively.

[0382]The three-dimensional pointing method of this embodiment 1-1 is a method for pointing at an object that is...

embodiment 1-3

[0430]FIGS. 11A-13C are schematic diagrams for explaining the three-dimensional pointing method of the embodiment 1-3 of the present invention. FIG. 11 shows a bird's-eye view showing a situation in the three-dimensional space when operating with an input pen, FIG. 12 shows a front view showing a situation in the three-dimensional space when operating with an input pen, and FIG. 13 is a flowchart showing a process procedure of the three-dimensional pointing method of the embodiment 1-3.

[0431]In embodiments 1-1 and 1-2, pointing methods are described for performing display control of the pointer in the three-dimensional space 301 represented on the display apparatus 3 and display control of the pointed object in response to operation of the input pen 201 of the input apparatus 2.

[0432]However, when pointing at the object in the three-dimensional space 301 by the method of the embodiments 1-1 and 1-2, there are many cases in which operation such as moving, editing and processing of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A three-dimensional pointing method is disclosed. In the three-dimensional pointing method of the present invention, a desired point in a three-dimensional space represented on a display apparatus is pointed at based on two-dimensional coordinates of a position that is pointed at by a pen tip of an input pen on a predetermined detection plane, and, based on pen pressure that is pressure applied to the pen tip of the input pen, time for continuing to point or operation of an operation means provided in the input pen. In addition, in the three-dimensional pointing method of the present invention, a depth direction coordinate of a three-dimensional pointer to be displayed in the three-dimensional space is changed according to the pen pressure of the input pen, the time for continuing to point or the operation of the operation means provided in the input pen, and the three-dimensional pointer is displayed.

Description

TECHNICAL FIELD[0001]The present invention relates a technology for performing three-dimensional pointing. More particularly, the present invention relates to a technology for performing pointing in a three-dimensional space, represented by a display apparatus, using an input apparatus including a pen-shaped operation unit. In addition, the present invention relates to a technology for three-dimensionally pointing at an object, with a pointer, placed (displayed) in a three-dimensional space represented on the display apparatus. Further, the present invention relates to a technology for three-dimensional display control for selecting an object placed and displayed in a three-dimensional space or for pointing at an object placed and displayed in the three-dimensional space.BACKGROUND ART[0002]In recent years, with remarkable improvement of calculation performance and processing speed, and with enhancement of graphic functions for PCs (personal computers), any of display, function and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(United States)
IPC IPC(8): G06F3/038G06F3/048G06F3/041G06T17/40G06F3/0481G06F3/0488
CPCG06F3/04815G06F3/03545G06F3/0354G06F3/0481G06T19/20
Inventor NAKADAIRA, ATSUSHISUZUKI, NAOBUMIOCHI, DAISUKE
Owner NIPPON TELEGRAPH & TELEPHONE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products