Image-based vehicle occupant classification system

Abstract

A system and method for processing acquired images to develop useful classifications of subjects such as occupants of a vehicle preferably employs a hierarchical and probabilistic structure, such as a Bayesian Network to analyze acquired images and produce a meaningful classification. The structure preferably includes set of analyzers, a set of Scenario analyzers and a set of Temporal models which are arranged in three respective hierarchical layers. Each respective analyzer operates on the acquired image and, in some circumstances, feedback from the Scenario analyzers, to produce an output representing the probability that a feature that the respective analyzer is concerned with is present in the acquired image. Each respective Scenario analyzer receives output probabilities from at least one of the analyzers and, in some circumstances, feedback from the Temporal Models, to produce an output indicating the probability that a scenario that the respective Scenario analyzer is concerned with, is the scenario captured in the acquired image. Each respective Scenario analyzer can also provide feedback inputs to one or more analyzers to alter their operation. Finally, each respective Temporal Model receives and operates on the output from at least one Scenario analyzer to produce a probability that a classification with which the Temporal Model is concerned is represented by the acquired image. Each respective Temporal Model can also provide feedback inputs to one or more Scenario analyzers to alter their operation. The structure processes the classification probabilities output from the Temporal Models to produce a classification for the acquired image.

Description

RELATED APPLICATIONS [0001] This application claims priority from U.S. Provisional Patent Applications 60 / 663,652, filed Mar. 21, 2005, and 60 / 699,248, filed Jul. 14, 2005 and the contents of both of these provisional applications are incorporated herein by reference.FIELD OF THE INVENTION [0002] The present invention relates to a system and method for determining information relating to the interior of a vehicle. More specifically, the present invention relates to a image-based method of determining a classification of occupants of a vehicle. BACKGROUND OF THE INVENTION [0003] Many passenger and other vehicles are now equipped with active restraint systems, such as airbags, to protect vehicle occupants in the event of an accident. However, while such active restraint systems can in many cases prevent or mitigate the harm which would otherwise occur to a vehicle occupant in an accident situation, in some circumstances it is contemplated that they can exacerbate the injury to the veh...

AI Technical Summary

Benefits of technology

[0012] The present invention provides a system and method for processing acquired images to develop useful classifications of subjects such as occupants of a vehicle. The system and method preferably employs a hierarchical and probabilistic structure, such as a Bayesian Network to analyze acquired images and produce a meaningful classification. The structure preferably includes set of analyzers, a set of Scenario analyzers and a set of Temporal models which are arranged in three respective hierarchical layers. Each respective analyzer operates on the acquired image and, in some circumstances, feedback from the Scenario analyzers, to produce an output representing the probability that a feature that the respective analyzer is concerned with is present in the acquired image. Each respective Scenario analyzer receives output probabilities from at least one of

Problems solved by technology

However, while such active restraint systems can in many cases prevent or mitigate the harm which would otherwise occur to a vehicle occupant in an accident situation, in some circumstances it is contemplated that they can exacerbate the injury to the vehicle occupant.

Specifically, active restrain systems such as airbags must deploy rapidly, in the event of an accident, and this rapid deployment generates a significant amount of force that can be applied to the occupant.

In particular, children and smaller adults can be injured by the deployment of airbags as they both weigh less than full sized adults and / or they may contact a deploying airbag with different parts of their bodies than would a taller adult.

However, such systems are subject to several problems including the inability to distinguish between object placed on the seat and people on the seat, the presence of child support seats, etc.

It has been proposed that vision based sensor systems could solve many of the problems of identifying and / or classifying occupants of a vehicle but, to date, no such system has been developed which can reliably make such determinations in real world circumstances wherein lighting conditions, the range of object variability, materials and surface coverings and environmental factors can seriously impede the ability of the proposed image-based systems from making a reliable classification.

Images