Latency enhanced note recognition method in gaming

Abstract

The present invention relates to the field of audio recognition, in particular to computer implemented note recognition methods in a gaming application. Furthermore, the present invention relates to improving latency of such audio recognition methods. One of the embodiments of the invention described herein is a method for note recognition of an audio source. The method includes: dividing an audio input into a plurality of frames, each frame having a pre-determined length, conducting a frequency analysis of at least a set of the plurality of frames, based on the frequency analysis, determining if a frame is a transient frame with a frequency change between the beginning and end of the frame, comparing the frequency analysis of each said transient frame to the frequency analysis of an immediately preceding frame and, based on said comparison, determining at least one probable pitch present at the end of each transient frame, and for each transient frame, outputting pitch data indicative of the probable pitch present at the end of the transient frame.

Description

FIELD OF INVENTION[0001]The present invention relates to the field of audio recognition, in particular to computer implemented note recognition methods. Furthermore, the present invention relates to improving latency of such audio recognition methods. Still yet, aspects relate to applications within gaming.BACKGROUND OF INVENTION[0002]Audio recognition software has been around for many years. However, most audio recognition software, particularly used for recognizing music and in particular notes, is used on recorded audio files. Since the audio sources are not live, it is possible for old audio recognition software to determine notes through an iterative and time consuming / processor consuming process in order to make accurate determinations.[0003]Current technology requires an audio recognition method for determining notes in an audio file in real time. For old audio recognition software which is not designed for real-time use several problems present themselves, particularly regar...

AI Technical Summary

Benefits of technology

This patent describes a way to quickly recognize notes in an audio signal. By making a guess at what the note is and outputting it even if there is low confidence, the method reduces how long it takes to analyze the audio. This results in a better user experience where they can quickly perceive changes in pitch.

Problems solved by technology

For old audio recognition software which is not designed for real-time use several problems present themselves, particularly regarding latency.

For example, known audio recognition software has trouble in determining what a new note is in a sequence of notes instantaneously.

Therefore, some software delay in outputting what the new note is until it is accurately determined.

However, the human ear and brain are quite sensitive and can very quickly determine that a new note is present almost instantaneously, though they may not know exactly what that new note is at the same instance.

When someone knows that a new note is present and recognition software they are using does not at the same time register a change, the discrepancy can be easily noticed and cause discomfort for a user.

Images