Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Automatic counting system for fish passing amount of fish passage based on underwater videos

An automatic counting and fishway technology, which is applied to the counting of randomly distributed items, counting objects, counting mechanisms/items, etc., can solve problems such as small range of activities, background changes, and invalid counting rules, so as to improve counting accuracy, The effect of simplifying the swimming state and reducing the counting times

Active Publication Date: 2016-10-12
平邑经济开发区投资发展有限公司
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the randomness of the time and quantity of fish passing, it is impossible to monitor the fishway manually 24 hours a day, and it is necessary to develop automated and intelligent monitoring and statistical methods
Studies have shown that general magnetic, electric and contact sensors are not suitable for fish counting work, and vision technology has the advantages of non-contact, visualization, and easy signal collection and transmission, which can be applied to the development of fish counting in fishways, but still There are many technical difficulties, which are mainly manifested in: (1) low visibility in natural water environment, strong light scattering and reflection, which makes video contrast poor and makes it difficult for fish target recognition; (2) fish is a flexible body, swimming During the process, the posture is changeable, and there are no obvious distinguishing features between the same fish except the size, which makes it difficult for the fish to lock and track; (3) Fish generally have phototaxis or flow, and the light source and fishway in the field of view Under the current of water, fish tend to hover in the field of view of the camera, shake their fins (causing body changes), roll over, swim back, etc., all of which make it difficult to count
[0003] The published invention patent ("An automatic counting system for live fish based on computer vision", 201510437308.7) proposes a video counting method that can be used for fry counting, but due to the limitations of experimental facilities, conditions, methods, etc., it cannot be used in It is used in the natural water environment, especially in real dam fishways, mainly because of: (1) hardware: the size of the fishway is only tens of centimeters, so the detected fish must be small enough and have a small range of activities. The state is single, and additional water filter tanks, fish suckers, fish dividers, etc. are required. These limiting conditions are impossible to realize in the real dam fishway monitoring environment; (2) counting rules and methods: in this invention, select the For an experimental fishway with a downward slope in the downstream direction, it is considered that when a tracked fish is detected when the center of mass coordinates of the current frame is lower than that of the previous frame, the counter is incremented by 1, but in fact, it is extremely rare for a fish to swim in the fishway. Regularly, common fish swim up and down quickly along the water depth direction in a small area, or hang somewhere and shake their tails, causing the position of the center of mass to change (in fact, there is no obvious shift), especially when there is a light source. Because of the phototaxis, the group tends to swim around the light source in a "vortex" shape. These common situations will invalidate the counting rules of the patent
In addition, the "standard background" used in this patent is to first shoot and extract the scene without fish as the standard background template, and then use the difference between the current frame image and the standard background template to obtain the foreground (fish) during monitoring. It is also unavailable in the dam fishway, because the water quality, flow velocity, and natural environment light in the dam fishway will change, resulting in different visibility, that is, the background will change, and it is not suitable to use a fixed background template

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic counting system for fish passing amount of fish passage based on underwater videos
  • Automatic counting system for fish passing amount of fish passage based on underwater videos
  • Automatic counting system for fish passing amount of fish passage based on underwater videos

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] As shown in Figure 1, it includes an underwater camera 2 and a video processing workstation 3, the underwater camera 2 is connected with the image acquisition card in the video processing workstation 3, and processed by the counting software installed in the video processing workstation 3 , counting; fishway 1 entrance is equipped with anti-escape net 5, and described underwater camera 2 is installed on fishway 1 side wall, and is close to anti-escape net 5 outlets, and above the shooting scene of underwater camera 2, lighting source 4 is installed Light the underwater in fishway 1.

[0039] Further, a part of the area within the shooting scene 6 of the selected underwater camera 2 is used as an effective counting area 7, and the fish is monitored only when the fish starts to swim into the area.

[0040] Further, a part of the selected effective counting area 7 is marked as an enhanced counting area 9, and the part that is not included is regarded as a counting buffer z...

Embodiment 2

[0043] A system for automatically counting the amount of fish passed in a fishway based on underwater video, which comprises the following steps:

[0044] S1: Moving fish or fish target recognition and tracking, including the following steps:

[0045] S11: Anti-interference background modeling: establish a mixed Gaussian background model in the effective counting area 7, which can adaptively eliminate the sundries in the effective counting area 7 including illumination changes, water fluctuations, static backgrounds, and swinging fixed positions (such as being caught inside the fishway 1) Interference with spam intercepted by software, etc.);

[0046] S12: Recognition of the moving target: Differentiate the image in the effective counting area 7 in the current frame and the background model of the established effective counting area, and binarize the difference result to obtain the moving target in the current effective counting area 7, which is Fish or schools of fish detect...

Embodiment 3

[0056] The effectiveness of the present invention will be further described below in conjunction with the typical fishway on-site embodiment:

[0057] Figure 4-7 takes a certain fish as the object of investigation (the fish marked by the box in the figure), closely surrounding the process shown in Figure 3, reflecting the main process and effect of the fish from partially entering the counting buffer until it is counted ( Other fish that appeared in the effective counting area 7 at the same time as this fish were also being tracked and locked, but at the end of the investigation period, the other fish had not yet reached the counting requirements, which was selected for the purpose of explaining the problem more conveniently). In the four figures, the area covered by the two blue (thick lines) lines is the effective counting area, and the area covered by the two yellow lines (thin lines) inside is the enhanced counting area. Each yellow line and its adjacent blue line The area...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an automatic counting system for the fish passing amount of a fish passage based on underwater videos. The system comprises an underwater camera and a video processing work station, and the underwater camera is connected with an image collection card of the video processing work station. The inlet of the fish passage is provided with an escape preventive net, the underwater camera is mounted in the sidewall of the fish passage and close to the outlet of the escape preventive net, and a light source is mounted over a shooting scene to light and illuminate underwater part in the fish passage. In the video processing process, part area in a visual field is designed as a counting buffer area via software to reduce the computational complexity, and further, an enhanced counting area is arranged in the countering buffer area. when fishes enter an effective counting area gradually from one side, the system identifies and tracks the fished automatically continuously, when the system finds, by tracking, that certain fish enters the enhanced counting area from onside and exits out of the other side gradually, counting is to be carried out, counting is started after monitoring and confirming in three continuous frames of images, and thus, the practical fish passing amount in the fish passage can be counted automatically all-day in a counting period.

Description

technical field [0001] The invention relates to the field of underwater target monitoring and counting, in particular to an automatic counting system for the amount of fish passing through a fishway based on underwater video. Background technique [0002] In recent years, a large number of various types of hydropower stations have been built in my country. The dams of these stations have caused difficulties for the free migration of fish, especially seasonal and physiological migration, threatening the survival and reproduction of fish. In order to solve this problem, the newly-built dam is specially designed with a fishway for fish to pass through, and uses light, sound and biochemical fish luring technology to try to induce fish to the entrance of the fishway, guide and help them pass through the fishway. However, different fish have different abilities to pass through the fishway, and different types of fishways also make the fish pass through the dam differently. Therefo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06M11/00G06K9/00G06T5/30G06T7/00
CPCG06M11/00G06T5/30G06T2207/10016G06V20/40G06V20/05
Inventor 陈从平聂葳胡琼黄正李林波郑霞忠石小涛
Owner 平邑经济开发区投资发展有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products