An early attempt to identify seals from aerial images of the sea ice.

Image:

Detection of sea mammals from aerial imagery

Efficient and reliable methods for automatic analysis of complex marine observation data are needed to ensure sustainable fisheries and harvest. The Institute for Marine Research (IMR) has a mission to be a leader in providing knowledge to ensure sustainable management of resources in our marine ecosystems.

Abundance estimation of sea mammals like ice breeding seals (harp and hooded) and coastal seals (grey and harbour) are based on aerial photographic surveys. The Institute of Marine Research (IMR) utilizes aerial images of the sea ice captured from above as a data source to estimate abundance of seal populations.

An aerial image cropped down to an identified seal pup.

To achieve this in a reliable and cost-effective manner better automation of this process is needed and will lead to better long-term management of seal populations. Previous activities have demonstrated that there is a potential in using deep learning for this. However, limitations in training data due to incomplete annotations and shifts in sensors and conditions over time are challenges that need to be solved.

For the detection and classification of seals on ice, the datasets will come from both drones and manned aerial surveys. We will start from previous models and extend these to include more species (coastal seal species). Furthermore, we need to improve on these models to better handle incomplete annotations and shifts in sensors and conditions over time, with the aim of limiting false positives, and to account for large fractions of images without seals.

Video

Further reading

New methods for automatic change detection in aerial images
January 19, 2021
A collaboration with Terratec to develop deep learning methods to automatically detect changes when updating an existing map database.
New algorithms for vessel and object detection
January 19, 2021
Visual Intelligence collaborates with KSAT to improve existing, and develop new algorithms, for vessel detection and object recognition.
Opening the black box of AI
January 19, 2021
Deep learning and AI models must become interpretable, explainable and reliable before they can be utilized in complex domains.