New Software Reveals the World Through Animal Eyes

New camera technology that reveals the world through the eyes of animals has been developed by University of Exeter researchers.

New camera technology that reveals the world through the eyes of animals has been developed by University of Exeter researchers. The details are published today in the journal Methods in Ecology and Evolution.

The software, which converts digital photos to animal vision, can be used to analyse colours and patterns and is particularly useful for the study of animal and plant signalling, camouflage and animal predation, but could also prove useful for anyone wanting to measure colours accurately and objectively.

The software has already been used by the Sensory Ecology group in a wide range of studies, such as colour change in green shore crabs, tracking human female face colour changes through the ovulation cycle, and determining the aspects of camouflage that protect nightjar clutches from being spotted by potential predators.

Jolyon Troscianko from the Centre for Ecology and Conservation at the University of Exeter said: “Viewing the world through the eyes of another animal has now become much easier thanks to our new software.

“Digital cameras are powerful tools for measuring colours and patterns in nature but until now it has been surprisingly difficult to use digital photos to make accurate and reliable measurements of colour. Our software allows us to calibrate images and convert them to animal vision, so that we can measure how the scene might look to humans and non-humans alike.

This shows how dandelions look to humans and honeybees.
Dandelions as seen in human vision (left), and honeybee vision (right). The center of the flower absorbs UV while the ends of the petals reflects it. Image credit: Jolyon Troscianko.

“We hope that other scientists will use this open access software to help with their digital image analysis.”

Until now, there has been no user-friendly software programme that enables researchers to calibrate their images, incorporate multiple layers – visible and UV channels -, convert to animal colour spaces, and to measure images easily. Instead, researchers have needed to do much of this manually, including the sometimes complex programming and calculations involved. This freely available open source software now offers a user-friendly solution.

Colour vision varies substantially across the animal kingdom, and can even vary within a given species. Most humans and old-world monkeys have eyes sensitive to three colours; red, green and blue, which is more than other mammals that are only sensitive to blue and yellow. It is impossible for humans to imagine seeing the world in more than three primary colours, but this is common in most birds, reptiles, amphibians and many insects that see in four or more. Many of them can also see into the ultraviolet range, a world completely invisible to us without the use of full spectrum cameras. So scientists studying these species need to measure UV to understand how these animals view the world.

Using a camera converted to full spectrum sensitivity, one photograph taken through a visible-pass filter can be combined by the software with a second taken through an ultraviolet-pass filter. The software can then generate functions to show the image through an animal’s eyes.

This shows a view through the eyes of a lizard.
Two Tenerife lizards (Gallotia galloti) are basking. The image on the left is in human-visible colours and although the male at the top is more colourful than the female at the bottom, he is still fairly well camouflaged amongst the foliage. However, the dusky blue/grey patches on his cheek and bars on his flank are much more conspicuous to the female lizard than ourselves, as highlighted in the false colour UV image on the right. This demonstrates how colours can be used as private signals in some species where evolutionary pressures for sexual signalling compete with evading predators. Image credit: Jolyon Troscianko.

The researchers have provided specific data on camera settings for commonly studied animals, such as humans, blue tits, peafowl, honey bees, ferrets and some fish.

Flowers often look particularly striking in UV because they are signalling to attract pollinators that can see in UV, such as bees. UV is also often important for birds, reptiles and insects in their colourful sexual displays to attract mates.

About this neuroscience and technology research

The software is free to download and is available here.

Source: University of Exeter
Image Source: The images are credited to Jolyon Troscianko
Original Research: Abstract for “Image calibration and analysis toolbox – a free software suite for objectively measuring reflectance, colour and pattern” by Jolyon Troscianko and Martin Stevens in Methods in Ecology and Evolution. Published online August 6 2015 doi:10.1111/2041-210X.12439


Abstract

Image calibration and analysis toolbox – a free software suite for objectively measuring reflectance, colour and pattern

Quantitative measurements of colour, pattern and morphology are vital to a growing range of disciplines. Digital cameras are readily available and already widely used for making these measurements, having numerous advantages over other techniques, such as spectrometry. However, off-the-shelf consumer cameras are designed to produce images for human viewing, meaning that their uncalibrated photographs cannot be used for making reliable, quantitative measurements. Many studies still fail to appreciate this, and of those scientists who are aware of such issues, many are hindered by a lack of usable tools for making objective measurements from photographs.

We have developed an image processing toolbox that generates images that are linear with respect to radiance from the RAW files of numerous camera brands and can combine image channels from multispectral cameras, including additional ultraviolet photographs. Images are then normalised using one or more grey standards to control for lighting conditions. This enables objective measures of reflectance and colour using a wide range of consumer cameras. Furthermore, if the camera’s spectral sensitivities are known, the software can convert images to correspond to the visual system (cone-catch values) of a wide range of animals, enabling human and non-human visual systems to be modelled. The toolbox also provides image analysis tools that can extract luminance (lightness), colour and pattern information. Furthermore, all processing is performed on 32-bit floating point images rather than commonly used 8-bit images. This increases precision and reduces the likelihood of data loss through rounding error or saturation of pixels, while also facilitating the measurement of objects with shiny or fluorescent properties.

All cameras tested using this software were found to demonstrate a linear response within each image and across a range of exposure times. Cone-catch mapping functions were highly robust, converting images to several animal visual systems and yielding data that agreed closely with spectrometer-based estimates.

Our imaging toolbox is freely available as an addition to the open source ImageJ software. We believe that it will considerably enhance the appropriate use of digital cameras across multiple areas of biology, in particular researchers aiming to quantify animal and plant visual signals.

“Image calibration and analysis toolbox – a free software suite for objectively measuring reflectance, colour and pattern” by Jolyon Troscianko and Martin Stevens in Methods in Ecology and Evolution. Published online August 6 2015 doi:10.1111/2041-210X.12439

Feel free to share this Neuroscience News.
Join our Newsletter
I agree to have my personal information transferred to AWeber for Neuroscience Newsletter ( more information )
Sign up to receive our recent neuroscience headlines and summaries sent to your email once a day, totally free.
We hate spam and only use your email to contact you about newsletters. You can cancel your subscription any time.