Commercial image library Shutterstock has introduced a new 'computer vision' search technology that finds photos according to their contents and not just the keywords that photographers have attached to them. It's designed for publishers and designers searching for professional quality photos they can license, but the technology has potential for photographers everywhere.
The company's new Reverse Image Search can find photos matching a sample image that you provide, which is designed for situations where you've found exactly kind of photo you want but it's owned by somebody else. It's really simple to use – you just drag an image into the search box to see a selection of visually similar alternatives.
Shutterstock's solution uses a combination of computing hardware and software algorithms. "It breaks down an image into principal features that it can define numerically." The system uses a 'convolutional neural network' which can learn the properties that define a 'cat', for example.
Its developers went through a whole series of iterations to improve and refine the search results before releasing it as a finished product on the Shutterstock website.
The Google Search by Image feature works in a similar way. You upload a photo and Google finds visually similar images online. This capability is built into Google Photos, too, so that you don't have to add keywords and tags any more because Google can find pictures through visual similarity, location data and other clues (mostly, anyway).
This could develop into the next big imaging revolution, where computers can not just recognise similar-looking images, but make connections between people, places and events that we may not have thought of.
