‘Eyes of a machine’: How to classify Planet Earth

We are a force of Nature. Humans have reshaped the surface of the Earth to their whim. Changes that used to occur naturally over hundreds, even thousands of years, can now turn over in a matter of weeks.

One of the ways we’ve tried to keep track of this relentless recasting of our planet is through the land cover map.

Researchers will take aerial photos or satellite images and categorise the scene below. Where are the grasslands and forests; the roads and buildings; what is water and what is snow or ice?

Such maps tell us where the resources are and help us to manage them. They aid urban planning, assess crop yields, analyse flood risks, and track impacts on biodiversity – the list is endless.

The challenge is corralling the flood of new data that threatens to make any land cover map out of date the moment it’s produced.

It’s why researchers are increasingly reaching for artificial intelligence (AI) tools.

Image: ESRI

Take for example, this week’s Living Atlas release from US company Esri, the leading producer of geographic information system (GIS) software.

Esri has produced a global land cover map for 2020 made from the pictures acquired by the European Union’s Sentinel-2 satellite constellation.

This is a pair of spacecraft in orbit that continuously photograph Earth’s surface at a resolution of 10m (the size of each pixel in an image). Terabytes of data are coming down every day.

An army of researchers would struggle to fully characterise the contents of all those pixels, but a machine can do it – and fast.

In a typical workflow, a 2020 land cover map would probably not come out until middle or late this year, because it takes that much processing time, it takes that much checking and validation work to go on,” explained Sean Breyer, who manages Esri’s Living Atlas of the World programme.

But we’ve come up with a process – with our partners Impact Observatory – that uses an AI approach. The entire runtime to compute the entire planet’s land cover was under a week. That brings in a whole new dimension to land cover mapping that says we could potentially do land cover mapping on a weekly basis or even a daily basis for targeted areas,” he told BBC News.

Image: Airbus

Tech firm Impact Observatory developed its AI land classification model using a training dataset of five billion human-labelled image pixels. This model was then given the Sentinel-2 2020 scene collection to classify, processing over 400,000 Earth observations to produce the final map.

So we had experts labelling these images, and then much like the way a child learns, we’re feeding information to the model,” said Dr Caitlin Kontgis, the head of science and machine learning at Impact Observatory.

“With more iterations and more information, the model learns these patterns. So if it sees ice in one location, it can then find ice in another location. “The data-set we used to train the model is incredibly novel and allows us to look not only at spectral features – like the colours in a satellite image – but also at the spatial context. And in doing so, we were able to train this model up and then run it over the globe to get this highest resolution map available in less than a week.

London. Image: ESRI

The Living Atlas Sentinel-2 2020 Land Cover Map, produced with the assistance of Microsoft, is open source. Anyone can play with it. Take a look at your home area and see how well you think the model did in gauging the different surface types.

If you look at some of the 30m-resolution products out there, they miss lots of the small town areas – the little shires, the collections of four or five buildings as part of a farm unit. But at 10m resolution, I think we’re picking most of those up,” said Sean Breyer.

There is a rapidly increasing population of satellites above our heads. Not only are they getting a sharper view of things (sub-1m resolution is the new battleground), but the type of information they return is becoming richer. More wavelengths, more colours; and the same scenes are being observed several times a day, looking for changes.

Whether it’s tracking deforestation or sensing gas plumes from volcanoes – this knowledge bounty just gets bigger and bigger. But it means nothing unless we can fully use the data. Machine learning solutions are the only way we’ll get near to staying on top of it all.

See more here: bbc.co.uk

Header image: ESRI

Please Donate Below To Support Our Ongoing Work To Defend The Scientific Method

PRINCIPIA SCIENTIFIC INTERNATIONAL, legally registered in the UK as a company incorporated for charitable purposes. Head Office: 27 Old Gloucester Street, London WC1N 3AX. 

Trackback from your site.

Comments (2)

  • Avatar

    tom0mason

    |

    Typical BBC nonsense report that FAILS to cast a critical eye over what is really happening. Still the BBC has no ‘science’ reporters that are qualified in any science field (well they have some with ‘Social Science’ humanities type qualifications which as many people know is neither ‘Social’ nor ‘Science’ 🙂 ) so it is to be expected — what are UK citizen paying their license fee for?
    No, this childish report is just another breathless over-the-top ‘gee-whizz’ look at what the latest technology does, style of reporting.
    Where are the questions about how to ensure that these AI computers are programmed correctly? Questions about how the IA programming uses validated systematic methods to ensure neither gross nor subtle biases are included, and that the output is checked to ensure it is logical and rational response for the input data.
    This like so many BBC reports on AI gives the innocent reader the false idea that AI’s output is somehow ‘picture perfect’ and can never be in error. Where were the questions about how all these AI computers’ programming are properly validated, verified and certified (preferably by an independent and qualified computer programming authority) to the highest available standards?

    So again the BBC does the readers and viewers a disservice in properly reporting on this topic, properly reporting on the advantages, disadvantages and possible downfalls of these new methods.

    Reply

  • Avatar

    Jerry Krause

    |

    Hi TomO,

    I only make this comment to possibly learn what, if any, your response might be.

    I believe BBC has been successful in diverting your attention from a more important fundamental issue. Which is that there are PLANNERS who are planning to control what a person can do with a 10 by 10 meter piece of a person’s property..

    Have a good day, Jerry

    Reply

Leave a comment

Save my name, email, and website in this browser for the next time I comment.
Share via