Red-crowned crane 2 (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
The DMZ and the surrounding Cheorwon plain is the wintering habitat of several endangered cranes species. Ecologists, environmental activists, and Cheorwon residents have made many efforts over the years to survey and protect these birds. In addition to the traditional surveying devices, Artificial Intelligence (AI) and Augmented Reality (AR) are also deployed. Shall we take a look at the technologies being used to protect the cranes?
White-naped crane 2 (2021-02) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Cranes in the Cheorwon-DMZ area
Every fall, Cheorwon welcomes the cranes which fly several hundred kilometers from Siberia to Korea. After the harvest, large quantities of the grains are left in the rice paddies for the cranes to feed on, while the wetlands inside of the DMZ provide a safe resting place for them to sleep.
Cranes at dawn (2021-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
World’s largest wintering site for red-crowned cranes
There are currently 14 species of cranes worldwide. Seven species of them are observed in the Korean Peninsula. Approximately 1,000 red-crowned cranes and 5,500 white-naped cranes (representing over 50 percent of the global population of their respective species) spend their winters in Cheorwon.
White-naped cranes (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Surveying and protecting the cranes
The cranes in Cheorwon are designated as internationally endangered species. Developmental projects near the CCL and the changes in farming methods poses additional threats to their habitats. Local residents in Cheorwon and researchers have been monitoring the crane population and their habitats.
Traditional surveys
From October until March of the following year, ornithologists and surveyors conduct a monthly population to count of all the cranes in the Cheorwon plains. For the crane census, the Cheorwon plains are divided into several sections. The surveyors are paired up and count each and every crane in their assigned section during the allocated survey time.
Crane survey in traditional methods 6 (2021-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
For effective crane survey, it is crucial to be equipped with: a sturdy vehicle that can travel over rough farm roads, a satellite map, a GPS navigation app, and the trained eyes to spot the cranes from far away!
Surveying cranes in traditional methods 2 (2021-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
The size and locations of the cranes are marked down on the print-outs of satellite maps. The red-crowned cranes are represented as triangles, and the white-naped cranes as circles. Cranes usually travel in family groups of three or four.
Surveying cranes in traditional methods 4 (2021-06) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
After the counting, the number of cranes per section, as recorded on the satellite map, are transcribed into the field notebooks, and then aggregated to calculate the total crane population. In January 2021, there was a total of 5,330 white-naped cranes and 1,126 red-crowned cranes.
Digital technologies for crane surveys
Surveying the crane population requires skills and knowledge on the cranes and the area being surveyed, which are gained through many years of practices. This requires large amounts of time, effort, and field experience. Then, wouldn’t it be possible that digital technologies – such as AI and unmanned remote surveillance equipment – are deployed to assist with the crane survey?
Collecting crane data from trail cameras
The research team decided to use the trail cameras. A trail camera automatically takes photos or videos when it detects movement of animals among others. It is small, handy, but a major tool for conducting ecological surveys especially for large mammals or birds. We have installed a dozen of trail cameras in the wetlands and rice paddies heavily frequented by the cranes.
White-naped cranes (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Over the past two winters, tens of thousands of photos and videos were captured. Not being disturbed by any human presence or activities, the cranes look as if they are not being observed at all. Shall we take a look at the examples?
Cranes at dawn (2021-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
The red-crowned crane has white and black feathers on its body, and a red patch on the head, as its name suggests. The white-naped crane in the background has gray wings and red patches around its eyes.
white-naped cranes on hunting (2021-11) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Cranes are omnivores. They eat not only the grains but also small animals, such as freshwater snails and loaches. The rice paddies, which have been flooded after the harvest, provide the cranes with the ideal place to stay.
Red-crowned crane4 (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Isn’t this sunset looks like a scene straight from a classical Eastern painting?
Cranes resting (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
What would have woken up the cranes late at night?
Crane flight (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
At sunrise, the cranes leave the rice paddies they’ve slept, and fly for food in small groups.
Whooper Swan (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
The cranes were not the only animals captured in the trail cameras. Whooper swans take a short rest at Cheorwon on their ways to Siberia from Junam Reservoir and the Nakdonggang River in the South.
Water deer (2020-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
A water deer carefully walks through a frozen rice paddy.
white-naped cranes 3 (2021-11) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
A curious white-naped crane is also snapped.
Deep-learning analysis of the crane population
The latest AI devices can analyze images to calculate the human populations. Can an AI device count the number of cranes then? The researchers at KAIST and National Institute of Ecology decided to develop deep learning algorithms, tentatively called “AI ecologist”, that can automatically provide the population-related figures for each crane species. Ornithologists who have studied Cheorwon’s cranes for a long time graciously provided 1,400 crane photos for AI training.
White-naped cranes and red-crowned cranes through fieldscope (2018-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Labelling of the cranes
In order to develop AI, the computer must be fed with the data that is correctly labeled. For the crowd counting of human population, the images are typically labelled by tagging a dot on the head of a person. However, this strategy was not easily applied to cranes; A lot of cranes feed with their head tucked under their wing, making it impossible to dot each head.
Crane identification labelling (2020-07) by Yoo Seong-Hwa, Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Then, how to label the cranes whose heads aren’t readily visible? The research team decided to draw a line that connects a dot on each crane’s head with a dot on their body. To reflect the crane’s unique characteristics and habits, the labeling method was changed from dots to lines.
AI training in the Lab (2021-01) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
AI training
Once the data is labeled, it is used for AI training. A computer is shown an image of the cranes, and provides an estimate of the crane population. Then the computer’s estimate is compared with the actual, correct figure. If the computer gives an incorrect answer, then it is sent back to square one! Repeating this process dozens of times, the computer finally begins to give much accurate answers.
Automated crane counting - the image (2020-10) by Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
Test
Let’s see how it works. This photo features dozens of white-naped cranes. The cranes with a brownish tinge on their head or neck are younger ones less than one year old. Those birds with a white head and neck are adults.
Analyzing the images, the AI produces species-specific density maps that show the locations and population density of each species. The red and yellow sections indicate a high density of cranes. This picture (left) shows the ground truth: 39 adult white-naped cranes (top) and seven young cranes (bottom). The AI device (right) counted 42 adult white-naped cranes (top) and four young cranes (bottom). Not too bad?
AI-assisted species-specific crane counting 1 (2021-04) by Yoo Seong-Hwa, Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
AI crane-counting
This crane video was filmed by one of our trail cameras. There are five density maps (one per species). The map below the crane image shows the population of adult white-naped cranes, which is the dominant species in the image. You can see the changes of AI estimates in accordance with the cranes entering and leaving the area.
Crane-counting AI by: Go Hyojun, Byun Junyoung, Cho Seungju, Dr.Changick Kim (School of Electrical Engineering, KAIST)
Demo video by: Cho Seungju
Red-crowned crane (2011-01) by Yoo Seong-HwaCenter for Anthropocene Studies, KAIST
Human and AI ecologists
The AI is still much less capable than a human surveyor. Although it produces relatively accurate counts for simple photos, its accuracy level drops significantly for photos of multiple crane species. There is still a long way to go. For the continued development of AI ecologist, we will develop an interspecies partnership between humans and AI, rather than replacement of one by another, through which the human and AI surveyors can make the best of their capacities.
Digital visualisation of cranes 1 (2020-09) by Yoo Seong-Hwa, Center for Anthropocene Studies, KAISTCenter for Anthropocene Studies, KAIST
AR visualisation of crane survey data
This video visualises the crane census data, which was written on the satellite map in pen, by using the MS HoloLens 2. The white dots represent the locations of the cranes. Each time you tap the screen with your finger, you can see the changes in the distribution of the crane population based on the year and species.
Data set by: Yoo Seunghwa (NIE)
Video: Jang Seokseong, Jeon Seongjin, Dr. Woo Woon-Tack (Graduate School of Culture Technology, KAIST)
Story: Myung-Ae Choi (Research Assistant Professor, CAS, KAIST)
The Center for Anthropocene Studies, KAIST would like to thank Drs Yoo Seunghwa Yoo, Gisup Lee, and Su-ho Kim, Yong-hyun Park, In-cheol Choi, and Ji-hoon Lee for allowing and welcoming the research them in the monthly crane census during the winters 2020-2022. The CAS would also like to thank Kyong-Won Seo, Jong-Soo Choi, and Yong-Bin Kim (local farmers and residents of Cheorwon) for their help installing and managing the trail cameras.
This story is an edited version of an article published in Volume 15 of EPI, a quarterly science magazine (“Making of an AI ecologist: Interdisciplinary research of humanities and social sciences, ecology, and engineering,” Myung-Ae Choi, 2021).