14 November 2024 The Future is the Product of the Past

Scientists Create a 3D Model of Lost Temple Relief from a 134-Year-Old Photo Using AI

The researchers developed a neural network that can take a single 2D photo of a three-dimensional object and produce a digital reconstruction in three dimensions. Particularly for artifacts that are hidden, too delicate for traditional 3D modeling, or too fragile to be excavated, this method may revolutionize digital preservation.

In a sense, scientists created a 21st-century stereoscope. Last month, at the 32nd edition of the ACM Multimedia conference, the team presented their proof-of-concept.

A research team at Ritsumeikan University led by Professor Satoshi Tanaka along with Dr. Jiao Pan, from the University of Science and Technology Beijing, used a 134-year-old photograph from the Borobudur Temple in Indonesia to demonstrate the incredible work this neural network can perform.

The largest Buddhist temple in the world, Borobudur is covered in 2,672 relief panels. Built in the 9th century CE, it was eventually abandoned, only to be discovered centuries later by Dutch archeologists.

Image Credit: Pan et al. 2024

The relief, found on the ground level of the famed Borobudur Temple a UNESCO World Heritage site, depicts a group of people in traditional attire set against a backdrop of trees and ancient architecture. It was only known by a black-and-white photo that was taken in the 19th century while the relief was exposed during reconstruction work. It was then covered over by reinforcement walls.

The recent team’s neural network managed to reconstruct one of those now-hidden reliefs using an old black-and-white photo from 134 years ago.

A depth map of the temple relief. Image Credit:: Pan et al. 2024

Although earlier reconstructions had been attempted, they were unable to capture the finer details of the reliefs. These three-dimensional reliefs contain detail from the carvings closest to the viewer and farthest from the viewer, and prior reconstruction attempts flattened out the details at these varying depths, resulting in the loss of those details due to the compression of depth values. Based on the computed curvature changes in the 3D space, the team created a map of the lost characteristics, which they called “soft edges.”

“Our multi-task neural network successfully reconstructed these hidden sections of Borobudur’s ground-level reliefs from surviving old photographs. Through computer visualization and virtual reality, our research now allows virtual exploration of these unseen treasures,” says Prof. Tanaka.

A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024
A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024

By enhancing the depth estimation, particularly around soft edges, they were able to produce images that more accurately represent the original reliefs. The technique is a breakthrough, as 3D scanning and photogrammetry can only record reliefs in their current state, whereas 3D digital restoration returns us to the original.

“Our technology holds vast potential for preserving and sharing cultural heritage,” shares Prof. Tanaka. “It opens new opportunities not only for archeologists but also for immersive virtual experiences through VR and metaverse technologies, preserving global heritage for future generations.”

DOI: 10.1145/3664647.3681612

Ritsumeikan University

Cover Image Credit: Terrace on the temple of Borobudur 1913. Wikipedia Commons

Related Articles

An Urartian fortress was discovered at an altitude of 3,300 meters in eastern Turkey

2 July 2022

2 July 2022

In the Gürpınar district of Van, located in eastern Turkey, a fortress ruin, which is considered to be used by...

500-year-old Ottoman bath revived after years of restoration

5 April 2024

5 April 2024

The 500-year-old Zeyrek Çinili Hammam, a masterpiece of Mimar Sinan and one of the most important examples of Ottoman Bath...

Decapitated skeletons of Roman ‘criminals’ found on HS2 route

5 February 2022

5 February 2022

Archaeologists working with the HS2 project have discovered 425 bodies on the route of the new railway line – around...

The first settlement of the Cimmerians in Anatolia may be Büklükale

7 June 2022

7 June 2022

Archaeologists estimated that the first settlement in Anatolia of the Cimmerians, who left Southern Ukraine before Christ (about 8th century...

From Researchers, a New İnterpretation of Norse Religion

26 February 2021

26 February 2021

Recent research on pre-Christian Norse religions shows that the variation in Norse religions is far greater than previously imagined. Ten...

Hidden past of Ani ruins in eastern Turkey to be uncovered by excavations

31 May 2021

31 May 2021

Archaeological excavations will reveal the historical mystery behind the ruins of Ani on the present-day Turkey-Armenia border. The Ani archaeological...

The ‘boiler room’ of the bath in the Ancient City of Metropolis was unearthed

11 August 2022

11 August 2022

The vault section, called the ‘boiler room’, which provides a heat source, has been unearthed in the historical bath of...

Historic Leeds cemetery discovery unearths an ancient lead coffin belonging to a late Roman aristocratic woman

14 March 2023

14 March 2023

Archaeologists in northern Britain uncovered the skeletal remains of a late-Roman aristocratic woman inside a lead coffin, as well as...

Roman camp of 10,000 people discovered in northern Portugal

2 July 2021

2 July 2021

A camp used by 10,000 Roman soldiers sent to conquer northwestern Iberia has been discovered in the Portuguese city of...

An architectural gem from the medieval monastery of Posa, Germany

26 July 2023

26 July 2023

Archaeological excavations have been taking place on the Posaer Berg (Posa Hill) near Zeitz (Burgenland) every year since 2017. They...

2500-year-old Persian ancient palace dish discovered in Oluz Höyük, Türkiye

18 October 2023

18 October 2023

A 2,500-year-old earthenware pot containing bone fragments and grains from the Persian-era palace kitchen was discovered during archaeological excavations at...

In the Mediterranean Oldest Hand-Sewn Boat is Preparing for its Next Journey

25 January 2024

25 January 2024

The oldest hand-sewn boat in the Mediterranean was discovered in the Bay of Zambratija near Umag on Croatia’s Istrian peninsula....

Research Helps İlluminate the History of the Scythians with 111 Ancient Genomes

27 March 2021

27 March 2021

Due to their interactions and conflicts with the major contemporaries of Eurasia, the Scythians enjoyed legendary status in history and...

Rare Five Bronze Age Axes found in the Forests of Poland

5 December 2023

5 December 2023

Archaeologists in Poland have discovered five Bronze Age axes in Starogard Forest District, located in Kociewie. A metal detectorist named...

Ceremonial meals may have been served in the 4500-year-old structure unearthed in the Yumuktepe Höyük in Southern Turkey

3 November 2021

3 November 2021

A 4,500-year-old structure containing a jar, many pots, and food fossils has been unearthed at the Yumuktepe Höyük (mound) in...

Comments
Leave a Reply

Your email address will not be published. Required fields are marked *