21 November 2024 The Future is the Product of the Past

Scientists Create a 3D Model of Lost Temple Relief from a 134-Year-Old Photo Using AI

The researchers developed a neural network that can take a single 2D photo of a three-dimensional object and produce a digital reconstruction in three dimensions. Particularly for artifacts that are hidden, too delicate for traditional 3D modeling, or too fragile to be excavated, this method may revolutionize digital preservation.

In a sense, scientists created a 21st-century stereoscope. Last month, at the 32nd edition of the ACM Multimedia conference, the team presented their proof-of-concept.

A research team at Ritsumeikan University led by Professor Satoshi Tanaka along with Dr. Jiao Pan, from the University of Science and Technology Beijing, used a 134-year-old photograph from the Borobudur Temple in Indonesia to demonstrate the incredible work this neural network can perform.

The largest Buddhist temple in the world, Borobudur is covered in 2,672 relief panels. Built in the 9th century CE, it was eventually abandoned, only to be discovered centuries later by Dutch archeologists.

Image Credit: Pan et al. 2024

The relief, found on the ground level of the famed Borobudur Temple a UNESCO World Heritage site, depicts a group of people in traditional attire set against a backdrop of trees and ancient architecture. It was only known by a black-and-white photo that was taken in the 19th century while the relief was exposed during reconstruction work. It was then covered over by reinforcement walls.

The recent team’s neural network managed to reconstruct one of those now-hidden reliefs using an old black-and-white photo from 134 years ago.

A depth map of the temple relief. Image Credit:: Pan et al. 2024

Although earlier reconstructions had been attempted, they were unable to capture the finer details of the reliefs. These three-dimensional reliefs contain detail from the carvings closest to the viewer and farthest from the viewer, and prior reconstruction attempts flattened out the details at these varying depths, resulting in the loss of those details due to the compression of depth values. Based on the computed curvature changes in the 3D space, the team created a map of the lost characteristics, which they called “soft edges.”

“Our multi-task neural network successfully reconstructed these hidden sections of Borobudur’s ground-level reliefs from surviving old photographs. Through computer visualization and virtual reality, our research now allows virtual exploration of these unseen treasures,” says Prof. Tanaka.

A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024
A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024

By enhancing the depth estimation, particularly around soft edges, they were able to produce images that more accurately represent the original reliefs. The technique is a breakthrough, as 3D scanning and photogrammetry can only record reliefs in their current state, whereas 3D digital restoration returns us to the original.

“Our technology holds vast potential for preserving and sharing cultural heritage,” shares Prof. Tanaka. “It opens new opportunities not only for archeologists but also for immersive virtual experiences through VR and metaverse technologies, preserving global heritage for future generations.”

DOI: 10.1145/3664647.3681612

Ritsumeikan University

Cover Image Credit: Terrace on the temple of Borobudur 1913. Wikipedia Commons

Related Articles

Excavation in Larissa finds a Hellenistic era sanctuary

27 November 2021

27 November 2021

The Hellenic Ministry of Culture and Sport reported on Friday the discovery of ancient Greek and Hellenistic era structures at...

Scenes of Warriors from 6th Century BC on a Slate Plaque Discovered at Tartessian Site in Spain

6 June 2024

6 June 2024

Archaeologists representing Spain’s National Research Council (CSIC) excavating at the archaeological site of Casas del Turunuelo have uncovered a slate...

Archaeologists find the largest bronze beast of Sanxingdui ruins

4 September 2022

4 September 2022

The largest and only one of its kind discovered in China to date, the bronze beast was discovered by archaeologists...

Archaeologists discover one of the largest Phallus Relief Carving of ancient Rome

28 August 2022

28 August 2022

According to an announcement by the region’s local history museum, a large Roman-era relief carving of a phallus has been...

Baptismal font from the Ottonian period discovered: Oldest evidence of a quatrefoil-shaped basin north of the Alps

19 March 2024

19 March 2024

The site of a font of the medieval Ottonian dynasty, from the tenth century, has been discovered in the crypt...

Swiss Scientists Identify Arrowhead Made from a Meteoritic Iron

1 August 2023

1 August 2023

In a recent study of archaeological collections in the Lake Biel region in Switzerland, an arrowhead from the Bronze Age,...

A rare 3,300-year-old wooden yoke found in northern Italy

30 October 2023

30 October 2023

After eight years of complex excavation, recovery, and restoration, a rare 3,300-year-old wooden yoke discovered in a Late Bronze Age...

Largest Headhunting Massacre of Women and Children in Neolithic China

12 November 2023

12 November 2023

A new study discovers that ancient headless skeletons discovered in mass graves in China are the remains of victims who...

Saudi shipwreck excavation reveals hundreds of 18th-century artifacts on sunken ship in the north Red Sea

25 February 2022

25 February 2022

Divers from Saudi Arabia’s Heritage Authority have discovered a shipwreck in the Red Sea from the 18th century filled with...

New study: Human brains preserve in diverse environments for at least 12 000 years

21 March 2024

21 March 2024

A study by forensic anthropologist Alexandra Morton-Hayward and her team from the University of Oxford has shown that the human...

Excavation of Carlisle Roman bathhouse uncovers a connection between the site and a third-century Roman emperor

27 September 2021

27 September 2021

Excavation of a Roman bath at the Carlisle Cricket Club in Stanwix, part of the Uncovering Roman Carlisle project, has...

Central Turkey’s largest Byzantine mosaic structure found

28 October 2021

28 October 2021

A 300-square-meter (3,330 square feet) ​floor mosaic belonging to the Late Roman-Early Byzantine period was discovered during excavation work in...

Evidence of Intentional Roman Use of Narcotic Seeds, Found in Bone Vessel in the Netherlands

8 February 2024

8 February 2024

Archaeologists have discovered the first conclusive evidence of the existence of a hallucinogenic and poisonous plant thought to have been...

Italian Research Team May Have Found Plato’s Burial Site in Athens

23 April 2024

23 April 2024

Graziano Ranocchia, a papyrologist at the University of Pisa, said he found Plato’s exact burial place based on papyri findings...

HS2 archaeologists discover Romanization of Iron Age village in Britain

12 January 2022

12 January 2022

Archaeologists have uncovered a vast Roman trading town on Britain’s HS2 high-speed rail route. Evidence found during a dig of...

Comments
Leave a Reply

Your email address will not be published. Required fields are marked *