25 May 2025 The Future is the Product of the Past

Scientists Create a 3D Model of Lost Temple Relief from a 134-Year-Old Photo Using AI

The researchers developed a neural network that can take a single 2D photo of a three-dimensional object and produce a digital reconstruction in three dimensions. Particularly for artifacts that are hidden, too delicate for traditional 3D modeling, or too fragile to be excavated, this method may revolutionize digital preservation.

In a sense, scientists created a 21st-century stereoscope. Last month, at the 32nd edition of the ACM Multimedia conference, the team presented their proof-of-concept.

A research team at Ritsumeikan University led by Professor Satoshi Tanaka along with Dr. Jiao Pan, from the University of Science and Technology Beijing, used a 134-year-old photograph from the Borobudur Temple in Indonesia to demonstrate the incredible work this neural network can perform.

The largest Buddhist temple in the world, Borobudur is covered in 2,672 relief panels. Built in the 9th century CE, it was eventually abandoned, only to be discovered centuries later by Dutch archeologists.

Image Credit: Pan et al. 2024

The relief, found on the ground level of the famed Borobudur Temple a UNESCO World Heritage site, depicts a group of people in traditional attire set against a backdrop of trees and ancient architecture. It was only known by a black-and-white photo that was taken in the 19th century while the relief was exposed during reconstruction work. It was then covered over by reinforcement walls.

The recent team’s neural network managed to reconstruct one of those now-hidden reliefs using an old black-and-white photo from 134 years ago.

A depth map of the temple relief. Image Credit:: Pan et al. 2024

Although earlier reconstructions had been attempted, they were unable to capture the finer details of the reliefs. These three-dimensional reliefs contain detail from the carvings closest to the viewer and farthest from the viewer, and prior reconstruction attempts flattened out the details at these varying depths, resulting in the loss of those details due to the compression of depth values. Based on the computed curvature changes in the 3D space, the team created a map of the lost characteristics, which they called “soft edges.”

“Our multi-task neural network successfully reconstructed these hidden sections of Borobudur’s ground-level reliefs from surviving old photographs. Through computer visualization and virtual reality, our research now allows virtual exploration of these unseen treasures,” says Prof. Tanaka.

A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024
A soft-edge map (left) and semantic map (right) of the 2d relief image Credit: Pan et al. 2024

By enhancing the depth estimation, particularly around soft edges, they were able to produce images that more accurately represent the original reliefs. The technique is a breakthrough, as 3D scanning and photogrammetry can only record reliefs in their current state, whereas 3D digital restoration returns us to the original.

“Our technology holds vast potential for preserving and sharing cultural heritage,” shares Prof. Tanaka. “It opens new opportunities not only for archeologists but also for immersive virtual experiences through VR and metaverse technologies, preserving global heritage for future generations.”

DOI: 10.1145/3664647.3681612

Ritsumeikan University

Cover Image Credit: Terrace on the temple of Borobudur 1913. Wikipedia Commons

Related Articles

Iron Age port discovered on Swedish island of Gotska Sandön

21 September 2023

21 September 2023

Archaeologists have discovered an Iron Age port on Gotska Sandön, an island and national park in Sweden’s Gotland district. In...

1700-year-old Roman shoes and craft district found in France

3 June 2023

3 June 2023

An ancient Roman craft district was discovered by archaeologists working in the southwest of the town of Therouanne near a...

Researchers identified, for the first time, the composition of a Roman perfume more than 2,000 years old

25 May 2023

25 May 2023

A research team at the University of Cordoba has identified, for the first time, the composition of a Roman perfume...

Coin hoard found in fireplace ‘belonging to Scottish clan chief’ murdered at infamous Glencoe Massacre

17 October 2023

17 October 2023 1

Coins believed to have belonged to a Scottish clan chief murdered in an infamous 17th-century Glencoe massacre, have been found...

Orkney dig reveals ruins of huge Neolithic tomb

21 October 2023

21 October 2023 1

A 5,000-year-old tomb was unearthed in Orkney, north-east Scotland. The discovery was announced by the Guardian, describing the tomb structure...

Over 4 feet long sword found in a medieval grave in Sweden

29 December 2023

29 December 2023

An unusual and exciting discovery was made during archaeological research at Lilla Torg in the port city of Halmstad on...

Declassified CIA Satellite Spy Program Reveals Lost Ancient Roman Forts

26 October 2023

26 October 2023

Archaeologists have discovered “massive” ancient Roman forts that redraw the borders of the ancient empire using images from a declassified...

Could the Kerkenes Settlement be Gordion the Second?

1 August 2022

1 August 2022

Although the settlement on the Kerkenes mountain, located within the borders of Sorgun district of Yozgat, has been known and...

Remains of a 5-year-old girl found under Real Alcázar in Spain

9 May 2021

9 May 2021

The body of a five-year-old fair-haired girl who lived in the late Middle Ages and was most likely of noble...

At Ostrowite, archaeologists have discovered a high-status burial dating back almost a thousand years

2 January 2022

2 January 2022

Archaeologists have discovered a burial chamber in Ostrowite, in Poland’s Pomeranian Voivodeship, containing several high-status grave goods from the 11th...

A Giant Stone Panel Discovered in Mexico Reveals the Name of a Previously Unknown Maya King’s

14 August 2024

14 August 2024

Archaeologists from Mexico’s National Institute of Anthropology and History (INAH) have discovered a fascinating panel containing an extensive Maya hieroglyphic...

Mummy of Egyptian pharaoh Amenhotep ‘unwrapped’ for the first time in 3,500 years!

30 December 2021

30 December 2021

Egyptian scientists have digitally unwrapped the 3,500-year-old mummy of pharaoh Amenhotep I. For the first time, a team in Egypt...

Remains of first Islamic madrassa found in Turkey’s Harran

1 December 2021

1 December 2021

The remnants of a 12th-century madrassa (Islamic institution of higher instruction) have been discovered in the archaeological site of Harran,...

A previously unknown Roman fort discovered in Pembrokeshire in Wales

8 August 2024

8 August 2024

A previously unknown Roman fort has been discovered in north Pembrokeshire. The site, which has excited archaeologists, had been hidden...

Archaeologists unearth mosaic floors in the ruins of a building they believe is the lost Church of the Apostles

23 October 2021

23 October 2021

In the historical village of Bethsaida on the edge of the Sea of Galilee, archaeologists discovered mosaic floors in the...