A groundbreaking digital preservation venture has created probably the most complete 3D map of Alcatraz Island ever produced, combining cutting-edge drone know-how, synthetic intelligence, and actuality seize methods to doc one among America’s most infamous historic websites. Pete Kelsey, founding father of VCTO Labs, introduced the outstanding achievements of this bold venture at Intergeo 2025 in Frankfurt, Germany, the place he detailed how his worldwide staff of over 20 volunteers accomplished what represents one of many largest-scale digital twin tasks of an American landmark.
The venture, accomplished in December 2023 in partnership with the Nationwide Park Service, represents a brand new frontier in cultural heritage preservation. Throughout his presentation, Kelsey mentioned the technical challenges and groundbreaking conclusions from what he described as one of the vital complete conservation tasks ever carried out in the USA. Rising sea ranges, seismic exercise from the San Andreas Fault, and the affect of over a million annual guests have created urgent considerations for the 22.5-acre island’s structural integrity.
Dwelling and Working in America’s Most Well-known Jail
Kelsey’s staff spent three weeks dwelling within the precise jail cells on Alcatraz, working across the clock to seize 4 terabytes of information utilizing terrestrial laser scanning, drone-based LiDAR, multispectral scanning, photogrammetry, and robotic methods. The weird dwelling preparations turned a part of the venture’s distinctive character.
“I used to be in D-block, third tier, cell quantity 31. Dwelling candy house!” joked Kelsey throughout his presentation. Regardless of considerations in regards to the island’s reported paranormal exercise, Kelsey stated his sleep was glorious, although he needed to relocate as soon as when a retired police officer on the staff’s loud night breathing turned disruptive. His unnamed colleague’s non permanent transfer to the mugshot room beneath the previous hospital proved short-lived on account of unexplained sounds from upstairs, together with what seemed like a piano participant and crowds of 50-100 individuals.
The cruel working situations prolonged past ghostly encounters. The staff needed to deliver all their very own provides, together with sleeping baggage and meals, whereas sharing a single toilet and brushing their enamel at ingesting fountains. Working primarily through the early morning hours earlier than vacationers arrived, the staff had solely two to three-hour home windows to seize information with out disrupting the customer expertise.
Superior Know-how Arsenal
The venture’s success trusted an unprecedented mixture of actuality seize applied sciences. With a background in development and surveying, Kelsey emphasised the significance of creating a sophisticated survey management community that achieved 6mm precision. This baseline made the in any other case practically unimaginable process of mixing and reconciling information from totally different sources manageable, making a basis from which the staff might work.
“Beginning with a survey management community helped so much – there is no such thing as a endgame with out that,” Kelsey defined.
Drone Know-how at Work
The venture’s aerial information assortment represented one of the vital refined multi-platform drone operations ever carried out at a Nationwide Park Service website, the place flights are normally banned. The staff deployed a number of specialised unmanned aerial automobiles, every chosen for particular mission necessities throughout Alcatraz’s various terrain and structural challenges.
The Impressed Flight 1200i served as the first heavy-lift platform, able to carrying bigger sensor payloads for prolonged flight occasions across the island’s perimeter and elevated constructions. For precision mapping of the island’s advanced topography, the staff utilized the EagleNXT eBee fixed-wing drone, which offered environment friendly protection of enormous areas whereas sustaining the accuracy required for survey-grade documentation.
Maybe most crucial to the venture’s success was the deployment of the Elios 3 collision-resistant drone for confined inside areas. This specialised platform allowed the staff to securely navigate the slim corridors, cells, and utility areas inside the jail buildings the place conventional drones would have been unimaginable to function. The Elios 3’s protecting cage and superior collision-avoidance methods enabled detailed scanning of inaccessible areas that had by no means been comprehensively documented.
ESRI performed an important position within the Alcatraz venture, offering each photogrammetry experience and superior processing capabilities by way of their ArcGIS Actuality suite of software program merchandise. The photogrammetry element represented one among three crucial aerial information assortment flights, alongside the LiDAR and multispectral scanning operations. ESRI’s contribution was important for creating the photorealistic texture mapping that will later be built-in with the LiDAR level cloud information to provide the ultimate digital twin.
Phoenix LiDAR Techniques offered the RANGER-U120 high-precision, long-range LiDAR scanner, which turned the cornerstone of the aerial mapping operations. This survey-grade system delivered the centimeter-level accuracy required for creating baseline documentation that would help many years of future monitoring. The RANGER-U120’s capacity to penetrate vegetation and seize exact measurements of deteriorating concrete and metal constructions proved important for documenting the island’s present structural situation.
The aerial operations required cautious coordination with Federal Aviation Administration rules and Nationwide Park Service necessities, significantly given Alcatraz’s location in restricted San Francisco Bay airspace. Flight operations have been additional difficult by the island’s seabird nesting seasons, which restricted entry to sure areas throughout crucial breeding durations. The staff needed to work inside slim time home windows, sometimes throughout early morning hours earlier than vacationer operations started, maximizing their temporary alternatives to gather complete aerial information with out disrupting customer experiences.
For areas with environmental hazards containing lead and asbestos, (the place using drones risked spreading poisonous mud) the staff deployed a Boston Dynamics robotic canine nicknamed “Spot”, outfitted with Emesent’s Hovermap LiDAR system. This robotic answer prevented human publicity to poisonous supplies whereas sustaining information assortment capabilities. The Hovermap system might seize steady scans at Spot’s most strolling tempo, making it considerably sooner than standard terrestrial laser scanning strategies.
RIEGL USA contributed terrestrial laser scanning tools, together with the VZ-600i for inside scans and the VZ-2000i for long-range exterior scanning able to reaching 2.5 kilometers distance, capturing parts of the San Francisco shoreline.
Processing Energy Challenges
One of many venture’s most important technical challenges got here from Alcatraz’s restricted web connectivity, which dominated out cloud-based information processing. The answer got here from AMD, which offered a prototype workstation outfitted with a 96-core Threadripper PRO processor and half a terabyte of RAM.
“The workplace on Alcatraz was actually chilly, however that machine saved us heat,” Kelsey famous.
Epic Video games Integration and Digital Actuality Purposes
Epic Video games performed a major position in creating the ultimate digital twin expertise utilizing their RealityScan, Twinmotion, and Unreal Engine applied sciences. The RealityScan 2.0 software program was used to generate an in depth digital reproduction from aerial LiDAR, images, and Bentley’s Cesium tiles, whereas Unreal Engine offered the framework for creating immersive, interactive experiences.
The Epic Video games integration allows a number of functions past easy documentation. In future, the mannequin might help digital tourism capabilities, permitting guests to discover areas usually restricted to the general public. “What about all of the individuals who need to go behind the velvet ropes? With a pair of goggles, I can present that world to you,” Kelsey defined.
Historic Discoveries and Documentation
The great scanning revealed beforehand unknown historic options and documented well-known components of Alcatraz’s previous. The staff efficiently mapped the whole escape route used within the notorious 1962 breakout by Frank Morris and brothers Clarence and John Anglin. Their scans captured the upstairs workshop the place the escapees constructed their rafts and the routes they used to succeed in the water.
Multi-spectral scanning methods revealed the stays of a helipad added through the Nineteen Sixties, uncovering island historical past that even Nationwide Park Service workers had forgotten. The staff additionally documented graffiti all through the power, together with notes written by guards and pictures created by rioting inmates, although Kelsey famous wryly that some prisoner paintings was too specific for public show.
Maybe most importantly, the venture revealed the unique Civil Battle-era sallyport, or secured entrance, on the japanese facet of the island – a characteristic that had not been seen for over a century. This discovery offered new insights into Alcatraz’s navy historical past earlier than its well-known jail years.
Conservation and Local weather Change Purposes
The digital twin serves a number of conservation functions, offering baseline documentation to observe the results of local weather change, seismic exercise, and customer affect on deteriorating constructions. The Nationwide Park Service can now examine future surveys towards this complete dataset to trace modifications over time.
“On the very least, we’ve created a baseline information set that future surveys will be primarily based on. Whether or not it’s sea degree rise or erosion, or San Francisco’s seismic exercise, we’ll have the ability to observe the modifications and be part of the way forward for the island,” Kelsey defined.
Future Income and Instructional Purposes of Digital Twins
Past conservation, the digital twin might create new income alternatives for the Nationwide Park Service by way of digital tourism and academic functions. The know-how allows immersive experiences for individuals unable to go to the island bodily and gives academic establishments with unprecedented entry to historic websites.
Kelsey envisions the venture contributing to his “BHAG” (Massive Furry Audacious Objective): creating the world’s first digital nationwide park. The filming and digital actuality know-how might turn into a major income driver for the park service whereas increasing entry to historic training.
“Actuality seize is educating the consumer in regards to the asset they now have, and the way it may very well be used for something, from upkeep to licensing,” Kelsey famous. The great documentation additionally helps upkeep planning by offering detailed structural data for preservation specialists.
Technical Classes and Trade Affect
The Alcatraz venture demonstrated a number of key ideas for large-scale actuality seize tasks. Kelsey emphasised the significance of thorough planning, noting that 9 months of preparation preceded the three-week information assortment part. Acquiring permits for drone operations in a nationwide park and coordinating round seabird nesting seasons required in depth advance work.
The venture’s success depended closely on collaboration between a number of know-how corporations and volunteers who contributed tools and experience. Phoenix LiDAR Techniques, Emesent, RIEGL USA, Boston Dynamics, AMD, Epic Video games, and quite a few different companions offered important parts of the excellent answer.
For drone professionals planning comparable tasks, Kelsey really useful beginning with a exact survey management community and calling on skilled companions. “Having executed massive strategic tasks like this earlier than, I had a way of easy methods to do it. I relied on individuals so much smarter than me – I known as in each favor anybody ever owed me,” he defined.
Advancing Digital Preservation Requirements
The Alcatraz digital twin venture units new requirements for cultural heritage preservation, demonstrating how superior geospatial applied sciences can shield America’s historic landmarks for future generations. As rising sea ranges and excessive climate occasions more and more threaten coastal historic websites, Kelsey’s work gives a replicable mannequin for complete digital documentation.
“We make the invisible seen. We make individuals see views and factors of view which have by no means been seen earlier than,” Kelsey stated, referring to actuality seize professionals. The venture’s mixture of a number of applied sciences, robotic methods, and superior processing capabilities creates a template for preserving different important historic websites dealing with comparable environmental and structural challenges.
The great dataset now serves as a everlasting document of Alcatraz Island’s situation in 2023, making certain that future researchers and conservationists can have exact documentation of this iconic American landmark no matter how local weather change and time could alter its bodily construction.
Extra data on VCTO Labs and Pete’s different tasks can be found right here.
Learn Extra
Ian McNabb is a journalist specializing in drone know-how and way of life content material at Dronelife. He’s primarily based between Boston and NH and, when not writing, enjoys mountain climbing and Boston space sports activities.