Skip to content
Darley Defense Day · Dec 1

Gaussian splatting

Gaussian splatting for defense mapping.

Gaussian splatting is a way to reconstruct a 3D scene from ordinary photos or video by fitting millions of small, semi-transparent 3D shapes, called Gaussians, to the images. The result renders in real time and keeps detail that meshes lose, such as wires, antennas, and foliage. SpatialGen reconstructs scenes from video as 3D Gaussian splats.

Last updated

Why Gaussian splatting matters for defense mapping

Most tactical 3D maps are textured meshes made by photogrammetry: triangles with photos draped over them. Meshes are good at solid surfaces, such as ground, walls, and roofs, and they are what route planners and TAK clients expect. They are poor at thin or see-through things. Power lines, fences, masts, and trees come out broken or missing, and those are exactly the obstacles a low-flying drone has to clear.

3D Gaussian splatting, introduced by Kerbl and colleagues in 2023, represents the scene as a cloud of Gaussians, each with a position, shape, color, and opacity. It reproduces fine structure and view-dependent appearance, and it draws fast enough to explore interactively on ordinary graphics hardware.

The trade is that a splat is not a surface. Measuring, collision checking, and route planning need geometry, and TAK clients draw meshes and tiles. A practical defense pipeline therefore uses splats for what they see well and geometry for what has to be measured or flown around.

Gaussian splats, meshes, and NeRF

RepresentationWhat it storesStrengthLimit
Textured mesh (photogrammetry)Triangles with photo texturesMeasurable surfaces; supported by ATAK as KMZ and 3D TilesThin structures, vegetation, and reflective surfaces reconstruct poorly
Neural radiance field (NeRF)A neural network queried along each camera rayHigh-fidelity views from new anglesSlow to render in its original form, and hard to edit or measure
3D Gaussian splatsMillions of Gaussians with position, shape, color, and opacityReal-time rendering with fine detailNot a surface: needs geometry alongside it for measurement and planning

How a splat is built

  1. 01

    Capture video

    Any camera works: a drone, a handheld device, or an ISR feed. The scene needs to be seen from more than one direction.

  2. 02

    Recover the camera path

    Structure from motion works out where the camera was for each frame and produces a sparse set of 3D points to start from.

  3. 03

    Fit the Gaussians

    An optimizer on a GPU adjusts the position, shape, color, and opacity of each Gaussian until rendering them reproduces the captured frames.

  4. 04

    Use the scene

    The splat can be explored from any angle. For TAK, the area is delivered as geometry: a KMZ model or a 3D Tiles scene package.

Terms

Gaussian splat
One small 3D Gaussian, or a whole scene made of them. Splatting is the act of projecting each Gaussian onto the screen and blending them.
Structure from motion
Recovering camera positions and a sparse 3D point cloud from overlapping images.
NeRF
Neural radiance field: a scene stored as a neural network that returns color and density for any point and viewing direction.

Questions

What is Gaussian splatting?

Gaussian splatting is a 3D reconstruction technique that represents a scene as millions of small, semi-transparent 3D Gaussians fitted to photos or video. Rendering them together reproduces the scene from any viewpoint in real time. It was introduced in 2023 and is now used for mapping, digital twins, and visual effects.

Is Gaussian splatting better than photogrammetry?

It is better at appearance and fine detail, and worse at producing clean surfaces. Splats capture wires, vegetation, and reflective materials that photogrammetry meshes break on. Meshes give measurable geometry that planners and TAK clients can use directly. For defense mapping the two are complementary, not substitutes.

Can ATAK display Gaussian splats?

ATAK's 3D model support is built around meshes, such as KMZ, and 3D Tiles. A scene captured as splats therefore has to be delivered to TAK as geometry in one of those formats. The SpatialGen ATAK plugin loads KMZ models and 3D Tiles scene packages and plans drone routes on them.

How is Gaussian splatting used in defense?

The main uses are mission rehearsal, where a team explores a photoreal model of a site; reconnaissance, where detail such as wires and antennas matters; and digital twins of facilities. Because a splat can be built from ordinary video, it fits sensors that units already carry.

What hardware does Gaussian splatting need?

Fitting the Gaussians is done on a GPU. Viewing a finished splat is much lighter and runs on ordinary graphics hardware, including in a web browser. The capture side needs only a camera.

How does SpatialGen use Gaussian splatting?

SpatialGen reconstructs scenes from video as 3D Gaussian splats, alongside the 3D map it builds from satellite imagery for drone navigation. Request a briefing to see reconstructions and discuss which representation fits your program.

Darley Defense Day · December 1

See it. Win it. December 1.

Live at Darley Defense Day.