Augmented Reality

Table of Contents

Overview #

The Augmented Reality feature is a beta feature allowing users to overlay KML/KMZ file data on the video in the Video Player panel within LineVision Desktop.

NOTE:  This beta feature only applies to video played back in LineVision Desktop and does not currently support exporting the new overlaid video as standalone .MP4 file.

LineVision Desktop Showing KML File Overlayed on Video Using the Augmented Reality Feature

LineVision Desktop showing a powerline KML file overlaid on video using the Augmented Reality feature

Feature Availability #

Feature Prerequisites #

  • This feature requires a video file that meets one of the following criteria:
    • Video file must have a companion file with “Camera Target Footprint” (CTF) metadata, such as from a geoDVR paired with a compatible gimbal camera.
    • Video file must meet MISB FMV/STANAG 4609 specifications with embedded Camera Target Footprint (CTF) metadata, such as from a modern military/law-enforcement gimbal camera or from a geoDVR paired with a compatible gimbal camera.
    • Video file must have a companion file with “estimated” Camera Target Footprint (CTF) metadata, such as a video modified and exported from LineVision Desktop. For more details on this capability, see the Estimate Camera Target Footprint on Map article in the LineVision Desktop documentation.
  • To load a KML file to LineVision Desktop you will need to be logged into your Esri ArcGIS Online account at the required user type level. You must be a Creator, Professional, or Professional Plus Esri user to use this feature. These user types are included in the Standard or Advanced license levels. For more details, see the Authenticate with Esri OAuth section of the LineVision Desktop documentation.
  • You must use the default Windows Media (DirectX) or optional FFMPEG decoder LineVision Desktop. The VLC decoder option will not work. For more details, see the Change Video Decoder section of the LineVision Desktop documentation.

Using Augmented Reality #

Select KML/KMZ File #

Select the KML or KMZ for the Augmented Reality overlay in LineVision Desktop. Go to Options > Video Mapping Settings > Augmented Reality Settings  > Augmented Reality Options.

Go to Options > Video Mapping Settings > Augmented Reality Settings > Augmented Reality Options.

This will open the Augmented Reality Settings window.

Selected KMLs will appear in the KML Overlay box. Click OK.

Uncheck Show Base Map.

Once you have selected the necessary KML/KMZ file, it should be listed in the KML Overlays box, along with previous selections (if applicable).

Click the OK button to confirm your selection.

Load the Video #

If you have not already loaded the video into LineVision Desktop, you will need to do so using the Open Video menu.

Open Video in the File Menu

Right click on the video in the Media Browser and select Camera Target Footprint Options > Show Augmented Reality.

Go to Camera Target Footprint Options > Show Augmented Reality

Once you begin playback, the video player will show the overlaid KML/KMZ files in the Video Player panel.

As noted in the Feature Prerequisite section, the user must be logged into their Esri account in order to use a KML/KMZ file that is downloaded to your computer. If you try to use a local resource and are not logged in, the software will allow you to play the video, but you will not see any Augmented Reality features with the video. If you reopen the Augmented Reality Settings (Options > Video Mapping Settings > Augmented Reality Settings > Augmented Reality Options), you will see the below error:

Augmented Reality Error when not logged into Esri.

To fix the issue, remove the KML/KMZ layer and log in to the Esri account (Map > Esri > Authenticate with Esri OAuth). Then return to Augmented Reality Settings and re-add the KML/KMZ under KML Overlays and the Augmented Reality should work.