Markers in Mixed Reality

Only available for Varjo XR HMD users.

Marker icon Use a visible marker, known as the origin marker, for easy placement of objects in a mixed reality scene. The coordinate system is automatically synced; however, your nodes need to be prepared before entering MR.

Marker with coordinate system

Note:

Varjo provides a PDF with several markers of different sizes that can be printed out.

Use Marker icon from the xR Home Menu to enable supported HMDs to detect markers. Once the HMD recognizes the marker, if a node is tagged with VarjoMarker, the node content is moved to the marker's location. The marker's ID number needs to be set as a separate tag.

Marker displaying the ID number

Note:

Tag syntax is case-sensitive.

Multiple markers can be combined into a single marker. This improves tracking stability.

Combined markers into a single marker

For example, multiple nodes are tagged with VarjoMarker, but each has a different tag number. The marker tracking system detects the markers and assigned a confidence value to each, ranging from 0.0 to 1.0. If deems correct, the node content is moved to the marker's location. For more about confident values, see the Min Marker Confidence Virtual Reality preference.

Marker Tracking

Only available for Varjo XR HMD users.

The marker tracking system detects each marker and assigned a confidence value to it, ranging from 0.0 to 1.0.

For example, a marker that gets a value of 0.9 means there is a 90% confidence in the correctness of the marker's position and IDs.

Preparing Nodes for Markers

Only available for Varjo XR HMD users.

Follow these steps to prepare your nodes before entering MR. Note that objects that won't fit in your room will need to be scaled down before entering MR.

Example scene tag node structure for markers

  1. Add a tag and rename it VarjoMarker.

  2. Drag and drop an object node onto this tag to assign it.

  3. Create another tag and rename it to the number printed on the Varjo marker.

    Marker in a scene with close up of number

  4. Drag and drop the same object node onto this tag.

Using Markers

Only available for Varjo XR HMD users.

Nodes from your scene must be tagged before continuing. If this has not been done, follow the instructions in Preparing Nodes for Markers.

  1. Wearing a connected Varjo HMD that supports MR, in VRED, select View > Display > Varjo HMD. The objects that were tagged with the VarjoMarker and number tags appear in MR.

  2. Open the xR Home Menu with your controller and select Markers (Markers). The geometry jumps directly onto the marker.

    Tip:

    Disable Markers in the xR Home Menu to stop any jiggling of the object that may occur.

Place Tool

Only available in MR mode.

Note:

When in a collaborative MR session, the position of objects are syncronized for users.

Place tool Use for placing objects on and moving them along the ground of the scene, using the laser pointer. These objects must have an assigned scene tag, called Place.

The Place tool uses a similar approach to Teleport for rotating objects, that is rotating your wrist. You can snap the rotation to a 10° angle by pressing the controller's Grip button. Use this when trying to align one object with another. It is also possible to place objects atop one another.

Preparing Nodes for Placement

Only available in MR mode.

To pick and place objects in MR, you must first prepare the nodes. If objects are too large or small for your room, they will need to be scaled to an appropriate size before entering MR.

image of an object with Place scene tag

  1. Create a tag and rename it Place.
  2. In the Scene Graph, drag and drop an object node onto this tag.

Using Place

Only available in MR mode.

Nodes from your scene must be tagged before continuing. If this has not been done, follow the instructions in Preparing Nodes for Placement.

Placing an object in MR

  1. Wearing a connected Varjo HMD that supports MR, in VRED, select View > Display > Varjo HMD. The objects that were tagged with the Place appear in MR.

  2. Open the xR Home Menu by pressing the menu button on your controller, then select Place icon in the xR Home Menu (Place).

    When highlighted orange, the tool is enabled. When gray, the tool is disabled. An indicator appears above your controller stating what is active and picked.

  3. Point to an object and continually squeeze the trigger to pick and move it along the virtual ground.

  4. Rotate your wrist to rotate the object around the up axis. This action is similar to that of the Teleport tool.

    Tip:

    Squeeze the Grip button to snap to 10 degree angle increments. Use this to help with the alignment of your object to another.

Python for Markers

These are the functions for the Python interface for implementing a custom version of marker tracking. They can be found in the vrImmersiveInteractionService documentation.

createMultiMarker

vrImmersiveInteractionService.createMultiMarker(multiMarkerName, markerNames, markerType) Creates a multi marker by averaging the pose of multiple regular markers.

getDetectedMarkers

vrImmersiveInteractionService.getDetectedMarkers(markerType) Gets all detected markers of a given type.

getMarker

vrImmersiveInteractionService.getMarker(name, markerType) Gets a marker that has already been detected.

getMinMarkerConfidence

vrImmersiveInteractionService.getMinMarkerConfidence() See also: setMinMarkerConfidence.

setMinMarkerConfidence

vrImmersiveInteractionService.setMinMarkerConfidence(confidence) Sets the minimum marker confidence. When markers are detected with a lower confidence they will be ignored. Markers that are already known to the system will not be updated, if the updated data has a lower confidence.

markersDetected

vrImmersiveInteractionService.markersDetected(markers) This signal is triggered when new markers are detected that have a confidence that is equal or higher than minimum marker confidence.

markersUpdated

vrImmersiveInteractionService.markersUpdated(markers) This signal is triggered when new markers are detected that have a confidence that is equal or higher than minimum marker confidence.