Roles

In DataMesh Studio, roles are the resources used to build 3D content. They include 3D models, attachment resources, built-in tool models, expanded tools, light sources, cameras, and more. You can combine these roles to create authentic 3D scenes that can be used for display, training, and demonstrations. Roles play a crucial role in constructing immersive and interactive experiences within DataMesh Studio. 

Model roles

In DataMesh Studio, you can utilize various 3D model files to create model roles within the scene. To use a 3D model, you need to create it using an external application program and then upload it to the resources of the FactVerse Services platform. 

Supported file formats for models include: .fbx, .glb, .obj, .stl, .3mf, and .ply. 

Upload models

There are two ways to upload a model file to the FactVerse Services platform: 

    • Upload model files on the FactVerse Services platform: You can upload model files directly on the platform. For detailed steps on how to upload a model file, please refer to DataMesh FactVerse Services User Manual.
    • Upload files via DataMesh Importer: DataMesh Importer allows you to not only upload models, but also check their structure, materials, and adjust attributes such as color, transparency, metallicity, and smoothness. For more information, please refer to DataMesh Importer User Manual. 

After uploading the model, you can add it to the scene by dragging and dropping it from the My Resources section in the Resources pane of DataMesh Studio. Once added, you can manipulate the model by moving, rotating, and zooming according to your requirements. Additionally, you can set model attributes and add actions as needed. 

Initial attributes of model roles

After dragging a model from the Resources pane to the scene in DataMesh Studio, the model will be placed in the scene and automatically selected. At this point, the attributes pane will display the initial attributes of the model roles, which include Appear, Model Attributes and IoT Data Binding

Appear: The Appear section represents the default initial action after adding roles to the scene. For more detailed information, refer to Appear

Model Attributes: Model Attributes are configuration settings specific to model roles and can only be configured within the first scene where the model appears. They are used to define fixed attributes of the model roles, including Obscure and Origin Scale

    • Obscure: The Obscure attribute allows you to designate a primary model (not a sub-model) as an obscure object. The obscuring object is transparent and blocks other models behind it. When using MR mode to play your scenario, the 3D content is always displayed in front of the real world. When you want real-world objects to block the 3D content, you need to create a model representing the real-world object and set it as an obscuring object. The roles set as obscuring objects are invisible but can block models behind them, giving the impression that the models are being blocked by real-world objects.  
    • Origin Scale: The Origin Scale attribute is like the Scale attribute in the Appear attributes settings. The product of these two scale factors determines the actual size of the model. The Origin Scale attribute is to adjust the model’s size when it is too large or too small. By modifying the scale factors, subsequent adjustments to the scale can be made more easily based on a 1x scale.

IoT Data Binding: The IoT Data Binding feature is one of the advanced functionalities in DataMesh Studio. It allows you to import external data to drive the behavior of model roles in your scenario, such as model movement, rotation, and color changes. This configuration item is used to establish a connection between model roles and digital twin objects. For more detailed information about IoT Data Binding, please refer to IoT Data Driven Instructions

Attachment roles

Attachment roles refer to supplementary resources such as images, videos, audio files, and PDF documents. They provide additional instructions for model structures, operation flows, creation norms, and more. These resources serve as valuable aids in enhancing the scenario experience. To use attachment roles, you need to upload the corresponding resources to the FactVerse Services platform. Once uploaded, you can easily drag and drop them from the My Resources section of the Resources pane into the scene area of DataMesh Studio.

Images

You can use images as supplementary instructions to enhance the visual experience of scenarios. They can provide visual references, serve as backgrounds, or act as base maps for various purposes. For instance, you can convert a building floorplan into a PNG image and use it as a layout reference in the scene for better visualization. 

Supported picture formats in DataMesh Studio include JPG and PNG. 

Facing User option is disabled in default. When checking the Facing User option, the image will always face users no matter how the view angle changes.

Audio

In DataMesh Studio, you can enhance the immersive experience of scenarios by adding audio files to the scene for background music or sound effects.

We recommend using MP3 and OGG formats for audio files in DataMesh Studio.

To add audio files to the scene, you can simply drag and drop them from My Resources to the scene in DataMesh Studio. If you need to adjust the attributes of audio files, such as volume and loop playback, you can select the file and modify its settings in the attributes pane. If you want to remove audio files from the scene, you can select the audio role in the scene and click the delete button. 

Set for BGM: When the option is checked, the audio role will be set as background music which is a global sound source. If this option is unchecked, the audio file will be served as ordinary sound effect with stereo effect and produce different sound effect according to different position.

Play Hide: Visible or not when play.

Auto Play: Play automatically or not.

Loop: Loop playback or not.

Volume: Adjust volume.

Video

The function of Facing User in the video attributes is the same as these in image roles. AutoPlay and Volume are the same as these in audio roles.

Recommended video format in the DataMesh Studio: MP4, MOV.

PDF documents

In DataMesh Studio, you can add PDF documents to the scene by dragging and dropping them from My Resources. After adding a PDF file, you can set the default page number to be displayed in the attributes pane. This way, when you navigate to this scene in the scenario, the PDF file will show the specified page number. 

Extension tools

You can design and create your tools in Unity following the provided tool production specifications. Afterward, use the DataMesh plugin to export your creations as a zip file. Once exported, you can open and view the zip file using DataMesh Importer. You can also upload the zip file to the FactVerse Services platform, making it available as a built-in tool for use in DataMesh Studio.

You can follow below steps to add an extension tool:

1. Click Libraries in the Resources pane of DataMesh Studio.

2. Click the ellipsis ︙ icon next to Extend and select Add extension tools from the options.

3. In the Add extension tool window, fill in Extension Gadget Name, Gadget Type and select the extension gadget file.

4. Once configured, you will see the added extended tool under the Extend section in Libraries.

Tools

In DataMesh Studio’s Libraries pane, various tool models are built-in, such as Text, Components, Shape, Symbol Name, Hand, IoT, etc. These tool models can help users in scenario creation. The method of adding these tool models is the same as adding regular models, and you can drag and drop them into the scene area.

Text

Text is used for showing information, explaining, or describing the task of roles in the scene.

In DataMesh Studio, you can add three types of text: Text, Tag and Web Tools.

Text

You can add a text via dragging and dropping it to the scene area. In the first scene where the text is added, the text will automatically have an appearing animation effect. You can adjust its position and rotation angle just like adjusting a model and resize the text box by dragging its four corners. In the attributes pane below, you can enter the text content and press Enter to create line breaks. Additionally, you can modify the width and height of the textbox, background color, text size, text color and alignment etc. After checking Facing User, the text will always face users’ direction of observation despite the changes in scene view.

Tag

A Tag tool consists of a textbox, a connection line, and an anchor. After adding a tag, you can move it to the desired model by clicking and dragging the anchor point. The anchor point can attach to the surface of the model and move along with it, and the text box will adjust its position accordingly. The properties displayed in the attributes pane for the tag are like those for text boxes. You can modify properties such as the width and height of the tag’s textbox, background color, font size, font color, and alignment. Like text boxes, tags present a textual description to the user, but with the addition of an anchor point that can attach to another role.

Web Tools

Web Tools allows you to embed website content into a scene. You can drag and drop the Web Tools from the Text tools section into the scene area, and then configure the Website URL you want to embed in the attributes pane. During playback, the web tool will display the configured website content. With the web tool, you can embed various online information, data, or real-time information directly into the scene, and can have simple interactions with the web page, resulting in a more vivid and intuitive presentation effect.

Components

Ruler

The Ruler can measure the distance of roles. It can identify horizontal planes of nearby roles and be perpendicular to the horizontal plane. Stretching the four corners of the ruler aligns both ends of the ruler with the ends of the target role, and the measured length is displayed in the middle of the ruler.

Meter Attributes

    • Auto Measure: When Auto Measure is enabled, the actual measurement length of the ruler is displayed on the ruler. Otherwise, the content configured in the Text Attributes is displayed.
    • Left/Right Endpoint: The X-axis coordinate of the left/right endpoint is relative to the center of the ruler. Therefore, the Left Endpoint can only be entered as a negative value, and the Right Endpoint can only be entered as a positive value.
    • Meter Color: The overall color of the ruler.
    • Meter Scale: Refers to the thickness of the ruler line and the size of the arrow.

Button

Button is a commonly used interactive tool that can be used to display information, control scene flow (jump between scenes).

To add a button, you can drag a button component to the scene in the DataMesh Studio.

In the attributes pane, you can enter the content of button, adjust the size and color of the button, and set the target scene that the button will jump to. During scenario playback, when the user clicks the button, the scene will automatically jump to the target scene that has been set.

Guide

Guide tools are commonly used to guide positions in a scenario, telling viewers to go to a certain location, or representing a process such as machining or item transfer. DataMesh Studio provides four guide style options, and you can also modify the size and display speed of the guide.

You can find Guide in the Components of the Libraries of the Resources pane and drag it to the scene. In the attribute area, you can choose distinctive styles and control properties such as the size and position of the marker.

Light Source

By default, when a new scenario is created in DataMesh Studio, it will contain two light source roles. The light source can provide lighting effects for the scene, and the light source will be automatically hidden during scenario preview to ensure that the light source itself does not interfere with the scene’s appearance.

You can use following ways to operate light source:

    • Add light source: To add light source, you can drag the Light Source component from Libraries of Resources to the scene. The newly added light source will be displayed in the role list.
    • Delete light source: Select the light source to be deleted and click the delete button in the toolbar. Please note that each scene needs to keep at least one light source.
    • Edit light source attributes: After selecting the light source, you can edit the light source attributes in the attributes pane area, such as light source Color, Intensity and Shadowed or not etc.
    • Add pose to the light source: You can add pose to the light source role which is used to simulate light movement, such as sunrise and sunset, headlights of a moving vehicle.

Light Source Type

Directional: Directional light is a kind of global light resource. It is only affected by the rotation angle which will affect the light angle and the direction of shadow. Its position does not affect directional light. Directional light is commonly used to simulate sunshine.

Point: Point is a kind of local light which lights up the surrounding environment. It can affect roles within the lighting range radius. The lighting effect will decay as the distance increases, eventually disappearing completely within a specific range. Point light is commonly used to simulate light sources such as light bulbs.

Conical: Conical light source constrains the lighting range within a specified direction cone area. The lighting effect is also affected by distance, but the lighting range will increase as the distance gets farther, until it is beyond the lighting range. Conical light is commonly used to simulate spotlight.

Light source color

In DataMesh Studio, the default color of a light source is white. You can change the color of the light source to change the color of the light that shines on the object. Generally, white light sources are suitable for “ordinary” lighting used to shade objects.

Light source intensity

Light intensity refers to the brightness of the light emitted by the light source, which can be adjusted in the range of 0.01-5.00. By adjusting the light intensity, you can change the brightness of the light shining on the object.

Shadowed

    • Checked: Shadows will be generated for corresponding roles based on the direction of the light.
    • Unchecked: Roles will not produce shadow.

Shape

The Shape tools included in DataMesh Studio are Cone, Sphere, Cylinder, Cube, Arrow. You can quickly create various shapes by simple dragging and adjusting properties, adding more elements and rich visual effects to the scene.

You can set attributes of shape model in the attributes pane, such as shape, color, base area, and height of cone.

Symbol Name

DataMesh Studio includes several types of signs: Right, Wrong, Warning, and Electric. These signs are designed to emphasize important information within the scene and help you showcase and direct the audience’s attention. For instance, you can add a Right sign to highlight the right answer, or a Wrong sign to alert the audience to incorrect information. The Warning sign is useful for displaying cautionary messages, and the Electric (lightning) sign can be utilized for special visual effects or attention-grabbing elements. These signs enhance the overall visual communication and engagement of your scenarios.

Hand

DataMesh Studio includes three types of hand models: Hold, Crawl and Point. These hand models can be used to simulate user gestures, such as holding or grasping an object, or pointing to a location in the scene. After dragging the corresponding hand model into the scene area, you can set the hand model’s left and right hand and color attributes in the attributes area. By using hand models, you can more vividly simulate users’ actual operational behavior, enhancing the immersion and interactivity of the scene.

IoT Data Pane

IoT Data Pane can be used to display real-time IoT data and simulated data. You can select data in the attributes pane, and set the background, text color, font size, and data prefix of the data at the same time. 

IoT Data Pane

    • Frame Size: The size of the text box can be set.
    • Text color: The color of the text font can be set.
    • Background color: The background color of the text box can be set.
    • Font size: The font size of the text can be set.
    • Alignment: The alignment of the text can be set, such as center, left, or right alignment.
    • Show Twin Names: Unchecked in default. If checked, the digital twin’s name will be shown.
    • Display Attribute Group Name: Unchecked in default. If checked, the attribute group name will be shown.
    • + Select Twins: Click + Select Twins, a Digital Twin list will pop up. This list displays all the digital twins’ names in the workgroup of this account and supports searching according to twin name. After selecting digital twins, the original + Select Twins position will change to the name of the selected digital twin name. Click the name of the selected digital twins, you can choose digital twins again.

For more details of IoT Data Binding, please refer to IoT Data Driven Instructions.

Arrow

DataMesh Studio provides many arrow models, including Steering Arrows, Unidirectional Arrows, Horizontal Surround Arrows, and Vertical Surround Arrows. You can use these arrow models to decorate your scene to better convey information. In the attributes area, you can adjust various attributes of the arrow model according to your needs.

Special Effects

DataMesh Studio contains many special effects tools, including Lightening, Stream, Fire and Smog.

You can drag special effects tool to the scene from Special Effects of Libraries of Resources pane and configure model attributes in the attributes pane.

The attribute descriptions for special effects are as follows:

    • Color: Set the color of the special effect, supporting the setting of RGBA values
    • Life Cycle: Set the life cycle of the special effect, i.e., the time the special effect exists, in seconds.
    • Initial Speed: Set the initial speed of the special effect, which affects the movement speed of the special effect.
    • Particle Quantity: Set the quantity of particles included in the special effect.
    • Direction: Set the direction of particle movement in the special effect.

Camera

In DataMesh Studio, the camera is a role that exists by default in the scene, like a light source role. However, it has a distinct characteristic in that it cannot be added or deleted; it is a permanent element within the scene. 

The primary function of the camera role is to define a trajectory of motion and corresponding perspective changes. This allows viewers to observe the scene’s contents based on the specified viewing path. By adjusting the camera’s position, rotation, and field of view, you can achieve various lens and motion effects. This capability enables you to incorporate diverse perspectives into the scenario, resulting in a more immersive and captivating experience for users. 

Camera Attributes and Camera Movement settings are shown in the figure below:

Camera Attribute

  • Whether to Use Mirror Movement: By default, it is disabled, which means the user’s camera movement setting will not take effect in the preview; when turned on, the camera movement setting will be applied in the preview of the scenario.
  • Manual Control of the Lens is Prohibited: When the camera movement setting is enabled, if this option is checked, users are not allowed to adjust the camera angle in the preview of the scenario and can only view the scenario content according to the configured camera movement setting. If this option is not checked, users can freely adjust the camera angle in the preview of the scenario.

Camera Movement

There are two buttons under Camera Movement:

  • Set Preset: This function adjusts the current scene editing view to the playback preview view that is consistent with the camera. You can use this function to further verify the effect of the camera view.
  • Set Current: This function adjusts the playback preview view of the camera to the editing view that is consistent with the current scene. Compared to manually dragging the camera role to modify the camera movement, this function is more convenient. Users only need to adjust the scene to find a suitable view and save it, without the need to adjust the camera position and rotation.

Add camera movement in straight-line path

When the view in the scene needs to change, such as bringing the camera closer or further away from the target position, orbiting or hovering around the target position, etc., you need to add pose action for the camera. After adding the action, dragging the camera with the mouse will show a straight-line path from the camera role’s initial position to the mouse position. At the same time, moving or rotating the camera will refresh the camera movement effect in the attributes pane.

You can follow below steps to add camera movement in straight line: 

1. Click on the camera to select it, then navigate to the attributes pane and check Whether to Use a Mirror Movement

2. In the attributes pane, click the button next to the role name, then select Add Pose.

3. To add a new camera perspective, you can use either of the following two methods: 

a). Method 1: Drag the camera to a desired position and rotate it in the scene area. This will update the camera’s position and orientation, creating a new perspective. 

b). Method 2: Adjust the scene view to the desired perspective, then select the camera in the Roles pane. In the attributes pane, locate the Camera Movement section and check the Set Current option. This will set the camera’s position and orientation to match the current scene view, creating a new camera perspective. 

4. Repeat step 2-3 to add multiple pose adjustment actions, you can create a motion trajectory consisting of multiple straight-line segments, as shown in the figure below:  

Add camera movement in curved path

Camera movement in curved path is an advanced camera movement. By using at least three path points, you can freely configure the positions of these points to create various camera movements in curved path. Compared to camera movement in straight-line path, curved camera movements make your scenario more dynamic and visually impactful.

Camera movement in curved path is shown in the figure below:

To use curved camera movement, you need to enable the camera movement feature in Camera Attribute, and then add pose action to the camera. You can set Pose Adjustment parameters such as Rotate Along Path and Waypoint to achieve the desired curve path effect. 

Rotate along Path: The camera direction always stays aligned with the path direction.

Waypoint: Waypoints are the middle points of the path. By adding waypoints, we can determine the bending direction and curvature of the curve, achieving a smoother curve path. The starting point of the path is the initial position of the camera (the position of camera in last action or last scene). The end point of the path is the final position of the camera role in the current scene.

The steps to create a camera movement in curved path are as follows:

1. Click to select the camera in the Roles pane and choose Whether to Use a Mirror Movement in the attributes pane to enable camera movement.

2. Click the button next to the role name to Add Pose action to the camera.

3. In the attributes pane, set Duration and check Curved Path for the Pose Adjustment action. 

4. To create waypoints in DataMesh Studio, you can choose either of the following methods:

a). Manually create a waypoint using the camera position: Select the camera and manually adjust the camera position and rotation angle, then click Create a Waypoint at the Current Position to create a waypoint for the curved path.

b). Create a waypoint using the current viewing angle: After adjusting the scene view, select the camera and click Create a Waypoint at the Current Position, then click the Use Current button under the Camera Movement diagram. The view of this waypoint will consist with the current edited scene view.

5. Repeat step 4 to create all the waypoints that you need to create.

Role operations

Add a role

To add a role in the scene, you can select a resource from the Resources pane and drag it into the scene.

Hide or show a role

You can hide or show a role in the role list. Click  or  to toggle its visibility status.

Delete a role

To delete a role, you need to select the role in the first scene where it appears, and then click the delete button in the toolbar. This will delete the role in all scenes.

Note: You can only delete a role in the first scene where it appears.

Select a role

When you select any role, the selected role in the scene area will have an orange highlight effect with four corners and buttons to help you visualize and adjust the model and certain tool roles.

Adjust the pose of a role

When the role is in the state of the Appear action or Pose Adjustment, you can position and adjust the posture of the role by translating, rotating, scaling, and adjusting the height.

Here are the simple steps to perform these operations:

    • Translating: After selecting a role, you can drag it to move it forward, backward, left, or right on the plane to change its position. You can also manually input the X and Z coordinate values in the attribute area to fine-tune its position. When the selection box appears in pink, it means that the model cannot be moved in the current state, such as in scatter or section actions. Adding pose adjustment actions to the model can restore visual operations.
    • Scaling: After selecting a role, you can drag the corners of the selection box to change its size. You can also manually input the model ratio in the attribute area for precise adjustment.
    • Rotation: After selecting a role, click the rotation arrows above, below, or on the right of the border of the selection box, and drag the arrow to rotate the role along the three axes and change the angle. You can also manually input the rotation angle in the attribute area for precise adjustment.
    • Height adjustment: After selecting a role, you can click the double arrow on the left side of the border and drag the arrow up or down to adjust the height of the role. You can also manually input the Y-axis value in the attribute area to fine-tune the height.

Move a role via move tool

Using the move tool can quickly and accurately move the role along a straight line, especially when you need to move the role to a precisely positioned location.

Here are the simple steps to drag the role along a straight line using Move Gizmo:

1. Click Tools in the toolbar and select Move Gizmo.

2. Click the role you want to move.

3. In the Move Gizmo, click the cone-shaped arrow corresponding to the X, Y, and Z axis lines respectively, and drag it to move the role along that axis line.

4. After dragging the role to the desired position, release the mouse button to complete the move operation.

Multiselect roles

When you need to adjust multiple roles at the same time, you can use the multiselect operation. The multiselect operation is applicable to roles that can be transformed, such as position, rotation, and scaling (including parent and child roles). You can use the shortcut key Ctrland click on the role in the scene to select multiple roles or use Shift and click on two roles’ names in the role list to select all roles between them.

After selecting multiple roles, you can perform the following operations on them:

    • Move and rotate: Adjust the position and rotation angle of multiple roles by moving and rotating the multi-selected roles.
    • Copy and paste: Use Ctrl + C and Ctrl + V to copy and paste these roles.
    • Delete multiple selected roles: Click the delete button in the toolbar to delete multiple roles at once. Note: Child roles cannot be deleted.
    • Set the center point of multi-selected roles: You can set the center point of multi-selected roles in the attributes pane. The center point setting will affect the rotation method and result of multi-selected roles.
      • Public Center: Refers to the center point of the bounding box that contains all multi-selected roles. The default center point of the multi-selected roles is the public center.
      • Assign Roles: Select the center point of a certain role in the multi-selected roles as the center point of the multi-selected roles.

Group roles

The grouping operation combines multiple roles into a single entity, creating a new group role. After the multi-selection operation, you can click the grouping button in the toolbar to group these roles together.

You can perform the following operations on the group:

  • Move and rotate: You can adjust the position and rotation angle of the group by moving and rotating it. 
  • Ungroup: After selecting a group, click the ungroup button   in the toolbar to dissolve the group. After ungrouping, the corresponding group entity in the role list disappears, and all roles in the group return to their state before grouping. If the group contains other sub-groups, the sub-groups will remain grouped after ungrouping.  
  • Rename: The default name of a group is “Group” followed by a sequence number, such as Group1, Group2. After creating the group, you can modify the group name in the attributes pane. 
  • Set the center point of the group: You can set the center point of the group in the attributes pane. The center point setting will affect the rotation method and result of the group. There are two ways to set the center point: 
    • Public center: Use the center point of the bounding box that contains all the roles in the group as the center point of the group. The default center point of the group is the public center. 
    • Assign Roles: Select the center point of a certain role in the group as the center point of the group. 

Note: When you click on a role in a group in the scene, the system will prioritize selecting the group. If you need to select a specific role in the group, click again to select that role. 

Scenes

Scenes in DataMesh Studio is a kind of way to organize the content of a scenario. A scenario can consist of one or multiple scenes, each containing various elements such as 3D models, pictures, videos, music, light sources, and cameras. Each scene functions as a node within the scenario, allowing you to create, edit, and manage scenes effectively within DataMesh Studio.

Scenes play a vital role in DataMesh Studio as they provide a core foundation for editing and managing scenarios. They allow you to organize and control the content of a scenario in a more intuitive manner. You can easily switch between different scenes to ensure consistency and smooth transitions within your scenario. Scenes offer you a flexible approach to scenario creation, empowering you with more creative possibilities. 

Manage scenes

To manage scenes in DataMesh Studio, you can perform the following operations:

    • Create a new scene: Click the + button in the thumbnail area or right click on the scene in the thumbnail area and select Add Scene.

    • Delete a scene: Right-click on the scene in the thumbnail area and select Delete Scene.

    • Rename a scene: Select the scene in the thumbnail area and click the edit button in the attributes pane to rename the scene.

Use the scene catalog

In DataMesh Studio, the scene catalog is used to display the structure and chapters of the current scenario.

By clicking the scene catalog icon , you can browse the entire scenario, understand the scenario’s structure, and chapter content, and navigate to the desired chapter and scene.

The following are the basic operations on the scene catalog:

    • New Chapter: Each chapter in the scene catalog represents an independent scene or plot. In DataMesh Studio, you can right-click on a scene in the thumbnail area, select New Chapter, and the New Chapter window will open. Fill in the chapter name, and you can add a new chapter before the scene.

If you uncheck Scene content before inheritance option in the New Chapter window, you can create an empty scene. This means that the scene will not inherit any content from the previous chapter. It provides flexibility in creating the structure of your scenario.

    • Delete Chapter: To delete a chapter in the scene catalog, right-click on the chapter name in the thumbnail area and select Delete Chapter. This will remove the chapter and all its associated scenes from the catalog.
    • Edit Chapter: To rename a chapter in the scene catalog, right-click on the chapter name in the thumbnail area and select Edit Chapter. This allows you to modify the name of the chapter.

Navigate the scene area

In DataMesh Studio, the scene area offers various functions to help you adjust and explore scenes efficiently.

You can browse the scene area by using drag-and-drop and zoom operations. Here are some fundamental operations:

Orbit the scene

To orbit the scene, follow these steps:

1. Press and hold the right mouse button anywhere in the scene area. The cursor will change to a magnifying glass, and a blue visual reference will appear in the view.

2. Move the mouse horizontally to rotate the scene. This allows you to change the viewpoint and observe models from different angles, providing a comprehensive view of the scene.

Pan the scene

To move the scene horizontally or vertically, follow these steps: 

1. Click on an empty space within the scene area. 

2. While holding down the left mouse button, drag the mouse to the left, right, up, or down on the screen. 

3. Alternatively, you can press and hold the mouse wheel and drag the mouse in the desired direction to pan the scene. This method ensures that the left mouse button is not used for selecting objects in the scene, allowing the mouse wheel to be exclusively used for scene panning. 

Raise or lower the scene

To raise or lower the scene in DataMesh Studio, follow these steps: 

1. Press and hold the Shift key on your keyboard. 

2. Click and hold the left mouse button in an empty area of the scene area. 

3. Move the mouse cursor up to lower the scene or down to raise the scene.

Zoom in and out of the scene

To zoom in and out of the scene in DataMesh Studio, you can use the scroll wheel on your mouse. Here are the steps: 

1. Place the mouse cursor over the scene area. 

2. Scroll up the scroll wheel to zoom in on the scene. 

3. Scroll down the scroll wheel to zoom out of the scene.

Reset view

The reset view function is commonly used to restore the scene view and focus the camera on a specific role. Resetting the view automatically adjusts the camera position and angle, ensuring that the target role is fully presented in the center of the scene area. You can also switch the perspective to a specific role by double-clicking its name in the role list. 

The reset view function includes the following operations:

    • Reset scene view: Click the reset button located in the top right corner of the scene area to reset the current scene view to the default view. The default view is positioned above and in front of the scene, looking towards the center. 

    • Reset role view: After selecting a role, click the reset button in the top right corner of the scene area to adjust the view to a position in front and above the selected role. 

    • Focus on a role: Double-click the target role in the Roles pane to switch the current view to focus on that specific role. 

Scene gizmo

The scene gizmo is in the top right corner of the scene area. It consists of six sides representing the front, back, left, right, top, and bottom views. Each side displays a different orientation to help users navigate and understand the spatial layout of the scene. The gizmo provides a visual reference for the six directions, allowing users to easily manipulate and adjust their view accordingly.

The scene gizmo allows you to adjust the scene view with respect to either the scene center or a role center:

    • View Centered on Scene: When no role is selected, clicking on any side of the gizmo will maintain the same camera distance from the scene center. The scene center will serve as the view center, and the view will switch to the corresponding standard view direction.
    • View Centered on Role: When a role is selected, clicking on any side of the gizmo will maintain the same camera distance from the role center. The role center will become the view center, and the view will switch to the corresponding standard view direction.

Projection modes

DataMesh Studio supports two projection modes: perspective projection and orthographic projection. 

To switch the projection mode of the scene, you can click the projection toggle button in the scene area. 

1. Perspective Projection (Default) 

Perspective projection is a projection mode where objects appear smaller when they are farther away from the camera in the scene interface, and larger when they are closer to the camera. 

2. Orthographic Projection 

No matter how far the camera is, objects are shown in the same size. Orthographic Projection likes watching the scene from an infinite distance. It provides a more “technical” insight for the scene, which is easy to model and judge scale. 

Set scene transitions

In scenarios with multiple branching storylines, scene transitions are crucial for controlling the flow of the scenario. 

In DataMesh Studio, there are several ways to set scene transitions: 

1. Setting scene transitions in the attributes pane: You can configure scene transitions directly in the attributes pane. This allows you to define the transition type and specify the target scene. For more information, please refer to Set scene attributes

2. Using buttons for scene transitions: When editing buttons in DataMesh Studio, you can configure them to trigger scene transitions. During scenario playback, you can click on the buttons to transition to the specified scenes. For more details, please refer to Button.  

3. Using models or sub-objects for scene transitions: You can add transition links to models or sub-objects and set the target scene for the transition. During scenario playback, clicking on the model or sub-object will trigger the scene transition. For more details, please refer to Link

Set scene attributes

When you click the empty space in the scene area, the attributes pane will display the scene attributes. 

The attributes of a scene will be shown as follows: 

A: (the edit button) + the scene name. 

B: Scene Switch

a). When you Tap: When the user clicks on the scene, it will transition to the next scene. 

b). Auto Switch, After: Set a delay time (in seconds) for the scene transition. After the specified delay, it will automatically transition to the next scene. 

c). After checking: The scenario will transition to the next scene when this checkbox is checked by the user. 

C: Ground opacity: Set the opacity of the ground in the scene. 

Scenarios

A scenario is a project file created and edited in DataMesh Studio. It consists of multiple scenes, each containing user-added models, pictures, attachments, text, and tools etc. In a scenario, you can configure jumping connections between scenes to enable interactive scene transitions. The scenario file format is .dirpkg and can be created, edited, saved, imported, and exported within DataMesh Studio. Scenario management is available in the Digital Twin service module of the DataMesh FactVerse Services platform.

Create a new scenario

To create a new scenario, click the Create button on the homepage. This will open the scenario editing interface and create a new scenario. By default, each new scenario includes two light sources and one camera.

If you are editing scenario in the edit interface, you can create a new scenario by clicking on the File menu and selecting New Scenario. Note: In this situation, you will be prompted to save the currently edited scenario.

Open a cloud scenario

To open a cloud scenario, follow these steps:

1. Click Open on the homepage.

2. In the Open Scenario window, select a cloud scenario and click Open.

If you are editing a scenario in the edit interface, you can click the File menu and choose Open Scenario to open a cloud scenario. Note: In this situation, you will be prompted to save the currently edited scenario.

Save a scenario

To save a scenario to the DataMesh FactVerse Services platform, follow these steps:

1. In the edit interface of DataMesh Studio, click the save button , or go to the File menu and select Save.

2. If this is your first time saving the scenario, you will be prompted to enter a scenario name, select a storage path, and click the Confirm button in the Save Scenario window to save scenario.

Import a local scenario

To import a local scenario into DataMesh Studio, please follow these steps:

1. On the homepage of DataMesh Studio, click the Import button. This will open a window displaying your local resources.

2. In the local resources window, locate and select the scenario file you want to import, then click the Open (O) button.

3. The scenario will be opened in the DataMesh Studio edit interface, allowing you to view, edit, and save the scenario.

Export a scenario

To export a scenario, follow these steps:

1. Click on the File menu and select Export Scenario. This will open the Export Scenario window.

2. In the Export Scenario window, you can configure the export options, such as selecting to Export Scenario, Export in Paly Resources and Export Resource Acceleration Attachment.

Export Scenario: The exported scenario file only contains the basic scenario file and does not include the resources within the scenario. Note: To import and use this basic scenario file, you must have access to all the resources within the scenario.

Export in Play Resources: The exported scenario includes the basic scenario file and all related original resources (not accelerated). You can directly use the scenario after importing, but the related resources need to be reaccelerated.

Export Resources Acceleration Attachment: The exported scenario includes the basic scenario file, related original resources, and the resources acceleration attachment. You can use the scenario and the accelerated resources directly after importing.

Preview a scenario

DataMesh Studio supports three play modes:

    • Preview from the Beginning: In the edit interface, you can play the entire scenario using the following methods:

        • Click the Preview menu and select Preview from the Beginning.
        • Click the first scene thumbnail to set it as the current scene, and then click the play button .
    • Preview from Current Scene: In the edit interface, you can play the scenario starting from the current scene using the following methods:
        • Select a scene thumbnail and click the play button .
        • Click the Preview menu and select Preview from Current Scene.
    • Preview the Current Scene: In the edit interface, select a scene, and click the Preview menu and select Preview the Current Scene to play current selected scene only.

The scenario will be played in full screen. Press Esc on the keyboard or click the close button in the top right corner of DataMesh Studio to exit the play mode.

Change the reflection environment of a scenario

The reflection environment of a scenario in DataMesh Studio refers to the background environment and lighting effects used to simulate light propagation, reflection, and refraction in the virtual scene. It influences the appearance, lighting, and shadow effects of objects, enhancing the overall realism and fidelity of the scenes.

By default, there is no specific reflection effect for newly created scenario in DataMesh Studio. You can create reflection environment of the scenario by choosing indoor or outdoor environments provided by the system, or by using a skybox to create a more authentic and immersive virtual reality experience.

To change the reflection environment, follow these steps:

1. Click the Scenario menu and select Change Reflection Environment. This will open the Select Reflection Environment window.

2. In the Select Reflection Environment window, choose one of the following options:

    • None: The default setting, where no specific reflection environment effect is applied.

    • Indoor: Suitable for indoor scenes, simulating the light reflection features of an indoor environment.

    • Outdoor: Suitable for outdoor scenes, simulating the light reflection features of an outdoor environment.

    • Customize: Allows you to select different skybox pictures to create a suitable environment background and sky effect for your scenario, catering to specific scene needs and creative purposes.

3. If you choose the Customize option, follow these additional steps:

i. Prepare six skybox pictures corresponding to the front, back, left, right, top, and bottom views. The pictures should be in PNG format and follow English naming conventions (Front, Back, Left, Right, Top, Bottom).

ii. Compress the pictures into a ZIP file and change the file extension to “.dmcm”.

iii. Go to the Resources page of the DataMesh FactVerse Services platform and upload the .dmcm file.

iv. In DataMesh Studio, click the Scenario menu, select Change Reflection Environment to open the Select Reflection Environment window.

v. In the Select Reflection Environment window, select Customize and locate the uploaded .dmcm file.

vi. After selecting the file, click the Confirm button to finish customizing the reflection environment.

Quick start

Creating a scenario: Basic process

When creating and using a scenario in DataMesh Studio, please follow the steps below:

1. Define the scenario content

Define the scenes, steps, roles, data, and interactions that the scenario needs to express.

2. Upload resources

Upload 3D models and attachment resources required for scenario creation, such as audio, video, pictures, and PDF files.

    • Use DataMesh Importer or the FactVerse Services platform to upload 3D models.
    • Upload pictures, audio, and other resources through the FactVerse Services platform.

3. Create a new scenario

After logging in, create a new scenario where you can utilize the resources and tools in DataMesh Studio to create and edit 3D content.

4. Edit the scenario

i. Edit scenes: Organize the scenario content by using multiple scenes, scene catalog, and scene jumping.

ii. Add roles: Add various roles from My Resources and Libraries, including model roles, attachment roles, and tool roles.

iii. Edit role attributes: Select a role and modify its position, rotation, and scale.

iv. Add action and interaction: Add action and interaction effects to the roles.

v. Publish the scenario: DataMesh Studio enables one-click publishing of the content to the cloud.

5. Quick scenario preview

You can quickly preview a scenario by using the URL or QR code. Simply open the URL link in a browser or use DataMesh One to scan the QR code for an instant preview.

Note: Users must have access permissions to the directory where the scenario is located.

6. Remote coordination

With DataMesh One, you can engage in 3D MR coordinated operations remotely with other users.

Example: Create a digital twin scenario for illustrating a coffee machine

This example demonstrates how to quickly create a simple scenario with a coffee machine model and four scenes. We will apply tags, disappearance, scatter, and remove scatter actions to the coffee maker model, as well as incorporate some basic camera movements.

Prerequisites

The coffee machine model has been uploaded to the FactVerse Services platform.

Steps

1. Log in to DataMesh Studio.

2. Click Create on the homepage to create a new scenario.

3. Find the coffee machine model in the My Resources section on the left side and drag and drop it into the scene area.

4. Click on the coffee machine model in the scene and adjust its position, rotation angle and scale by using drag-and-drop and rotation operations.

5. Select the coffee machine model and set its Duration to 2s in the attributes pane.

6. In the Resources pane, click the Libraries tab. From the Libraries section, select Tag. Drag the tag to the scene area and drop it above the coffee machine model.

7. You can customize the tag by adjusting its size, moving the anchor, and modifying the text size and content.

8. Click the + button in the thumbnail area to create a new scene named “Scene_2”.

9. Add a “disappear” action to the tag in “Scene_2”. For more details, refer to Disappear.

10. Select the coffee machine model in the scene area and click Add Scatter in the action menu to add a scatter action to the model. For more details, please refer to Scatter.

Set the Scatter Type as Axial.

11. Create “Scene_3”. Select the coffee machine model in “Scene_3” and click Add Scatter.

12. Select the Reset checkbox in the scatter action to restore the coffee machine model to its initial status.

13. Add an Section action to the coffee machine model.

To configure the section action of the coffee machine model, you can move the section cube to adjust the section’s position.

14. Create “Scene_4” and select the coffee machine model. In “Scene_4”, we will implement the action of removing the section of the coffee machine model.

15. Click on Add Section to add a section action to the coffee machine model.

16. In the section settings of the attributes pane, check the Reset checkbox. To configure the removal of the section, adjust the position of the section cube and set the direction for quick sectioning (Preset).

17. Adjust the viewing angle of the scene and select the camera in Roles pane. Click Set current to save the current viewing angle. For more information on camera movements, refer to the Camera section.

18. In the thumbnail area, select the first scene and click  in the Menus to preview the scenario.

19. Click to save the scenario.

Basics

Installation

System requirement

To make sure DataMesh Studio works well, the following content are minimum and recommended configuration requirements.

SystemMinimum ConfigurationRecommended Configuration
Windows PCSoftware:
Window10 or above
Direct3D 11.0 or above
Hardware:
CPU: Intel®Core™i5-6200U 2.30Ghz
RAM:8GB
GPU: NVIDIA GTX 1050Ti
Software:
Window10 or above
Direct3D 11.0 or above
Hardware:
CPU: Intel®Core™i7-11700 3.60Ghz
RAM:16GB
GPU: NVIDIA GTX 3070
macOSSoftware:
Monterey 12.0.1
Hardware:
CPU: Intel Core i7
RAM:8GB
GPU: Intel Iris Plus Graphics 640
Software:
Monterey 12.0.1
Hardware:
Chip: Apple M1
RAM:16GB
Note: macOS platform supports Intel i7 and M1 chip, Intel i5 device is not supported any more.

Download

Please make sure you have downloaded the installation program before you install DataMesh Studio 6.0.

Download link for DataMesh Studio:

    • DataMesh Studio 0.0-Windows PC download short URL: datame.sh/Studio
PlatformApp StoreURL
Windows PCMicrosoft Storehttps://apps.microsoft.com/store/detail/datamesh-studio/9N57Q5SL7XKX?hl=en-us&gl=us
macOSApple Storehttps://apps.apple.com/cn/app/datamesh-studio/id1525519778?l=en
iOSApple Storehttps://apps.apple.com/cn/app/datamesh-studio/id1525519778?l=en

Login

The following picture shows the login interface:

    • Language: DataMesh Studio supports Simplified Chinese, English, Japanese, and Traditional Chinese.
    • Server List: You can switch to different servers, including China Mainland, Japan, and Singapore.
    • Private Deployment: If your enterprise has deployed a private server, you need to enter the exclusive service code for the private deployment when logging in.
    • Third-party Login: For more information about third-party login, please refer to the specific section on Third-party login in the user manual.

Regular login

To log in to DataMesh Studio, use your FactVerse account and password on the login interface.

Steps

1. Open the login interface of DataMesh Studio.

2. Select the desired language and server.

3. If your enterprise has deployed a private server, please follow the configuration steps below before logging in:

a. Click the private deployment icon .
b. Enter the exclusive service code provided by your enterprise in the Private deployment service dialog box.
c. Click Confirm return to the login interface.

4. Enter your FactVerse account and password.

5. Click Sign in.

6. If you have only one enterprise account, then you will log into the homepage directly.

7. If you have multiple enterprise accounts, an enterprise list will be shown. Choose one account, and then the homepage will be shown.

Third-party login

For third-party login, it uses Azure Active Directory (Azure AD) which is an identity and access management service of Microsoft to improve security when use DataMesh FactVerse Services.

Steps

1. Open the login interface of DataMesh Studio.

2. Select the language and server.

3. If your enterprise has deployed a private server, please follow the configuration steps below before logging in:

a. Click the private deployment icon .

b. Enter the exclusive service code provided by your enterprise in the Private deployment service dialog box.

c. Click Confirm to return to the login interface.

4. Click the Microsoft third-party login icon, and then enter your third-party account and password to log in.

User interface

There are two main user interfaces in DataMesh Studio: “Homepage” and “Edit Interface”.

Homepage

After a successful login, you will enter the homepage. The homepage serves as the entry page of the edit interface. From the homepage, you can access recently edited scenarios, create new scenarios, open cloud scenarios, import local scenarios, clean the cache, and upload logs.

The homepage supports the following functions:

    • Create scenario: Click the Create button to create a new scenario.

    • Open cloud scenario: Click the Open button to open a cloud scenario.

    • Import local scenario: Click the Import button to import a local scenario (*.dirpkg) into DataMesh Studio.

    • Open recently edited scenario quickly: The Recently Edited list displays the six most recent scenarios. Clicking on one of the scenarios allows for quick opening of that scenario.

    • Upload log: Click Upload Log to upload the seven most recent logs to the DataMesh FactVerse Services platform.

    • Clean cache: Click Clean Cache to clean all or not frequently used cached resources.

    • Check software version: DataMesh Studio software version information is displayed below Provide Feedback.

    • Log out: Click your username on the top-right corner of the homepage, and then select Log Out to log out.

Edit interface

In the edit interface, you can organize 3D models, edit, and arrange demo procedure of the 3D content demo.

The edit interface consists of menus, toolbar, Resources pane, Roles pane, scene area, thumbnail area, and attributes pane.

Menus

The menus contain all the tools and commands you may use when creating 3D content. The following table provides the instructions for each menu function:

File

    • New scenario: Create a new scenario in the selected directory. If the current scenario has not been saved, you will be prompted to save it before proceeding.
    • Open Scenario: Open a cloud scenario. If the current scenario has not been saved, you will be prompted to save it before proceeding.
    • Save: Save the current scenario.
    • Save as: Save the current content as a new scenario in the selected directory.
    • Export Scenario: Export the scenario in dirpkg format and save it as a file.
    • Close Scenario: Close the current scenario and return to the homepage. If the current scenario has not been saved, you will be prompted to save it before closing.
    • Quit: Exit DataMesh Studio. If the current scenario has not been saved, you will be prompted to save it before exiting.

Edit

    • Undo: Revert the previous operation performed by the user.
    • Redo: Restore the previously cancelled operation of the user.
    • Delete: Remove the selected role from the interface.

Scenario

    • Change Scenario Title: Modify scenario title.
    • Change Scenario Cover: Upload local picture as scenario cover.
    • Change Reflection Environment: Support modification of scenario reflection environment. You can choose built-in indoor and outdoor reflection environment or upload new skybox data to the cloud. For more details, please refer to Change the reflection environment of a scenario.
    • Modify Scenario Positioning: Support modification of scenario positioning. For more details, please refer to Customize spatial positioning methods.
    • Change Scenario Preview Way:
      • Whether to turn pages: If the option is checked, when playing scenario in DataMesh Learn, you can skip to different scenario by clicking turn page button.
      • Whether stage list is required: If the option is checked, when play scenario in DataMesh Learn, you can skip to different scenario by clicking steps name in the list.

Assessment

Task: Create scenario with task. For more details, please refer to Create scenarios with assessment tasks and scoring.

Preview

    • Preview from the Beginning: Preview from the first scene to the last scene.
    • Preview from Current Scene: Preview from selected scene to the last scene.
    • Preview the Current Scene: Merely preview the selected scene.

Tools

    • Move Gizmo: Used for enabling or disabling drag-and-drop navigation to help users drag and drop roles in straight path.
    • Operating Parameters: Display memory occupation, DrawCall, Batches and FPS etc. key data.

Settings

    • Languages: Switch to different languages: Simple Chinese, Traditional Chinese, English and Japanese.
    • Account:
    • User account: Display currently log in account.
    • Log out: Log out current account.
    • Upload Log: Upload recent seven logs to DataMesh FactVerse Services.
    • Rendering Quality: Quality of MR frames, there are 6 levels to choose.
    • About: Check current application version.

Toolbar

The toolbar provides quick access to frequently used tools and commands in DataMesh Studio.

IconDescription
Homepage
Clicking the Homepage button to return to the homepage. If there are any unsaved changes in the current scenario, a prompt will appear asking whether to save the current scenario or not before navigating back to the homepage.
Save
Save any changes made to the scenario, ensuring that the progress is preserved.
Undo
Revert to the previous operation. It can cancel the actions, including group and ungroup operations.
Redo
Redo the last action that was undone using the Undo button. It can also redo group and ungroup operations.
Group
Create a group role by combining the currently selected roles. The grouped role is then saved in the Roles section.
Ungroup
Cancel a group by selecting a grouped role and clicking the Ungroup button. After ungrouping, the grouped role in the Roles section will disappear, and all the roles in the group will return to their original state before being grouped. If a group contains other groups, those groups will remain in the grouped state after ungrouping.
Copy
Copy a selected role, including grouped roles. However, if the selected object contains a child object, it cannot be copied.
Paste
Paste the most recently copied content.
Delete
Delete the selected role.
Preview
Preview scenarios.

Resources pane

The Resources pane is in the upper left window. You can adjust the size of the Resources pane by dragging the bottom or right edge of the window. Clicking on the Resources title can expand or collapse the pane.

The Resources pane can be divided into two sections: My Resources and Libraries.

My Resources

My Resources section contains a variety of resources uploaded by users, which can be used to build 3D scenes.

    • Resources Filter: In the My Resources section, you can filter resources by tags. The displayed results are all the resources that contain the selected tags.

    • Resources Storage Directory: The path where resources are stored. Click  to return to the parent directory.

    • Resources Search Bar: Use the search bar to search for resources with partial or vogue names in the My Resources section.

    • Refresh: Click to refresh resources materials. After uploading resources, click the Refresh button to check the new materials in the My Resources section.

Resources Status:

    • Uncached: The material in the cloud has not been cached locally. The icon appears grey.

    • Downloading: Click on the uncached material to initiate the download process. The download progress will be displayed.

    • Cached: Once the material has been successfully downloaded, its icon will be highlighted. You can then drag and drop the material to the scene area.

Libraries

The Libraries section comprises built-in models and advanced resources created and added by users. If you don’t have any available resources in My Resources, you can still experience DataMesh Studio using the built-in models available in Libraries.

Roles pane

The Roles pane is on the bottom left window which contains all the roles in the current scene.

The Roles pane supports the following functions:

1. Show or hide roles: When the mouse cursor hovers over role name, a show or hide icon appears on the left side of role name. Click this icon to show or hide the role or group.

: The role is shown. Click to hide the role.

: The role is hidden. Click to show the role.

2. Select a role: Click the role name to select a role.

3. Focus on a role: Double-click on the role to focus on it.

4. Resize the Roles pane: Drag the right edge of the Roles pane to adjust its size.

5. Collapse the pane: Click the Roles pane title to collapse the pane.

Scene area

The scene area is in the middle of the edit interface and serves as the primary workspace for editing 3D content and procedures. You can drag roles from the Resources pane to the scene area to create their 3D content. During playback, the roles in the scene will interact based on the user-defined logic.

The scene area displays various elements in the current scene, including:

    • Light Source: By default, every new scenario contains two light sources .

    • Camera: By default, every new scenario contains one camera .

    • User-added resources, such as models, in the scene.

    • Scenario name: The current scenario name is shown in the top-left corner of the scene area. The default format for scenario names is “Project-<date>-<number>”. You can change the scenario name when saving the scenario.

    • Scene gizmo : Located in the upper-right corner of the scene area, the scene gizmo indicates the current viewing angle direction. Clicking scene gizmo allows you to switch between six views (front view, rear view, left view, right view, top view, and bottom view).

    • Viewing angle reset button : Clicking the reset button restores the initial viewing angle.

    • Projection switch button : The default projection is perspective projection. You can switch to orthographic projection. For more details, please refer to Projection methods.
    • Scene catalog :Used to display the structure and chapters of the current scenario. For more details, refer to Use the scene catalog.

Attributes pane

The attributes pane is on the right side of the edit interface which enables you to edit the attributes of scenes and roles. You can add actions to roles and configure their executive rules via the attributes pane.

The attributes pane is context-sensitive, which shows attributes of current focused window (scene, task) and the attributes of the selected role in the scene. For example, when you click on a blank space, the attributes pane will display attributes of the scene. While if you select a role in the scene, it will display the attributes of that role along with its action information.

The following picture illustrates the configuration of actions and attributes for a model:

For more details about the parameters in the attributes pane, please refer to following chapters:

    • Roles: This chapter introduces various roles in the scenario and provides guidance on how to edit and adjust roles’ attributes.
    • Action: This chapter helps you understand how to add and configure action effects for roles.

Thumbnail area

The thumbnail area is below the scene area which contains thumbnails of all the scenes. Like the slide list in PowerPoint, thumbnails are used to display an overview of each scene along with its scene name.

The main function of the thumbnail area is to assist users in identifying scenes quickly and accurately within a long story line. By utilizing thumbnails, you can easily locate and differentiate between different scenes in a convenient manner.

You can create new scenes and add new chapters. To access additional functions, you can right-click on a thumbnail and a context menu will appear with the following options:

Add Scene: Create a new scene. Clicking the “+” button can create a new scene as well.

Delete Scene: Delete the current scene.

New Chapter: Create a new chapter.

Add Previous Scene: Add a previous scene to the current scene.

Besides, you can switch scenes in the thumbnail area via keyboard shortcuts:

    • ←     switch to the previous scene.
    • →     switch to the next scene.

The thumbnail area provides an intuitive interface for managing and navigating scenes. It gives users the ability to easily locate and switch between different scenes and manage and adjust scene settings.

Keyboard shortcuts

DataMesh Studio provides keyboard shortcuts to enhance user productivity. For example, using Ctrl + S allows you to quickly save their current project, while Ctrl + Z enables them to undo the most recent operation.

OperationWindowsMacOS
CopyCtrl+C Command+C
PasteCtrl+V Command+V 
DeleteDeleteDelete
UndoCtrl+Z Command+Z
RedoCtrl+RCommand+R
GroupCtrl+GCommand+G
UngroupCtrl+Shift+GCommand+Shift+G
NewCtrl+NCommand+N
OpenCtrl+OCommand+O
SaveCtrl+SCommand+S
Save asCtrl+Shift+SCommand+Shift+S
CloseCtrl+WCommand+W
ExitAlt+F4Command+Q
New scene
Previous scene

DataMesh Studio 6.0 update notes

Core function optimization, action system upgrade

Action system is the foundation of scenario expressive force and interaction. DataMesh Studio provides seven actions: Add Pose, Add Scatter, Add Section, Disappear, Add Link and Color Changes.

In this upgraded version, we have redesigned configuration method of link, section, scatter, and color changes action. You can add the actions in any model nodes and configure other nodes action effect independently.

Link: You can add link action on any node. After adding nodes, you can click which page current scene will jump to from current page. Besides, you can change targeted nodes’ interaction scale via drag-and-drop action in the scene.

Section: You can add sections on any node and configure other nodes’ section effect, such as section direction and section animation.

There are three section animations to choose from in DataMesh Studio: along X axis, along Y axis and along Z axis.

Scatter: Scatter action helps users dismantle model quickly with two scatter ways: exploded and axial. You can adjust the position of dismantled model manually and add scatter action to split-up child objects or finish all scatter configuration in one scatter action.

Color changes: This action can change the color of any model nodes. You can change the color of the whole model or some child objects. Color changes provide two figuration styles: Gradient and Flash.

Other functions

Adjust scene viewing angle

When browsing in 3D mode, you can adjust the viewing angle by using the following methods:

On PC:

    • Rotate he scene: Hold down the right mouse button at any position in the scene, then move the mouse left or right to horizontally rotate the scene for a full view of the model.
    • Pan the scene: To move left, right, forward, or backward in the scene, click on a blank space in the scene, hold down the left mouse button, and drag the mouse to the left or right of the screen or up and down on the screen. You can also hold down the mouse wheel and drag the mouse in the direction you want to pan. This operation can avoid selecting any characters with the left mouse button, and the wheel can only be used to drag the scene.
    • Zoom in and out of the scene: To zoom in and out of the scene, you can use the mouse wheel button, scroll up to zoom in, and scroll down to zoom out.
    • Raise and lower the scene: To raise and lower the scene, you can hold down the Shift key and the left mouse button and move up or down on a blank space in the scene to lower or raise the scene.

On mobile devices:

    • Rotate the scene: Tap any position in the scene with your finger, then use a single finger to swipe horizontally to rotate the scene.
    • Gesture zooming: Through gestures, pinch or spread with two fingers in space to zoom in or out of the scene.
    • Pan the scene: You can pan the scene by sliding two fingers on the screen.

Offline mode

When the network condition is poor, after a period of network request, an Offline Mode button option will appear. You can switch to Offline Mode to view previously downloaded models or scenarios and play and use them normally.

Note: In offline mode, the resource list will display all local content. You can click to reconnect to try switching back to online mode.

Event

The Event function of DataMesh One provides users with rich AR experience and collaboration functions, allowing users to create and participate in immersive AR events. 

Here is a description of the Event function of DataMesh One: 

    • New Event: With DataMesh One, users can create new virtual reality events. When creating a new event, users can set basic information such as the name and valid date of the event and set the scenario for the AR scene. The scenario defines the scenes, roles, actions, and interaction processes in the event. 
    • Event management: As the creator and owner of the event, users can manage the event. This includes editing event information, modifying scenario settings, and more. The event management function enables users to flexibly control and customize the event. 
    • Play event scenarios: The event creator can guide the event by playing the scenario of the event. During the event, the event creator can gradually play the scenes and guide participants to complete various tasks and experiences according to the scenario. 
    • Participate in events: DataMesh One allows users to participate in virtual reality events created by others. Users can select events of interest from the event list and enter the event scene through devices such as HoloLens, mobile phones, and tablets. Event participants can watch the scenario, but do not have permission to play the scenario. This provides convenience for observing, learning, and sharing events.

New event

Steps

1. Click the add button in the event list to go to the New Event interface. 

2. In the New Event interface, fill in the Event Name (default format yyyy-mm-dd hh:mm:ss) and select the event’s Valid Date

3. Click the Create button to open the event setting interface.

4. In the event setting interface, click Add button.

5. Open the folder where the scenario is located, select the scenario, and click Save to add the scenario to the event.

6. Click on a blank space in the scene to place a model.

7. Wait for the scenario to finish loading to complete the creation of the event.

Edit event

To modify an already created event, such as changing the event scenario or modifying the event name, please follow these steps:

Note: Only the owner of the event has permission to edit the event.

1. Click on the event to be edited in the event list to enter the event details page.

2. On the event details page, click the Change Scenario button.

3. To replace an existing scenario with a new one, simply click on the Change Scenario button.

4. After editing is complete, click the “<” button in the upper left corner to exit the event details page and return to the event list page.

Play event

To play a created scenario in the event details page, follow these steps:

1. Select the event to be played in the event list and enter the event details page.

2. Wait for the models in the event to download and load.

3. After all participants are ready, the creator of the event can click the Play button to start playing the scenario.

4. Place the models and adjust their position and orientation to ensure that the scenario can be played in the correct scene. For more information on placing models and adjusting their position, please refer to Position mode.

5. Click the Stage List button  to open the scenario’s Stage List. Click the scene name in the list to play the scene on a single page.

6. After the scenario is finished playing, click the “<” button in the upper left corner to exit the event.

Edit mode

To facilitate playback and viewing experience, the edit mode can be used to adjust the position, size, rotation angle, and transparency of models, sub-objects, tools, and other resource content in the scenario. 

Edit mode settings

After opening the resource, you can enter Edit mode by clicking on the Edit button . Then click the adjust function button to open the Settings pane of edit mode.

Operation Settings: There are two types of operation modes in edit mode, Gesture operation and Joystick operation. You can switch between the two modes here. 

Scene axis: You can enable the Scene axis for Gesture operation, which can quickly and accurately move objects along a straight line. After enabling the Scene axis, cone-shaped arrows corresponding to the X, Y, and Z axes appear around the model. Click and drag the Scene axis to move the model along that axis. 

Scene Settings: In the Settings pane of edit mode, you can adjust the Opacity and Zoom of the resource, and further adjust the editing precision through Advanced options. 

Gesture operation

When using gesture operation, you can adjust the position, size, and rotation angle of the model or sub-object by using gestures such as moving, scaling, and rotating. This method is more flexible and intuitive and can quickly complete editing operations. It is suitable for editing scenes, models, and other content on touch screens, such as on mobile devices. 

Here are the detailed steps for using gesture operation on a mobile device: 

1. After opening resource, click on the Edit button to enter the edit mode.

2. After entering the edit mode, click the adjust function button  to enter edit mode Settings, and then select Gesture operation.

3. Click the object to be edited, and a blue highlight border will appear around the object. Use Gesture operation to move, scale, and rotate the object.

a. Move the object: Click and drag anywhere inside the border to move the object.

b. Scale the object: Click on one corner of the blue border around the object to create a blue square. Drag the square to scale the object.

4. Rotate the object: Hold down the center of one of the blue borders to create a blue sphere. Drag the sphere to rotate the object.

Joystick operation

You can also use the joystick to edit the model or sub-object.

The specific steps for using joystick operation are as follows:

1. After opening the resource, click on the Edit button to enter the edit mode.

2. After entering the edit mode, select Joystick operation in the edit mode Settings. You can also adjust the sensitivity, rotation angle, and other parameters of the joystick by adjusting the precision.

3. Click to select the object to be edited, and a blue highlight border will appear around the object. 

4. Use the joystick to move and horizontally rotate the object. 

Position mode

DataMesh One offers various methods for positioning resources in MR mode. These positioning methods allow users to adjust the position, distance, height, and angle of resources to ensure accurate placement. 

Adjust function

In DataMesh One’s position mode, users can fine-tune the precision of adjustments. It includes the following options: 

Movement: Adjusts the unit size of each movement. The default unit is millimeters (mm), but users can select other units such as centimeters (cm), decimeters (dm), or meters (m) as needed. By adjusting the unit size, users can achieve precise position adjustments. 

Rotation: Users can adjust the angle of each rotation. The default angle is 3 degrees (3˚), but users have the flexibility to customize the rotation angle for more precise adjustments. 

The steps for adjusting accuracy are as follows: 

The steps for adjusting the click accuracy are as follows: 

1. After opening the resource, you can click on the Position button to enter position mode.

2. After entering position mode, click on to open the More function pane.

3. To open Set click accuracy window, click on the adjust function button .

4. According to specific needs, personalize the click accuracy settings, and click Apply to complete the settings.

Wheel adjustment

Wheel adjustment method can more accurately adjust the position, distance, height, and angle of resources.

Steps

1. After opening the resource, you can click on the Position button to enter position mode.

2. After entering position mode, the wheel adjustment method is displayed by default.

3. Use the wheels to adjust the position, distance, height, and angle of the resource.

When using the wheel adjustment method, in addition to using the left wheel to control the resource’s forward, backward, left, and right movement on the horizontal plane, use the right wheel to control the resource’s height and orientation angle.

4. Click on to complete positioning.

Gaze mode

In Gaze mode, resources are placed based on where the user is looking. Users only need to look at or move the camera view to the desired location, click on the blank space on the screen, and the resource will be placed in that location. The advantage of placing resources in Gaze mode is that models can be quickly placed on recognized surfaces in the surroundings.

When opening a resource, you will enter Gaze mode by default. After placing the resource, if you need to use Gaze mode to place the resource again, you can follow these steps:

1. Click on the Position button to enter the position mode. 

2. Click on the gaze mode button to enter Gaze mode. 

3. After entering the Gaze mode, move the camera (view) and click on the blank space on the screen to place the resource.

4. Click on the button  to complete positioning.

QR Code positioning

By scanning the QR code you can more accurately position virtual objects, ensuring that they correspond to real-world physical objects and improving the user’s experience and learning effectiveness. For example, in an exhibition, you may need to precisely place a virtual exhibit in the same location as a real exhibit, which enables visitors to observe the virtual exhibit’s effect in the real environment. 

The steps for scanning the code to position resources are as follows: 

1. On FactVerse Services, go to the Resource page in the Digital Twin module, find the scenario file you need.  

2. Open the Resource details window and download locating code. 

3. Open scenario in the resources list on DataMesh One.

4. Click on the Position button to enter the position mode.

5. Click button to scan QR code. 

6. Scan the QR code downloaded in step 2.

7. Click on to complete positioning.

Spatial anchor positioning

A spatial anchor is a positioning anchor relative to physical space. It uses the device’s camera to scan the surrounding environment to determine the device’s location, then determines the position of resources relative to that location through location algorithms. 

Note:

    • The spatial anchor positioning function is only visible to all users under the corporate tenant when the corporate administrator has configured the correct Account ID, Account Key, Account Domain in the Spatial Location Configuration in Enterprise Management > Enterprise Settings on FactVerse Services.
    • The spatial anchor positioning function is only applicable to scenarios.
    • It is recommended to add anchors in flat, important, and easily readable locations.
    • In the current version, the spatial anchor positioning mode is turned off by default and you need to be manually entered into the location mode to turn it on; except for the scenario creator, other users cannot create, update, and delete anchor data on the scenario.
    • The HoloLens end uses the same process as mobile devices.

Icon meaning:

 : The spatial anchor positioning mode is not turned on, and clicking the icon can switch the spatial anchor positioning mode to the on state.

 : The spatial anchor positioning mode has been turned on, but no created spatial anchors have been found around, and clicking the icon can switch the spatial anchor positioning mode to the off state.

 : Spatial anchor positioning has been turned on, and spatial anchors have been recognized around and used for positioning. Clicking the icon can switch the spatial anchor positioning mode to the off state, and long pressing the icon can delete all created anchors in this scenario.

Permissions

    • Scenario creator: Create, update, use, delete.
    • Other viewers: Use permission.

Spatial positioning configuration

Users with enterprise management permissions can perform the following spatial positioning configuration:

1. Create an Azure Spatial Anchor account. For more information, please refer to Azure Spatial Anchor documentation.

The Spatial Anchors function requires the use of the Azure Spatial Anchors Service. For more information on the service charge, please refer to Spatial Anchors pricing.

2. Log in to FactVerse Services.

3. Enter the Enterprise Settings page in the Enterprise Management module.

4. In the Spatial Anchor Configuration, enter the Account ID, Account key, and Account domain of the spatial anchors account created in step 1.

5. Click the save button  to save the spatial positioning configuration.

With the above configuration, all members of the enterprise can use the spatial anchor positioning function.

Add spatial anchors to scenarios

The scenario creator can add spatial anchors to the scenario, the specific steps are as follows:

1. Open the scenario, complete the initial position placement, and click  to turn on the spatial anchor positioning mode.

2. After the spatial anchor icon changes to the turned-on state , the icon in the upper right corner of the icon is gray, which means that there are no spatial anchors around you. You can create spatial anchors around you through the wheel, scanning, and gaze mode.

Wheel mode

1. After turning on the spatial anchor positioning mode, you can use the wheels to adjust the position of the model.

2. Click , at this time it will prompt you to move your phone to recognize the surrounding environmental information.

3. After the information is collected, a spatial anchor is created. At this time, the dot in the upper right corner of the spatial anchor turns green , indicating that you are using the surrounding spatial anchor for positioning

4. If you need to create multiple spatial anchors in succession, you can move your phone. When the dot in the upper right corner of the anchor icon turns gray  (indicating that no spatial anchors are recognized around you), use the wheel, gaze, or scan mode to create a new spatial anchor. Note: If you adjust the current positioning when the dot in the upper right corner of the anchor icon is green, it will update the positioning information of the current anchor and will not create a new anchor.

QR Code positioning mode

1. After turning on the spatial anchor positioning, use the scan mode to place the model at the position of the QR code positioning.

2. Click , at this time it will prompt you to move your phone to recognize the surrounding environmental information. After the recognition is over, the dot turns green, and a spatial anchor is created.

3. If you need to create anchors in succession, just move your phone. When the dot in the upper right corner of the anchor icon turns gray, scan the QR code again or use other modes to position, and a new spatial anchor will be created.

Gaze mode

The process of creating anchors in gaze mode is like scan mode, but because the characteristic of gaze mode is to allow users to place models faster, rather than precise positioning, the created spatial anchors’ position may not be accurate. It is recommended to use scan mode to create accurate spatial anchors and use the wheel to fine-tune and correct anchor positioning.

Clear spatial anchors

The scenario creator can clear all the created spatial anchors in the scenario.

The specific steps are as follows:

1. After opening the scenario, in the position mode, turn on the spatial anchor positioning mode.

2. Long press the spatial anchor positioning icon  to pop up the confirmation window.

Note: The anchor data cannot be recovered after being cleared.

3. Click OK in the prompt window to confirm the removal of all spatial anchors in the scenario.

View resource information

In DataMesh One, an information pane is provided to help users view resource information and better understand the content in the scene. Through the information pane, users can obtain the following resource-related information:

    • Resource name: Displays the name of the resource, helping users quickly identify the selected resource.
    • Model properties: Provides related information such as model attributes and node attributes. These properties information can help users understand the characteristics and structure of the model.

Steps

1. In the case of opening a resource or playing an event, click on the resource to be viewed in the scene.

2. Click on the Info button  on the right side to expand the resource information pane.

3. In the resource information pane, you can view more resource information, such as model name and node name.

4. To collapse the resource information pane, click the information button again.