Interaction position and assessment

When you have permission to access learning management (set by the administrator within the DataMesh FactVerse platform), you can use the interaction position and assessment features in DataMesh Studio to create training and assessment scenarios.

You can set up user interactions with the scenario by adding link actions or interaction position to characters, thus creating scenarios with assessment tasks and scoring. Through these interactive actions, users can complete assessment tasks, and their performance can be evaluated and assessed based on their actions.

Set Target Location

This feature allows you to assess the viewer’s ability to move an element from a starting location to a target location while viewing the scenario in mixed reality, which can simulate machine assembly, disassembly, repairs, and more.

Add an interaction position

In DataMesh Studio, you can add interaction positions for models and tools, and configure relevant parameters to achieve precise interaction effects, such as initial position, target position, tolerance angle range, automatic attraction range, etc.

The steps to add interaction positions to elements are as follows:

1. Select the element, then press the white Set Interaction Position button in the attributes pane.

2. A prompt should appear at the top of the workspace, which signifies that you have entered interactive building mode. From here, you can drag, rotate, and resize the model into your desired target location.

3. Users can set the interaction position in the attributes pane. For example, customize the interaction name, set the target position of the element, etc.

The Interaction Position pane is shown in the figure below:

    • Name: This is the name of the interactive position, which can be viewed from the Scene Attributes pane.
    • Initial Position: This parameter shows the starting position and rotation of the element and is grayed out during target mode. To change the initial position, exit target mode to move the element, then return to target mode.
    • Target Location: This parameter shows the coordinates and rotation of the target location. You can change this by dragging and rotating the model in the workspace, or by manually inputting the values.
    • Rotational Lock-on: This is an optional parameter that allows you to configure how similar the angle of the element needs to be to the target location in order to lock into place.
    • Positional Lock-on: This is an optional parameter that allows you to configure how far away the element needs to be from the target location in order to lock into place.

4. Click on the top corner of the Interaction Position pane, click YES in the popping up box to save the operation.

Check the interaction position list

Click on the workspace and then select the Interaction dropdown icon in the scene, all the interaction positions within the scene will be shown in the attributes pane.

The interaction position list is arranged in ascending order of creation time, displaying interaction order, name, description, and operations.

Operations supported by the interaction position list:

1. Delete: Press the trash can icon to remove the interaction.

2. Move up or down: Click the up or down icons to change the order of interactions.

3. Edit: Click interaction name to enter interaction edition mode to edit the position interaction.

Task

A task refers to a specific objective that scenario editors can set for viewers in order for them to progress through the scenario. Tasks can be used to guide viewers through a simulated workflow, test viewers to see what they would do during certain situations and evaluate their performance. You can also set task categories in order to test for different criteria, and you can set numerical score values for each task in order to quantitatively assess the effectiveness of each viewer.

Create a task category

Steps for creating task categories are as follows:

1. Click Assessment in the Menu and then select the Task option. In the toolbar, go to Assessment > Task.

2. In the Task List, click the Task Category Management to manage your categories.

3. In the Task Category List, click the Add button to open the Task Category window.

4. In the pop-up window, set the parameters of your new type. Below is an explanation of each parameter.

    • Category Name: Enter the type name here. Each task that belongs to this category will display a label containing this name in the task list. The character limit is 18, with no restriction on character format.
    • Label Color: This changes what color the type label is. Changing this allows you to easily differentiate between categories in the task list. The default color is red.
    • Total Available Points: This allows you to set the maximum score a viewer can earn for this category.
    • Passable: If this option is enabled, you could enter a passing grade to easily see if viewers passed or failed in this category.

5. Click Confirm to add your new category.

Create a task

The steps to create a new task are as follows:

1. In the toolbar, go to Assessment > Task.

2. In the Task List, click the Add button to open the Task Type window.

DataMesh Studio provides two task types for you to select:

    • Progression: This type of task scores the viewer based on their progression through the scenario. This is effective when utilized in choice-based scenes that navigate to other scenes based on the viewer’s choice.
    • Interaction: This type of task scores the viewer based on performing the correct actions in each scene. This is effective when utilized in hands-on scenes where the viewer must place a component in the correct location.

Scenario play mode

When a scenario is created with the purpose of testing viewers, some scenarios can have a linear progression through their scenes, while others may need to jump around between scenes using the link action. The navigation window allows you to control how viewers are able to navigate between scenes, ensuring that they cannot skip forwards or backwards in an unintended order.

To modify the scenario playback mode, you can click on the scenario menu, select Modify Play Mode.

In the window of Modify Play Mode, check or uncheck the option for “Enable Stage Traversal” as needed. When this option is checked, you can navigate scenes by clicking the page turn button while playing the scenario in the training mode of DataMesh One.

Enable Stage Traversal: If this option is enabled, viewers can freely travel to the next scene whenever they want. Disabling this option ensures that they have to fulfill any conditions you have set before moving forward.

Enable Table of Contents: When this is enabled, viewers can see the table of contents, and select any scene that it contains in order to travel to that scene.

Exercise: Create a Graded Scenario About Assembling Cable Lines

Objective

The training instructor can use DataMesh Studio to create a scenario for assembling cable lines that includes task assessment and scoring.

Prerequisite

The cable line models (DianLanXian_A, DianLanXian_B, CRMA15_Xian) and the cable interface models (DianLanJieKou, CRMA16_JieKou) have been uploaded to the resource library of FactVerse.

Steps

1. From the Resources pane, add all the necessary models into the workspace.

2. Add interaction position for cable line DianLanXian_A.

a) Select the cable line “DianLanXian_A” in the element list and click the Set Interaction Position button in the attributes pane.

b) In the Interaction pane, change the interaction Name to “Cable Line A Position Interaction”.
c) Move the cable line to the cable interface location in the scene and set the target position for the cable line.

d) In the Interaction pane of the attributes pane, set the Positional Lock-on to “1” (unit: m).
e) Click x button to exit the Set interaction position mode, in the pop-up prompt box, click the Yes button to save the operation.

3. Add interaction position for cable line DianLanXian_B.

a) Select the cable line “DianLanXian_B” in the element list and click the Set Interaction Position button in the attributes pane.
b) In the Interaction pane, change the interaction Name to “Cable Line B Position Interaction”.
c) Move the cable line to the cable interface location in the scene and set the target position for the cable line.

d) In the Interaction pane of the attributes pane, set the Positional Lock-on to “1” (unit: m).
e) Click x button to exit the Set interaction position mode, in the pop-up prompt box, click the Yes button to save the operation.

4. Add position interaction for cable line CRMA15_Xian.

a) Select the cable line “CRMA15_Xian” in the element list and click the Set Interaction Position button in the attributes pane.
b) In the Interaction pane, change the interaction Name to “Cable Line C Position Interaction”.
c) Move the cable line to the cable interface location in the scene and set the target position for the cable line.

d) In the Interaction pane of the attributes pane, set the Positional Lock-on to “1” (unit: m).
e) Click x button to exit the Set interaction position mode, in the pop-up prompt box, click the Yes button to save the operation.

5. Click anywhere in your workspace that does not select an element, and the attributes pane will display the list of interaction positions in the scene.

6. Create a task category.

a) Click on the Assessment menu in the Menu, and then select the Task option.
b) In the Task List of the attributes pane, click on the Task Category Management to open the Task Category List.
c) In the Task Category List, click the Add button to open the Task Category window.
d) In the Task Category window, enter the task Category Name as “Interaction” and select the necessary parameters such as Passable and Passing Score.
e) Click Confirm to complete the addition of the task category.

f) Click < to exit the Task Category List.

7. Create a new scoring task.

a) In the Task List pane, click the Add button.

b) In the Task Type window, select Interaction and click Confirm button.

c) In the Add task window, fill in Task name as “Assemble Cable Line with Cable Interface”.

    • Select Task type as “Interaction”.
    • Selection Interaction ID as “ID:2”.
    • Set Scoring rules as Result Scoring, Operation succeeded as + 20 scores.

d) Click the Confirm button to complete the addition of the task.

8. Click in the toolbar to view the real effect.

a) Click one interaction in the interaction list to display interaction effect.

b) Click the Complete button.

c) After demonstrating all the interactions, you can click the Skip button to enter the next scene.

9. Click Modify Play Mode in the Menu and uncheck the option Passable.
10. Save the scenario with the name “Assembling Cable Lines”.

Customize spatial positioning methods

In DataMesh One, users can view DataMesh Studio scenarios in Mixed Reality. To ensure that the digital objects are to the desired scale relative to the real environment, DataMesh One users can change the size of the overall scenario and typically use all elements from the first scene to perform adjustments. To ensure that all digital objects are scale relative to each other, DataMesh Studio provides two tools to help scenario editors maintain spatial awareness while engineering their scenes: Reference Models and QR Marker.

Reference model positioning

Here is how to utilize reference models in your scenes:

1. To enter reference mode, select Scenario > Modify Scenario Positioning from the toolbar.

2. Find the model you would like to use as your reference model in the resources pane, then drag it into the workspace. In reference mode, you can freely position and adjust your reference model.

3. Once you are done, click the Quit button at the top right of your workspace to exit reference mode.

4. Play the scenario in DataMesh One and use joystick position scenario.

Note: In DataMesh One, the Position Reference setting needs to be set to First Frame, aligning with the first frame of the first scene in the script for positioning.

5. Click to complete positioning.

QR code positioning

QR Markers allow you to view your scenario in Mixed Reality through multiple locations in the virtual space. Each QR Marker corresponds to a QR code, and by scanning a physical copy of that code using DataMesh One, you can generate the digital elements found in your scenario. The layout and position of your elements depend on where you placed your QR Markers and which QR code you scanned. You can also toggle between horizontal markers for QR codes on the floor or a table, and vertical markers for QR codes on the wall.

Note: DataMesh FactVerse does not support downloading positioning codes from scenarios created using versions of DataMesh Studio prior to 5.5. To download the positioning codes, you need to open the scenario using DataMesh Studio 5.5 or above, re-upload the scenario, and then you will be able to download the included positioning codes from the FactVerse platform.

The steps for using QR code positioning are as follows:

1. Click the Scenario menu in the menu and select Modify Scenario Positioning from the drop-down menu to enter positioning mode.

2. Select the QR code (QR Code_ ) that needs to be positioned from the Elements pane and drag it to the desired location.

3. Click a blank space in the workspace to deselect the QR code. Then, in the attributes pane, click the Add Marker button under the Stage Attributes section to add a new marker.

Note: In DataMesh Studio versions 5.6 and up, the maximum number of markers you can add is 20. Otherwise, you can only add up to 10.

Clicking the Remove Marker button per time will sequentially delete a QR code within the scene from back to front.

4. Click the Quit button to exit the positioning mode, edit the scenario and save it.

5. Log in to DataMesh FactVerse, find the scenario and download the Position QR code on the resources detail page.

6. Print the downloaded position RQ code.

7. In the MR mode of DataMesh One, scan the QR code printed in step 6 and then the model will appear above the QR code.

Elements

In DataMesh Studio, elements are all the various types of objects that you can incorporate into your scene. This ranges from 3D models to attachment resources, built-in tool models, expanded tools, light sources, cameras, and more. You can combine these elements together in order to create organic 3D scenes that can be used for display, training, and demonstrations.

Models

In DataMesh Studio, you can convert a variety of 3D model files into models, which can then be found in your resources tab. To use a 3D model, you need to create it using an external application program and then upload it to the resources of the FactVerse platform.

Supported file formats for models include: .fbx, .glb, .obj, .stl, .3mf, and .ply.

Upload models

To utilize an external model in DataMesh Studio, you must first upload it through our FactVerse platform. There are two ways to do this:

    • Directly through FactVerse: You can upload model files directly on the platform. For detailed steps on how to upload a model file, please refer to DataMesh FactVerse User Manual.
    • DataMesh Importer: DataMesh Importer allows you to not only upload models, but also check their structure, materials, and adjust attributes such as color, transparency, metallicity, and smoothness. For more information, please refer to DataMesh Importer User Manual.

After uploading the model, you can add it to the scene by dragging and dropping it from the My Resources section in the Resources pane of DataMesh Studio.

Model element attributes

After dragging a model from the Resources pane to the scene in DataMesh Studio, the model will be placed in the scene and automatically selected. At this point, the attributes pane will display the initial attributes of the models, which include Appear, Model Attributes and IoT Data Binding.

Appear: This option controls how the model first appears onto the screen. For more detailed information, refer to Appear.

Model Attributes: These are settings specific to models, and can only be configured within the first scene that the model appears in.

IoT Data Binding: This allows you to import external data regarding the behavior of the model in your scenario, such as model movement, rotation, and color changes. This primarily is used to establish a connection between models and digital twin objects. For more detailed information about IoT Data Binding, please refer to DataMesh FactVerse DFS User Manual.

Attachment elements

Attachment elements refer to 2D resources such as images, videos, audio files, and PDF documents. They provide additional instructions for model structures, operation flows, guidelines, and more. These resources serve as valuable aids in enhancing the scenario experience. To use attachment elements, you need to upload the corresponding resources to the FactVerse platform. Once uploaded, you can easily drag and drop them from the My Resources section of the resources pane into the workspace of DataMesh Studio.

Images

Images in your scenario can be used as a background for your virtual environment, diagrams that showcase information that is hard to otherwise convey, and blueprints that present a secondary visual aid. This feature increases the effectiveness of your scenario, especially for visual learners.

Supported image formats in DataMesh Studio include JPG and PNG.

Always Face User: This toggles whether or not the image always faces the user, regardless of direction or viewing angle.

Audio

In DataMesh Studio, you can enhance the immersive experience of your scenarios by adding audio files that act as background music or sound effects.

We recommend using MP3 and OGG formats for audio files in DataMesh Studio.

To add audio files to the scene, you can simply drag and drop them from My Resources to the scene in DataMesh Studio. If you need to adjust the attributes of audio files, such as volume and loop playback, you can select the file and modify its settings in the attributes pane. If you want to remove audio files from the scene, you can select the audio element in the scene and click the delete button.

    • Background Music: This toggles whether this audio file is played in mono, where there is no sense of direction or dimensionality to the sound, or stereo, where the user’s position changes the direction and effect of the audio.
    • Hide During Scenario Playback: This toggles whether or not the audio file is visible when the scenario is in progress.
    • Autoplay: This toggles whether or not the audio file plays automatically.
    • Loop: This toggles whether or not the audio file restarts from the beginning once it has ended.
    • Volume: This allows you to adjust the volume of the audio file.

Video

There are still situations where you would want to include 2D videos in your scenario, such as functioning as a tutorial while the user follows the instructions in the virtual space or imitating a real-life screen to add realism to your simulation.

We recommend using MP4 and MOV formats for video files.

    • Always Face User: This toggles whether or not the video always faces the user, regardless of direction or viewing angle.
    • Autoplay: This toggles whether or not the audio file plays automatically.
    • Volume: This allows you to adjust the volume of the video file.

PDF documents

In DataMesh Studio, you can add PDF documents to the scene by dragging and dropping them from the resources pane. After adding a PDF file, you can set the default page number to be displayed in the attributes pane. This way, when you navigate to this scene in the scenario, the PDF file will show the specified page number.

Extensions

You can design and create custom tools in Unity following the provided tool production specifications. Afterward, use the DataMesh plugin to export your tools as a zip file. Once exported, you can open and view the zip file using DataMesh Importer. You can also upload the zip file to the FactVerse platform, making it available as a built-in tool for use in DataMesh Studio.

You can follow the steps below to add an extension tool:

1. Open the zip file in the Importer and click the Save button to upload the file to the FactVerse platform.

2. Open the libraries tab in the resources pane of DataMesh Studio.

3. Click the ellipsis ︙ icon next to the Extensions header and select New Extension from the drop-down menu.

4. In the New Extension window, fill in Name, and Type and select the extension file from the server.

5. Once configured, you will see the newly added extension under the Extensions section.

Tools

DataMesh Studio comes with a multitude of built-in tools which can be found in the libraries tab of the resources pane. These tools can help users in scenario creation. The method of adding these tools is the same as adding regular models: direct drag and drop.

Text

Text is used for showing information, explaining a concept, or describing the purpose of an element in the scene.

In DataMesh Studio, you can add three types of text: Textbox, Tag and Web Tools.

Textbox

You can add a textbox via dragging and dropping it to the workspace. In the first scene where the text is added, the text will automatically have an appearing animation effect. You can adjust its position and rotation angle just like adjusting a model and resize the text box by dragging its four corners. In the attributes pane below, you can enter the text content and press Enter to create line breaks. Additionally, you can modify the width and height of the textbox, background color, text size, text color, alignment etc. After checking Always Face User, the text will always face the user regardless of viewing direction.

AI Assistant

The AI Assistant feature in DataMesh Studio is built upon the FactVerse AI capabilities of the FactVerse platform. Users can generate textual content through conversation with the AI Assistant.

The workflow for using the AI Assistant is as follows:

1. On the FactVerse platform, create a knowledge base and an AI Assistant. If an AI Assistant is not configured, the system provides a default AI Assistant with no configuration. For more detailed information, please refer to the FactVerse User Manual.

2. In the workspace of DataMesh Studio, add a textbox.

3. Select the textbox, and in the right-side textbox attributes panel, you can see a FactVerse AI tool below the content box.

4. Click the switch icon to display a list of available AI Assistants for content generation. If there are no AI Assistants available for switching, the switch icon will not be displayed, and the system default AI Assistant will be used.

5. Enter a question, and the AI Assistant will automatically generate content and populate the textbox with it.

    • Language: The language of the audio file, currently supporting Chinese, English, Japanese, and Korean.
    • Gender: The gender of the voice for the audio.

6. Click Text to speech button, and a Create audio window will pop up.

7. After selecting the language and gender, click Confirm to create the voice.

8. Once created, you can click Audio preview to listen to the generated audio. Clicking Confirm will add the generated audio content to the text box.

9. When editing the content of a textbox that already has generated audio, you will see a prompt saying “The text content has been changed and does not match the audio.”
Note: This prompt will only appear once during editing. If you reopen the textbox, you will be reminded again when editing.

Tag

A Tag tool consists of a textbox, a connection line, and an anchor. After adding a tag, you can move it to the desired model by clicking and dragging the anchor point. The anchor point can attach to the surface of the model and move along with it, and the text box will adjust its position accordingly. The properties displayed in the attributes pane for the tag are like those for text boxes. You can modify properties such as the width and height of the tag’s textbox, background color, font size, font color, and alignment. Like text boxes, tags present a textual description to the user, but with the addition of an anchor point that can attach to another element.

Web Tools

Web Tools allows you to embed website content into a scene. You can drag and drop the Web Tools from the Text tools section into the workspace, and then configure the Website URL you want to embed in the attributes pane. During playback, the web tool will display the website on its screen. With the web tool, you can embed various online information, data, or real-time information directly into the scene, and can have simple interactions with the web page, resulting in a more vivid and intuitive presentation effect.

Components

Ruler

The Ruler can measure the distance of other elements by identifying their horizontal planes. Stretching the four corners of the ruler aligns both ends of the ruler with the ends of the target element, and the measured length is displayed in the middle of the ruler.

Ruler Attributes

    • Auto Measure: When this is enabled, the actual measurement length of the ruler is displayed above it. Otherwise, the content configured in the Text Attributes is displayed.
    • Left/Right Endpoint: The X-axis coordinate of the left/right endpoint is relative to the center of the ruler. Therefore, the Left Endpoint can only be entered as a negative value, and the Right Endpoint can only be entered as a positive value.
    • Color: This sets the color of the ruler element.
    • Size: This sets the size of the ruler element.

Button

The button is a tool that can be used to display information and control the order and duration of scenes.

In the attributes pane, you can change the label of the button, adjust its size and color, and set which scene the button will travel to when pushed.

Guide

The guide element is a 2D row of arrows that travel forward in a straight line. DataMesh Studio provides four guide style options that change the appearance of the arrows, and you can also modify the size and movement speed of the arrows.

You can find Guide in the Components of the Libraries of the Resources pane and drag it to the scene. In the attribute area, you can choose distinctive styles and control properties such as the size and position of the marker.

Light Source

By default, new scenarios come with two light source elements. They provide lighting effects for the scene, and the light source will be automatically hidden during scenario preview to ensure that the light source itself does not interfere with the scene’s appearance.

You can use following ways to operate light source:

    • Add light source: To add light source, you can drag the Light Source component from Libraries of Resources to the scene. The newly added light source will be displayed in the element list.
    • Delete light source: Select the light source to be deleted and click the delete button in the toolbar. Please note that each scene needs to keep at least one light source.
    • Edit light source attributes: After selecting the light source, you can edit the light source attributes in the attributes pane area, such as light source Color, Brightness and Generate Shadows.
    • Add movement to the light source: You can add movement to the light source which is used to simulate light movement, such as sunrise and sunset, and headlights of a moving vehicle.

Light Source Types

Directional Lights: This type of light illuminates the entire virtual environment in the same direction and can be thought of as sunlight. The light’s source does not come from the element itself, but from a distant point outside of the environment which can be adjusted by rotating the element.

Point Lights: This creates a localized light source that illuminates the surrounding environment within a specified radius. Its brightness will decay with distance and will eventually disappear completely once you are out of its range. Point light is commonly used to simulate weaker light sources such as candles, lanterns, or light bulbs.

Spot Lights: This type of light narrows its range into a cone shape, similar to a flashlight. Its brightness also decays with distance, but the spread of its range will widen as well. Spot light is commonly used to simulate spotlights, flashlights, and classic desk lamps.

Color

In DataMesh Studio, the default color of a light source is white. You can change the color of the light source to change the color of the light that shines on the object. Generally, white light sources are suitable for “ordinary” lighting used to shade objects.

Brightness

Brightness refers to the brightness of the light emitted by the light source, which can be adjusted in the range of 0.01-5.00. By adjusting the brightness, you can change the brightness of the light shining on the object.

Generate Shadows

This option toggles whether or not elements generate shadows from this element’s light.

Shape

Our library also provides several 3D shapes for you to utilize, which include Pyramids, Spheres, Cylinders, Cubes, and Arrows. You can change the color of every shape, and there are multiple other customization options that are unique for each shape.

You can set attributes of the shape model in the attributes pane, such as shape, color, base area, and height of the pyramid.

Symbols

Our library includes several universal symbols that may be relevant based on the needs of your simulation: Correct, Incorrect, Warning, and Electricity Hazard. Symbols are important because they can be applied to multiple different situations and their meanings are instantly comprehensible regardless of language barriers or literacy levels, making your scenario more accessible to all viewers.

Hand Gestures

Our library includes three types of 3D hand gesture models: Hold, Reach and Point. These elements can be used to convey meaning, machine operation instructions, and examples of what not to do. The hands can be swapped between left and right in the attributes panel so that you can simulate both hands of the same person doing different things.

IoT Data Pane

IoT Data Pane can be used to display real-time IoT data and simulated data. You can select data in the attributes pane, and set the background color, font size, alignment, title and select digital twins.

IoT data binding

Click + Select Digital Twins, and a Digital Twin list will pop up. This list displays all the digital twins’ names under this account and supports searching by the digital twin’s name. After selecting digital twins, the original + Select Digital Twins UI will change to the name of the selected digital twin. Click the name of the selected digital twins, you can select digital twins again.

For more details of IoT Data Binding, please refer to DataMesh FactVerse DFS User Manual.

Arrow

Our library includes many different arrows that can be applied to a multitude of different situations.

Special Effects

DataMesh Studio contains many special effects tools, including Lightening, Water Leak, Fire and Gas Leak.

You can drag special effects tool to the scene from Special Effects of Libraries of Resources pane and configure model attributes in the attributes pane.

The attribute descriptions for special effects are as follows:

    • Color: Changes the color of the special effect.
    • Life Cycle: Sets how long the special effect exists, in seconds.
    • Initial Speed: Set the initial speed of the special effect.
    • Particle Quantity: Set the quantity of particles included in the special effect.
    • Direction: Set the direction of particle movement in the special effect.

Camera

Similar to the light source element, all scenarios start out with one camera. However, the camera cannot be deleted, and more cameras cannot be added. Since the camera defines what the viewer sees from the scenario, there has to be exactly one in every scene. By adjusting the camera’s position, rotation, and field of view, you can achieve various lens and motion effects. This capability enables you to incorporate diverse perspectives into the scenario, resulting in a more immersive and captivating experience for viewers of your scenario.

Camera Attributes and Camera POV settings are shown in the figure below:

Camera Attribute

    • Apply Camera Movement: This option is enabled by default, which means that any movement effects you have set for the camera will occur during the preview. If you are viewing a scenario made using previous versions of this application, you may need to deselect this due to compatibility issues.
    • Disable Preview Movement: This option is only available when the Apply Camera Movement setting is enabled. If this option is checked, users cannot move the camera during a preview, and can only follow the camera’s preconfigured path. If this option is not checked, users can freely adjust the camera angle during the preview.

Camera POV

There are two buttons under Camera POV:

    • Get Camera POV: This function changes your view of the scene to your camera’s current point of view.
    • Set Camera POV: This function changes the camera’s point of view to your current view of the scene.

How to move the camera in a straight line

When the view in the scene needs to change, such as bringing the camera closer or further away from the target position, orbiting or hovering around the target position, etc., you need to add pose action for the camera. After adding the action, dragging the camera with the mouse will show a straight-line path from the camera element’s initial position to the mouse position. At the same time, moving or rotating the camera will refresh the camera movement effect in the attributes pane.

You can follow below steps to add camera movement in straight line:

1. Click on the camera to select it, then navigate to the attributes pane and check Apply Camera Movement.

2. In the attributes pane, click the button next to the element name, then select Movement.

3. To add a linear movement to the camera, make sure that the Curved Path option is disabled. Then, you can use either of the following two methods:
a) Method 1: Drag the camera to where you would like it to move to, and you can rotate it to change its angle as well. You should see a blue and white line connecting the camera to its old position, which represents the path that the camera will take to reach its new location.
b) Method 2: Change your view of the scene to what you would like the next camera angle to be, then select the camera in the elements pane. In the attributes pane, press the blue Set Camera POV button that is located underneath the Camera POV header. This will bring the camera to your location and set the camera’s point of view as what you currently see in the workspace.

4. In the attributes pane, you can change both the duration value to control how fast the camera moves to its new location, and the movement type in order to control its acceleration along the path.

5. Repeat Step 2-4 to add multiple linear camera movements. You can create a motion trajectory consisting of multiple straight-line segments, as shown in the figure below:

How to move the camera in a curved path

Camera movement in curved path is an advanced camera movement. By using at least three path points, you can freely configure the positions of these points to create various camera movements in curved path. Compared to camera movement in straight-line path, curved camera movements make your scenario more dynamic and visually impactful.

Camera movement in curved path is shown in the figure below:

To use curved camera movement, you need to enable the camera movement feature in Camera Attribute, and then add pose action to the camera. You can set Movement parameters such as Face the Path and Control Point to achieve the desired curve path effect.

Here are some of the camera attributes that you will need to know in order to move the camera in a curved path.

Curved Path: Enabling this option allows the camera’s path to curve around control points.

Face the Path: The camera direction always stays aligned with the path direction.

Control Point: These are points along the camera’s path that guide the way that the path curves. You can set as many as you want, and setting multiple points along one curve allows for more gradual and smoother camera movements.

The steps to create a camera movement in curved path are as follows:

1. Click to select the camera in the Elements pane and choose Apply Camera Movement in the Attributes pane to enable camera movement.

2. Click the button near the element name to add a Movement action to the camera.

3. In the attributes pane, set Duration and check Curved Path for the Movement action.

4. To add a curved movement to the camera, make sure that the Curved Path option is enabled. Then, you can use either of the following two methods:
a) Method 1: Drag the camera along the path you would like it to follow and press the button Create a control point at the current position in the attributes pane when you would like the path to curve. You can also rotate the camera before doing so, and the camera will turn in that direction during the motion. Depending on your desired path, you may need to add multiple control points per curve.
b) Method 2: Click on the blue button Set Camera POV to change your view to the camera’s point of view. Then, move your view around the virtual environment in the same way you would like the camera to move, and use the Create a control point at the current position button to set control points when you would like to curve the camera in another direction. The more control points you set, the more accurate the camera will be when replicating your movements.

5. Repeat the previous step until you have achieved your desired movement. You can also edit the position and rotation of your camera during previous control points by selecting a control point, then adjusting the camera accordingly.

Element operations

Add an element

To add an element to your scene, select the element from the resources pane and directly drag it into the workspace.

Hide or show an element

If you hover over an element’s name in the elements pane, a button will appear. Press this button to toggle the element’s visibility.

Delete an element

To delete an element, select it by clicking on its model in the workspace or its name in the elements pane. Then, press the delete icon in the toolbar or the delete button on your keyboard to remove the element from all scenes.

Note: Elements can only be deleted in their first appearance scene.

Select an element

To select an element, click on its model in the workspace or its name in the elements pane. A selected element will have an orange outline around it (blue for special elements like light sources and cameras), along with corner lines that can be dragged to change its size and buttons that can be dragged to rotate it or change its elevation. Dragging anywhere within the corner lines allows you to change the element’s position on the horizontal plane.

Adjust the movement of an element

When the element is in the state of the Appear action or Movement, you can position and adjust the posture of the element by panning, rotating, scaling, and adjusting the height.

Here are the simple steps to perform these operations:

    • Horizontal Movement: After selecting an element, you can drag it anywhere within the highlighted corner lines in order to move it across the horizontal plane. You can also manually change its X and Z coordinates in the attributes pane to fine-tune its new position. When the selection highlight is pink instead of orange or blue, this means that the model cannot be moved in its current state. This occurs when the element’s subcomponents are spread out due to the disassemble effect, or when the element is currently applying the cross-section effect.
    • Resize: After selecting an element, you can drag the corners of the selection box to change its size during the scene. You can also change its scale attribute, which will affect its size.
    • Rotation: After selecting an element, drag the rotation arrows above, below, or to the right of the selection highlight to rotate the element during the scene. You can also manually input the rotation angle in the attribute pane for precise adjustment.
    • Vertical Movement: After selecting an element, you can drag the double arrow icon to the left of the highlight up or down to adjust its vertical movement during the scene. You can also manually input the Y-axis value in the attribute pane.

Move an element via Directional Movement

Using the move tool can quickly and accurately move the element along a straight line, especially when you need to move the element to a precisely positioned location.

Here are the simple steps to drag the element along a straight line using Directional Movement:

1. Click Tools in the toolbar and select Directional Movement.

2. Select the element that you want to move in a straight line during the scene.

3. Three cone-shaped arrows will appear, which each correspond to an axis in the 3D space. Dragging an arrow will move the element along the corresponding axis in a straight line.

4. After dragging the element to the desired position, release the mouse button to complete the move operation.

Multiple selection

When you need to perform the same action on multiple elements at the same time, you can use the multiple selection operation. To do this, hold down the Ctrl key and add elements to your selection by clicking their model in the workspace or their name in the elements pane.

After selecting multiple elements, you can perform the following operations on them:

    • Move and rotate: Adjust the position and rotation angle of multiple elements by moving and rotating the multi-selected elements.
    • Copy and paste: Use Ctrl + C and Ctrl + V to copy and paste these elements.
    • Delete multiple selected elements: Click the delete button in the toolbar to delete multiple elements at once. Note: Sub-elements cannot be deleted.
    • Set the center point of multi-selected elements: You can set the central point of all the selected elements in the attributes pane, which affects their behavior when rotated.
      • Central Location: The center point is the central location of the bounding box for all selected elements. It is a default option.
      • Central Elements: Select one element as the center point from the selected elements.

Group elements

The grouping function behaves like a more permanent form of multiple selection; it combines multiple elements into a single entity and creates a new group element in the elements pane. To create a new group, select all elements that you would like to include, then press the group button in the toolbar.

You can perform the following operations on the group:

    • Move and rotate: You can adjust the position and rotation angle of the group by moving and rotating it.
    • Ungroup: Select a group, then press the ungroup button in the toolbar to disband the group. This causes the group element in the elements pane to disappear, and all elements previously in the group will now behave independently of each other. If you had groups within the disbanded group, those elements would remain grouped.
    • Rename: The default name of a group is “Group” followed by a sequence number, such as Group1, Group2. After creating the group, you can modify the group name in the attributes pane.
    • Set the center point of the group: You can set the central point of the group in the attributes pane, which affects their behavior when rotated.
      • Central Location: The center point is the midpoint of the bounding box for the group. It is a default option.
      • Central Elements: Select one element as the center point from the group.

Note: When you click on an element that belongs to a group, the system will prioritize selecting the group. If you need to select a specific element within the group, click on that element when the group is selected.

Scenarios

A scenario is a .dirpkg file created and edited in DataMesh Studio that consists of multiple scenes, each containing user-added models, pictures, attachments, text, and tools etc. In a scenario, not only you can compose and structure each scene, but also animate dynamic transitions in between the scenes. Scenario management is available in the Digital Assets module of the DataMesh FactVerse platform.

Create a new scenario

To create a new scenario, click the Create button on the homepage. This will open the scenario editing interface and create a new scenario. By default, each new scenario includes two light sources and one camera.

If a scenario file is already open, you can create a new scenario by clicking on the File menu and selecting New Scenario. Note: In this situation, you will be prompted to save the currently edited scenario.

Open a cloud scenario

To open a cloud scenario, follow these steps:

1. Click Open on the homepage.

2. In the Open Scenario window, select a cloud scenario and click Open.

If you are editing a scenario, you can open a cloud scenario by clicking the File menu and selecting Open Scenario. Note: In this situation, you will be prompted to save the currently edited scenario.

Save a scenario

To save a scenario to the DataMesh FactVerse platform, follow these steps:

1. In the edit interface of DataMesh Studio, click the save button , or go to the File menu and select Save.

2. If this is your first time saving the scenario, you will be prompted to enter a scenario name, select a storage path, and click the Confirm button in the Save Scenario window to save the scenario.

Import a local scenario

To import a local scenario into DataMesh Studio, please follow these steps:

1. On the homepage of DataMesh Studio, click the Import button. This will open a window displaying your local resources.

2. In the local resources window, locate and select the scenario file you want to import, then click the Open (O) button.

3. The scenario will be opened in the DataMesh Studio edit interface, allowing you to view, edit, and save the scenario.

Export a scenario

To export a scenario, follow these steps:

1. Click on the File menu and select Export Scenario. This will open the Export Scenario window.

2. In the Export Scenario window, you can configure the export options by choosing between Export Basic Scenario, Export Full Scenario and Export Accelerated Scenario.

        • Export Basic Scenario: The exported scenario file only contains the basic scenario file and an index to its resources, but not the resources themselves. Note: To import and use this basic scenario file, you must have access to all the resources within the scenario.
        • Export Full Scenario: The exported scenario includes the basic scenario file and all its resources but does not include an accelerator. This option outputs a lower file size, but scenarios will take a longer time to load.
        • Export Accelerated Scenario: The exported scenario includes the basic scenario file, all of its resources, and the resource acceleration attachment. This option outputs a higher file size but takes significantly less time to load.

      Preview a scenario

      DataMesh Studio supports three play modes:

        • Start from Beginning: In the edit interface, you can play the entire scenario using the following methods:
          • Click the Preview menu and select Start from Beginning.
          • Click the first scene thumbnail to set it as the current scene, and then click the play button .
        • Start Preview: In the edit interface, you can play the scenario starting from the current scene using the following methods:
          • Select a scene thumbnail and click the play button .
          • Click the Preview menu and select Start Preview.
        • Current Scene Only: In the edit interface, select a scene, and click the Preview menu and select Current Scene Only to play the currently selected scene only.

      The scenario will be played in full screen. Press Esc on the keyboard or click the close button in the top right corner of DataMesh Studio to exit the play mode.

      Change rendering environment

      The rendering environment refers to the background lighting effects used to simulate light propagation, reflection, and refraction in the virtual environment. It influences the appearance, lighting, and shadow effects of objects, enhancing the overall realism and fidelity of the scenes.

      In DataMesh Studio, you can choose either the built-in rendering environment or customize the rendering environment for scenario creation, making the virtual scene realistic and immersive.

      To change the rendering environment of a scenario, you can follow these steps:

      1. Click on the Scenario menu and select Change rendering environment from the dropdown menu. You can open the Change rendering environment window.

      2. In the Change rendering environment window, you can choose the system-built rendering environments. When you choose “None”, there is no specific environment rendering effects.

      You can also create a custom rendering environment to suit the scenario’s background and sky effects for different scene requirements and creative purposes.

      Steps for custom reflection environment:

      1. Prepare six images: These images should correspond to the front, back, left, right, top, and bottom directions of the rendering environment. The images should be in PNG format and follow English naming conventions (Front, Back, Left, Right, Top, Bottom).

      2. Compress these images into a zip file and change its extension to .dmcm.

      3. Upload this .dmcm file to the resource library on the DataMesh FactVerse platform.

      4. In DataMesh Studio, click on the Scenario menu and select Change rendering environment from the dropdown menu to open the Change rendering environment window.

      5. In the Change rendering environment window, select the Custom tab and click Select rendering environment.

        6. In the window for Select rendering environment, find the uploaded .dmcm file.

        7. After selecting the file, click the Confirm button to complete the customization of the rendering environment.

        Manage scenario structure

        In DataMesh Studio, the table of contents is used to display a list view of the structure of scenes chapters in the current scenario.

        By clicking the table of contents button , you can browse the entire scenario, grasp the overall structure and chapter contents, and quickly jump to the desired chapters and scenes.

          The following are the basic operations on the scenario structure:

            • Start New Chapter: Each chapter in the table of contents represents a group of scenes. To start a new chapter, you can right-click on a scene in the timeline, select New Chapter, and a window will appear. Type in the chapter’s name, and this will make the selected scene a starting point for a new chapter.

          Keep Elements: This option is a checkbox found in the New Chapter window that toggles whether or not you keep the elements from the previous scene. When checked, all the elements remained where they were. When unchecked, this converts the scene into a completely blank slate by removing all of its elements.

            • Delete Chapter: To delete a chapter, right-click on the chapter name in the timeline and select Delete Chapter. This will remove the chapter and all its associated scenes from the table of content.
            • Rename Chapter: To rename a chapter in the scene catalog, right-click on the chapter name in the timeline and select Rename Chapter.

          Basics

          Installation

          System requirement

          To make sure DataMesh Studio works well, the following content are minimum and recommended configuration requirements.

          System

          Minimum Configuration

          Recommended Configuration

          Windows PC

          Software:

          • Window10 or above
          • Direct3D 11.0 or above

          Hardware:

          • CPU: Intel®Core™i5-6200U 2.30Ghz
          • RAM:8GB
          • GPU: NVIDIA GTX 1050Ti

          Software:

          • Window10 or above
          • Direct3D 11.0 or above

          Hardware:

          • CPU: Intel®Core™i7-11700 3.60Ghz
          • RAM:16GB
          • GPU: NVIDIA GTX 3070

          macOS

          Software:

          • Monterey 12.0.1

          Hardware:

          • CPU: Intel Core i7
          • RAM:8GB
          • GPU: Intel Iris Plus Graphics 640

          Software:

          • Monterey 12.0.1

          Hardware:

          • Chip: Apple M1
          • RAM:16GB

          Note: macOS platform supports Intel i7 and M1 chip, Intel i5 device is not supported any more.

          Download

          Please ensure you have downloaded the installation program before installing DataMesh Studio.

          Download link for DataMesh Studio:

            • DataMesh Studio 1-Windows PC download short URL: datame.sh/Studio

          Platform

          App Store

          URL

          Windows PC

          Microsoft Store

          https://apps.microsoft.com/store/detail/datamesh-studio/9N57Q5SL7XKX?hl=en-us&gl=us

          macOS

          Apple Store

          https://apps.apple.com/cn/app/datamesh-studio/id1525519778?l=en

          iOS

          Apple Store

          https://apps.apple.com/cn/app/datamesh-studio/id1525519778?l=en

          Account Permission

          Before using DataMesh Studio, you need to request permission from the organization administrator. The administrator will add your user account, bind it to a department and position on the FactVerse platform, and grant you access to use DataMesh Studio along with other necessary functionalities.

          Login

          The following picture shows the login interface:

            • Server List: This changes which server you connect to; we have servers located in China, Japan, and Singapore. Make sure that the server you connect to is the same one that your organization uses.
            • : Private Server icon. If your organization uses a private server, you will need to enter a code before logging in.
            • Third-party Login: For more information about third-party login, please refer to the specific section on Third-party login in the user manual.
            • Forgot Password: Click Forgot Password, open the server login interface to reset password.

          Regular login

          To log in to DataMesh Studio, use your FactVerse account and password on the login interface.

          Steps

          1. Open the login interface of DataMesh Studio.

          2. Select the correct server.

          3. If your organization has a private server, follow these directions below. Otherwise, skip to step 4.

          a) Click the private server icon .
          b) In the popup, enter the private server’s code.
          c) Click Confirm to return to the login interface.

          4. Enter your FactVerse account and password.

          5. Click the Login button.

          a) If you have only one account, you will be directly logged in.
          b) If you have multiple accounts, select the correct one from a list and you will be logged in.

          Third-party login

          DataMesh Studio supports using Third-party login methods for logging in, using Microsoft Entra ID, an identity and access management service, in order to enhance user security.

          Steps

          1. Open the login interface of DataMesh Studio.

          2. Select the correct server.

          3. If your organization has a private server, follow these directions below. Otherwise, skip to step 4.

          a) Click the private server icon .
          b) In the popup, enter the private server’s code.
          c) Click Confirm return to the login interface.

          4. Click the Microsoft third-party login icon, and then enter your third-party account and password to log in.

          SMS verification login

          When a company enables the dual authentication of account passwords and SMS in FactVerse, users are required to undergo an SMS verification process when logging into the DataMesh client and FactVerse platform. Upon the first login to DataMesh Importer, you will encounter a prompt asking you to bind your mobile number for login verification. You will need to log in to the FactVerse platform to complete the binding.

          The steps for using SMS verification are as follows:

          1. Open the DataMesh One login interface.

          2. Select the correct server.

          3. If your organization has a private server, follow these directions below. Otherwise, skip to step 4.

          a) Click the private server icon .
          b) In the popup, enter the private server’s code.
          c) Click Confirm return to the login interface.

          4. Enter your FactVerse account and password, then click the Log in button.

          5. (Optional) Select the company your account belongs to: If you have multiple enterprise accounts, a list of company accounts will be displayed for you to choose from.

          6. If the selected company has enabled dual authentication with FactVerse account passwords and SMS, the mobile phone you bound will receive a login verification code, valid for 5 minutes.

          7. Enter the code to complete the login process.

          User interface

          There are two main user interfaces in DataMesh Studio: the Homepage and the Edit Interface.

          Homepage

          After a successful login, you will enter the homepage. From here, you can access recently edited scenarios, create new scenarios, open scenarios from the cloud, import local scenarios, clear cache, and upload logs.

          The homepage supports the following functions:

            • Create Scenario: Click the Create button to create a new scenario.
            • Open cloud scenario: Click the Open button to open a scenario from FactVerse.
            • Import local scenario: Click the Import button to import a local scenario (*.dirpkg) into DataMesh Studio.
            • Open a recently edited scenario quickly: This displays a list of your six most recent scenarios.
            • Upload log: This uploads the last seven logs to the FactVerse Used for troubleshooting.
            • Clear cache: This gives you the option to clear all of your cache, or resources that are infrequently used.
            • Provide feedback: Click Provide Feedback to provide product feedback to service@datamesh.com.
            • Version: This shows you details about the current version of the application.
            • Log out: Select your username on the top-right corner of the homepage, and then select Log Out to log out.

          Edit interface

          In the edit interface, you can organize 3D models, edit, and arrange demo procedure of the 3D content demo.

          The edit interface consists of the menu, toolbar, resources pane, elements pane, workspace, timeline, and attributes pane.

          Menu

          The menu contains all the tools and commands you may use when creating 3D content. The following table provides the instructions for each menu function:

          Menu

          Function

          File

          • New scenario: Create a new scenario in the selected directory. If the current scenario has not been saved, you will be prompted to save it before proceeding.
          • Open Scenario: Open a cloud scenario from FactVerse. If the current scenario has not been saved, you will be prompted to save it before proceeding.
          • Save: Save the current scenario.
          • Save as: Save the current content as a new scenario in the selected directory.
          • Export Scenario: Export the scenario in dirpkg format and save it as a file.
          • Close Scenario: Close the current scenario and return to the homepage. If the current scenario has not been saved, you will be prompted to save it before closing.
          • Quit: Exit DataMesh Studio. If the current scenario has not been saved, you will be prompted to save it before exiting.

          Edit

          • Undo: Revert the previous operation performed by the user.
          • Redo: Restore the previously canceled operation of the user.
          • Delete: Remove the selected element from the interface.

          Scenario

          • Rename: Change the scenario’s name.
          • Set Cover Image: Upload a picture as the scenario’s cover image.
          • Change Rendering Environment: Support modification of scenario rendering environment. You can use built-in indoor and outdoor rendering environments or customize rendering environments. For more details, please refer to Change rendering environment.
          • Modify Scenario Positioning: This allows you to set a model as a reference, which proves helpful when you need to make edits in connection to a model without interfering with your process. For more details, please refer to Customize spatial positioning methods.
          • Modify Play Mode: The playback method for scenarios in the training mode of DataMesh One can be set to Stage traversal. For more details, please refer to the Scenario play mode.

          Assessment

          Preview

          • Start from Beginning: Preview the scenario from the first scene.
          • Start Preview: Preview the scenario starting from the current scene.
          • Current Scene Only: Preview the current scene only.

          Tools

          • Directional Movement: When enabled, each object has three cones when selected that allow the user to move that object in straight lines across the X, Y, or Z axis.
          • Performance Statistics: Display important statistics such as FPS, Memory Usage, etc.

          Settings

          • Language: You can switch to different interface languages. The DataMesh Importer offers four interface languages: Simplified Chinese, Traditional Chinese, English, and Japanese. After users log in, the interface language will default to the system language. If the system language is not one of these four application languages, the interface language will default to English.
          • Account:
          • User account: Display currently the current user.
          • Log out: Log out of the current account.
          • Upload Log: Upload the last seven logs to our servers.
          • Rendering Quality: To adapt to different device performance, DataMesh One provides six different rendering quality options. Increasing the quality can optimize screen aliasing, ripple, and shadow effects.

          o    1 (Lowest Quality): The most basic rendering level, ideal for quickly viewing the model or when the device performance is limited.

          o    6 (Highest Quality): The best image quality and detail display, but it may significantly impact software performance.

          • About: Check the current application version.

          Toolbar

          The toolbar provides quick access to frequently used tools and commands in DataMesh Studio.

          Icon

          Description

          Homepage

          Clicking the Homepage button to return to the homepage. If there are any unsaved changes in the current scenario, a prompt will appear asking if you want to save the current scenario before navigating back to the homepage.

          Save

          Save any changes made to the scenario since the last save.

          Undo

          Revert the previous action.

          Redo

          Redo the last action that was undone using the Undo function.

          Group

          Group together the set of currently selected elements. This group is then saved in the Elements pane.

          Ungroup

          The ‘Ungroup’ button, when selected for a certain group, can dissolve that group; after ungrouping, the corresponding group in the element list disappears, and all elements within the group revert to their state prior to grouping. If the group includes sub-groups, the ungrouping operation of the parent group does not affect the sub-groups.

          Copy

          Copy the selected element, and grouped elements can also be copied.

          Paste

          Paste the most recently copied content.

          Delete

          Delete the selected element.

          Preview
          Preview a scenario.

          Resources pane

          The Resources pane is in the upper left window. You can adjust the size of the Resources pane by dragging the bottom or right edge of the window. Clicking on the Resources title can expand or collapse the pane.

          The Resources pane can be divided into two sections: My Resources and Libraries.

          My Resources

          My Resources section contains a variety of resources uploaded by users, which can be used to build 3D scenes.

            • Filter: You can filter resources by tags in order to display all resources that have that tag.
            • Storage Directory: The file path to your current folder. Click to return to the previous folder.
            • Search Bar: Use the search bar to search for the resource you are looking for.
            • Refresh: Click to refresh resources materials. Any resources added before the refresh will appear.

          Resources Status:

            • Uncached: A gray icon means that a resource has not been downloaded, and you must do so before you can use it in your scenario.
            • Downloading: Clicking on a grayed out resource will initiate the download process. The download progress will be displayed.
            • Cached: Once the material has been successfully downloaded, its icon will be highlighted. You can then drag and drop the material to the workspace.

          Libraries

          The Libraries section comprises built-in models and advanced resources created and added by users. If you do not have any available resources in My Resources, you can still experience DataMesh Studio using the built-in models available in Libraries.

          Elements pane

          The Elements pane is on the bottom left of the interface and contains all the elements in the current scene.

          The Elements pane supports the following functions:

          1. Show/Hide: When you hover over an element, an icon will appear to the left of the element. Clicking on this icon will show a hidden element or hide a visible element.

          2. Select: Clicking on an element will select it.

          3. Focus: Double-clicking on an element will transport the scene viewer to its location.

          4. Resize: Dragging the right edge of the elements pane will adjust its size.

          5. Collapse: Clicking on the Elements pane header will collapse the pane.

          Workspace

          The workspace is in the middle of the interface and shows you the virtual environment of your scenes and scenarios. You can drag elements from the resources pane to the workspace to add them to your scenario. During playback, the elements in the scene will interact based on user-defined logic.

          The workspace displays various elements that you have added to the current scene, including:

            • Light Source: By default, every new scenario contains two light sources .
            • Camera: By default, every new scenario contains one camera .
            • User-added resources, such as models in the scene.
            • Scenario name: The current scenario name is shown in the top-left corner of the workspace. The default format for scenario names is “Project-<date>-<number>”. You can change the scenario name when saving the scenario.
            • View cube : Located in the upper-right corner of the workspace, the view cube indicates the current viewing angle direction. Clicking the view cube allows you to switch between six views (front view, rear view, left view, right view, top view, and bottom view).
            • Focus button :

          When no element is selected:

              • Clicking the button will focus the view to the center of the scene, resetting the current scene view to the default perspective. The default perspective is positioned in the front and above, looking towards the center of the scene.

          After selecting the element:

              • Clicking the focus button will switch the view focus to the selected element.
              • Clicking the focus button a second time will move closer to the selected element.
            • Projection switch button : Toggles between perspective mode, where objects appear smaller the further they are from your view, and orthographic mode, where objects remain the same size. For more details, please refer to Projection modes.
            • Table of Contents : Gives a list view of the order of scenes and chapters in the current scenario.

          Attributes pane

          The attributes pane is located on the right side of the interface and enables you to edit the attributes of scenes and elements. You can add actions to elements and configure their behaviors via the attributes pane.

          The attributes pane is context-sensitive; it shows the attributes of anything that is selected.

          If nothing is selected, then the attributes pane will display attributes of the overall scene.
          The following picture illustrates the layout of the attributes pane if a model is selected:

          For more details about the parameters in the attributes pane, please refer to following sections:

            • Set scene attributes: This section introduces how to edit and configure scene attributes.
            • Elements: This chapter introduces various elements in the scenario and provides guidance on how to edit and adjust elements’ attributes.
            • Actions : This chapter helps you understand how to add and configure action effects for elements.

          Timeline

          The timeline is located directly below the workspace and contains thumbnails of all the scenes for easy recognition. The order of the scenes goes from earliest at the left to latest at the right. In addition, users can click on each thumbnail to quickly switch to the scene that the thumbnail represents. Here are the features of the timeline:

            • Add Scene: By right clicking and selecting this option, you can add a scene directly to the right of the selected scene. Additionally, you can add a new scene at the end of the timeline by clicking on the “+” button.
            • Delete Scene: Delete the selected scene.
            • New Chapter: Create a new chapter.
            • Add Previous Scene: Add a previous scene to the current scene.

          Additionally, you can navigate through the timeline via keyboard shortcuts:

            • ← switch to the previous scene.
            • → switch to the next scene.

          The timeline provides an intuitive interface for managing and navigating scenes. It gives users the ability to easily locate and switch between different scenes and manage and adjust scene settings.

          Keyboard shortcuts

          DataMesh Studio provides keyboard shortcuts to enhance user productivity. For example, using Ctrl + S allows you to quickly save their current project, while Ctrl + Z enables them to undo the most recent operation.

          Operation

          Windows

          MacOS

          New

          Ctrl+N

          Command+N

          Open

          Ctrl+O

          Command+O

          Save

          Ctrl+S

          Command+S

          Save as

          Ctrl+Shift+S

          Command+Shift+S

          Close

          Ctrl+W

          Command+W

          Exit

          Alt+F4

          Command+Q

          Paste

          Ctrl+V 

          Command+V 

          Delete

          Delete

          Delete

          Undo

          Ctrl+Z 

          Command+Z

          Redo

          Ctrl+R

          Command+R

          Group

          Ctrl+G

          Command+G

          Ungroup

          Ctrl+Shift+G

          Command+Shift+G

          New scene

          Previous scene

          Drag visual reference

          Shift+left button

          Shift+left button

          Element range selection

          Shift+ left button muti-selection

          Shift+ left button muti-selection

          Element disjointed selection

          Ctrl+ left button

          Command + left button

          User interface

          The layout of DataMesh Importer user interface are as follows:

          Menu

          The Menu includes functions such as File, Settings, and Information Panel. You can perform operations such as opening local models, opening cloud models, and saving models.

          File menu

            • Open Local: Open a locally saved model file.
            • Open Cloud: Open a model file from the FactVerse resources.
            • Save Model: Upload the currently imported model to the FactVerse resources.
            • Save As: Perform a Save As operation on the current model and specify a new name for it.

          Save

          It is the same as the Save Model function in the File menu. It saves the model resource to the FactVerse resources.

          Settings

            • Language: You can switch to different interface The DataMesh Importer offers four interface languages: Simplified Chinese, Traditional Chinese, English, and Japanese. After users log in, the interface language will default to the system language. If the system language is not one of these four application languages, the interface language will default to English.
            • Account > User account: Display current login user account.
            • Account > Log out: Exit current user account.
            • Rendering Quality: To adapt to different device performance, DataMesh One provides six different rendering quality options. Increasing the quality can optimize screen aliasing, ripple, and shadow effects.
            • Change Rendering Environment: Support modifying the rendering environment of the scene, which can include system-built rendering environments or custom rendering environments. For detailed information, please refer to the guide on Change rendering environment.
            • Upload log: You can upload the latest seven log files to FactVerse.
            • Operating Parameters: Display the application’s Memory, FPS, DrawCall, Batches, Polygons, Vertices, and other key data.
            • About: View the current application version number.
            • Quit: Close the application.

          Information Panel

          Display attributes information of the model.

          Node structure directory

          The Node structure directory is a feature in DataMesh Importer that displays the hierarchical structure and node relationships of the imported 3D models. The Node structure directory can help you better manage and control the structure of the imported 3D model. You can select, deselect, and merge nodes as needed to flexibly adjust the model’s hierarchical structure. This can improve the model’s operability and flexibility, making it easier for you to perform subsequent model editing and scene creation work.

          In the Node structure directory, you can perform the following operations:

            • Smart Select All: With Smart Select All, you can quickly select or deselect all nodes for batch operations.
            • Single node selection: Each node has a checkbox that you can click to select or deselect the node. Through the checkbox, you can selectively control the components of the model. When you upload the model, the selected nodes will be uploaded as separate objects, while the unselected nodes will be merged into other nodes.
            • Select same-level nodes quickly: By double-clicking the checkbox of a node, you can quickly select or deselect all nodes at the same level. This feature makes it convenient for you to perform mass selection or deselection operations on nodes at the same level.

          Note: When the number of nodes exceeds 500, you need to manually select the nodes.

          Scene area

          The Scene area can load and display imported 3D models. Users can import various format model files (such as FBX, GLTF, OBJ, etc.) and present them as realistic 3D objects in the Scene area. Users can freely browse and observe the model in the Scene area.

          When loading and displaying imported 3D models in the Scene area, users can use the following methods to adjust the scene perspective:

            • Rotate the scene: Hold down the right mouse button at any position in the scene and move the mouse horizontally to rotate the scene in all directions for a comprehensive view of the model.
            • Pan the scene: To move the scene to the left, right, forward, or backward in the scene, click on a blank area in the scene, hold down the left mouse button, and drag the mouse to the left, right, or up and down on the screen. You can also hold down the mouse wheel and drag the mouse in the direction you want to pan.
            • Zoom the scene: To zoom in and out of the scene, you can use the scroll wheel on the mouse. Scroll up to zoom in and scroll down to zoom out.
            • Raise and lower the scene: To raise and lower the scene, hold down the Shift key and the left mouse button, and move up and down on the blank area of the scene. Move up to lower the scene and move down to raise the scene.

          Model Attributes pane

          The Model Attributes pane displays the current model’s performance on various platforms and its basic attribute information. At the same time, the attributes pane provides material editing functions that allow users to adjust and modify the model’s materials. Users can choose the type of material ball for the model (such as metal, wood, plastic, etc.), or customize the color, glossiness, roughness, and other attributes of the material to achieve the desired visual effect.

            • Available Platforms: The platform availability indicates the availability of models on different platforms. The size and complexity of the model’s structure can affect its performance on different platforms. When using DataMesh Importer to open a model, we will prompt you to see whether the DataMesh application on three platforms supports the model’s normal operation.
            • Polygons: The polygons refer to the number of polygons in the model. It is an important indicator for measuring model complexity and detail level. Higher polygon counts usually mean more details and more refined appearance but may also lead to performance burdens. In DataMesh Importer, when the polygon count of the model is too large, it may affect the use of the application and give corresponding prompts.
            • Vertices: The model vertices refer to the total number of vertices in the model. Vertices are the basic building blocks of the model, forming polygons by connecting vertices, thus forming the entire model. The vertices are related to the detail and complexity of the model. A high vertex may increase rendering and computational burdens. Therefore, when using DataMesh Importer, if the vertices of the model are too large, prompts may be given.
            • Textures: The texture count refers to the number of texture images applied to the model. Textures can give the model visual effects such as color, texture, and reflection. Increasing the number of textures may increase memory usage and render burdens. In DataMesh Importer, the textures can provide an evaluation of the model’s texture usage, allowing users to understand the details of the model.
            • Materials: The materials represent the number of materials used in the model. Materials define the characteristics of the model’s surface, such as color, transparency, metallicity, and smoothness. In DataMesh Importer, users can edit and adjust each material, including modifying properties such as color, transparency, metallicity, and smoothness. Understanding the number of materials in the model can help users understand the changes in appearance and detail control of the model.
            • Animation: When the model has built-in animation, users can click the Play button to play it.

          Login

          After opening DataMesh Importer, click on the settings button in the toolbar, and select Account > Account Login from the drop-down menu to open the login page.

          Following figure is the login interface:

          The login interface supports following configuration:

            • Server List: You can switch to different servers, including China, Japan, and Singapore.
            • Private Deployment: If an enterprise has deployed a private server, users need to enter the exclusive service code for the private deployment when logging in.
            • Third-party Login: For more information about third-party login, please refer to the specific section on Third-party Login in the user manual.
            • Forgot Password: Click Forgot Password, open the server login page, and proceed with the password reset.

          Regular login

          To log in to DataMesh Importer, use your FactVerse account and password on the login interface.

          1. Open the login interface of DataMesh Importer.

          2. Select the correct server.

          3. If your organization has a private server, follow these directions below. Otherwise, skip to step 4.

          a. Click the private server icon .
          b. In the popup, enter the private server’s code, for example: “dtcs-sg”.
          c. Click Confirm to return to the login page.

          4. Enter your account and password of FactVerse.

          5. Click Sign in.

          a. If you have only one account, you will be directly logged in.
          b. If you have multiple accounts, select the correct one from a list and you will be logged in.

          Third-party login

          DataMesh Importer supports using Third-party login methods for logging in, using Microsoft Entra ID, an identity and access management service, in order to enhance user security.

          1. Open the login interface of DataMesh Importer.

          2. Select the correct server.

          3. (Optional) Private server deployment. If your company has deployed a private server, you need to configure the private server settings before logging in.

          4. Click the Microsoft third-party login icon, and then enter the third-party account and password to log in.

          SMS verification login

          When a company enables the dual authentication of account passwords and SMS in FactVerse, users are required to undergo an SMS verification process when logging into the DataMesh client and FactVerse platform. Upon the first login to DataMesh Importer, you will encounter a prompt asking you to bind your mobile number for login verification. You will need to log in to the FactVerse platform to complete the binding.

          Once your phone number is bound, the steps for using SMS verification are as follows:

          1. Open the DataMesh Importer login interface

          2. Select the correct server.

          3. (Optional) Private server deployment. If your company has deployed a private server, you need to configure the private server settings before logging in.

          4. Enter your FactVerse account and password, then click the Login button.

          5. (Optional) Select the company your account belongs to: If you have multiple enterprise accounts, a list of company accounts will be displayed for you to choose from.

          6. If the selected company has enabled dual authentication with FactVerse account passwords and SMS, the mobile phone you bound will receive a login verification code, valid for 5 minutes.

          7. Enter the code to complete the login process.

          Overview

          DataMesh Importer is a lightweight and efficient 3D model viewing tool that supports importing various formats of 3D model resources, including FBX, GLTF, OBJ, PLY, 3MF, and STL formats. With DataMesh Importer, you can intuitively understand the structure and basic attributes of the imported model, quickly preview the running effect of the model on different devices and adjust and edit the material properties of the model to optimize the rendering effect.

          DataMesh Importer also supports one-click upload of models to the cloud resource library of DataMesh FactVerse, facilitating team collaboration and resource sharing. At the same time, when used in conjunction with DataMesh Studio, it can easily add 3D models to presentations, providing users with an efficient 3D content creation tool.

          Training mode

          This chapter will provide a detailed overview of the user interface and numerous features of DataMesh One in training mode. You’ll learn how to use DataMesh One in training mode, including the processes to design learning and test tasks by instructors, as well as the procedures followed by students to complete these learning and test tasks.

          User interface

          Main interface

          The main interface of DataMesh One in training mode is as follows:

          My Tasks: The My Tasks page displays a list of all learning tasks and test tasks.

          Course record: The Course record shows all learning records and test records, including time, task names, duration, and scores.

          Settings

          The Settings for the training mode interface are the same as those for the standard mode. For more details, refer to the section Settings under standard mode.

          Resource positioning

          The side buttons in the Position Mode interface support the following actions:

            • Complete positioning adjustments: Click the Complete button to exit Positioning Mode and enter the scene playback interface.
            • Adjust displacement and rotation precision: You can open the additional features panel by clicking the More Options button and then click the setting  button  to enter the Set click accuracy window for refining the precision of displacement and rotation.
            • QR code Positioning: Click the QR code Positioning button to use the scan-based positioning feature for a more accurate positioning of the scenario.
            • Gaze Mode: Click the gaze mode button to enter the Gaze Mode, adjust the scenario’s position by moving the camera’s field of view.

          For more details, please refer to the section Resource positioning under standard mode.

          Learning tasks

          Task Status

            • Incomplete: Tasks that have not been started or have not been completed are considered incomplete.
            • Completed: Tasks that have been completed within the task period.
            • Expired: Tasks that exceed the task deadline are considered expired tasks.

          Playback interface of the learning task

          The side buttons in the playback interface of the learning task support the following actions:

            • Settings: Click the settings button to open the settings page for configuration.
            • View task timer: If the task has set a task duration, clicking the timer button will display the remaining time until the learning task ends. If the duration is exceeded, the task will automatically end.
            • View task score: Click the task score button to see the real-time task scoring situation.
            • Switch to position mode: Click the position mode button to enter the position mode for adjusting the scenario’s position.
            • Help: Provide concise operating instructions and relevant tips to help you better understand and use the features.

          Interaction interface of the learning task

          The interaction interface of the learning task appears as follows:

          You will find the Skip, Demo, Reset, and Confirm buttons below the interaction interface:

            • Demo: Clicking the Demo button allows you to watch the correct way for roles to interact.
            • Reset: Clicking the Reset button restores the model to its state before being moved.
            • Confirm: After placing the interactive role in the correct position and rotating it to the proper angle, clicking the Confirm button completes the interaction.
            • Skip: Clicking the Skip button lets you directly skip the interaction task for the current scene.

          The side buttons in the interaction scene of the learning task support the following actions:

            • Settings: Click the settings button to access the general settings.
            • View task timer: If the task has set a task duration, clicking the timer button will display the remaining time until the learning task ends. If the duration is exceeded, the task will automatically end.
            • View task score: Click the task score button to see the real-time task scoring situation.
            • Switch to position mode: Click the position mode button to enter position mode and adjust the position.
            • Switch interaction method: Click to choose the input type, turn the scene axis on or off, and adjust the scene opacity, and the scene scale ratio.
            • Help: Provide concise operating instructions and relevant tips to help you better understand and use the features.

          Exam tasks

          Task Status

            • Incomplete: Tasks that have not been started or have not been completed are categorized as incomplete tasks.
            • Completed: Tasks that have been completed within the task period by learners.
            • Expired: Tasks that exceed the task deadline are considered expired tasks.

          Playback interface of the exam task

          The side buttons in the playback interface of the exam task support the following actions:

            • Settings: Click the settings button to open the settings page for configuration.
            • View task timer: If the task has set a task duration, clicking the timer button will display the remaining time until the learning task ends. If the duration is exceeded, the task will automatically end.
            • View task score: Click the task score button to see the real-time task scoring situation.
            • Switch to position mode: Click the position mode button to enter the position mode for adjusting the scenario’s position.
            • Help: Provide concise operating instructions and relevant tips to help you better understand and use the features.

          Interaction interface of the exam task

          The interaction interface of the exam task appears as follows:

          You will find the Reset, and Confirm buttons below the interaction interface:

            • Reset: Clicking the Reset button restores the model to its state before being moved.
            • Confirm: After placing the interactive element in the correct position and rotating it to the proper angle, clicking the Confirm button completes the interaction. Note: If there are multiple interactive elements in the scene, you need to click Confirm after completing each operation for the scoring to take effect.

          The side buttons in the interaction scene of the learning task support the following actions:

            • Settings: Click the settings button to access the general settings.
            • View task timer: If the task has set a task duration, clicking the timer button will display the remaining time until the learning task ends. If the duration is exceeded, the task will automatically end.
            • View task score: Click the task score button to see the real-time task scoring situation.
            • Switch to position mode: Click the position mode button to enter position mode and adjust the position.
            • Switch interaction method: Click to choose the input type, turn the scene axis on or off, and adjust the scene opacity, and the scene scale ratio.
            • Help: Provide concise operating instructions and relevant tips to help you better understand and use the features.

          Score interface

          Course record

          The Course record page displays the user’s name, custom avatar, learning records, and exam records.

            • Avatar: Users can upload a custom avatar on the FactVerse platform.
            • User Name: For external users, the name is displayed upon login; for internal users, the username is displayed.
            • Learning/Exam Records:
              • Time: Displayed in ascending order of completion time; format is yyyy.mm.dd hh:mm, for example, 2022.02.02 12:23.
              • Task Name: Displays the name of the learning or exam task.
              • Time Taken: Format is hh:mm:ss.
              • Score: Shows the final score for a task.

          Training Process

          Training preparation

          Create task assessment scenarios

          Training instructors use DataMesh Studio to create scenarios with task assessments. The following is the basic process for creating scenarios with task assessments:

          1. Upload the required resources for scenario creation (e.g., models, images, PDF files, etc.) to the resource library of the FactVerse platform.

          2. Log in to DataMesh Studio.

          3. Add the necessary resources, such as models, to the scene.

          4. Add linking actions or interactive positions to the roles.

          5. Create assessment tasks, set scores for tasks, and bind interactive actions.

          6. Set the scenario playback mode.

          For more information about creating assessment scenarios with task assessments, you can refer to the Interaction Position and Assessment section in the DataMesh Studio user manual.

          Training management

          Training instructors need to perform the following training management tasks in the Learning Management module on the DataMesh FactVerse platform:

          1. Create training groups

          In the Learning Management module on the DataMesh FactVerse platform, create internal training groups and add learners to these groups. For more information, please refer to the section Create an internal training group in the DataMesh FactVerse User Manual.

          2. Create courseware

          Training instructors need to create training courseware and bind task assessment scenarios in the Learning Management module on the DataMesh FactVerse platform to provide learning resources for training content. For more information, please refer to the section on Create a new courseware in the DataMesh FactVerse User Manual.

          3. Create learning tasks

          In the Learning Management module on the DataMesh FactVerse platform, set up learning tasks for the previously created training groups to guide learners in their learning and training. For more information, please refer to the section on Create a new task in the DataMesh FactVerse User Manual.

          4. Create exam tasks

          In the Learning Management module on the DataMesh FactVerse platform, create exam tasks for training groups to assess and evaluate learners. For more information, please refer to the section on Create a new task in the DataMesh FactVerse User Manual.

          Complete learning tasks

          Trainees in the training group complete learning tasks in the training mode of DataMesh One. These tasks must be completed within the task’s validity period. The specific steps for completing a learning task are as follows:

          1. Log in to the training mode of DataMesh One.
          2. Click on My Tasks, select the learning task you want to complete, and enter the learning task interface.

          3. Move your mobile device’s camera to recognize the surrounding environment.

          4. After recognizing a flat surface, tap on an empty area on the screen to quickly place the model on the recognized surface.

          5. Position Adjustment: After placing the model, enter the position adjustment mode. You can adjust the model’s position using the joystick, QR code positioning, or by reselecting the gaze mode. For more information, please refer to the section Resource positioning in the standard mode.

          6. Adjust Translation and Rotation Accuracy (Optional): If you need to fine-tune the translation and rotation accuracy, you can open the additional options panel by clicking the button on the side of the position adjustment interface. Then, click the adjustment function button to enter the adjustment and click accuracy window for corresponding adjustments.

          7. After completing the position adjustment, click the Complete button to start playing the scene.
          8. When there are interactive tasks in the scene, click the “Demo” button after all the characters in the scene have finished playing to see how to perform the operation.

          9. Click on the model you want to interact with in the scene; the selected model will be surrounded by a blue highlighted outline.

          10. According to the task requirements, move the model to the designated area or rotate the model. If the model is within the automatic adsorption range and rotation angle error, it will automatically move to the correct position and rotate to the correct angle. Note: The interactive behavior in this scene does not affect the roles in the next scene.
          11. Click Confirm after completing an action. Note: If there are multiple interactive actions in the scene, you need to click Confirm after completing each action for the scoring to take effect.

          12. After completing all interactive actions in the current scene, click the arrow to turn the page and continue playing the next scene.

          13. After all scenes have been played, the message “The task is Over” will be displayed.

          14. Click the Next button to display the score results.

          15. Click the Next button to exit the learning task.
          16. Click Course record to view learning records.

          Complete exam tasks

          Trainees in the training group complete exam tasks in the training mode of DataMesh One. These tasks must be completed within the task’s validity period. The specific steps for completing an exam task are as follows:

          1. Log in to the training mode of DataMesh One.
          2. Click on the exam task you want to complete in My Tasks and enter the exam task interface.

          3. Move your mobile device’s camera to recognize the surrounding environment.

          4. After recognizing a flat surface, tap on an empty area on the screen to quickly place the model on the recognized surface.

          5. Adjust Position: After placing the model, enter the position adjustment mode. You can adjust the model’s position using the joystick, QR code positioning, or by reselecting the gaze mode. For more information, please refer to the section Resource positioning in the standard mode.
          6. Adjust Translation and Rotation Accuracy (Optional): If you need to fine-tune the translation and rotation accuracy, you can open the additional options panel by clicking the button on the side of the position adjustment interface. Then, click the adjustment function button to enter the adjustment and click accuracy window for corresponding adjustments.

          7. After completing the position adjustment, click the Complete button to start playing the scene.
          8. When there are interactive tasks within the scene, after all roles in the scene have finished playing, enter the interactive mode.
          9. Click on the model you want to interact with in the scene; the selected model will be surrounded by a blue highlighted outline.

          10. According to the task requirements, move the model to the designated area or rotate the model. If the model is within the automatic adsorption range and rotation angle error, it will automatically move to the correct position and rotate to the correct angle. Note: The interactive behavior in this scene does not affect the roles in the next scene.

          11. Click Confirm after completing an action. Note: If there are multiple interactive actions in the scene, you need to click Confirm after completing each action.

          12. After completing all interactive actions in the current scene, click the arrow to turn the page and continue playing the next scene.

          13. After all scenes have been played, the message “The task is Over” will be displayed.

          14. Click the Next button to display the exam score results.

          15. Click the Next button to display whether the exam has been passed.

          16. Click the Exit button to finish the exam task.
          17. Click Course record to view exam records.

          Standard mode

          In this chapter, we’ll delve into the user interface of DataMesh One in standard mode, as well as the features it contains. You’ll learn how to navigate and use DataMesh One in standard mode, including resource positioning, resource editing, and opening resources and scenes.

          User interface

          Main interface

          Resources

          The Resources tab contains all the folder directories and resource files that your account has access to. These resource files include 3D models, scenarios, images, PDF files, and more. The resource type of each file is indicated in the top-right corner of its respective resource file.

          The following figure shows the toolbar found in the Resources tab:

          Events

          The Event tab is used to manage all the events that the current account has access to. In the Event tab, you can browse the event list, view event details, participant information, and scenarios. If you are the creator of the event, you can also edit the event.

          The following figure shows the toolbar of the Events tab:

          Scenes

          DataMesh One provides access to scene files that are created in FactVerse Designer. A user who has permissions for the scene function can view the scene interface directly in the application. The scene tab contains all folder directories and scene files that the current account has access to.

          Settings

          Clicking on the gear icon on the top right takes you to the application’s settings, where you can find general settings like account, browse mode, appearance, language, watermark, cache, and features such as uploading logs to our servers.

          Browse Mode: If a user has the authority to toggle between the standard and training modes, the interface will default to the training mode. However, the user can adjust this default by altering the browsing mode settings. If the user have access to only one mode, this option to switch will not be displayed in the settings.

          Language:  DataMesh One supports Simplified Chinese, English, Japanese and Traditional Chinese.

          Appearance: This option allows the user to swap between the light mode and dark mode interface. The default appearance is Light.

          Rendering Quality: To adapt to different device performance, DataMesh One provides six different rendering quality options. Increasing the quality can optimize screen aliasing, ripple, and shadow effects.

          Position Reference: The position reference setting aligns the content displayed by DataMesh One in positioning mode with the target object in the real world to achieve positioning effects.

            • Current Frame: Positioning is based on the current playback content of the scenario.
            • First Frame: Positioning is based on the first frame of the first scene of the scenario. For example, if A is added in the positioning mode of the DataMesh Studio scenario, A will be displayed for positioning under the initial positioning settings.

          Watermark: Supports turning the watermark on/off. (Trial accounts and demo mode do not support turning off the watermark).

          MR: This toggles the viewing modes between Mixed Reality (MR) and 3D. When using DataMesh One on mobile devices, MR mode is enabled by default, and you can switch to 3D viewing mode by turning off the MR switch in the settings. When using DataMesh One on a PC, only 3D mode is supported, and MR mode is not supported.

          Cache: This allows you to clear the cache of either the entire system or resources that have not been accessed in thirty days. Doing this is a good way to increase performance when necessary.

          Sort List: List Sorting: The list sorting function allows users to sort resources, scenes, and events according to different criteria, making it easier to find and manage resources, scenes, and events.

          Help: Interface elements that assist users in understanding specific features or completing particular tasks. They typically appear in the form of prompts, explanations, or examples to provide guidance and assistance with user operations. You can enable or disable the feature to control the display of help information in DataMesh One.

          Logs: DataMesh One supports uploading the latest seven logs.

          Log out: Click the Logout button to log out of the account and return to the login page.

          Open resources

          In the Standard Mode of DataMesh One, you can view 3D models, 2D resources, scenarios, and other content in the Resources tab.

          Before opening resources, please make sure your device is connected to a stable network, otherwise it might take a while for larger 3D models to load.

          In the Mixed Reality (MR) viewing mode, resources can be placed and viewed through your device’s camera and can be moved via our application’s Position Mode. For more information, please refer to our Resource positioning article.

          In 3D viewing mode, resources will automatically appear in front of your view. You can rotate, zoom, and move the resources using gestures or joysticks to better observe and experience. If you need to edit the position, rotation angle, scale, or transparency of a resource, you can enter Edit mode to perform the operation. For more information, please refer to Resource editing.

          3D models

          Please follow the following steps to open 3D models from the resources list:

          1. In the Resources interface, navigate to the folder containing the 3D models. If you know the name of the file, you can search for it with the search bar at the top.

          2. Click on the 3D model file you want to view in the resource list, which will start the downloading process.

            • In MR viewing mode, the model center is placed at (0, 0, 0) and you will enter position mode. Move your mobile device and click on the blank space in the screen to place the model.
            • In 3D viewing mode, the model will automatically appear in front of your view after it is loaded.


          3. If you need to adjust the position of a model that has already been placed, you can click the position button to reset the position. For more information, please refer to Resource positioning.

          4. If you need to adjust the position, rotation angle, scale, or transparency of the model, you can enter Edit mode for editing. For more information, please refer to Resource editing.

          2D resources

          The standard mode of DataMesh One also supports opening 2D resources such as images, videos, and PDF files. The opening process is the same as for 3D models, and they start out in the environment, but can be incorporated into the HUD (Head-up Display) for convenient viewing and operation by the user.

          Image

          After opening an image, you can minimize, hide, and view the image in full screen.

            • : Minimize. Clicking on this option will minimize the resource and fix it in the upper right corner of the screen for convenient viewing at any time.
            • : Hide. Clicking on the Hide icon will hide the image. After hiding the image, a Show icon will appear. Clicking on the Show icon, the image will be displayed again.
            •  : View in full screen.
            • : Unminimize. Select the image in the minimized state in the upper right corner of the screen, and then click to unminimize the image.

          Video

          After selecting a video, you can use the control buttons to play, pause, fast forward, rewind, adjust the progress bar, and control the volume.

          After clicking on the minimize icon, the video will minimize and be fixed to the upper right corner of the screen. You can click on the minimized video and use the control buttons to play, pause, fast forward, rewind, and adjust the video progress. You can also unminimize the video or watch the video in full screen.

          PDF

          The standard mode supports operations such as page turning, minimizing, and hiding PDF files.

          Clicking the minimize icon will minimize the PDF file and fix it to the upper right corner of the screen. You can click on the minimized PDF file and choose to turn pages, deselect minimize, or read in full screen mode.

          Scenario

          Scenario playbacks are one of the highlights of our application. Through scenarios, users can create and view complex tutorials, training guides for workers, and much more. Here’s how to open scenarios in the standard mode of DataMesh One.

          Steps

          1. Click on the folder where the scenario is located in the Resources tab.

          2. Click on the scenario you want to play, which will start the downloading process.

          3. After opening the scenario, you can manipulate the properties and position of the models and other resources using the Position and Edit Modes. For more information, please refer to the Resource Positioning and Resource Editing articles.

          4. Click on the Stage List button to open a list of all the stages found in the scenario. Selecting one of the stages will cause the object to change states into the one that you selected.

          Scan QR code to open resources

          Standard mode also supports opening resources by scanning the code. Here are the steps:

          1. On FactVerse, go to the Resources page in the Digital Assets module, navigate to the model or scenario file you want to view and open it.

          2. Click on the QR icon at the top right. Users with permission to access the corresponding directory can use the standard mode of DataMesh One to scan the QR code, open and view the resource quickly.

          In the standard mode of DataMesh One, click on the scan button , and scan the QR code generated in the previous step, which will then load and open the model or scenario.

          View resource information

          In the standard mode of DataMesh One, an information pane is provided to help users view resource information and better understand the content in the scene. Through the information pane, users can obtain the following resource-related information:

            • Resource name: Displays the name of the resource, helping users quickly identify the selected resource.
            • Model properties: Provides related information such as model attributes and node attributes. The information contained within these properties can help users understand the characteristics and structure of the model.
            • Engineering Information: Engineering information in the BIM file properties includes display options, identity data, constraints, dimensions, and other metadata. These details are used to describe elements in architectural design, such as door types. Display options can define the appearance of doors, such as color and line styles. Identity data can include the name, number, and material information of the door, used for annotations and identification. Constraints ensure the correct placement of doors within walls and alignment with other elements. Dimensions represent the width, height, and thickness of the door, providing size-related information.

          Steps

          1. In the case of opening a resource or playing an event, select the resource to be viewed in the scene.

          2. Press the Info button on the right side to expand the resource information pane.

          3. In the resource information pane contains more details, such as model name and node name.

          4. To collapse the resource information pane, press the Info button again.

          Resource positioning

          In MR mode, you can accurately position resources, including adjustments for location, distance, height, and angle, to ensure that resources are precisely placed where needed.

          Joystick controls

          Utilizing the touchpad joystick controls can adjust the position, distance, height, and angle of resources with a greater degree of accuracy and precision.

          Steps

          1. After completing the placement of resources, you can click on the Position button .

          2. After entering Position mode, the touchpad joystick controls are used by default.

          3. (Optional) Set the precision for each displacement or rotation in the joystick adjustment:

          a. Click the More functions button to open the More functions panel.

          b. Click the Adjust function button to open the Set click accuracy window.

            • Move: Adjusts the unit size of each movement. The default unit is 2 centimeters (cm)millimeters (mm), but users can change the number and select different unit types such as millimeters (mm), decimeters (dm), or meters (m). By adjusting the unit size, users can achieve precise position adjustments.
            • Rotate: Users can adjust the angle of each rotation. The default angle is 3 degrees (3˚), but users have the flexibility to customize the rotation angle for more precise adjustments.

          c. Set the movement sensitivity or rotation precision according to specific requirements, then click Apply to complete the setup.

          4. When using the touchpad joystick controls, in addition to using the left joystick to control the resource’s horizontal movement, you can also use the right joystick to control the resource’s vertical movement and orientation angle.

          5. Click to complete the resource positioning.

          Gaze mode

          In Gaze Mode, resources follow the center of the device’s camera and can be placed by tapping on the screen when the white grid is located at the desired location. This allows for faster placement of resources in a mixed reality space.

          When opening a resource, you will enter Gaze Mode by default. After placing the resource, if you need to place a virtual object using the camera again, you can follow these steps:

          1. Select the Position button to enter the position mode.

          2. Select the Gaze Mode button   to enter Gaze mode.

          3. After entering Gaze Mode, move the camera when the white grid is at the desired location, then tap anywhere on the screen to place the resource.

          4. Click on the button to complete positioning.

          QR code positioning

          By scanning the QR code while positioning virtual objects, you can place them into the mixed reality world with more precision, ensuring that they correspond to the real-world physical environment. For example, in an exhibition, you may need to precisely place a virtual exhibit in the same location as a real exhibit, which enables visitors to observe the virtual exhibit’s effect in the real environment. Note: QR code positioning only supports object positioning in the scenario.

          The steps for scanning the code to position are as follows:

          1. On FactVerse, go to the Resource page in the Digital Twin module and find the scenario file you need.

          2. Open the Resource details window and download the locating code.

          3. Place the downloaded QR code in the target position.

          4. Open scenario in the resources list on DataMesh One.

          5. Click on the Position button  to enter position mode.

          6. Click  button to scan QR code.

          7. Scan the QR code placed in the target position to complete scenario positioning.

          8. Click on to complete resource positioning.

          Resource editing

          To facilitate playback and viewing experience, the edit mode can be used to adjust the position, size, rotation angle, and transparency of models, sub-objects, tools, and other resource content in the scenario.

          Edit mode setting

          1. After opening the resource, you can enter Edit mode by clicking on the Edit button .

          2. Then, press the Settings button to open Edit Mode Settings.

          Input type: There are two input types in edit mode, Touchscreen Gesture and Touchscreen Joystick. You can switch between the two types here.

          Dimensional Movement: This setting is unique to touchscreen gesture inputs. Dimensional Movement allows users to move virtual objects in straight lines across the three dimensions (X, Y, and Z) for extra precision. Three cones will appear around an object’s central point, each corresponding to an axis, and by pressing and dragging a cone you will be able to move objects across only that axis.

          Resources properties: In this section, you can adjust the opacity and zoom ratio of the resource, as well as further adjust the accuracy through the settings of advanced options.

          Gesture operation

          You can adjust the position, size, and rotation angle of objects or sub-objects by using touchscreen gestures. This input type is more flexible, quick, and intuitive than using the joysticks, and is designed for devices that have a touchscreen.

          Here are the detailed steps for using touchscreen gestures on a mobile device:

          1. After completing the placement of a resource, press the Edit icon to enter Edit Mode.

          2. Press the settings button to enter Edit Mode Settings and select the Touchscreen Gesture.

          3. Select the object to be edited, and a blue highlight border will appear around the object. Use gesture controls to move, scale, and rotate the object.
          a) Movement: Press and drag anywhere inside the border to move the object.
          b) Resizing: Press and hold any corner of the border, which will create a blue square, then drag the square to increase or decrease the size of the object.

          c) Rotation: Press and hold the center of any of the lines that make up the border to create a blue sphere, then drag the sphere to rotate the object.

          Joystick operation

          Utilizing the touchpad joystick controls can more accurately adjust the position, distance, height, and angle of resources with a greater degree of accuracy and precision.

          Steps:

          1. After completing the placement of the resource, click on the Edit button to enter the edit mode.

          2. After entering the edit mode, select Touchscreen Joystick. You can also adjust the sensitivity, rotation angle, and other parameters of the joystick by adjusting the Movement Sensitivity.

          3. Click to select the object to be edited, and a blue highlight border will appear around the object.

          4. Use the joystick to move and horizontally rotate the object.

          Open scene files

          When you have the necessary permissions for the scene function in your enterprise, you can open scene files accessible to you in DataMesh One using the following steps in MR mode:

          The steps to open a scene file in MR mode are as follows:

          1. On the main interface, click on the Scene tab to enter the scene interface.

          2. In the Scene interface, browse and open the folder containing the target scene file. Scroll through the folder’s contents using the dropdown scrollbar, locate the scene file you want to play, and click to open the scene file.

          3. After opening the scene file, move the camera (field of view) to recognize the environment and automatically place resources.

          4. You can click the positioning button to enter the joystick adjustment mode.

          5. In joystick adjustment mode, or by switching to gaze mode, adjust the position of the scene. Once the resource placement is complete, click to finish scene position adjustment. For more information on resource positioning, please refer to the relevant instructions for Resource positioning.

          6. After completing the scene position adjustment, enter scene playback mode. You can move the camera to roam the entire scene.

          Events

          The Events function in the standard mode of DataMesh One provides users with rich AR experience and collaboration functions, allowing users to create and participate in immersive AR events.

          Here is a description of the Events function:

            • New Event: With the standard mode of DataMesh One, users can create new virtual reality events. When creating a new event, users can set basic information such as the name and valid date of the event and set the scenario for the AR scene. The scenario defines the scenes, roles, actions, and interaction processes in the event.
            • Event management: As the creator and owner of the event, users can manage the event. This includes deleting events, changing event scenarios, and more. The event management function enables users to flexibly control and customize the event.
            • Play event scenarios: The event creator can guide the event by playing the scenario of the event. During the event, the event creator can gradually play the scenes and guide participants to complete various tasks and experiences according to the scenario.
            • Participate in events: The standard mode of DataMesh One allows users to participate in virtual reality events created by others. Users can select events of interest from the event list and enter the event scene through devices such as HoloLens, mobile phones, and tablets. Event participants can watch the scenario, but do not have permission to play the scenario. This provides convenience for observing, learning, and sharing events.

          Create events

          Users with collaboration creation permissions can create events.

          Steps

          1. Click the add button in the event list to go to the New Event interface.

          2. In the New Event interface, fill in the Event Name (default format yyyy-mm-dd hh:mm: ss) and select the event’s Validity Period.
          3. Click the Create button to open the event setting interface.
          4. In the event setting interface, click Add button.


          5. Open the folder where the scenario is located, select the scenario, and click Save to add the scenario to the event.

          6. After the scenario loading is completed, the event is created successfully.

          Change event scenarios

          The steps to change event scenarios are as follows:

          Note: Only the owner of the event has permission to edit the event.

          1. Click on the event in the event list to enter the event details page.

          2. On the event details page, click the Change Scenario button.

          3. Select one scenario to replace the existing scenario.

          4. After editing is complete, click the “<” button in the upper left corner to exit the event details page and return to the event list page.

          Play events

          To play a created scenario in the event details page, follow these steps:

          1. Select the event to be played in the event list and enter the event details page.

          2. Wait for the models in the event to download and load.

          3. After all participants are ready, the creator of the event can click the Play button to start playing the scenario.

          4. Place the models and adjust their position and orientation to ensure that the scenario can be played in the correct scene. For more information on placing models and adjusting their position, please refer to the Resource Positioning.

          5. Click the Stage List button to open the scenario’s Stage List. Click the scene name in the list to play the scene on a single page.

          6. After the scenario is finished playing, click the “<” button in the upper left corner to exit the event.

          Note: During the collaborative event demo, if the host exits the event, all participants and the host will return to the event preparation page. If a participant exits the event while the host remains, the participant will directly return to the event interface.

          Delete events

          The creator or owner of the event can delete it. The specific steps to delete an event are as follows:

          1. Log in to the FactVerse platform.

          2. Go to Collaboration > Event Management page.

          3. In the event list, find the event you want to delete and click the corresponding delete button .

          4. In the prompt window, click Confirm to confirm the deletion of the event.

          Other functions

          Adjust scene viewing angle

          When browsing in 3D mode, you can adjust the viewing angle by using the following methods:

          On PC:

            • Rotate the scene: Hold down the right mouse button at any position in the scene, then move the mouse left or right to horizontally rotate the scene for a full view of the model.
            • Pan the scene: To move left, right, forward, or backward in the scene, click on a blank space in the scene, hold down the left mouse button, and drag the mouse to the left or right of the screen or up and down on the screen. You can also hold down the mouse wheel and drag the mouse in the direction you want to pan. This operation can avoid selecting any characters with the left mouse button, and the wheel can only be used to drag the scene.
            • Zoom in and out of the scene: To zoom in and out of the scene, you can use the mouse wheel button, scroll up to zoom in, and scroll down to zoom out.
            • Raise and lower the scene: To raise and lower the scene, you can hold down the Shift key and the left mouse button and move up or down on a blank space in the scene to lower or raise the scene.

          On mobile devices:

            • Rotate the scene: Tap any position in the scene with your finger, then use a single finger to swipe horizontally to rotate the scene.
            • Gesture zooming: Through gestures, pinch or spread with two fingers in space to zoom in or out of the scene.
            • Pan the scene: You can pan the scene by sliding two fingers on the screen.

          Offline mode

          When the network condition is poor, after a period of network request, an Offline Mode button option will appear. You can switch to Offline Mode to view previously downloaded models or scenarios and play and use them normally.

          After clicking on Offline Mode, the resource list will display all local content. Note: Search, filter, and scan functions are not supported in offline mode.

          When the internet is connected, you can choose Click to reconnect to switch back to online mode.