DataMesh to Advance Digital Twin and XR Accessibility with New Updates to the FactVerse Platform

Singapore, 24 May, 2024 – DataMesh, a pioneering tech innovator democratising Digital Twin, announces a series of updates to the FactVerse platform, including the release of Data Fusion Services (DFS). Utilising the cutting-edge capabilities of the Snapdragon Spaces™ XR Developer Platform, DataMesh introduces a diverse range of applications to various AR glasses and tablets globally, delivering unmatched XR experiences for enterprise users.

DataMesh empowers hundreds of customers to enhance operational efficiency and achieve innovative business outcomes by facilitating the construction of digital twin scenarios, fostering symbiotic virtual and real environments, and seamlessly integrating with business applications. Today, with new extended coverage and performance improvements, DataMesh is further moving forward with its mission of making digital twin more accessible and empowering frontline workers.

Jie Li, CEO and Founder of DataMesh, emphasises,

“The support from the Snapdragon Spaces team is invaluable. DataMesh is shaping the future, creating innovative experiences that are impactful for businesses and help ordinary people improve capabilities.”

Steve Lukas, Director of XR Product Management at Qualcomm Technologies, Inc. acknowledges DataMesh for its expertise in digital twins and the seamless integration of FactVerse SDK with Lenovo headsets and the Snapdragon ecosystem.

“Working with companies like DataMesh is truly inspiring,” says Steve. “Companies utilising Snapdragon Spaces can better adopt digital twin-based experiences through XR, and we’re excited to continue working to expand the XR ecosystem.”

DataMesh FactVerse: Driving Innovations with Industrial Digital Twin

Focusing on manufacturing, architecture, engineering & construction (AEC), and facility management, DataMesh drives transformation and operational efficiency in a cost-effective and compliant manner. Recent practices showcase FactVerse’s advantages to drive long-term productivity improvements:

  • Aircraft Maintenance Innovation: DataMesh collaborates with an aircraft maintenance company to build a flight data analysis platform. Unlike the earlier platform, limited to post-flight and partial manual monitoring and analysis of onboard data, the new independent platform powered by DataMesh FactVerse supports comprehensive exploration, analysis, anomaly detection, and fault prediction based on different stages of aircraft flight and maintenance business requirements, thereby improving overall efficiency and automating the means of discovering anomalies to identify potential risks.
  • Automotive Manufacturing Innovation: DataMesh collaborates with an automotive company to build an industrial digital twin platform with FactVerse, supporting digital mapping, monitoring, diagnosis, prediction, simulation, and optimisation of key data. It effectively optimises across equipment design, process, production, quality, and operation and maintenance aspects, enabling the automotive manufacturer to rebuild competitiveness in the global market.

New Updates on FactVerse

FactVerse DFS serves as a fusion engine connecting and processing data from various industrial systems, playing a critical role in creating and managing digital twin scenarios on the FactVerse platform, breaking down barriers between data acquisition platforms, simulation platforms, and analysis platforms. DFS addresses two major challenges in applying digital twin: efficient and stable integration of various types of enterprise business system data and rapid standardisation of enterprise business data processing.

The new FactVerse Designer 1.1 brings a user experience tailored to common business environments, introduces standard business workflows, offers practical assistance and value to frontline personnel, and provides robust simulation capabilities and an easy-to-use drag-and-drop experience.

Additionally, the FactVerse platform enhances its IoT connectivity, now offering Brick Schema-based relational structure import and export, further enhancing compliance with Singapore’s building green standard specifications.

The long-trusted 3D+XR process design and training product DataMesh Director has extended compatibility with popular XR headsets such as Lenovo ThinkReality VRX, A3, Apple Vision Pro, and Meta Quest 3. Users can install the glasses version of these FactVerse digital twin applications from app stores and easily design training content, easily publishing it to XR headsets and tablets across platforms for an enhanced experience in business scenarios such as training.

Furthermore, there are many enhancements on FactVerse AI, DataMesh Inspector, and FactVerse SDK, to name a few.

About DataMesh

DataMesh is democratising Digital Twin technology, empowering frontline workers, and driving enterprise-level innovation globally. Headquartered in Singapore, DataMesh has supported over 500 customers across Japan, North America, Southeast Asia, China, and Australia. In 2020, DataMesh was the only finalist from Asia in the Microsoft Partner of the Year, Mixed Reality category. The company won NTT Docomo’s top DX award in 2021 and was enrolled in the IMDA Spark program in Singapore. Additionally, DataMesh was recognised in Forbes Asia’s ‘100 to Watch’ list in 2022.

Snapdragon and Snapdragon Spaces are trademarks or registered trademarks of Qualcomm Incorporated. Snapdragon and Qualcomm branded products are products of Qualcomm Technologies, Inc. and/or its subsidiaries. Qualcomm patented technologies are licensed by Qualcomm Incorporated.

DataMesh FactVerse Updates Released for Industrial Digital Twin Innovation

DataMesh, a high-tech innovator focused on Digital Twin, has made significant updates to its FactVerse industrial metaverse platform, aimed at enhancing its suite of applications and services. These enhancements across the entire FactVerse ecosystem deliver better performance and experience for enterprise users in constructing digital twin scenarios, fostering symbiotic virtual and real environments, and seamlessly integrating with business applications.

FactVerse Designer

FactVerse Designer 1.1 brings a user experience more tailored to common business environments and introduces standard business workflows. New features include adjustable scene playback speed and support for recording scene runs under different configurations, providing comprehensive equipment operation details for decision-making. Integrated with FactVerse Data Fusion Services, it offers practical assistance and value to frontline personnel in fields like production simulation in factories. Additionally, the reengineered intuitive interface and drag-and-drop experience provide better overall performance stability and user experience.

A scenario being played at an accelerated speed
Recording a scene

FactVerse Data Fusion Services (DFS)

The FactVerse Data Fusion Services have been publicly released. DFS serves as a fusion engine connecting and processing data from various industrial systems, playing a critical role in creating and managing digital twin scenarios on the FactVerse platform. It establishes digital twin mapping standards based on traditional data acquisition interfaces and data warehouses, breaking down barriers between data acquisition platforms, simulation platforms, and analysis platforms. DFS addresses two major challenges in the application of digital twins: efficient and stable integration of various types of enterprise business system data and rapid standardization of enterprise business data processing, meeting the rendering and computing needs of XR interactions and the application of digital twins. DFS is currently offered both cloud-hosted and on-premises deployment.

DataMesh Director

DataMesh Director 6.2.0’s artistic effects and user experience of interacting with scenarios are optimized, with new selection options for rendering environment. DataMesh One has been compatible with Apple Vision Pro, Meta Quest 3, Lenovo ThinkReality VRX, and A3. Users can download the respective glasses version applications from the app store of each platform and easily design training content using DataMesh Studio, publishing it to XR headsets and tablets across platforms for an enhanced experience in business scenarios such as training.

Rendering effects are optimized
Using DataMesh One on Apple Vision Pro
Using DataMesh One on Apple Vision Pro
Using DataMesh One on Apple Vision Pro
Using DataMesh One on Apple Vision Pro

DataMesh Inspector

DataMesh Inspector 1.1.2 UX optimization, particularly improves the display efficiency of large spatial scenes with optimization from BIM model layers level, enabling frontline personnel such as construction teams and supervisors to efficiently carry out operations such as mixed reality (MR) content comparison with CAD drawings and 3D model-to-real-space alignment.

Dynamic loading of large spatial scenes

FactVerse AI

Starting from April, the FactVerse AI International Edition has been using the latest GPT-4-Turbo as the backend for large language models. Users enjoy enhanced conversational/text generation capabilities for their private knowledge bases within the FactVerse platform, without any additional action required.

FactVerse Express

The FactVerse Express Apple Vision OS 1.0 version is available. Users can quickly experience the features of FactVerse Apps such as DataMesh Director, Checklist, and more provided in the Apple Vision Pro without downloading these Apps. The initial experiences cover scenarios such as automotive production lines, aviation engines, coffee machines, and shield machines.

FactVerse Platform Support Updates

The FactVerse platform has undergone various optimizations focusing on functional logic and interactions, introducing better interaction in batch upload, unified digital twin operations, optimized user management, and layout optimization for various module pages, improving the user experience in managing digital twin resources. In terms of IoT connectivity, FactVerse now offers Brick Schema-based relational structure import and export, further enhancing compliance with Singapore’s building green standard specifications.

What is Brick?

Brick is an open-source project aimed at providing standardized semantic descriptions of the physical, logical, and virtual assets within buildings, as well as the relationships between them. Brick includes an extensible dictionary containing terms and concepts found within and around buildings, a set of relationships for linking and combining these concepts, and a flexible data model that allows seamless integration with existing tools and databases. Leveraging powerful semantic web technologies, Brick enables consistent descriptions of various specialized and custom features, assets, and subsystems throughout entire building complexes.

Using Brick as a typical description for buildings enables the following functionalities:

  • Brick reduces the costs associated with deploying analytics, energy-saving measures, and intelligent controls within buildings.
  • Brick facilitates integrated descriptions of numerous subsystems found in modern buildings, such as HVAC, lighting, fire protection, and security, across various vendors.
  • Brick streamlines the development process of intelligent analysis and control applications.
  • Brick diminishes dependence on proprietary, non-standard, and unstructured labels specific to building management systems.
Dynamic loading of large scale scenes

FactVerse SDK

DataMesh FactVerse SDK has evolved into version 6.2, enabling developers to easily adopt and integrate more digital twin capabilities of the FactVerse into their own applications/software. The current version includes FactVerse platform general operations, resource library, scenario playback of DataMesh Director, digital twin body invocation, etc.

FactVerse Hands-on-Lab

Furthermore, FactVerse Hands-on-Lab, open to users and content creators, has recently released a series of efficient learning resources to help users quickly obtain skills in using frontline products of FactVerse, including proficiently acquiring digital twin content creation skills.

FactVerse is committed to providing users with simple and user-friendly digital twin products and solutions with instant ROI. The platform’s great flexibility and scalability, combined with different data sources and capabilities such as artificial intelligence and machine learning, empower enterprises to innovate through industrial digital twins, accelerating business transformation, and ensuring frontline personnel benefit from digitization.

DataMesh Contributes to Success of SMART MANUFACTURING SUMMIT

As the inaugural event of “Global Industrie,” one of Europe’s largest industrial trade fairs, held in Japan, the SMART MANUFACTURING SUMMIT is currently ongoing from today until the 15th at the Aichi Sky Expo in Aichi Prefecture. Aichi Prefecture Government, in collaboration with KDDI and DataMesh, has jointly created an immersive digital industrial landscape based on MR technology, integrating the concept of Industry 5.0 into the summit experience to promote the development of the next-generation industrial revolution and strengthen innovation exchange between Japan and Europe.

The summit aims to drive the development of Industry 5.0 and enhance innovation exchange between Japan and Europe. At the summit, a variety of interactive digital scenes deployed based on the DataMesh digital twin platform provide an engaging experience for participants. From introducing the cultural history and industrial evolution of Aichi Prefecture to guiding attendees through virtual routes between booths using avatars, and showcasing various 3D industrial machinery such as die-casting machines, large-scale industrial printers, and laser equipment through MR, DataMesh’s applications significantly enhance product displays and overall participant engagement. Additionally, DataMesh FactVerse, an industrial metaverse platform was also applied in virtual factory demonstrations, showcasing data-driven smart manufacturing scenarios in the Industry 5.0 era.

Industry 5.0 complements and enhances Industry 4.0, bringing value in several aspects:

  • More humane working environments: Industry 5.0 emphasizes human-machine collaboration, freeing humans from tedious, repetitive tasks to focus on more creative and valuable work, enhancing work experience and satisfaction.
  • Sustainable development: Industry 5.0 focuses on environmental protection and sustainable resource utilization, achieving the unity of economic and social benefits through the development of circular economy, reducing energy consumption, and waste emissions.
  • Enhanced enterprise resilience: Industry 5.0 helps enterprises improve their ability to respond to emergencies, enhance the resilience of supply chains and production systems, and address various risks and challenges.
  • Personalized customization: Industry 5.0 can meet consumer demand for personalized products through human-machine collaboration and intelligent technology, realizing flexible production and customized services.
  • Attracting and retaining talents: Industry 5.0 provides a more challenging and creative work environment, attracting and retaining high-quality talents, enhancing enterprise competitiveness.

Industry 5.0 provides a genuine opportunity for the manufacturing industry to re-industrialize production in a smart and responsible manner. As one of the leaders in technology innovation in manufacturing, construction, and other fields, DataMesh has long collaborated with leading enterprises and organizations such as Aichi Prefecture Government, KDDI, etc., dedicated to providing cutting-edge digital twin and mixed reality expertise and experience globally, rapidly building flexible, data-driven digital twin scenarios, and helping enterprises meet ecological and green development requirements.

Through the democratization of digital twin and XR technology, DataMesh has helped enterprises optimize operational efficiency, reduce costs, and improve efficiency in fields such as manufacturing, AEC (Architectural Engineering and Construction), and facility equipment maintenance, significantly enhancing the capabilities of frontline workers and addressing social challenges such as declining birth rates and aging populations. DataMesh Director is widely deployed in Japanese manufacturing and construction fields, enabling frontline workers to easily create digital twin content and improve work efficiency, promote team communication and collaboration, and enhance the speed and quality of professional training. Furthermore, DataMesh Director plays an important role in after-sales services, providing high-quality after-sales services remotely through XR technology, breaking geographical constraints, and improving the employment environment.

The SMART MANUFACTURING SUMMIT, organized by GL events and co-sponsored by Aichi Prefecture Government, has attracted participation from hundreds of companies from 40+ countries worldwide and is expected to host over 15,000 attendees.

DataMesh is proud to have contributed to this event and welcomes industry professionals to visit Booth SD-02 in D-Hall to experience the Aichi Digital Island showcase and engage in interactive discussions with us. Committed to constant innovation and the Democratization of Digital Twin, DataMesh continuously provides advanced digital transformation solutions to address increasingly complex challenges and drive revolutionary innovation in manufacturing and beyond.

DataMesh: Unleashing Innovation with Singtel’s 5G Partner Ecosystem

Singtel Business 5G has unveiled a gateway (https://www.singtel.com/business/products-services/5g/partners) to a world of dynamic possibilities within 5G technology and advanced digital innovations. As a key part of the Singtel 5G Partner Ecosystem in the AR/MR/Digital Twin space, this marks a transformative milestone for us, together with Singtel and a diverse group of collaborative companies, we are at the forefront of driving digital business transformation across the Asia Pacific region and beyond.

Empowering Business with Speed, Precision, and Innovation through 5G Solutions

Singtel 5G provides access to an ecosystem of partners with a variety of solutions, including high-speed connectivity, 5G innovation, and cutting-edge computing solutions like Paragon. Collaborating with partners like DataMesh, Singtel propels businesses forward, leveraging applications for computational tasks, AI workloads, spatial measurement, 3D rendering, and real-time monitoring to achieve transformative goals.

The partner ecosystem converges industry leaders in Video Analytics/AI, AR/MR/Digital Twin, Devices, and more, aimed at empowering businesses with speed, precision, and innovation through meticulously tailored 5G solutions tailored to enhance operations across diverse industries.

Pioneering Innovation, Enhancing Productivity, and Empowering Front-line Workers

As an ambitious high-tech player in the Asia Pacific region, DataMesh remains steadfast in democratizing digital twins and XR to bridge the digital and real worlds. Focused on pioneering innovation through FactVerse—an Industrial Metaverse platform—DataMesh elevates the utility of Digital Twin and XR tech, transcending spatial data constraints for real-time 3D collaboration, ensuring that front-line workers and ordinary individuals alike can benefit from digital transformation, fostering opportunities and capability building across industries.

Rooted in digital twins and directly connected to current business operations, DataMesh adheres to the business TEMS principle – Training, Experience enhancement, Monitor and Control, and Simulation, emphasizing tangible ROI and bringing the metaverse concept down to earth.

DataMesh Pte Ltd is the headquarters of DataMesh in the Asia-Pacific region. Supporting over 500 clients in the AEC, manufacturing, and facility management industries, DataMesh has received recognition such as Microsoft’s Partner of the Year Award in the Mixed Reality category, NTT Docomo’s top DX award, and inclusion in Forbes Asia’s 100 to Watch list over the past few years.

Currently, innovative FactVerse’s industrial metaverse applications are showcased at Singtel, both online and offline.

Featured Solutions at Singtel’s 5G Partner Ecosystem

  • DataMesh Director:
    • 3D Digital Twin content creation and management tool.
    • User-friendly drag-and-drop experience.
    • Supports IoT data binding, remote collaboration, and cross-platform content publishing.
    • Ideal for creating job SOPs, support guides, 3D product manuals, and real-time monitoring.
  • FactVerse Designer:
    • Frontline application of the flagship LCAP (low-code application platform) FactVerse, providing an open-world gaming structure and a rapid scene designer for content creators to effortlessly develop Enterprise Metaverse scenes.
    • Out-of-the-box features and ready-to-use DLCs (downloadable content) for key industrial scenarios, streamlining hands-on experience.
    • Spatial data processing and real-time 3D collaboration with CAD, BIM, and IoT.
    • Enhances productivity with the latest digital twin and XR technologies.

    Explore online here.

    • 5G-enabbled Collaborative Showcases at Singtel FIC: DataMesh collaborated with Singtel to present a demonstration of digital twin and 5G tech at Singtel’s FutureNow Innovation Centre (FIC) earlier.
    • A digital twin of a smart factory.
    • An XR-based 3D modeling training and guidance solution for construction sites.
    A showcase at Singtel FIC: 5G-enabled Digital Twin in Smart Manufacturing

    Experience FactVerse and 5G at Singtel FIC in-person or learn more here.

    The last year has been an extraordinary journey for DataMesh. We’re proud to have released multiple upgraded versions of our FactVerse applications, including DataMesh Director, FactVerse Designer, FactVerse DLC, FactVerse SDK, DataMesh Learn solutions, FactVerse Express, and the DataMesh Simulator Platform. As we embark on a new year, we extend our sincerest congratulations on this new development in Singtel’s 5G business. Here’s to the exciting journey ahead in the dynamic partnership between Singtel and DataMesh. Cheers to innovation and unparalleled success!

    DataMesh Reshapes Tower Crane Training Experience with Simulator 2.1

    Today, DataMesh Simulator 2.1 is released, introducing simulation-based training and assessment tailored for tower crane operations. This innovative motion simulation platform focuses on providing trainees with an authentic learning experience while operating tower cranes, through upgraded operational scenarios that faithfully replicate real equipment models, construction environments, and operational procedures.

    1:1 Digital Twin of Construction Environment

    Construction machinery models, including tower cranes and others within the Simulator, are meticulously crafted to mirror selected reference machines in appearance, movement, status, and characteristics.

    Models undergo meticulous treatments in color, material, texture, lighting, and background to achieve a heightened sense of realism.

    Real-time rendering of tower cranes and collaborating construction machinery models ensures seamless immersion in the virtual environment without visual or auditory delays, fostering an unparalleled sense of participation for users.

    Rigorous collision detection, interference verification, and motion synchronization ensure the authenticity and integrity of the tower crane and other construction machinery models involved.

    Authentic Operational Procedure Replication

    Operational procedures are designed based on insights from experienced tower crane operators, integrating text, voice, signal commands, dynamic UI elements, and instructional videos at each training step. The crane hook offers multiple operational perspectives, including front and rear views, external views, and cabin views, enhance the training experience.

    The system interface provides real-time monitoring of machine parameters, such as wind speed, rotation angle, lifting weight, trolley position, and hook distance from the ground.

    The comprehensive curriculum resources bridge the gap between training and real-world operations, allowing trainees to familiarize themselves with common terminology and signal gestures used in actual construction scenarios. This immersive training approach facilitates practical application and offers tangible hands-on training benefits.

    Immersive Learning Experience

    Integrated with the DataMesh Learn system, the Simulator platform streamlines the management, sharing, storage, and analysis of various mechanical equipment simulation training materials and assessment results. Instructors can autonomously customize and distribute training and assessment tasks to enhance teaching effectiveness, making it the preferred choice for engineering machinery professionals. The tower crane simulator comprises the DataMesh Simulator system software and hardware platforms, offering features such as course play, operational training, assessment, personnel management, and learning management. Hardware options include six degrees of freedom motion platforms, three degrees of freedom motion platforms, and a basic non-motion platform, catering to diverse user needs.

    DataMesh Simulator revolutionizes industrial training by providing an immersive and lifelike learning environment that significantly improves trainee engagement and learning outcomes. By enabling trainees to understand equipment operations safely and effectively, it mitigates safety risks and boosts training efficiency. For purchasing inquiries or further product information, please contact service@datamesh.com.

    Learn more about the DataMesh Simulator platform by watching this video:

    DataMesh Inspector 1.1 Releases, Enhancing Collaboration and MR Experience in AEC

    Today, DataMesh released Inspector 1.1, introducing innovative features to deliver outstanding mixed reality experiences for the AEC (Architecture, Engineering, and Construction) sector. Focused on streamlining and optimizing visualization, on-site collaboration, and resource management, Inspector empowers construction and engineering professionals to achieve higher project execution efficiency throughout the AEC lifecycle.

    Inspector, a cutting-edge inspection and maintenance toolkit powered by digital twin and mixed reality, can overlay large-scale BIM models and other real-time data onto the work site through augmented reality (AR). It visualizes digital twin data in the real world and enables fast inspection throughout the entire lifecycle of buildings and facilities. As a gateway to the industrial metaverse FactVerse, Inspector efficiently conveys business knowledge to frontline workers through immersive interactive methods.

    Dynamically loads large-scale BIM data onto the site, empowering engineering acceptance with AR to verify planning and actual construction

    Streamlining On-site Collaboration with Enhanced Annotations

    Inspector 1.1 introduces enhanced collaborative annotation, allowing users to instantly view annotations like issue markers, inspection results, technical communications, and action plans added by team members during inspections or project walkthroughs. This feature significantly improves communication efficiency and provides robust process management tools for general contractors and subcontractors during the inspection of divisions and sections of projects.

    View annotations within the building scene in browsing mode powered by mixed reality

    With the upgraded collaborative annotation feature in Inspector 1.1, users can instantly view annotations added by other team members during the inspection process, such as issue markings, inspection results, technical communications, and action plans. This significantly improves communication efficiency, providing powerful process management tools for general contractors and various specialty contractors in the acceptance of subprojects.

    Moreover, users can toggle between work scenarios with a single click by enabling/disabling browsing mode: In browsing mode, all annotation information is presented as pop-ups in the building scene. Users can review the information within the scene, visually inspect annotation descriptions and on-site photos, compare them with the standard practices represented by the BIM model, and engage in business communication through annotation messaging; When browsing mode is turned off, users can control a joystick to freely inspect component engineering information. They can overlay the BIM model onto the actual site for comparative viewing based on augmented reality (AR) mode.

    Seamless Cloud Resource Integration for Enhanced On-site Work

    Furthermore, Inspector 1.1 optimizes resource viewing strategies, enabling users to easily access 2D/3D resources from the cloud anytime, anywhere, enhancing the user experience. Users can showcase reference resources to specified locations or 3D models in the scene without the cumbersome process of file searching. This addresses the needs of construction sites for reviewing and presenting relevant reference resources during design reviews, design briefings, and acceptance processes.

    Users can also associate annotation tasks with corresponding building scenes in FactVerse Services, facilitating rapid viewing and management of annotation entries and exporting annotations in chart format. This module also supports exporting structured data from the processes of building acceptance and construction communication, meeting the Common Data Environment (CDE) requirements in various regions. The comprehensively optimized component operation panel provides a more intuitive view of BIM data information, enabling users to clearly annotate specific components during the acceptance process. The newly added messaging feature allows teams to provide timely feedback on annotations.

    Connecting 2D/3D resources from the cloud to the scene projected on-site
    Connecting 2D/3D resources from the cloud to the scene projected on-site

    Advancing Cloud Resource Processing and Data Access Optimization

    Concurrently, FactVerse has upgraded its ability to process building scene resource files. Users can now effortlessly convert original BIM resource files into Inspector-compatible format files with a single click in the cloud, streamlining processes like resource matching, file processing, large-scale model simplification, and scene construction, significantly reducing the complexity of the original toolchain and user operational costs. The newly added universal data format conversion capability allows users to apply BIM file format building scenes to the entire DataMesh product family. Users can also convert imported model resources into formats such as FBX over the cloud, with configurable model optimization available during the process for maximum resource utilization.

    Additionally, FactVerse Services now supports data connectivity between the FactVerse platform and Autodesk BIM 360, enabling users to quickly import cloud resources from BIM 360 into the FactVerse resource library and apply them to the DataMesh platform. The integration of FactVerse with other engineering industry cloud platforms facilitates data interoperability, helping a range of users reduce operational costs and fully capitalize on their own cloud assets.

    As a gateway to the industrial metaverse platform FactVerse, DataMesh Inspector is committed to enhancing the efficiency and MR experience of construction operations and maintenance in the fields of architecture, engineering, and construction. It achieves this through an innovative 3D+MR visualization of the entire building process, enabling cloud-enabled data in the engineering industry and empowering the entire building lifecycle.

    DataMesh Inspector 1.1 is now available on the Apple App Store. Feel free to install and experience it today. For any queries, please contact service@datamesh.com.

    An education and training tool utilizing MR and Digital Twins to improve engineer skills to ensure expressway safety

    The expressway network of Japan has been constantly expanded since the 1960s and its total road length is currently over 10,000km. On the other hand, more than half of the expressway network has been used for over 30 years and aging of structures such as road surfaces, bridges, and tunnels has emerged as a social issue. The dwindling number of expressway maintenance and management engineers in line with the decline in the productive population is also one of the significant challenges.

    Given the circumstances, Nexco-East Engineering operating about 4,000km of all the expressways in Japan developed a training app for ETC equipment and tunnel emergency facilities using MR and digital twin technologies, which is implemented in its training center “Technical Training Center (TTC)” located in Takasaki, Gunma. The app serves as an efficient education and training tool to equip every engineer with necessary knowledge and skills to develop quality engineers.

    Initiated MR tool development toward improvement and standardization of trainees’ levels of understanding

    Since about 10 years ago, the NEXCO EAST group has projected the aging of expressways and maintenance and management labor shortage and promoted the Smart Maintenance Highway (SMH) project to match the existing expressway maintenance and management technologies that the group has acquired with ICT technologies. Through the project, operational DX has been advanced with proactive application of digital capacities to the field operations, e.g. conversion of paper-based drawing preparation into tablet-based tasks and analysis and utilization of accumulated data with Microsoft PowerBI. Assigned with the project, Mr. Tetsuo Hideshima, the Managing Director and General Planning Manager of Nexco-East Engineering said with regard to the project policies,

    “We at Nexco-East Engineering ensure that drivers can safely use expressways by providing inspections and troubleshooting all day, all year. For continuous maintenance and management of expressways, it is critical to conduct thorough inspections and diagnoses without overlooking any tiny changes in facilities and structures. To that end, streamlining and labor saving based on ICTs are imperative.”

    The company also opened TTC in 2012 as a training facility to enhance performance of expressway inspection engineers. For practical training, TTC offers a training environment equipped with real power receiving and distribution equipment, ETC (automatic toll payment system) equipment, and component samples that are exactly the same as those used on expressways.


    With regard to the roles of TTC, Mr. Masayuki Namiki, the General Manager of TTC said, “At TTC, over 1,000 of our engineers participate in training programs every year. They go through training to enhance skills based on the internal skill check system to become experts of expressway inspection and maintenance, called ‘highway doctors.'”

    Meanwhile, highway structures and facilities have become more and more complex along with the technological advancement and, despite the hands-on learning with such training materials, levels of understanding of the mechanisms and internal structures varied among trainees. This hindered standardization of trainees’ technical levels, constituting an issue for TTC.

    The issue was particularly conspicuous in education on ETC equipment. “ETC equipment is composed of multiple devices and how ETC equipment operates was explained with extensive materials such as paper-based radio communication and control signal flow charts, PowerPoint slides, and chalk talks of instructors and then tested with actual ETC devices,” said Mr. Yoshitaka Nakamura, the Manager, Facilities Construction Work Division, Facilities Construction Work Department of Nexco-East Engineering.

    “However, it requires considerable time to gain understanding of associations among the training materials. Also, radio communication and control signal flows are impossible to see, so we had to rely on trainees’ imaginations. This resulted in gaps in understanding.”

    In response, the company focused attention on the MR (mixed reality) and digital twin technologies. Then a project to develop an “MR for ETC equipment training” was launched out of an idea of combining a 3D model of ETC equipment as well as infrared sensors, radio communication, and data communication routes (which are invisible in reality) with the ETC practice lanes to foster better intuitive understanding.

    Endeavor to develop training materials that are easy-to-use for every trainee with no example available as a model

    It was DataMesh that contracted with Nexco-East Engineering for its extensive achievements and experiences in the field of digital twins and XR. Mr. Kensho Kashimada, the Director, Marketing and Sales of DataMesh Japan Co., Ltd. looked back, “At that time, there had been no similar attempts at least in Japan. The point was how we could build up MR materials that are easy-to-understand for every trainee while there was no correct answer about what the outcome should be like.”

    The first step they took to that end was employment the agile development approach based on a quick PDCA cycles, rather than waterfall-model development that relies on detailed specifications from the beginning. “We carefully proceeded with the development through repeated hearing sessions with the project leading department and TTC instructors who would actually use the tool in practice,” said Mr. Kashimada.
    They also received the same courses that TTC actually provides to trainees to gain knowledge of ETC equipment mechanisms and applied it to the system.

    “By receiving lectures with oral explanations and 2D materials, we witnessed how difficult it is to understand the ETC mechanisms firsthand. We could also appreciate the potential value of the tool we were trying to create. So I think it was a very valuable process,” said Mr. Kashimada.

    Thus, after the development period of about six months, accurate 3D models of ETC devices were made and the MR for ETC equipment training using 3D animation superimposed on ETC equipment that is visible via a tablet device or Microsoft MR device “HoloLens 2” was completed.

    “Normally, accuracy of SLAM (Simultaneous Localization and Mapping) in positioning of MR superimposition depends on hardware performance. However, for this MR for ETC equipment training, SLAM features of DataMesh’s proprietary digital twin platform (FactVerse) were used to make SLAM accuracy levels of multiple devices uniform,” explained Mr. Kashimada. Ingenuities are made to realize superimposition of massive 3D data without dependence on device performance by using a technology to load necessary portions of data only.


    Mr. Kashimada said those features provides trainees immersive experiences in the MR world without stressful events such as misalignment or freezing of 3D animation.

    Mr. Namiki said, “It was really a tremendous work to explain invisible things verbally. But now data and radio waves are visible and this increased the level of understanding dramatically.”


    Once getting used to the operational feeling of HoloLens 2, trainees can adjust the position just by reading a QR code on the display without taking any complex procedure. It was reported that instructors could acquire basic operation methods only through a one-day lecture provided by DataMesh.

    The MR for ETC equipment training, which is well recognized by field operators, too, has been further improved based on feedback from instructors. Currently, additional features such as repeated playback of individual work steps and animation speed adjustment for in-depth explanation make the tool even more effective.

    MR for tunnel emergency facilities training making full use of HoloLens 2 characteristics

    Out of its confidence in the success of MR for ETC equipment training, Nexco-East Engineering promptly commenced next training MR development, which is the “MR for tunnel emergency facilities training.”

    “The internal structure of automatic water sprinkler system for tunnel emergencies cannot be seen from the outside, so we superimposed a CG simulation of the internal water flow and developed training materials for visualizing internals and operating status,” said Mr. Nakamura.

    Mr. Namiki said, “In the past, we presented pipe samples from real equipment and illustrations to teach their structures and operations, but we couldn’t actually let water through them to demonstrate the mechanism. Also, explanations somewhat varied among instructors. As with ETC equipment, the gap in levels of understanding among trainees was recognized as an issue.”

    As a measure to resolve the issue, DataMesh reproduced the equipment movements from an onset of vehicle fire to watering and visualized the internal structures based on its know-how acquired through development of the MR for ETC equipment training.
    Furthermore, a feature to adjust transparency of 3D animation of water flowing inside the pipe was added give trainees freedom to observe how water flows and stops inside. Implementation of realistic 3D effects of fire also give realistic experiences to enhance understanding.

    Finally, quality of this MR for tunnel emergency facilities training is surprisingly high and precise even to experienced engineers including Mr. Hideshima. “From water flow and the valve opening mechanism to things going on behind pipes are all comprehensible at a glance. I sensed the poser of MR anew,” said Mr. Hideshima.

    As the MR for tunnel emergency facilities training is equipped with the “pseudo reproduction feature” to learn points to check in the event of any malfunction and restoration methods, the MR system has a possibility to be applied to a future remote maintenance system.


    Plus, linking tablets and other devices has enabled remote training, creating an environment where a greater number of trainees can take part.

    Above all, the MR for tunnel emergency facilities training fully taps HoloLens 2 potential compared with the MR for ETC equipment training.
    In fact, for training using the MR for ETC equipment training with outdoor ETC equipment, tablets are mainly used as output devices because visibility of HoloLens 2 can be deteriorated depending on sunlight intensity. On the other hand, tunnel emergency facilities are indoor equipment and not subject to sunlight. This is where HoloLens 2 comes in.

    Mr. Namiki said, “While a tablet needs to be held with both hands, HoloLens 2 is a head-mounted display, which sets both hands free. So trainees can touch devices while going through MR training. It also allows individual trainees to rewind, pause, and adjust the transparency level, giving an advantage in tailoring training sessions to individual levels of understanding.”

    Toward even more effective ICTs through professional collaborations

    After realizing the quality training tools by using the digital twin and MR technologies, Nexco-East Engineering has a plan to further promote use of ICTs to address the issues of facilities aging and labor shortage, which are expected to be further accelerated.

    Exploring possibilities of ICT usages in various scenes, Mr. Nakamura said, “We have an ambition to expand our use of ICTs beyond TTC hands-on training to online training, OJT training, establishment of hands-on safety education system to improve field safety management skills, and remote maintenance, etc.”

    With a view to establishment of a system for effective use of ICTs, Mr. Namiki struggling in the field of training said, “In recent years, equipment and facilities have become more and more sophisticated and suffered less failures. It may appear to be a good thing, but on the other side of the coin, most engineers in the future could be inexperienced in failure responses. We would like to establish a system to support engineers with the power of ICTs rather than relying on experienced engineers when the time comes.”

    On the other hand, Mr. Hideshima is hopeful about professional partnerships. He said, “Although we have excellent expertise in expressway technologies, we admit we cannot fully catch up with ever-improving ICT seeds and technological innovations. In that regard, we are really hopeful about continuation of partnerships with ICT professionals such as DataMesh and Microsoft Japan.”

    Based on ideal partnerships in which expressway professionals and ICT professionals work together to resolve issues and mutually give valuable input to technologies and knowledge, Nexco-East Engineering will continue maintaining and advancing safety on expressways, one of the essentials of our modern lives.

    “From water flow and the valve opening mechanism to things going on behind pipes are all comprehensible at a glance. I sensed the poser of MR anew,”

    — Mr. Tetsuo Hideshima, Managing Director and Chief of Planning Headquarters, Nexco-East Engineering

    “While a tablet needs to be held with both hands, HoloLens 2 is a head-mounted display, which sets both hands free. So trainees can touch devices while going through MR training. It also allows individual trainees to rewind, pause, and adjust the transparency level, giving an advantage in tailoring training sessions to individual levels of understanding,”

    — Mr. Masayuki Namiki, General Manager, Technical Training Center Manager, Nexco-East Engineering

    “We have an ambition to expand our use of ICTs beyond TTC hands-on training to online training, OJT training, establishment of hands-on safety education system to improve field safety management skills, and remote maintenance, etc.”

    — Mr. Yoshitaka Nakamura, Manager, Facilities Construction Work Division, Facilities, Construction Work Department, Nexco-East Engineering

    “At that time, there had been no similar attempts at least in Japan. The point was how we could build up MR materials that are easy-to-understand for every trainee while there was no correct answer about what the outcome should be like.”

    — Mr. Kensho Kashimada, Director, Marketing and Sales, DataMesh Japan Co., Ltd.

    This customer story was originally published by Microsoft here.

    DataMesh FactVerse AI Officially Launches

    Driving Creation and Management Efficiency through Digital Twin-Based Generative AI

    Aug 17, Beijing — DataMesh is proud to unveil FactVerse AI. This groundbreaking tool is the newest innovation from FactVerse, DataMesh’s enterprise metaverse platform, designed to democratize digital twins. By harnessing the power of generative AI tools and GPT technology, FactVerse AI seeks to significantly enhance the efficiency of digital twin content creation. This empowers businesses to operate and manage more intelligently, delivering an unparalleled digital twin experience.

    FactVerse AI, an AIGC tool built in FactVerse, addresses AIGC-related tasks tailored for enterprise-level needs, facilitating organizations in rapidly developing digital twins and comprehensive enterprise metaverse environments.

    Considering the widespread appeal of ChatGPT, the role of generative AI technology in influencing digital twin innovations is clear. In this context, the multi-modal functionalities powered by LLM emerge as foundational engines for constructing the enterprise metaverse. FactVerse AI incorporates three core components: LLM (the foundational language model), Modifier (fine-tuning the LLM for specific industries or applications), and Agent (FactVerse’s multi-modal interactive interface). Collectively, these capabilities of FactVerse AI provide a solution that amplifies business operations and management.

    Key Features Include:

    • Knowledge Base Integration: Enables businesses to seamlessly integrate various types of corporate knowledge documents and data into FactVerse AI’s knowledge hub, granting the AI model instant access to real-time, proprietary corporate data.
    Easily deploying a knowledge base with up-to-date data
    • Smart Search and Content Creation: Offers sophisticated search capabilities within the corporate knowledge base. Combined with its content generation capabilities, it ensures rapid access to essential data and subsequent content production.
    • Adaptable Chatbot Frameworks: Pre-embedded Conversational AI/Virtual Agent/Chatbot templates allow for the customization of AI assistants, aligning them with varied operational roles, fostering efficient collaboration.
    Using AI Assistant Template to deploy a virtual assistant based on different role needs
    • Industry-Specific Knowledge: FactVerse AI support implement of GPT-like AI models to provide customized content creation and processing tools, tailored to capture the intricacies of specific industries or user profiles.
    • Translation and Voice Capabilities: Offers extensive multi-language translation tools and voice synthesis, enhancing cross-lingual communication and content generation.
    • Real-time Data Access: Enables instant interfacing with existing corporate data systems, drawing real-time data (such as production data or monitoring data) into digital twin scenarios for enhanced monitoring and management.

    In its current iteration, FactVerse AI has been seamlessly integrated into the DataMesh FactVerse cloud platform, making it readily available for enterprises. Organizations are now equipped to leverage this product for the development of proprietary corporate knowledge bases and the strategic deployment of AI assistants. The versatility to introduce a range of AI assistants tailored for varied tasks – from data analytics and market research to bid document drafting – redefines the landscape of operational efficiency. Furthermore, the one-click voice generation capability, complemented by robust multilingual support, sets a new benchmark for modern content creation efficiency.

    For more information about FactVerse AI and product trials, please reach out to us at service@datamesh.com.

    DataMesh Unveils New Digital Twin-based Simulator Platform

    DataMesh has announced the launch of DataMesh Simulator 2.0, an innovative platform designed to provide operators with an immersive learning experience. Based on digital twin and motion simulation technologies, it integrates equipment operation simulation training, job simulation training, and operational behavior assessment into a single platform, addressing key challenges in heavy machinery, mining equipment, specialized vehicles, aircraft, and more.

    Traditional training in these fields often faces challenges such as training duration, cost, accessibility, safety, and weather dependencies, as it heavily relies on the availability of real equipment and physical environments. To overcome these challenges, many enterprises are turning to digital solutions to supplement their training activities.

    DataMesh Simulator 2.0 features several key modules, including environmental simulation, mechanical simulation, practical training, and practical examinations. It effectively helps deal with limited training durations and environments on actual machines by allowing trainees to familiarize themselves with various types of engineering machinery before engaging with real equipment and environments. With DataMesh Simulator, users can practice extensively at any time, gaining operational skills and techniques while significantly improving training efficiency.

    The platform creates a 1:1 replication of the real machine experience by combining the advantages of hardware and software. It includes a three-degree-of-freedom (3-DOF) or six-degree-of-freedom (6-DOF) motion platform, a dynamic simulation system, environment simulation, a simulated training cockpit, a motion control system, and front/left/right panoramic display screens with surround sound simulation systems. Additionally, it is equipped with software covering theoretical learning, cloud services, simulation, visualization, examination, signal acquisition, sound, and motion control systems. Together, these components create digital twins of the real working environment, enabling an effective alternative to traditional engineering equipment training methods.

    For trainees, DataMesh Simulator allows them to fully immerse themselves using handheld controllers, displays, pedals, joysticks, control panels, and other interactive elements and the platform incorporates text prompts, guided animations, force feedback, and motion simulation within the teaching process. For trainers, such as training schools or enterprises, the platform enables them to develop diverse interactive means for simulation-based training and assessment and provides flexibility to design comprehensive quantifiable indicators, facilitating content creation and reuse of virtual courseware.

    Compared to traditional training methods, DataMesh Simulator offers several advantages:

    • Reduced Training Costs: By eliminating the need for specific environmental conditions like weather and terrain and powered by electricity instead of gasoline, DataMesh Simulator utilizes digitized and iterative 3D content and courseware based on the FactVerse platform, achieving significant cost savings compared to investments in real equipment.
    • Greater Flexibility: The platform provides exceptional flexibility in training scenarios. Training schools or enterprises can create customizable digital twins, scenarios, and assessment logics using FactVerse’s zero-code tools. It supports multi-user collaborative training, allowing users to easily switch between different training scenarios as needed.
    • Enhanced Safety: DataMesh Simulator significantly reduces operational safety risks, property damage, and potential risks to life. By simulating dangerous operations within a safe environment, operators gain valuable experience without compromising safety.
    • Comprehensive Training Management: The platform incorporates a comprehensive learning management system with an immersive training experience that enables extensive tracking and feedback on training performance data and assessment methods. It ensures an immersive training experience and seamless integration with mainstream examination systems, supporting various file formats.

    DataMesh Simulator empowers businesses to enhance flexibility in training scenarios, reduce training costs, and deliver safer and more reliable training methods and comprehensive training management. By using DataMesh Simulator, SANY and Sunward recreate the operating process of rotary drilling rigs to enhance operational and training efficiency in a digitized manner, significantly reducing accidents caused by inexperienced operators, lowering training costs, and minimizing mechanical wear and tear on equipment.

    Setting New Standards for Motion Simulation Training

    DataMesh Simulator distinguishes itself from other training platforms through its exceptionally immersive simulation fidelity, realistic motion simulation, and immersive operating cabin experience. Unlike conventional equipment systems with limited visual effects and outdated architecture, DataMesh Simulator utilizes digital twin technology, simulation-based solutions, and motion control to create an authentic sensory experience. It accurately reproduces mechanical states such as movement, tilting, rotation, and vibration, offering a user-friendly UI and simulation system.

    Powered by DataMesh’s enterprise metaverse platform, FactVerse, the Simulator offers diverse interactive means for simulation-based training and assessment. Trainees can fully immerse themselves using handheld controllers, displays, pedals, joysticks, control panels, and other interactive elements.

    DataMesh Simulator integrates DataMesh Learn training solution, providing a comprehensive and unified assessment system for trainee information management, which supports tracking training progress, editing and distributing examination content, archiving and querying assessment results, and more.

    The platform supports private and cloud-based deployment, with a modular approach offering zero-code tools for content creation, enabling customization and upgrades to meet evolving enterprise needs. Additionally, the visual system seamlessly integrates with mainstream VR presentation methods, offering flexibility in adjusting courses and enhancing the overall training experience.

    With DataMesh Simulator, trainees can be able to handle equipment in advance and gain valuable experience, addressing challenges such as limited learning time, opportunity and efficiency, and safety in real environments. For enterprises, manufacturers, and training institutions, it provides an efficient, cost-effective, safe, and controllable training solution. By applying digital twin and motion simulation technologies, DataMesh Simulator 2.0 will help drive the development of simulation-based training and provide a new training and assessment approach for the engineering equipment industry.

    Exciting New Features from DataMesh Director 6.0

    Today, we are delighted to announce the official release of DataMesh Director 6.0, the industry-leading platform for digital twin content creation and collaboration. This latest version brings comprehensive upgrades to key functionalities, character actions, editing capabilities, and the user interface, offering users an even smoother and enhanced experience.

    New Features of DataMesh Studio

    Actions serve as the foundation for the expression and interactivity of DataMesh scenarios. In DataMesh Director 6.0, DataMesh Studio introduces seven types of actions: posture adjustment, dispersal, sectioning, disappearance, linking, coloring, and animation. With redesigned configuration methods, users can add these actions to any model node and independently customize the action effects for other nodes.

    Linking: Users can now add linking actions to any scene element. Simply clicking on the element seamlessly transitions the scenario from the current page to the target page. Additionally, users have the flexibility to set the trigger range for the linking action within the scene using a convenient drag-and-drop feature, enabling flexible transitions in 3D scenes.

    Sectioning: Users can apply sectioning actions to any node and configure the sectioning effects for other nodes, including the sectioning direction and animation. Unlike previous versions, where sectioning was limited to the entire model, version 6.0 enables users to set individual sectioning for each level of child objects. Furthermore, animations have been added for the appearance and disappearance of sectioning actions. DataMesh Studio offers three types of slicing animations to choose from: slicing along the X-axis, Y-axis, or Z-axis.

    Dispersal: The dispersal action enables quick disassembly of models. Two methods, explosion and linear dispersal, are available. In version 6.0, users have the flexibility to manually adjust the positions of dispersed models and add dispersal actions to child objects. Alternatively, all dispersal configurations can be completed within a single dispersal action.

    Coloring: With the coloring action, users can change the color of any model node, whether it’s the entire model or individual child objects. Two styles of coloring, gradient and flickering, are supported to achieve the desired visual effects.

    New Features of DataMesh Importer

    Support for Cloud Resources: Importer now allows users to directly open files from the cloud by selecting the “File – Open From Cloud” option.

    Model Material Editing: Importer not only reads crucial information such as triangle count, vertex count, texture count, and material count, but also allows users to modify material properties. Materials define surface characteristics, such as color, reflection, and transparency, significantly impacting the appearance and visual effects. Users can now replace the original material with commonly used materials, including metal, wood, plastic, glass, marble, glaze, and concrete.

    Moreover, users can adjust various properties, such as color, transparency, metallicness, and smoothness. These properties can be adjusted individually or collectively, providing users with the flexibility to effortlessly achieve their desired effects.

    New Features of DataMesh One

    DataMesh One has undergone a complete interface redesign, optimizing and enhancing the overall user experience.

    DataMesh Director 6.0 is now available on supported application stores, and existing customers who have purchased DataMesh SaaS services can directly upgrade their clients. For product trials, subscriptions, and collaborations, please feel free to contact us directly at service@datamesh.com. We are excited to support you on your journey with DataMesh Director 6.0.