As the inaugural event of “Global Industrie,” one of Europe’s largest industrial trade fairs, held in Japan, the SMART MANUFACTURING SUMMIT is currently ongoing from today until the 15th at the Aichi Sky Expo in Aichi Prefecture. Aichi Prefecture Government, in collaboration with KDDI and DataMesh, has jointly created an immersive digital industrial landscape based on MR technology, integrating the concept of Industry 5.0 into the summit experience to promote the development of the next-generation industrial revolution and strengthen innovation exchange between Japan and Europe.
The summit aims to drive the development of Industry 5.0 and enhance innovation exchange between Japan and Europe. At the summit, a variety of interactive digital scenes deployed based on the DataMesh digital twin platform provide an engaging experience for participants. From introducing the cultural history and industrial evolution of Aichi Prefecture to guiding attendees through virtual routes between booths using avatars, and showcasing various 3D industrial machinery such as die-casting machines, large-scale industrial printers, and laser equipment through MR, DataMesh’s applications significantly enhance product displays and overall participant engagement. Additionally, DataMesh FactVerse, an industrial metaverse platform was also applied in virtual factory demonstrations, showcasing data-driven smart manufacturing scenarios in the Industry 5.0 era.
Industry 5.0 complements and enhances Industry 4.0, bringing value in several aspects:
More humane working environments: Industry 5.0 emphasizes human-machine collaboration, freeing humans from tedious, repetitive tasks to focus on more creative and valuable work, enhancing work experience and satisfaction.
Sustainable development: Industry 5.0 focuses on environmental protection and sustainable resource utilization, achieving the unity of economic and social benefits through the development of circular economy, reducing energy consumption, and waste emissions.
Enhanced enterprise resilience: Industry 5.0 helps enterprises improve their ability to respond to emergencies, enhance the resilience of supply chains and production systems, and address various risks and challenges.
Personalized customization: Industry 5.0 can meet consumer demand for personalized products through human-machine collaboration and intelligent technology, realizing flexible production and customized services.
Attracting and retaining talents: Industry 5.0 provides a more challenging and creative work environment, attracting and retaining high-quality talents, enhancing enterprise competitiveness.
Industry 5.0 provides a genuine opportunity for the manufacturing industry to re-industrialize production in a smart and responsible manner. As one of the leaders in technology innovation in manufacturing, construction, and other fields, DataMesh has long collaborated with leading enterprises and organizations such as Aichi Prefecture Government, KDDI, etc., dedicated to providing cutting-edge digital twin and mixed reality expertise and experience globally, rapidly building flexible, data-driven digital twin scenarios, and helping enterprises meet ecological and green development requirements.
Through the democratization of digital twin and XR technology, DataMesh has helped enterprises optimize operational efficiency, reduce costs, and improve efficiency in fields such as manufacturing, AEC (Architectural Engineering and Construction), and facility equipment maintenance, significantly enhancing the capabilities of frontline workers and addressing social challenges such as declining birth rates and aging populations. DataMesh Director is widely deployed in Japanese manufacturing and construction fields, enabling frontline workers to easily create digital twin content and improve work efficiency, promote team communication and collaboration, and enhance the speed and quality of professional training. Furthermore, DataMesh Director plays an important role in after-sales services, providing high-quality after-sales services remotely through XR technology, breaking geographical constraints, and improving the employment environment.
The SMART MANUFACTURING SUMMIT, organized by GL events and co-sponsored by Aichi Prefecture Government, has attracted participation from hundreds of companies from 40+ countries worldwide and is expected to host over 15,000 attendees.
DataMesh is proud to have contributed to this event and welcomes industry professionals to visit Booth SD-02 in D-Hall to experience the Aichi Digital Island showcase and engage in interactive discussions with us. Committed to constant innovation and the Democratization of Digital Twin, DataMesh continuously provides advanced digital transformation solutions to address increasingly complex challenges and drive revolutionary innovation in manufacturing and beyond.
Today, DataMesh unveils its cutting-edge spatial computing innovation – FactVerse Express, a powerful and user-friendly content creation tool designed for global users to effortlessly and joyfully immerse themselves in the world of XR.
Incorporating the core advantages of the enterprise-level Digital Twin and XR content creation tool – DataMesh Director, FactVerse Express also includes a 3D asset library, providing abundant resources to inspire users of all skill levels to easily craft unique XR content using an intuitive interface, tapping into their creativity to the fullest.
FactVerse Express is compatible with Apple Vision Pro, ready to empower users across platforms with an exceptional spatial computing experience upon the imminent availability of Apple Vision Pro, in addition to its existing support for various devices, including Meta Quest 3, iPhone, and iPad.
The key strengths of FactVerse Express lie in its industry-leading cross-platform compatibility and user-friendly design. Whether you’re a professional user or a beginner entering the XR field, getting started with the tool to create content is quick and easy.
Moreover, FactVerse Express is more than just for individual creators, making XR more accessible and is an ideal choice for enterprise users looking to optimize operations and efficiency. The professional version – DataMesh Director – has been widely adopted in various business scenarios, such as education and training, operational guidance, remote collaboration & monitoring, maintenance & inspections, effectively improving productivity for hundreds of customers across continents.
FactVerse Express is currently available on the Apple App Store for free download and use without registration.
With the surging interest in spatial computing thanks to the advent of Apple Vision Pro, we are proud to be among the first movers, now opening a disruptive new spatial content creation platform powered by FactVerse Express for existing and new users to explore the fun and creativity in XR, especially when the Apple Vision Pro arrives at their door!
For any inquiries about Express or enterprise-level digital twins and the industrial metaverse, please feel free to reach out at service@datamesh.com.
Today, DataMesh Simulator 2.1 is released, introducing simulation-based training and assessment tailored for tower crane operations. This innovative motion simulation platform focuses on providing trainees with an authentic learning experience while operating tower cranes, through upgraded operational scenarios that faithfully replicate real equipment models, construction environments, and operational procedures.
1:1 Digital Twin of Construction Environment
Construction machinery models, including tower cranes and others within the Simulator, are meticulously crafted to mirror selected reference machines in appearance, movement, status, and characteristics.
Models undergo meticulous treatments in color, material, texture, lighting, and background to achieve a heightened sense of realism.
Real-time rendering of tower cranes and collaborating construction machinery models ensures seamless immersion in the virtual environment without visual or auditory delays, fostering an unparalleled sense of participation for users.
Rigorous collision detection, interference verification, and motion synchronization ensure the authenticity and integrity of the tower crane and other construction machinery models involved.
Authentic Operational Procedure Replication
Operational procedures are designed based on insights from experienced tower crane operators, integrating text, voice, signal commands, dynamic UI elements, and instructional videos at each training step. The crane hook offers multiple operational perspectives, including front and rear views, external views, and cabin views, enhance the training experience.
The system interface provides real-time monitoring of machine parameters, such as wind speed, rotation angle, lifting weight, trolley position, and hook distance from the ground.
The comprehensive curriculum resources bridge the gap between training and real-world operations, allowing trainees to familiarize themselves with common terminology and signal gestures used in actual construction scenarios. This immersive training approach facilitates practical application and offers tangible hands-on training benefits.
Immersive Learning Experience
Integrated with the DataMesh Learn system, the Simulator platform streamlines the management, sharing, storage, and analysis of various mechanical equipment simulation training materials and assessment results. Instructors can autonomously customize and distribute training and assessment tasks to enhance teaching effectiveness, making it the preferred choice for engineering machinery professionals. The tower crane simulator comprises the DataMesh Simulator system software and hardware platforms, offering features such as course play, operational training, assessment, personnel management, and learning management. Hardware options include six degrees of freedom motion platforms, three degrees of freedom motion platforms, and a basic non-motion platform, catering to diverse user needs.
DataMesh Simulator revolutionizes industrial training by providing an immersive and lifelike learning environment that significantly improves trainee engagement and learning outcomes. By enabling trainees to understand equipment operations safely and effectively, it mitigates safety risks and boosts training efficiency. For purchasing inquiries or further product information, please contact service@datamesh.com.
Learn more about the DataMesh Simulator platform by watching this video:
The expressway network of Japan has been constantly expanded since the 1960s and its total road length is currently over 10,000km. On the other hand, more than half of the expressway network has been used for over 30 years and aging of structures such as road surfaces, bridges, and tunnels has emerged as a social issue. The dwindling number of expressway maintenance and management engineers in line with the decline in the productive population is also one of the significant challenges.
Given the circumstances, Nexco-East Engineering operating about 4,000km of all the expressways in Japan developed a training app for ETC equipment and tunnel emergency facilities using MR and digital twin technologies, which is implemented in its training center “Technical Training Center (TTC)” located in Takasaki, Gunma. The app serves as an efficient education and training tool to equip every engineer with necessary knowledge and skills to develop quality engineers.
Initiated MR tool development toward improvement and standardization of trainees’ levels of understanding
Since about 10 years ago, the NEXCO EAST group has projected the aging of expressways and maintenance and management labor shortage and promoted the Smart Maintenance Highway (SMH) project to match the existing expressway maintenance and management technologies that the group has acquired with ICT technologies. Through the project, operational DX has been advanced with proactive application of digital capacities to the field operations, e.g. conversion of paper-based drawing preparation into tablet-based tasks and analysis and utilization of accumulated data with Microsoft PowerBI. Assigned with the project, Mr. Tetsuo Hideshima, the Managing Director and General Planning Manager of Nexco-East Engineering said with regard to the project policies,
“We at Nexco-East Engineering ensure that drivers can safely use expressways by providing inspections and troubleshooting all day, all year. For continuous maintenance and management of expressways, it is critical to conduct thorough inspections and diagnoses without overlooking any tiny changes in facilities and structures. To that end, streamlining and labor saving based on ICTs are imperative.”
The company also opened TTC in 2012 as a training facility to enhance performance of expressway inspection engineers. For practical training, TTC offers a training environment equipped with real power receiving and distribution equipment, ETC (automatic toll payment system) equipment, and component samples that are exactly the same as those used on expressways.
With regard to the roles of TTC, Mr. Masayuki Namiki, the General Manager of TTC said, “At TTC, over 1,000 of our engineers participate in training programs every year. They go through training to enhance skills based on the internal skill check system to become experts of expressway inspection and maintenance, called ‘highway doctors.'”
Meanwhile, highway structures and facilities have become more and more complex along with the technological advancement and, despite the hands-on learning with such training materials, levels of understanding of the mechanisms and internal structures varied among trainees. This hindered standardization of trainees’ technical levels, constituting an issue for TTC.
The issue was particularly conspicuous in education on ETC equipment. “ETC equipment is composed of multiple devices and how ETC equipment operates was explained with extensive materials such as paper-based radio communication and control signal flow charts, PowerPoint slides, and chalk talks of instructors and then tested with actual ETC devices,” said Mr. Yoshitaka Nakamura, the Manager, Facilities Construction Work Division, Facilities Construction Work Department of Nexco-East Engineering.
“However, it requires considerable time to gain understanding of associations among the training materials. Also, radio communication and control signal flows are impossible to see, so we had to rely on trainees’ imaginations. This resulted in gaps in understanding.”
In response, the company focused attention on the MR (mixed reality) and digital twin technologies. Then a project to develop an “MR for ETC equipment training” was launched out of an idea of combining a 3D model of ETC equipment as well as infrared sensors, radio communication, and data communication routes (which are invisible in reality) with the ETC practice lanes to foster better intuitive understanding.
Endeavor to develop training materials that are easy-to-use for every trainee with no example available as a model
It was DataMesh that contracted with Nexco-East Engineering for its extensive achievements and experiences in the field of digital twins and XR. Mr. Kensho Kashimada, the Director, Marketing and Sales of DataMesh Japan Co., Ltd. looked back, “At that time, there had been no similar attempts at least in Japan. The point was how we could build up MR materials that are easy-to-understand for every trainee while there was no correct answer about what the outcome should be like.”
The first step they took to that end was employment the agile development approach based on a quick PDCA cycles, rather than waterfall-model development that relies on detailed specifications from the beginning. “We carefully proceeded with the development through repeated hearing sessions with the project leading department and TTC instructors who would actually use the tool in practice,” said Mr. Kashimada. They also received the same courses that TTC actually provides to trainees to gain knowledge of ETC equipment mechanisms and applied it to the system.
“By receiving lectures with oral explanations and 2D materials, we witnessed how difficult it is to understand the ETC mechanisms firsthand. We could also appreciate the potential value of the tool we were trying to create. So I think it was a very valuable process,” said Mr. Kashimada.
Thus, after the development period of about six months, accurate 3D models of ETC devices were made and the MR for ETC equipment training using 3D animation superimposed on ETC equipment that is visible via a tablet device or Microsoft MR device “HoloLens 2” was completed.
“Normally, accuracy of SLAM (Simultaneous Localization and Mapping) in positioning of MR superimposition depends on hardware performance. However, for this MR for ETC equipment training, SLAM features of DataMesh’s proprietary digital twin platform (FactVerse) were used to make SLAM accuracy levels of multiple devices uniform,” explained Mr. Kashimada. Ingenuities are made to realize superimposition of massive 3D data without dependence on device performance by using a technology to load necessary portions of data only.
Mr. Kashimada said those features provides trainees immersive experiences in the MR world without stressful events such as misalignment or freezing of 3D animation.
Mr. Namiki said, “It was really a tremendous work to explain invisible things verbally. But now data and radio waves are visible and this increased the level of understanding dramatically.”
Once getting used to the operational feeling of HoloLens 2, trainees can adjust the position just by reading a QR code on the display without taking any complex procedure. It was reported that instructors could acquire basic operation methods only through a one-day lecture provided by DataMesh.
The MR for ETC equipment training, which is well recognized by field operators, too, has been further improved based on feedback from instructors. Currently, additional features such as repeated playback of individual work steps and animation speed adjustment for in-depth explanation make the tool even more effective.
MR for tunnel emergency facilities training making full use of HoloLens 2 characteristics
Out of its confidence in the success of MR for ETC equipment training, Nexco-East Engineering promptly commenced next training MR development, which is the “MR for tunnel emergency facilities training.”
“The internal structure of automatic water sprinkler system for tunnel emergencies cannot be seen from the outside, so we superimposed a CG simulation of the internal water flow and developed training materials for visualizing internals and operating status,” said Mr. Nakamura.
Mr. Namiki said, “In the past, we presented pipe samples from real equipment and illustrations to teach their structures and operations, but we couldn’t actually let water through them to demonstrate the mechanism. Also, explanations somewhat varied among instructors. As with ETC equipment, the gap in levels of understanding among trainees was recognized as an issue.”
As a measure to resolve the issue, DataMesh reproduced the equipment movements from an onset of vehicle fire to watering and visualized the internal structures based on its know-how acquired through development of the MR for ETC equipment training. Furthermore, a feature to adjust transparency of 3D animation of water flowing inside the pipe was added give trainees freedom to observe how water flows and stops inside. Implementation of realistic 3D effects of fire also give realistic experiences to enhance understanding.
Finally, quality of this MR for tunnel emergency facilities training is surprisingly high and precise even to experienced engineers including Mr. Hideshima. “From water flow and the valve opening mechanism to things going on behind pipes are all comprehensible at a glance. I sensed the poser of MR anew,” said Mr. Hideshima.
As the MR for tunnel emergency facilities training is equipped with the “pseudo reproduction feature” to learn points to check in the event of any malfunction and restoration methods, the MR system has a possibility to be applied to a future remote maintenance system.
Plus, linking tablets and other devices has enabled remote training, creating an environment where a greater number of trainees can take part.
Above all, the MR for tunnel emergency facilities training fully taps HoloLens 2 potential compared with the MR for ETC equipment training. In fact, for training using the MR for ETC equipment training with outdoor ETC equipment, tablets are mainly used as output devices because visibility of HoloLens 2 can be deteriorated depending on sunlight intensity. On the other hand, tunnel emergency facilities are indoor equipment and not subject to sunlight. This is where HoloLens 2 comes in.
Mr. Namiki said, “While a tablet needs to be held with both hands, HoloLens 2 is a head-mounted display, which sets both hands free. So trainees can touch devices while going through MR training. It also allows individual trainees to rewind, pause, and adjust the transparency level, giving an advantage in tailoring training sessions to individual levels of understanding.”
Toward even more effective ICTs through professional collaborations
After realizing the quality training tools by using the digital twin and MR technologies, Nexco-East Engineering has a plan to further promote use of ICTs to address the issues of facilities aging and labor shortage, which are expected to be further accelerated.
Exploring possibilities of ICT usages in various scenes, Mr. Nakamura said, “We have an ambition to expand our use of ICTs beyond TTC hands-on training to online training, OJT training, establishment of hands-on safety education system to improve field safety management skills, and remote maintenance, etc.”
With a view to establishment of a system for effective use of ICTs, Mr. Namiki struggling in the field of training said, “In recent years, equipment and facilities have become more and more sophisticated and suffered less failures. It may appear to be a good thing, but on the other side of the coin, most engineers in the future could be inexperienced in failure responses. We would like to establish a system to support engineers with the power of ICTs rather than relying on experienced engineers when the time comes.”
On the other hand, Mr. Hideshima is hopeful about professional partnerships. He said, “Although we have excellent expertise in expressway technologies, we admit we cannot fully catch up with ever-improving ICT seeds and technological innovations. In that regard, we are really hopeful about continuation of partnerships with ICT professionals such as DataMesh and Microsoft Japan.”
Based on ideal partnerships in which expressway professionals and ICT professionals work together to resolve issues and mutually give valuable input to technologies and knowledge, Nexco-East Engineering will continue maintaining and advancing safety on expressways, one of the essentials of our modern lives.
“From water flow and the valve opening mechanism to things going on behind pipes are all comprehensible at a glance. I sensed the poser of MR anew,”
— Mr. Tetsuo Hideshima, Managing Director and Chief of Planning Headquarters, Nexco-East Engineering
“While a tablet needs to be held with both hands, HoloLens 2 is a head-mounted display, which sets both hands free. So trainees can touch devices while going through MR training. It also allows individual trainees to rewind, pause, and adjust the transparency level, giving an advantage in tailoring training sessions to individual levels of understanding,”
— Mr. Masayuki Namiki, General Manager, Technical Training Center Manager, Nexco-East Engineering
“We have an ambition to expand our use of ICTs beyond TTC hands-on training to online training, OJT training, establishment of hands-on safety education system to improve field safety management skills, and remote maintenance, etc.”
— Mr. Yoshitaka Nakamura, Manager, Facilities Construction Work Division, Facilities, Construction Work Department, Nexco-East Engineering
“At that time, there had been no similar attempts at least in Japan. The point was how we could build up MR materials that are easy-to-understand for every trainee while there was no correct answer about what the outcome should be like.”
— Mr. Kensho Kashimada, Director, Marketing and Sales, DataMesh Japan Co., Ltd.
This customer story was originally published by Microsoft here.
Seattle, WA, USA— July 13, 2020 — DataMesh today announced it has been named a finalist of Mixed Reality 2020 Microsoft Partner of the Year Award. The company was honored among a global field of top Microsoft partners for demonstrating excellence in innovation and implementation of customer solutions based on Microsoft technology.
This award is a recognition of the contribution DataMesh Director made in remote customer support during Covid-19 pandemic.
The Microsoft Partner of the Year Awards recognize Microsoft partners that have developed and delivered exceptional Microsoft-based solutions during the past year. Awards were classified in several categories, with honorees chosen from a set of more than 3,300 submitted nominations from more than 100 countries worldwide. DataMesh was recognized for providing outstanding solutions and services of Mixed Reality in China and Japan.
“It is an honor to recognize the winners and finalists of the 2020 Microsoft Partner of the Year Awards,” said Gavriella Schuster, corporate vice president, One Commercial Partner, Microsoft. “These partners go above and beyond, delivering timely solutions that solve the complex challenges that businesses around the world face – from communicating and collaborating virtually to helping customers realize their full potential with Azure cloud services, and beyond. I am proud to honor and congratulate each winner and finalist.”
