Audit Holosen 4.0: Intelligent auditing using mixed reality
In addition to requiring periodic maintenance and revision to ensure optimum operation, energy distribution or generation infrastructures are usually located quite far from major urban centers. For this reason, it is usually necessary to send specialized personnel to perform on-site evaluations, with the additional factor that these operations involve a high risk when working with high voltage.
In addition, many of the systems currently used for these inspections are not very developed, as, in the most advanced ones, a simple verification is performed through geopositioned photos uploaded by an operator.
Audit Holosen 4.0 is a project carried out together with onTech Innovation, the University of Seville and the Cuerva Group with the aim of providing Spanish SMEs in the electricity sector with an assistance tool to perform smart audits that will accelerate the digitization and modernization of their critical infrastructures towards the new paradigm of Industry 4.0.
– Full project title: Intelligent auditing in maintenance and electrical technical inspection using new methods of mixed reality and sensorization.
– Project dossier code: AEI-010500-2021b-31
Today, there are centralized and remotely connected control systems that provide effective and regular overall monitoring and control. However, human intervention still plays an important role, preventing, among other things, hacks that take control of the infrastructure due to these physical control points that act as firewalls.
Therefore, the energy sector needed an intelligent audit assistance tool that would facilitate the control of the execution of maintenance and technical inspection tasks using new mixed reality and sensorization technologies.
Platform to promote digitization and access to alternative financing for SMEs on a self-service basis, “HELIX 2”.
The process
We used HoloLens 2 to perform operations in the technical environment, using virtual elements projected on these mixed reality glasses to visualize important information and interact with it.
In addition, by means of AI and computer vision techniques, the possibility of interpreting elements of the environment and detecting whether certain operations have been performed correctly is added, validating them and minimizing human error in complex situations and maintenance with risk.
The solution was based on a Mixed Reality and AI approach.
Finally, the sensory part has been developed, where wearable sensors have been applied in order to take into consideration factors such as stress level and to alert of its potential incidence.
Development with HoloLens 2, Computer Vision and Sensoritics.
Results
- Problem solving to verify the status of operations.
- Propose new ways of interacting with the virtual world. – Detection and prediction of error causes. – Data reading and access to a visual information layer.
- Increased reliability and cost savings. – Reduction of accident rates.
- Tele-assistance and action on elements that are not physically present thanks to projected holograms.
- Consultation of infrastructure status in real time,
- Stress control, olfactory control, among others.
We are ready for new challenges
Iniciativa financiada por el Ministerio de Industria, Comercio y Turismo, como parte del Plan de Recuperación, Transformación y Resiliencia, con los fondos Next Generation EU de la Unión Europea.
Referencia: AEI-010500-2021b-31
