The system of headlights operation recognition using the digital twin method.
Abstract
Virtual digital representation of a physical object or system, created with precision through computer simulations, data analysis, and various digital technologies can be used as training set for real life situations. The principal aim behind creating a virtual representation is to furnish a dynamic, data-fueled, and digital doppelgänger of the physical asset. This digital counterpart serves multifaceted purposes, including the optimization of performance, the continuous monitoring of its well-being, and the augmentation of informed decision-making processes. Main advantage of employing a digital twin is its capacity to facilitate experimentation and assessment of diverse scenarios and conditions, all without impinging upon the actual physical entity. This capability translates into substantial cost savings and superior outcomes, as it allows for the early identification and mitigation of issues before they escalate into significant problems in the tangible world. Within our research endeavors, we've meticulously constructed a digital twin utilizing the Unity3D software. This digital replica faithfully mimics vehicles, complete with functioning headlamp toggles. Our lighting system employs polygons and normal vectors, strategically harnessed to generate an array of dispersed and reflected light effects. To ensure realism, we've meticulously prepared the scene to emulate authentic road conditions. For validation and testing, we integrated our model with the YOLO (You Only Look Once) neural network. A specifically trained compact YOLO model demonstrated impressive capabilities by accurately discerning the status of real vehicle headlamps. On average, it achieved an impressive recognition probability of 80%, affirming the robustness of our digital twin.
References
Home | NHTSA, https://www.nhtsa.gov/, last accessed 2023/01/17.
AAA | American Automobile Association, https://www.ace.aaa.com/, last ac-cessed 2023/01/17.
Z. Sun, G. Bebis, and R. Miller,"On-road vehicle detection: a review", IEEE Trans. Pattern Anal. Mach. Intell., vol 28, pp. 694–71, 2006. https://doi.org/10.1109/TPAMI.2006.104.
A. Mukhtar, L. Xia, and T. Boon Tang,"Vehicle Detection Techniques for Collision Avoidance Systems: A Review", IEEE Trans. Intell. Transp. Syst. Vol 16, pp. 2318–2338, 2015. https://doi.org/10.1109/TITS.2015.2409109.
A. Dawid, "PSR-based research of feature extraction from one-second EEG signals: a neural network study", SN Appl. Sci., vol. 1, article number 1536, 2019. https://doi.org/10.1007/s42452-019-1579-9.
A. Bhattacharyya, M. Sharma, R. B. Pachori, P. Sircar, and U. R. Acharya, "A novel approach for automated detection of focal EEG signals using empirical wavelet transform.", Neural Comput. Appl., vol. 29, pp. 47–57, 2018. https://doi.org/10.1007/s00521-016-2646-4.
E.S. Madhan, S. Neelakandan, R. Annamalai, R., “A Novel Approach for Vehicle Type Classification and Speed Prediction Using Deep Learning.”, J. Comput. Theor. Nanosci. vol. 17, pp. 2237–2242, 2020. https://doi.org/10.1166/jctn.2020.8877.
A. Dawid, P. Buchwald, B. Pawlak, "The Digital Twin to Train a Neural Network Detecting Headlamps Failure of Motor Vehicles", In: W. Zamojski, J. Mazurkiewicz, J. Sugier, T. Walkowiak, J. Kacprzyk (eds) Dependable Computer Systems and Networks. DepCoS-RELCOMEX 2023. Lecture Notes in Networks and Systems. Springer, Cham., vol 737, pp. 29-38, 2023. https://doi.org/10.1007/978-3-031-37720-4_3
Regulation No 48 of the Economic Commission for Europe of the United Nations (UNECE) — Uniform provisions concerning the approval of vehicles with regard to the installation of lighting and light-signalling devices [2019/ 57].
Y. Kim, H. Gwak, J. Oh, M. Kang., J. Kim, H. Kwon, and S. Kim, “CloudNet: A LiDAR-Based Face Anti-Spoofing Model That Is Robust Against Light Variation.” IEEE Access. vol. 11, pp. 16984–16993, 2023. https://doi.org/10.1109/ACCESS.2023.3242654.
D. Palka, M. Sobota, P. Buchwald, "3D Object Digitization Devices in Manufacturing Engineering Applications and Services.", Multidiscip. Asp. Prod. Eng., vol. 3, pp. 450–463, 2020. https://doi.org/10.2478/mape-2020-0038.
C-Y Wang, A. Bochkovskiy, and Hong-Yuan Mark Liao, "YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors", http://arxiv.org/abs/2207.02696, 2022. https://doi.org/10.48550/arXiv.2207.02696.
C. Goutte, E. Gaussier, "A Probabilistic Interpretation of Precision, Recall and F-Score, with Implication for Evaluation", In: Losada, D.E. and Fernández-Luna, J.M. (eds.) Advances in Information Retrieval.. Springer, Berlin, Heidelberg, pp. 345–359, (2005). https://doi.org/10.1007/978-3-540-31865-1_25.
K. Szyc, "An Impact of Data Augmentation Techniques on the Robustness of CNNs", In: W. Zamojski, J. Mazurkiewicz, J. Sugier, T. Walkowiak, and J. Kacprzyk, (eds.) “New Advances in Dependability of Networks and Systems.”, Springer International Publishing, Cham, pp. 331–339, 2022. https://doi.org/10.1007/978-3-031-06746-4_32.
C. Shorten and T. M. Khoshgoftaar, "A survey on Image Data Augmentation for Deep Learning", J. Big Data., vol 6, article number 60, 2019. https://doi.org/10.1186/s40537-019-0197-0.
A. Pilch and H. Maciejewski, "Labeling Quality Problem for Large-Scale Image Recognition", In: W. Zamojski, J. Mazurkiewicz, J. Sugier, T. Walkowiak, and J. Kacprzyk, (eds.) “New Advances in Dependability of Networks and Systems.”, Springer International Publishing, Cham, pp. 206–216, 2022. https://doi.org/10.1007/978-3-031-06746-4_20.
A. Dawid, "PSR-based research of feature extraction from one-second EEG signals: a neural network study." SN Appl. Sci. 1, 1536, 2019. https://doi.org/10.1007/s42452-019-1579-9.
K. Szyc, "Determining the Minimal Number of Images Required to Effectively Train Convolutional Neural Networks". In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Theory and Applications of Dependable Computer Systems. DepCoS-RELCOMEX 2020. Advances in Intelligent Systems and Computing, Springer, Cham. vol 1173. pp 652–661, 2022, https://doi.org/10.1007/978-3-030-48256-5_64.
A. Rusiecki, "Standard Dropout as Remedy for Training Deep Neural Networks with Label Noise.", In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Theory and Applications of Dependable Computer Systems. DepCoS-RELCOMEX 2020. Advances in Intelligent Systems and Computing, Springer, Cham. Vol 1173, pp 534–542, 2020. https://doi.org/10.1007/978-3-030-48256-5_52.
J. Mazurkiewicz and A. Cybulska, (2020). Softcomputing Art Style Identification System. In: Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., Kacprzyk, J. (eds) Engineering in Dependability of Computer Systems and Networks. DepCoS-RELCOMEX 2019. Advances in Intelligent Systems and Computing, Springer, Cham., vol 987., pp 321–330, 2019, https://doi.org/10.1007/978-3-030-19501-4_32.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 International Journal of Electronics and Telecommunications
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
1. License
The non-commercial use of the article will be governed by the Creative Commons Attribution license as currently displayed on https://creativecommons.org/licenses/by/4.0/.
2. Author’s Warranties
The author warrants that the article is original, written by stated author/s, has not been published before, contains no unlawful statements, does not infringe the rights of others, is subject to copyright that is vested exclusively in the author and free of any third party rights, and that any necessary written permissions to quote from other sources have been obtained by the author/s. The undersigned also warrants that the manuscript (or its essential substance) has not been published other than as an abstract or doctorate thesis and has not been submitted for consideration elsewhere, for print, electronic or digital publication.
3. User Rights
Under the Creative Commons Attribution license, the author(s) and users are free to share (copy, distribute and transmit the contribution) under the following conditions: 1. they must attribute the contribution in the manner specified by the author or licensor, 2. they may alter, transform, or build upon this work, 3. they may use this contribution for commercial purposes.
4. Rights of Authors
Authors retain the following rights:
- copyright, and other proprietary rights relating to the article, such as patent rights,
- the right to use the substance of the article in own future works, including lectures and books,
- the right to reproduce the article for own purposes, provided the copies are not offered for sale,
- the right to self-archive the article
- the right to supervision over the integrity of the content of the work and its fair use.
5. Co-Authorship
If the article was prepared jointly with other authors, the signatory of this form warrants that he/she has been authorized by all co-authors to sign this agreement on their behalf, and agrees to inform his/her co-authors of the terms of this agreement.
6. Termination
This agreement can be terminated by the author or the Journal Owner upon two months’ notice where the other party has materially breached this agreement and failed to remedy such breach within a month of being given the terminating party’s notice requesting such breach to be remedied. No breach or violation of this agreement will cause this agreement or any license granted in it to terminate automatically or affect the definition of the Journal Owner. The author and the Journal Owner may agree to terminate this agreement at any time. This agreement or any license granted in it cannot be terminated otherwise than in accordance with this section 6. This License shall remain in effect throughout the term of copyright in the Work and may not be revoked without the express written consent of both parties.
7. Royalties
This agreement entitles the author to no royalties or other fees. To such extent as legally permissible, the author waives his or her right to collect royalties relative to the article in respect of any use of the article by the Journal Owner or its sublicensee.
8. Miscellaneous
The Journal Owner will publish the article (or have it published) in the Journal if the article’s editorial process is successfully completed and the Journal Owner or its sublicensee has become obligated to have the article published. Where such obligation depends on the payment of a fee, it shall not be deemed to exist until such time as that fee is paid. The Journal Owner may conform the article to a style of punctuation, spelling, capitalization and usage that it deems appropriate. The Journal Owner will be allowed to sublicense the rights that are licensed to it under this agreement. This agreement will be governed by the laws of Poland.
By signing this License, Author(s) warrant(s) that they have the full power to enter into this agreement. This License shall remain in effect throughout the term of copyright in the Work and may not be revoked without the express written consent of both parties.
