<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">pimi</journal-id><journal-title-group><journal-title xml:lang="ru">Приборы и методы измерений</journal-title><trans-title-group xml:lang="en"><trans-title>Devices and Methods of Measurements</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2220-9506</issn><issn pub-type="epub">2414-0473</issn><publisher><publisher-name>BNTU</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.21122/2220-9506-2021-12-2-98-107</article-id><article-id custom-type="elpub" pub-id-type="custom">pimi-708</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>Средства измерений</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>Measuring instruments</subject></subj-group></article-categories><title-group><article-title>Автоматизированная система тепловой дефектометрии многослойных материалов на основе глубокого обучения</article-title><trans-title-group xml:lang="en"><trans-title>Deep Learning Automated System for Thermal Defectometry of Multilayer Materials</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Момот</surname><given-names>А. С.</given-names></name><name name-style="western" xml:lang="en"><surname>Momot</surname><given-names>A. S.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Адрес для переписки: Момот А.С. – Национальный технический университет Украины «Киевский политехнический институт имени Игоря Сикорского», пр-т Победы, 37, г. Киев 03056, Украина</p><p>e-mail: drewmomot@gmail.com</p></bio><bio xml:lang="en"><p>Address for correspondence: Momot A.S. – National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute", Peremohy Ave., 37, Kyiv 03056, Ukraine</p><p> e-mail:   drewmomot@gmail.com</p></bio><email xlink:type="simple">drewmomot@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Галаган</surname><given-names>Р. М.</given-names></name><name name-style="western" xml:lang="en"><surname>Galagan</surname><given-names>R. M.</given-names></name></name-alternatives><bio xml:lang="ru"><p>пр-т Победы, 37, г. Киев 03056</p></bio><bio xml:lang="en"><p>Peremohy Ave., 37, Kyiv 03056</p></bio><email xlink:type="simple">drewmomot@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Глуховский</surname><given-names>В. Ю.</given-names></name><name name-style="western" xml:lang="en"><surname>Gluhovskii</surname><given-names>V. Yu.</given-names></name></name-alternatives><bio xml:lang="ru"><p>пр-т Победы, 37, г. Киев 03056</p></bio><bio xml:lang="en"><p>Peremohy Ave., 37, Kyiv 03056</p></bio><email xlink:type="simple">drewmomot@gmail.com</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Национальный технический университет Украины «Киевский политехнический институт имени Игоря Сикорского»</institution><country>Украина</country></aff><aff xml:lang="en"><institution>National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute"</institution><country>Ukraine</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2021</year></pub-date><pub-date pub-type="epub"><day>25</day><month>06</month><year>2021</year></pub-date><volume>12</volume><issue>2</issue><fpage>98</fpage><lpage>107</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Момот А.С., Галаган Р.М., Глуховский В.Ю., 2021</copyright-statement><copyright-year>2021</copyright-year><copyright-holder xml:lang="ru">Момот А.С., Галаган Р.М., Глуховский В.Ю.</copyright-holder><copyright-holder xml:lang="en">Momot A.S., Galagan R.M., Gluhovskii V.Y.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://pimi.bntu.by/jour/article/view/708">https://pimi.bntu.by/jour/article/view/708</self-uri><abstract><p>На сегодняшний день, вместе с ростом темпов промышленного производства повышаются также и требования к контролю качества продукции. В задачах дефектоскопии и дефектометрии многослойных материалов перспективным является использование теплового метода неразрушающего контроля. В то же время, интерпретация данных теплового контроля усложнена рядом факторов, что делает использование традиционных методов анализа данных неэффективным. Поэтому актуальным заданием является поиск новых методов теплового контроля, которые позволят автоматизировать процесс диагностики и повысить информативность полученных результатов. Целью статьи являлось использование достижений в области глубокого обучения для обработки результатов активного теплового контроля изделий из многослойных материалов и разработка автоматизированной системы тепловой дефектоскопии и дефектометрии таких изделий.</p><p>Предлагаемая система состоит из источника нагрева, тепловизора для регистрации последовательностей термограмм и блока цифровой обработки информации. Для автоматизированной обработки данных используются три нейросетевых модуля, каждый из которых выполняет одну из задач: обнаружение и классификация дефектов, определение глубины залегания дефекта и его раскрытия (толщины). Программные алгоритмы и интерфейс взаимодействия с системой выполнены в среде разработки NI LabVIEW.</p><p>Экспериментальные исследования на образцах из многослойного стеклотекстолита показали значительное преимущество разработанной системы над методами, использующими традиционные алгоритмы анализа данных теплового контроля. Ошибка определения типа (классификации) дефекта на тестовом образце составила 15,7 %. Разработанная система обеспечила определение глубины дефекта с относительной погрешностью 3,2 %, а также толщины дефекта с относительной погрешностью 3,5 %.</p></abstract><trans-abstract xml:lang="en"><p>Currently, along with growth in industrial production, the requirements for product quality testing are also increasing. In the tasks of defectoscopy and defectometry of multilayer materials, the use of thermal nondestructive testing method is promising. At the same time, interpretation of thermal testing data is complicated by a number of factors, which makes the use of traditional methods of data processing ineffective. Therefore, an urgent task is to search for new methods of thermal testing that will automate the diagnostic process and increase information content of obtained results. The purpose of article is to use the advances in deep learning for processing results of active thermal testing of products made of multilayer materials and development of an automated system for thermal defectoscopy and defectometry of such products. The proposed system consists of a heating source, an infrared camera for recording sequences of thermograms and a digital information processing unit. Three neural network modules are used for automated data processing, each of which performs one of the tasks: defects detection and classification, determination of the defect depth and thickness. The software algorithms and user interface for interacting with system are programmed in the NI LabVIEW development environment.Experimental studies on samples made of multilayer fiberglass have shown a significant advantage of the developed system over using traditional methods for analyzing thermal testing data. The defect classification (determining the type) error on the test dataset was 15.7 %. Developed system ensured determination of defect depth with a relative error of 3.2 %, as well as the defect thickness with a relative error of 3.5 %.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>тепловой контроль</kwd><kwd>композиционные материалы</kwd><kwd>глубокое обучение</kwd></kwd-group><kwd-group xml:lang="en"><kwd>thermal testing</kwd><kwd>multilayer materials</kwd><kwd>deep learning</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Galagan R.М. Analysis of application of neural networks to improve the reliability of active thermal NDT. KPI Science News, 2019, no. 1, pp. 7–14. DOI: 10.20535/kpi-sn.2019.1.157374</mixed-citation><mixed-citation xml:lang="en">Galagan R.М. Analysis of application of neural networks to improve the reliability of active thermal NDT. KPI Science News, 2019, no. 1, pp. 7–14. DOI: 10.20535/kpi-sn.2019.1.157374</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Jiangang S. Analysis of data processing methods for pulsed thermal imaging characterisation of delaminations. Quantitative InfraRed Thermogra- phy Journal, 2013, vol. 10, pp. 9–25. DOI: 10.1080/17686733.2012.757860</mixed-citation><mixed-citation xml:lang="en">Jiangang S. Analysis of data processing methods for pulsed thermal imaging characterisation of delaminations. Quantitative InfraRed Thermogra- phy Journal, 2013, vol. 10, pp. 9–25. DOI: 10.1080/17686733.2012.757860</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Ahmed J., Gao B., Woo W.L., Wavelet-Integrated Alternating Sparse Dictionary Matrix Decomposition in Thermal Imaging CFRP Defect Detection. IEEE Transactions on Industrial Informatics, 2019, vol. 15, no. 7, pp. 4033–4043. DOI: 10.1109/TII.2018.2881341</mixed-citation><mixed-citation xml:lang="en">Ahmed J., Gao B., Woo W.L., Wavelet-Integrated Alternating Sparse Dictionary Matrix Decomposition in Thermal Imaging CFRP Defect Detection. IEEE Transactions on Industrial Informatics, 2019, vol. 15, no. 7, pp. 4033–4043. DOI: 10.1109/TII.2018.2881341</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Vavilov V.P. Dynamic thermal tomography: Recent improvements and applications. NDT&amp;E International, 2018, no. 135, pp. 129–141. DOI: 10.1016/j.ndteint.2014.09.010</mixed-citation><mixed-citation xml:lang="en">Vavilov V.P. Dynamic thermal tomography: Recent improvements and applications. NDT&amp;E International, 2018, no. 135, pp. 129–141. DOI: 10.1016/j.ndteint.2014.09.010</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Dudzik S. Analysis of the accuracy of a neural algorithm for defect depth estimation using PCA processing from active thermography data. Infrared Physics &amp; Technology, 2013, no. 56, pp. 1–7. DOI: 10.1016/j.infrared.2012.08.006</mixed-citation><mixed-citation xml:lang="en">Dudzik S. Analysis of the accuracy of a neural algorithm for defect depth estimation using PCA processing from active thermography data. Infrared Physics &amp; Technology, 2013, no. 56, pp. 1–7. DOI: 10.1016/j.infrared.2012.08.006</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Balageas D., Maldague X., Burleigh D, Vavi- lov V.P., Oswald-Tranta B., Roche J.-M., Pradere C., Carlomagno G.M. Thermal (IR) and other NDT techniques for improved material inspection. Journal of Nondestructive Evaluation, 2016, vol. 35, no. 1, article 18, 17 p. DOI: 10.1007/s10921-015-0331-7</mixed-citation><mixed-citation xml:lang="en">Balageas D., Maldague X., Burleigh D, Vavi- lov V.P., Oswald-Tranta B., Roche J.-M., Pradere C., Carlomagno G.M. Thermal (IR) and other NDT techniques for improved material inspection. Journal of Nondestructive Evaluation, 2016, vol. 35, no. 1, article 18, 17 p. DOI: 10.1007/s10921-015-0331-7</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Marani R., Palumbo D., Reno V. Modeling and classification of defects in CFRP laminates by thermal non-destructive testing. Composites Part B: Engineering, 2018, no. 135, pp. 129–141. DOI: 10.1016/j.compositesb.2017.10.010</mixed-citation><mixed-citation xml:lang="en">Marani R., Palumbo D., Reno V. Modeling and classification of defects in CFRP laminates by thermal non-destructive testing. Composites Part B: Engineering, 2018, no. 135, pp. 129–141. DOI: 10.1016/j.compositesb.2017.10.010</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Hellstein P., Szwedo M. 3D thermography in non- destructive testing of composite structures. Measurement Science and Technology, 2016, vol. 27, no. 12, article id. 124006. DOI: 10.1088/0957-0233/27/12/124006</mixed-citation><mixed-citation xml:lang="en">Hellstein P., Szwedo M. 3D thermography in non- destructive testing of composite structures. Measurement Science and Technology, 2016, vol. 27, no. 12, article id. 124006. DOI: 10.1088/0957-0233/27/12/124006</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Vavilov V.P., Nesteruk D.A. Aktivnyj teplovoj kontrol' kompozicionnyh materialov s ispol'zovaniem nejronnyh setej [Active thermal testing of composite materials using neural networks]. Defektoskopiya [Defectoscopy], 2011, no. 10, pp. 10–18 (in Russian).</mixed-citation><mixed-citation xml:lang="en">Vavilov V.P., Nesteruk D.A. Aktivnyj teplovoj kontrol' kompozicionnyh materialov s ispol'zovaniem nejronnyh setej [Active thermal testing of composite materials using neural networks]. Defektoskopiya [Defectoscopy], 2011, no. 10, pp. 10–18 (in Russian).</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Saeed N., Omar M.A., Abdulrahman Y. A neural network approach for quantifying defects depth, for nondestructive testing thermograms. Infrared Physics &amp; Technology, 2018, no. 94, pp. 55–64. DOI: 10.1016/j.infrared.2018.08.022</mixed-citation><mixed-citation xml:lang="en">Saeed N., Omar M.A., Abdulrahman Y. A neural network approach for quantifying defects depth, for nondestructive testing thermograms. Infrared Physics &amp; Technology, 2018, no. 94, pp. 55–64. DOI: 10.1016/j.infrared.2018.08.022</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Chulkov A.O., Nesteruk D.A., Vavilov V.P. An Automated Algorithm for Constructing Maps of Defects in Active Thermal Testing. Russian Journal of Nondestructive Testing, 2019, vol. 55, pp. 617–621. DOI: 10.1134/S1061830919080035</mixed-citation><mixed-citation xml:lang="en">Chulkov A.O., Nesteruk D.A., Vavilov V.P. An Automated Algorithm for Constructing Maps of Defects in Active Thermal Testing. Russian Journal of Nondestructive Testing, 2019, vol. 55, pp. 617–621. DOI: 10.1134/S1061830919080035</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Vavilov V., Plesovskikh A., Chulkov A. A com- plex approach to the development of the method and equipment for thermal nondestructive testing of CFRP cylindrical parts. Composites Part B: Engineering, 2015, vol. 68, pp. 375–384. DOI: 10.1016/j.compositesb.2014.09.007</mixed-citation><mixed-citation xml:lang="en">Vavilov V., Plesovskikh A., Chulkov A. A com- plex approach to the development of the method and equipment for thermal nondestructive testing of CFRP cylindrical parts. Composites Part B: Engineering, 2015, vol. 68, pp. 375–384. DOI: 10.1016/j.compositesb.2014.09.007</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Ciampa F., Mahmoodi P., Pinto F., Meo М. Re- cent Advances in Active Infrared Thermography for Non- Destructive Testing of Aerospace Components. Sensors, 2018, vol. 18(2), article id. 609. DOI: 10.3390/s18020609</mixed-citation><mixed-citation xml:lang="en">Ciampa F., Mahmoodi P., Pinto F., Meo М. Re- cent Advances in Active Infrared Thermography for Non- Destructive Testing of Aerospace Components. Sensors, 2018, vol. 18(2), article id. 609. DOI: 10.3390/s18020609</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Momot A., Galagan R. Influence of architecture and training dataset parameters on the neural networks efficiency in thermal nondestructive testing. Sciences of Europe, 2019, no. 44, pp. 20–25.</mixed-citation><mixed-citation xml:lang="en">Momot A., Galagan R. Influence of architecture and training dataset parameters on the neural networks efficiency in thermal nondestructive testing. Sciences of Europe, 2019, no. 44, pp. 20–25.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Chulkov A.O. Analyzing efficiency of optical and THz infrared thermography in nondestructive testing of GFRPs by using the Tanimoto criterion. NDT &amp; E International, 2021, vol. 117, article id. 102383. DOI: 10.1016/j.ndteint.2020.102383</mixed-citation><mixed-citation xml:lang="en">Chulkov A.O. Analyzing efficiency of optical and THz infrared thermography in nondestructive testing of GFRPs by using the Tanimoto criterion. NDT &amp; E International, 2021, vol. 117, article id. 102383. DOI: 10.1016/j.ndteint.2020.102383</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
