Next Article in Journal
Effect of Nanohydroxyapatite on Silk Fibroin–Chitosan Interactions—Molecular Dynamics Study
Next Article in Special Issue
A Baseline Drift-Elimination Algorithm for Strain Measurement-System Signals Based on the Transformer Model
Previous Article in Journal
The Neotectonic Deformation of the Eastern Rif Foreland (Morocco): New Insights from Morphostructural Analysis
Previous Article in Special Issue
WordBlitz: An Efficient Hard-Label Textual Adversarial Attack Method Jointly Leveraging Adversarial Transferability and Word Importance
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Denoising of Wrapped Phase in Digital Speckle Shearography Based on Convolutional Neural Network

College of Aerospace Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2024, 14(10), 4135; https://doi.org/10.3390/app14104135
Submission received: 8 March 2024 / Revised: 3 May 2024 / Accepted: 9 May 2024 / Published: 13 May 2024

Abstract

:
Speckle-shearing technology is widely used in defect detection due to its high precision and non-contact characteristics. However, the wrapped-phase recording defect information is often accompanied by a lot of speckle noise, which affects the evaluation of defect information. To solve the problems of traditional denoising algorithms in suppressing speckle noise and preserving the texture features of wrapped phases, this study proposes a speckle denoising algorithm called a speckle denoising convolutional neural network (SDCNN). The proposed method reduces the loss of texture information and the blurring of details in the denoising process by optimizing the loss function. Different from the previous simple assumption that the speckle noise is multiplicative, this study proposes a more realistic wrapped image-simulation method, which has better training results. Compared with representative algorithms such as BM3D, SDCNN can handle a wider range of speckle noise and has a better denoising effect. Simulated and real speckle-noise images are used to evaluate the denoising effect of SDCNN. The results show that SDCNN can effectively reduce the speckle noise of the speckle-shear wrapping phase and retain better texture details.

1. Introduction

Material safety stands as a crucial factor for ensuring aircraft structural integrity. Therefore, the detection and assessment of material defects to ensure they remain within critical limits are of paramount importance. This underscores the significance of employing a highly precise and versatile inspection method. To ensure the dependable performance of structures, non-destructive testing (NDT) is increasingly being employed. Among the various NDT techniques, digital speckle interferometry has emerged as an indispensable approach due to its universal applicability, ease of implementation, and exceptional accuracy. Speckle interference techniques encompass digital speckle-pattern interferometry (DSPI) [1,2,3,4] and digital speckle-shearing pattern interferometry (DSSPI) [5,6,7,8,9]. DSPI excels in accurate displacement measurement but necessitates a more controlled environment and may result in fuzzier detection of defect edges. In contrast, DSSPI is less sensitive to displacement and requires lower levels of vibration isolation. However, shear misalignment may introduce fuzziness or loss of information around certain defect edges. Consequently, a denoising process becomes essential to obtain clear defect edges.
Numerous related algorithms have been proposed for speckle-noise reduction [10,11,12,13,14,15,16,17]. While non-local mean filtering algorithms, such as NLM [10] and OBNLM [11], effectively reduce noise, they exhibit high computational complexity and tend to compromise texture detail preservation. Three-dimensional block-matching algorithms like BM3D [12] excel at denoising, with good detail preservation, but face challenges with complex structures. The wavelet thresholding method [13] introduces boundary blurring during denoising, accompanied by the challenges of threshold adjustment and increased computational complexity. The windowed Fourier transform (WTF) [14] has demonstrated efficacy in denoising wrapped phases, albeit requiring substantial adjustments and processing time. The sine/cosine average filter (SCAF) [15] is introduced to address speckle noise by separate denoising of the numerator and denominator of the arctangent, effectively resolving the phase 2π discontinuity and noise issues.
As neural networks progress, more study is focused on speckle-noise reduction. In Reference [16], CNNs are used to denoise DSPI fringe maps in batches, effectively reducing medium-level noise in fringes but potentially causing slight edge blurring. Reference [17], based on DnCNN [18], proposed a method for the speckle suppression of digital holography, which is effective for noise reduction of stripes with different noise levels, but it is not good for edge recovery of stripes. Reference [19] proposed a DBDNet based on dilated blocks, which effectively recovers DSPI-striped images with high noise levels. In Reference [20], a lightweight residual dense neural network, LRDUNet, is proposed for ESPI stripe noise reduction based on U-Net. While effective in noise reduction, a single model is tasked with handling stripe maps of varying noise levels.
To denoise the wrapped phase, this study introduces a processing approach for denoising interferograms acquired through DSSPI. To address the issues of noise and boundary blurring within the wrapped phase, we propose a deep-learning technique for denoising the sine and cosine fringes. Subsequently, the denoised sine and cosine fringes are processed using the arctangent function to obtain an improved wrapped phase. Simulation and experimental results demonstrate the effectiveness of this method in successfully suppressing speckle noise and eliminating the boundary blurring associated with defects.

2. Theoretical Analysis and Proposed CNN Denoiser

2.1. Related Theoretical Model of DSSPI

In this study, the Wollaston shearing system is used as an example to introduce DSSPI. As shown in Figure 1, a helium–neon laser is irradiated on the object surface after beam expansion, and the scattered field emitted from the diffuse reflective object surface is imaged by the Wollaston shearing system (object surface-shearing imaging). The intensity of the sheared scattered field is recorded by the CCD and stored in the computer.
For single-beam laser irradiation, assume that I o 1 and I o 2 are the intensity of the speckle fields corresponding to the two points O 1 x 0 , y 0 and O 2 x 0 + Δ x , y 0 + Δ y on the object surface recorded at one point on the CCD, which can be expressed as
I o 1 x , y = A 1 exp i φ 1 x , y ,
I o 2 x , y = A 2 exp i φ 2 x , y ,
where A 1 and A 2 are the beam amplitudes corresponding to I o 1 x , y , I o 2 x , y respectively, and φ 1 x , y and φ 2 x , y are the initial phases of the two speckle fields. Before the deformation of the object, the intensity recorded on the CCD can be written as
I 1 x , y = I o 1 x , y + I o 2 x , y 2 = I o 1 x , y + I o 2 x , y + 2 I o 1 x , y I o 2 x , y cos Δ φ x , y ,
where Δ φ x , y = φ 2 x , y φ 1 x , y , denotes the initial phase difference. The intensity distribution of the speckle field after the object is deformed by the load can be expressed as
I 2 x , y = I o 1 x , y + I o 2 x , y + 2 I o 1 x , y I o 2 x , y cos Δ φ x , y + Δ δ x , y ,
where Δ δ x , y = δ 2 x , y δ 1 x , y . δ 1 x , y and δ 2 x , y are the deformation phases of the two speckle fields, and Δ δ x , y denotes the deformation phase difference. The intensity distributions before and after the deformation are subtracted and squared to obtain the speckle fringe pattern, which can be expressed as
E x , y = I 2 x , y I 1 x , y 2 = 8 I o 1 x , y I o 2 x , y sin 2 Δ φ x , y + Δ δ x , y 2 1 cos Δ δ x , y
By Equations (3)–(5), the speckle fringe patterns are obtained by the four-step phase-shift method [1] with phase shifts of 3 α , α , α , and 3 α .
E i x , y = A x , y + B x , y cos Δ δ x , y + 2 i 5 α ,   i = 1 , 2 , 3 , 4
The phase distribution of the object deformation is obtained by Equations (7) and (8).
Δ δ x , y = arctan tan β x , y I 2 x , y I 3 x , y + I 1 x , y I 4 x , y I 2 x , y + I 3 x , y I 1 x , y + I 4 x , y ,
β x , y = arctan 3 I 2 x , y I 3 x , y I 1 x , y I 4 x , y I 2 x , y I 3 x , y + I 1 x , y I 4 x , y ,
The phase distribution can be further derived so that
Δ δ ( x , y ) = arctan S 0 ( x , y ) C 0 ( x , y ) ,
where S 0 ( x , y ) is sine fringe patterns, C 0 ( x , y ) is cosine fringe patterns. Δ δ ( x , y ) is the wrapped phase containing speckle noise, which is distributed in (−π/2, π/2].

2.2. Proposed CNN Denoiser

2.2.1. Network Architecture

CNN has been successful in processing various visual tasks and has demonstrated effective performance in handling Gaussian denoising. In this work, SDCNN for denoising the wrapped phase is based on FFDNet [21]. The deeper neural network architecture is illustrated in Figure 2. SDCNN consists of a series of 3 × 3 convolution layers. Each layer is composed of three types of operations: convolution (Conv), batch normalization (BN), and rectified linear units (ReLU). More specifically, “Conv + ReLU” is adopted for the first convolution layer, “Conv + BN + ReLU” for the middle layers, and “Conv” for the last convolution layer. The noisy S N 0 and C N 0 fringe patterns are, respectively, reshaped into four sub-images, which are then input into the 32-layer CNN together with the noise-level map. The final output is reconstructed by the four denoised sub-images.

2.2.2. Loss Function

To better deal with the case of wrapped-phase boundary blurring, this work uses smooth L 1 to replace the L 2 loss function. The L 2 loss function typically results in a significant loss of texture details when dealing with speckle maps. On the contrary, the denoising model based on the L 1 loss function can obtain an image with relatively clearer edges. The L 1 loss function calculates the average distance between the denoised image f x and its corresponding noise-free image y . The definition and gradient calculation equations are as follows
L 1 = i = 1 N f x i y i / N ,
L 1 d = 1 , d > 0 1 , d < 0 ,
where x i is the block of the input, x , y i is the block of the corresponding position of the real value y, and d = f x i y i . From Equations (10) and (11), for any input other than d = 0 , the absolute value of the gradient is the same. The increased stability of the gradient suggests its resilience to outliers and reduced likelihood of gradient explosions.. However, when the d value is very small, the absolute value of the gradient is still one, and the model convergence is difficult. In addition, the non-differentiability of L 1 at d = 0 is also a shortcoming that cannot be ignored. Therefore, this paper uses the smooth L 1 [22] loss function. The definition of the loss function and its gradient calculation equations are as follows
smooth L 1 d = 0.5 e 2 , i f e < 1 e 0.5 otherwise ,
smooth L 1 d d = d , i f d < 1 ± 1 , otherwise ,
In Equations (12) and (13), the smooth L 1 loss function retains the advantage that L 1 is not easy to gradient explosions and can be derived at any point. Meanwhile, when the d value is small, the corresponding gradient value is also small enough. Therefore, without increasing the complexity of the model and affecting the real-time performance, a low-cost solution is proposed; smooth L 1 is used to replace the traditional L 1 and L 2 as the loss function. Based on this, the trained denoising model can better preserve the image details while denoising and reduce the loss of edge information.

2.2.3. Dataset Generation and Network Training

The establishment of the database is necessary to train the model. Combining Equations (1)–(6) for data simulation, the undeformed intensity I 1 can be generated by Equation (3). The amplitude A is set as a random variable distributed within (0, 1], and the initial phase difference Δ φ is set as a random variable uniformly distributed within (−π, π]. Similarly, after the object deformation, the deformed intensity I 2 can also be simulated by Equation (4), where the phase φ of the object beam is changed into Δ φ + Δ δ . The deformation of I 2 is controlled by expanding Equation (2) and varying it according to Equation (14).
  φ 2 x , y = φ 1 x , y + λ × ( 1 + cos Q × Z , Z = 3 ( 1 x ) 2 × exp x 2 × y + 1 2 10 × x 5 x 3 y 5 × exp x 2 y 2 1 3 × exp x + 1 2 y 2
where the laser wavelength λ = 632 . 8   nm , Q denotes the angle of light incidence relative to the object surface, and Z symbolizes a three-dimensional surface subject to deformation through adjustments in its value, thereby altering the object surface. By manipulating the value of Z, such adjustments involve adding or removing various terms and modifying coefficients. Figure 3 illustrates the wrapped phase resulting from distinct deformations.
In addition, assume that the incident laser is perpendicular to the object surface and the surface is sheared along the x direction. The relationship between the deformation phase, the derivative of the out-of-plane displacement along the x direction, and the phase-shift shear is shown in Equation (15).
Δ δ = 4 π λ × G x , y x × Δ S
G x , y = 600 × 1 2 π σ 2 exp ( x ε ) 2 + ( y ε ) 2 2 σ 2
where G x , y / x is the derivative of the out-of-plane displacement in the x direction by adjusting the Gaussian function with the different mean values (from 1 to 80) and standard deviations (from 1 to 80) shown in Equation (15) to simulate the pixel displacement. The wrapped phase produced by different shears Δ S (from 20 to 60) is shown in Figure 4.
FFDNET introduces different noise-level maps to make the denoising model adapt to different noise levels. In order to make the model adapt to different levels of speckle noise, this paper proposes a new wrapped-phase map generation method based on the characteristics of speckle noise. A clean wrapped-phase diagram is obtained from Equations (1)–(9), and wrapped-phase maps with different noise levels are obtained from Equations (17)–(19).
Δ δ ( x , y ) N = Δ δ ( x , y ) × I G + I N
I G x ; k , θ = x k 1 e x θ Γ k θ k
I N x ; σ = 1 σ 2 π exp x 2 2 σ 2
where I G is a random variable whose value conforms to gamma distribution. k denotes the shape parameter, with the default value of 1. θ is the inverse scale parameter of the distribution. The larger the value, the lower the visibility of the wrapped-phase fringe. In this paper, θ is used to adjust the noise level of the training image, θ = 0.5 to 4. I N is a random variable whose value obeys the Gaussian distribution and σ is the variance. The greater the value, the greater the noise, σ = 25 to 100.

3. Experiments

In this study, we conducted simulation experiments using an NVIDIA RTX 1080 Ti GPU (NVIDIA, Santa Clara, CA, USA) with 11 GB of memory and implemented the Python 3.6 programming language. The neural network was trained and tested using PyTorch 0.4.1. Our training dataset consists of 21,847 speckle-wrapped phase images with different shear amounts and different 3D deformations, each with a size of 480 × 480 pixels. During SDCNN training, we employ a chunking strategy to divide the images into 32 × 32 pixels. Finally, the training effect is verified using 100 random images generated in the same way. Furthermore, we utilize both PSNR (Peak Signal-to-Noise Ratio), SSIM (Structural SIMilarity) and RMSE (Root Mean Square Error), to holistically evaluate the denoising effectiveness.

3.1. Influence of the Input Noise Level

In this section, we evaluate the sensitivity of SDCNN by varying the input noise levels while maintaining a constant simulated ground level of noise. In practical applications, accurately estimating the noise-level map from observed noise can be challenging, often resulting in a mismatch between the estimated input and the actual noise levels. When the input noise level is lower than the real noise level, complete noise removal becomes unfeasible. Consequently, users typically opt for higher noise levels to enhance noise reduction, although this may inadvertently lead to the removal of some image details along with the noise. In real-world scenarios, it is essential for denoising models to exhibit tolerance towards such mismatches in noise levels. To address this, we utilized Equation (16) to train the model by adjusting parameters θ and σ and enabling control over the input noise level. The testing results of this training are presented in Table 1, offering the following key observations.
The testing results of this training are presented in Table 1. Various trained models, each with a distinct input noise level (e.g., ‘SDCNN-1-25’ signifying SDCNN with a fixed input noise level of 1–25), are assessed using simulated images characterized by noise levels ranging from 0.5–0 to 4–100. The multiplicative noise coefficient of the input noise image was determined, and different additive noise coefficients were applied during training. The sensitivity of the trained models to additive noise is evaluated using a variety of noise speckle images. The results reveal that SDCNN exhibits robust adaptability to denoise different additive noise speckle images. Similarly, when the multiplicative coefficient is set to one, SDCNN produces better results in reducing noise and maintaining structural similarity.

3.2. Influence of the Loss Function

Furthermore, in order to evaluate the effectiveness of the SmoothL1 loss function in denoising and detail preservation, a comparative analysis of the model performance based on the two loss functions, SMELoss and SmoothL1Loss, is presented in Figure 5 and Figure 6.
The comparative results indicate that the SMELoss model, overall, exhibits slightly lower denoising effectiveness than the SmoothL1Loss model. However, as the input noise level increases, the difference between the two becomes negligible, particularly when the noise level reaches 60. Furthermore, the SMELoss model notably lags behind the SmoothL1Loss model in preserving image details, a trend that persists even at higher input noise levels.

3.3. The Denoising Effect on Simulated Images

In order to test the training effect of the model more fully, this paper proposes a method to generate wrapped phases with different noise intensities. This work first performs low-pass filtering on the two speckle fields of Equations (1) and (2) by adjusting the aperture size in the 4f system [2], and the filtered speckle field intensity can be expressed as
I 1 , 2 = F 1 f ( d ) × F A exp i φ 1 , 2
where F represents the Fourier transform, F 1 represents the inverse Fourier transform, f ( k 1 , k 2 ) represents a low-pass filter. The speckle fringes (480 × 480 pixels) with the different aperture sizes generate different speckle sizes, where the smaller selected aperture produces a larger speckle size.
In addition, to evaluate the denoising performance of SDCNN on wrapped phases generated by apertures of different sizes, we conducted tests on 100 images and compared the results with the algorithms OBNLM, BM3D, and DNCNN. The test comparison results are illustrated in Figure 6; the test data is presented in Table 2.
Figure 7 and Table 2 reveal that SDCNN significantly outperforms OBNLM, BM3D, and DNCNN in terms of denoising efficacy and the preservation of intricate details in speckle-corrupted maps. This phenomenon clearly demonstrates the strong generalization ability of SDCNN for effectively balancing noise reduction and detail preservation.
An illustrative example, depicting the test results presented in Figure 8, reveals that SDCNN significantly outperforms OBNLM, BM3D, and DNCNN in terms of denoising efficacy and the preservation of intricate details in speckle-corrupted images.
The enlarged details, highlighted by the red border in the image, provide compelling evidence of this superiority. In Figure 8b, OBNLM performs well in denoising at lower noise levels, but its effectiveness diminishes significantly when the noise intensity is higher. In Figure 8c, BM3D demonstrates relative effectiveness in speckle-noise reduction while excelling at preserving fine details. However, the BM3D algorithm performs filtering in the transform domain, resulting in the appearance of pseudo-texture artifacts in the denoised images, which can affect the accuracy of phase unwrapping in the denoised images. Conversely, in Figure 8d, DNCNN achieves remarkable denoising effects but introduces noticeable boundary blurring, impacting visual quality. As evident from Figure 8e, images processed by SDCNN not only attain outstanding denoising results but also exhibit clearer edges and textures, preserving a greater amount of image detail.

3.4. The Denoising Effect on Experimental Data

To demonstrate the denoising effect of the model in structural damage detection, data were obtained using the digital speckle-shear interferometry system shown in Figure 1 to validate the performance. The experimental setup depicted in Figure 9 utilizes a 120 mm diameter circular plate made of 6061 aluminum alloy, with a thickness measuring 4 mm. Furthermore, coherent light from a helium–neon laser, characterized by a wavelength of 632.8 nm, is employed.
In Figure 10, the contour pattern obtained by the four-step phase-shifting method is shown. In addition, since there is no ground-truth image for a real noisy image, visual comparison is employed to evaluate the performance of SDCNN. We choose the BM3D and DNCNN method for comparison because it is widely accepted as a benchmark for denoising applications.
Figure 11 compares the denoising results of BM3D, DNCNN, and SDCNN on wrapped-phase maps. Visually, all three methods, BM3D, DNCNN, and SDCNN, effectively remove a significant amount of speckle noise. BM3D and DNCNN show comparable denoising results, but they are slightly outperformed by SDCNN. Regarding detail preservation, the red border in the lower right corner of the image demonstrates the effects on details. BM3D and DNCNN reduce noise but may introduce blurring in details, potentially impacting subsequent phase unwrapping. Figure 12a,b demonstrates the phase unwrapping effect of BM3D and DNCNN, from which the boundary blurring caused by poor noise reduction can be clearly seen. In contrast, SDCNN not only removes noise but also keeps important details intact, avoids interference between fringes, and shows better generalization abilities. Figure 12c shows the effect of phase unwrapping after noise reduction, and the unwrapping is significantly smoother and clearer.
Figure 13 provides additional insight into the denoising capabilities of SDCNN on a series of authentic experimental maps. The visual results are notably effective. From Figure 13b, it is obvious that the SDCNN presents good results in both stripe preservation and noise-reduction effects, while Figure 13c unpacks the phase of the parcels after noise reduction. The unpacked phase information can be more intuitively seen in Figure 13d.

4. Conclusions

In this study, we introduce a CNN model, called SDCNN, with the aim of achieving a balance between speckle-noise reduction and boundary preservation in the context of defect detection using speckle-shear interferometry. To realize this objective, we incorporate various techniques during the network’s design and training phase, including cosine regularization, a more realistic speckle-noise simulation approach, and the application of a specific loss function. Based on the results obtained from four-step phase-shifting simulated images, SDCNN demonstrates outstanding performance not only when the input noise levels match the actual speckle noise but also in effectively harmonizing denoising and detail preservation in the wrapped phase. Furthermore, through a comprehensive analysis of experimental results pertaining to the wrapped phase, we observe that SDCNN also performs favorably in handling real-world speckle-noise scenarios. Consequently, SDCNN provides valuable insights and a practical tool for future research in wrapped-phase denoising.

Author Contributions

Conceptualization, H.Z.; Methodology, H.Z.; Software, H.Z.; Validation, H.Z.; Formal Analysis, H.Z.; Investigation, H.Z.; Resources, H.Z.; Data Curation, H.Z.; Writing—Original Draft Preparation, H.Z.; Writing—Review and Editing: H.Z., D.H. and K.W.; Visualization, H.Z.; Supervision, H.Z.; Project Administration, H.Z.; Funding Acquisition: K.W. and H.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The original contributions presented in the study are included in the article material, further inquiries can be directed to the corresponding author/s.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Butters, J.N.; Leendertz, J.A. Speckle Pattern and Holographic Techniques in Engineering Metrology. Opt. Laser Technol. 1971, 3, 26–30. [Google Scholar] [CrossRef]
  2. Gu, G.; Wang, K.; Zhou, K.; Xu, X. Accurate Measurement of Composite Laminates Deflection Using Digital Speckle Pattern Interferometry. Optik 2013, 124, 4117–4119. [Google Scholar] [CrossRef]
  3. Wang, K.F. Boundary Detection of Internal Defect Based on Discontinuity of Second-Order Gradient of out-of-Plane Displacement in Phase-Shifting Digital Speckle Pattern Interferometry. NDT E Int. 2014, 61, 71–74. [Google Scholar] [CrossRef]
  4. Loukil, M.S.; Varna, J.; Ayadi, Z. Damage Characterization in Glass Fiber/Epoxy Laminates Using Electronic Speckle Pattern Interferometry: Damage Characterization in Laminates Using ESPI. Exp. Tech. 2015, 39, 38–45. [Google Scholar] [CrossRef]
  5. Nakadate, S.; Yatagai, T.; Saito, H. Digital Speckle-Pattern Shearing Interferometry. Appl. Opt. 1980, 19, 4241–4246. [Google Scholar] [CrossRef] [PubMed]
  6. Hung, Y.Y. Digital Shearography versus TV-Holography for Non-Destructive Evaluation. Opt. Lasers Eng. 1997, 26, 421–436. [Google Scholar] [CrossRef]
  7. Leendertz, J.A.; Butters, J.N. An Image-Shearing Speckle-Pattern Interferometer for Measuring Bending Moments. J. Phys. E 1973, 6, 1107–1110. [Google Scholar] [CrossRef]
  8. Liu, Z.; Gao, J.; Xie, H.; Wallace, P. NDT Capability of Digital Shearography for Different Materials. Opt. Lasers Eng. 2011, 49, 1462–1469. [Google Scholar] [CrossRef]
  9. Liu, B.; Guo, X.; Qi, G.; Zhang, D. Quality Evaluation of Rubber-to-Metal Bonded Structures Based on Shearography. Sci. China Phys. Mech. Astron. 2015, 58, 1–8. [Google Scholar] [CrossRef]
  10. Uzan, A.; Rivenson, Y.; Stern, A. Speckle Denoising in Digital Holography by Nonlocal Means Filtering. Appl. Opt. 2013, 52, A195–A200. [Google Scholar] [CrossRef] [PubMed]
  11. Zhou, Y.; Zang, H.; Xu, S.; He, H.; Lu, J.; Fang, H. An Iterative Speckle Filtering Algorithm for Ultrasound Images Based on Bayesian Nonlocal Means Filter Model. Biomed. Signal Process. Control 2019, 48, 104–117. [Google Scholar] [CrossRef]
  12. Dabov, K.; Foi, A.; Katkovnik, V.; Egiazarian, K. Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering. IEEE Trans. Image Process. 2007, 16, 2080–2095. [Google Scholar] [CrossRef] [PubMed]
  13. Nasri, M.; Nezamabadi-pour, H. Image Denoising in the Wavelet Domain Using a New Adaptive Thresholding Function. Neurocomputing 2009, 72, 1012–1025. [Google Scholar] [CrossRef]
  14. Ning, X.; Li, W.; Wu, S.; Dong, M.; Zhu, L. Fast Phase Denoising Using Stationary Wavelet Transform in Speckle Pattern Interferometry. Meas. Sci. Technol. 2020, 31, 025205. [Google Scholar] [CrossRef]
  15. Aebischer, H.A.; Waldner, S. A Simple and Effective Method for Filtering Speckle-Interferometric Phase Fringe Patterns. Opt. Commun. 1999, 162, 205–210. [Google Scholar] [CrossRef]
  16. Hao, F.; Tang, C.; Xu, M.; Lei, Z. Batch Denoising of ESPI Fringe Patterns Based on Convolutional Neural Network. Appl. Opt. 2019, 58, 3338–3346. [Google Scholar] [CrossRef] [PubMed]
  17. Yan, K.; Chang, L.; Andrianakis, M.; Tornari, V.; Yu, Y. Deep Learning-Based Wrapped Phase Denoising Method for Application in Digital Holographic Speckle Pattern Interferometry. Appl. Sci. 2020, 10, 4044. [Google Scholar] [CrossRef]
  18. Zhang, K.; Zuo, W.; Chen, Y.; Meng, D.; Zhang, L. Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising. IEEE Trans. Image Process. 2017, 26, 3142–3155. [Google Scholar] [CrossRef] [PubMed]
  19. Li, J.; Tang, C.; Xu, M.; Fan, Z.; Lei, Z. DBDNet for Denoising in ESPI Wrapped Phase Patterns with High Density and High Speckle Noise. Appl. Opt. 2021, 60, 10070–10079. [Google Scholar] [CrossRef] [PubMed]
  20. Gurrola-Ramos, J.; Dalmau, O.; Alarcón, T. U-Net Based Neural Network for Fringe Pattern Denoising. Opt. Lasers Eng. 2022, 149, 106829. [Google Scholar] [CrossRef]
  21. Zhang, K.; Zuo, W.; Zhang, L. FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising. IEEE Trans. Image Process. 2018, 27, 4608–4622. [Google Scholar] [CrossRef]
  22. Meyer, G.P. An Alternative Probabilistic Interpretation of the Huber Loss. In Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 20–25 June 2021; pp. 5257–5265. [Google Scholar] [CrossRef]
Figure 1. Digital speckle-shearing interferometry system.
Figure 1. Digital speckle-shearing interferometry system.
Applsci 14 04135 g001
Figure 2. The architecture of the proposed network for image denoising.
Figure 2. The architecture of the proposed network for image denoising.
Applsci 14 04135 g002
Figure 3. The wrapped phase produced by different deformations.
Figure 3. The wrapped phase produced by different deformations.
Applsci 14 04135 g003
Figure 4. The wrapped phase produced by different shear amounts.
Figure 4. The wrapped phase produced by different shear amounts.
Applsci 14 04135 g004
Figure 5. PSNR comparison between two loss functions on different input noise levels.
Figure 5. PSNR comparison between two loss functions on different input noise levels.
Applsci 14 04135 g005
Figure 6. SSIM and RMSE comparison between two loss functions on different input noise levels.
Figure 6. SSIM and RMSE comparison between two loss functions on different input noise levels.
Applsci 14 04135 g006
Figure 7. Denoising results on the wrapped phase of different aperture simulations: (a) noise image; (b) denoising result of OBNLM; (c) denoising result of BM3D; (d) denoising result of DNCNN; and (e) denoising result of SDCNN.
Figure 7. Denoising results on the wrapped phase of different aperture simulations: (a) noise image; (b) denoising result of OBNLM; (c) denoising result of BM3D; (d) denoising result of DNCNN; and (e) denoising result of SDCNN.
Applsci 14 04135 g007
Figure 8. Denoising results on images from the test dataset with different noise levels by different methods: (a) noise maps with different noise levels; (b) denoising results of OBNLM; (c) denoising results of BM3D; (d) denoising results of DNCNN; and (e) denoising results of SDCNN.
Figure 8. Denoising results on images from the test dataset with different noise levels by different methods: (a) noise maps with different noise levels; (b) denoising results of OBNLM; (c) denoising results of BM3D; (d) denoising results of DNCNN; and (e) denoising results of SDCNN.
Applsci 14 04135 g008
Figure 9. Digital speckle-shear interferogram: (a) speckle-pattern image before deformation; (b) speckle-pattern image after deformation.
Figure 9. Digital speckle-shear interferogram: (a) speckle-pattern image before deformation; (b) speckle-pattern image after deformation.
Applsci 14 04135 g009
Figure 10. Experimental speckle-pattern image: (a) fringe pattern with phase shift 3 α ; (b) fringe pattern with phase shift α ; (c) fringe pattern with phase shift α ; and (d) fringe pattern with phase shift 3 α .
Figure 10. Experimental speckle-pattern image: (a) fringe pattern with phase shift 3 α ; (b) fringe pattern with phase shift α ; (c) fringe pattern with phase shift α ; and (d) fringe pattern with phase shift 3 α .
Applsci 14 04135 g010
Figure 11. Denoising results on experimental speckle-pattern map: (a) noise map; (b) denoising result of BM3D; (c) denoising result of DNCNN; and (d) denoising result of SDCNN.
Figure 11. Denoising results on experimental speckle-pattern map: (a) noise map; (b) denoising result of BM3D; (c) denoising result of DNCNN; and (d) denoising result of SDCNN.
Applsci 14 04135 g011
Figure 12. The unwrapped phase of Figure 11: (a) the unwrapped phase of BM3D; (b) the unwrapped phase of DNCNN; and (c) the unwrapped phase of SDCNN.
Figure 12. The unwrapped phase of Figure 11: (a) the unwrapped phase of BM3D; (b) the unwrapped phase of DNCNN; and (c) the unwrapped phase of SDCNN.
Applsci 14 04135 g012
Figure 13. Experiment results: (a) experimental wrapped-phase noise maps; (b) denoising result of (a) by SDCNN; (c) the unwrapped phase of (b); and (d) contour map of (c).
Figure 13. Experiment results: (a) experimental wrapped-phase noise maps; (b) denoising result of (a) by SDCNN; (c) the unwrapped phase of (b); and (d) contour map of (c).
Applsci 14 04135 g013
Table 1. The average PSNR(dB), SSIM, and RMSE results of SDCNN on simulated noise images with different noise level combinations θ = 0.5 , 1 , 2 , 4 and σ = 10 , 50 , 90 .
Table 1. The average PSNR(dB), SSIM, and RMSE results of SDCNN on simulated noise images with different noise level combinations θ = 0.5 , 1 , 2 , 4 and σ = 10 , 50 , 90 .
Additive Coefficient σ = 10 σ = 50 σ = 90
Multiplicative Noise coefficient θ = 0.5
Model- θ - σ PSNRSSIMRMSEPSNRSSIMRMSEPSNRSSIMRMSE
SDCNN-0.5-2522.730.9160.07320.960.850.08911.990.2820.251
SDCNN-0.5-5023.870.8920.06422.30.8680.07717.420.6580.135
SDCNN-0.5-7520.960.8470.08922.40.8990.07618.480.7240.119
SDCNN-0.5-10016.710.7880.14622.060.8640.07918.790.7660.115
Multiplicative Noise coefficient θ = 1
Model- θ - σ PSNRSSIMRMSEPSNRSSIMRMSEPSNRSSIMRMSE
SDCNN-1-2524.640.8960.05923.160.8670.06918.360.6650.121
SDCNN-1-5025.250.920.05423.580.8680.06619.290.750.108
SDCNN-1-7524.60.8980.05923.750.880.06520.910.850.09
SDCNN-1-10024.220.9020.06124.130.8990.06222.930.8770.071
Multiplicative Noise coefficient θ = 2
Model- θ - σ PSNRSSIMRMSEPSNRSSIMRMSEPSNRSSIMRMSE
SDCNN-2-2525.010.9180.05620.340.8510.09616.370.610.152
SDCNN-2-5022.040.8650.07923.170.8810.06917.140.6430.139
SDCNN-2-7520.880.8870.0923.40.8940.06820.740.8090.092
SDCNN-2-10019.350.8310.10823.080.8460.0720.540.8180.094
Multiplicative Noise coefficient θ = 4
Model- θ - σ PSNRSSIMRMSEPSNRSSIMRMSEPSNRSSIMRMSE
SDCNN-4-2524.30.9070.06117.020.6860.14112.940.3720.226
SDCNN-4-5021.430.8910.08520.870.8070.0914.370.4150.191
SDCNN-4-7522.740.8480.07317.430.7070.13413.680.3710.207
SDCNN-4-10021.160.7950.08719.190.7320.1116.580.5830.148
Table 2. The average PSNR(dB), SSIM, and results RMSE of different methods on simulated noise images with different noise level combinations θ = 1 and σ = 0 , 25 , 50 , 75 , 100 .
Table 2. The average PSNR(dB), SSIM, and results RMSE of different methods on simulated noise images with different noise level combinations θ = 1 and σ = 0 , 25 , 50 , 75 , 100 .
MethodsNoise LevelPSNR (dB)SSIMRMSETime (s)
OBNLM25200.760.185
5018.840650.1180.6
7517.630.560.1379.63
10016.680.490.1575.6
BM3D25250.970.13289
5023.070.950.30290
7521.80.940.26287
10021.460.930.18292
DNCNN2524.410.8950.060.01
5023.500.8640.070.01
7522.530.870.070.01
10021.840.8660.080.01
SDCNN2525.880.890.050.01
5024.780.920.060.01
7523.640.880.060.01
10022.160.890.070.01
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, H.; Huang, D.; Wang, K. Denoising of Wrapped Phase in Digital Speckle Shearography Based on Convolutional Neural Network. Appl. Sci. 2024, 14, 4135. https://doi.org/10.3390/app14104135

AMA Style

Zhang H, Huang D, Wang K. Denoising of Wrapped Phase in Digital Speckle Shearography Based on Convolutional Neural Network. Applied Sciences. 2024; 14(10):4135. https://doi.org/10.3390/app14104135

Chicago/Turabian Style

Zhang, Hao, Dawei Huang, and Kaifu Wang. 2024. "Denoising of Wrapped Phase in Digital Speckle Shearography Based on Convolutional Neural Network" Applied Sciences 14, no. 10: 4135. https://doi.org/10.3390/app14104135

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop