Research on real-time image enhancement
Considering an imaging system under varying lighting conditions, the captured images or videos would be severely degraded due to the imbalance of image illumination. This challenging problem, in fact, exists in a wide range of imaging systems, from mobile and professional cameras, hyperspectral imaging to medical imaging.
(joint with Beijing University of Aeronautics and Astronautics (BUAA), China)
This is research in progress. Some related papers can be seen:
- Huang, J., Ruzhansky M., Wang, H. (2020). Weakly supervised learning photo enhancer with inexact training pairs.
- Huang, J., Wang, L., and Wang, H. (2019a). Intrinsic image transfer for illumination compensation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (on submission).
Deep/machine Learning for medical image analysis
(joint with North-Eastern Federal University, Yakutsk, Russia)
Every year approximately 500,000 women are diagnosed with cervical cancer (WHO, 2018). It is the second most common cancer among women (Ault, 2006) and is very deadly accounting for around 260,000 deaths worldwide (Ault, 2006) and being the leading cause of death by cancer among the female population of developing countries (Denny, 2019).
Mamaeva S.N., Kononova I.V., Ruzhansky M., Nikiforov P.V., Nikolaevа N.A., Pavlov A.N., Fedorova N.F., Huang J., Semenova M.N., Barashkova D.V., Frolova L.S., Maksimov G.V., Using Scanning Electron Microscopy and Atomic Force Microscopy to Study the Formation of Nanoparticles on Red Blood Cell Surface in Cervical Cancer Patients, International Journal of Biomedicine, 10(1): 70-75, 2020. link to the article
Image denoising and segmentation
In some situations, these microscope images may suffer from noise. In our case, “pepper” and “salt” noise and Gaussian noise occur frequently under the high magnification resolution imaging situations. In general, the size of the nanoparticles is around 10-50 pixels in 100,000X, and that of noise can be 3-5 pixels. In this case, it is always difficult to measure the size of nanoparticles with high accuracy. In order to reduce the interference of the noise, we introduce two denoising methods: median filter and L0-norm smoothing filter. The median filter is proved to be helpful to remove “pepper” and “salt” noise, while the L0-norm smoothing algorithm shows a strong ability in filtering out the noise as well as persevering the salient edges.
The median filter is very easy to implement. As shown in Figure (in the middle of first row), the “pepper” and “salt” noise are significantly suppressed in comparison of the original image. Moreover, in order to compute the size of nanoparticles more accurately, we introduce the L0-norm smoothing to boost the edges. Mathematically, this method is based on an optimization framework and can preserve the main edges of the nanoparticles while smoothing the local small gradients. The reader is referred to the algorithm (Huang J., Ruzhansky M. et al., 2019) for more details. Obviously, the original data (blue) has strong “pepper” and “salt” noise, and the median filter (red) can reduce some noise but the outline of the nanoparticles is still not clear, while these residual noise can be further reduced with L0-norm filter (yellow).
Some related applications can be seen here, for example, feature extraction algorithms for licence plates based on L0-pseudo-norm sparsity techniques:
Huang J., Ruzhansky M., Feng H., Zheng L., Huang X., Wang H., Feature extraction for license plate location based on L0-norm smoothing. Open Comput. Sci. 2019; 9:28-135. link (open access)
Deep learning for cell analysis
Machine learning (ML) in medical data analysis has drawn great attention in recent years. The rise of deep learning algorithms such as Convolutional Neural Networks (CNN) provides an interesting perspective for automatic medical image analysis. The question is:
“Can ML algorithms improve medical diagnosis?”
The answer is yes, yet, that will be a long journey of scientific exploration …