Adaptive Meta Transfer Learning with Efficient Self-Attention for Few-Shot Bearing Fault Diagnosis (original) (raw)

References

  1. Xu Y, Li Z, Wang S et al (2021) A hybrid deep-learning model for fault diagnosis of rolling bearings. Measurement 169(6):108502
    Article Google Scholar
  2. Zhang Y, Xing K, Bai R et al (2020) An enhanced convolutional neural network for bearing fault diagnosis based on time–frequency image. Measurement 157(99):107667
    Article Google Scholar
  3. Guo C, Li L, Hu Y, et al. (2020) A deep learning based fault diagnosis method with hyperparameter optimization by using parallel computing IEEE. Access 8:131248–131256
    Article Google Scholar
  4. Tz A, Jc A, Fl A , et al. (2021) Intelligent fault diagnosis of machines with small & imbalanced data: a state-of-the-art review and possible extensions - ScienceDirect ISA Transactions
  5. 葛轶洲,刘恒,王言,等.小样本困境下的深度学习图像识别综述[J]. 软件学报, 2022, 33(1):18.
  6. Wen Q, Sun L, Song X, et al. (2020) Time series data augmentation for deep learning: A survey[J]. arXiv preprint arXiv:2002.12478
  7. Weiss K, Khoshgoftaar TM, Wang DD (2016) A survey of transfer learning. J Big Data 3(1):1–40
    Article Google Scholar
  8. Huisman M, Rijn J, Plaat A (2021) A survey of deep meta-learning. Artif Intel Rev 54:4483
    Article Google Scholar
  9. Tianhao H, Tang T, Ronglai L et al (2020) A simple data augmentation algorithm and a self-adaptive convolutional architecture for few-shot fault diagnosis under different working conditions. Measurement 156:107539
    Article Google Scholar
  10. Shao S, Wang P, Yan R (2019) Generative adversarial networks for data augmentation in machine fault diagnosis. Comput Ind 106:85–93
    Article Google Scholar
  11. Kingma D P, Welling M (2014) Auto-encoding variational bayes arXiv.org
  12. Fu Q, Wang H (2020) A novel deep learning system with data augmentation for machine fault diagnosis from vibration signals. Appl Sci 10(17):5765. https://doi.org/10.3390/app10175765
    Article Google Scholar
  13. Yin H, Li Z, Zuo J et al (2020) Wasserstein generative adversarial network and convolutional neural network (WG-CNN) for bearing fault diagnosis. Math Probl Eng 2020(6):1–16
    Google Scholar
  14. Zhang H, Goodfellow I, Metaxas D, et al. (2018) Self-attention generative adversarial networks. International conference on machine learning, pp 7354–7363
  15. Li C, Zhang S, Qin Y et al (2020) A systematic review of deep transfer learning for machinery fault diagnosis. Neurocomputing 407:121
    Article Google Scholar
  16. Zhuang F, Qi Z, Duan K, et al. (2019) A comprehensive survey on transfer learning. Proc IEEE 109(1):43–76
    Article Google Scholar
  17. Han T, Liu C, Yang W, et al. (2018) Deep transfer network with joint distribution adaptation: a new intelligent fault diagnosis framework for industry application. ISA Trans 97:269–281
    Article Google Scholar
  18. Lu N, Xiao H, Sun Y et al (2020) A new method for intelligent fault diagnosis of machines based on unsupervised domain adaptation. Neurocomputing 427:96
    Article Google Scholar
  19. Jie Wu, Tang T, Chen M, Wang Yi, Wang K (2020) A study on adaptation lightweight architecture based deep learning models for bearing fault diagnosis under varying working conditions. Expert Syst Appl 160:113710
    Article Google Scholar
  20. Shen J, Qu Y, Zhang W, et al. (2017) Wasserstein distance guided representation learning for domain adaptation arXiv.org
  21. Cheng CA, Bz A, Gmb C et al (2020) Wasserstein distance based deep adversarial transfer learning for intelligent fault diagnosis with unlabeled or insufficient labeled data. Neurocomputing 409:35–45
    Article Google Scholar
  22. Peng XA, Bt A, Lei DA et al (2020) Multi-block domain adaptation with central moment discrepancy for fault diagnosis. Measurement 169:108516
    Google Scholar
  23. Guo L, Lei Y, Xing S et al (2019) Deep convolutional transfer learning network: a new method for intelligent fault diagnosis of machines with unlabeled data. IEEE Trans Industr Electron 66(9):7316–7325
    Article Google Scholar
  24. Zhang M, Wang D, Lu W et al (2019) A deep transfer model with wasserstein distance guided multi-adversarial networks for bearing fault diagnosis under different working conditions IEEE. IEEE Access 7:65303
    Article Google Scholar
  25. Mahmud MMH and Ray SR (2008) Transfer learning using kolmogorov complexity: basic theory and empirical evaluations, In Proceedings of the 20th Annual Conference on Neural Information Processing Systems Cambridge, MA: MIT Press, pp 985–992
  26. Lemke, Christiane, Gabrys, et al. (2015) Metalearning: a survey of trends and technologies. Artif Intel Rev 44(1):117–130
  27. Jadon S (2020) An overview of deep learning architectures in few-shot learning domain. arXiv e-prints, arXiv: 2008.06365
  28. Koch G, Zemel R, Salakhutdinov R Siamese neural networks for one-shot image recognition. arXiv e-prints, arXiv: 2008.06365
  29. Snell J, Swersky K, Zemel R (2017) Prototypical networks for few-shot learning Adv Neural Inf Process Syst 4078–4088
  30. Vinyals O, Blundell C, Lillicrap T, Kavukcuoglu K, Wierstra D (2016) Matching networks for one shot learning Adv Neural Inf Process Syst pp 3637–3645
  31. Sung F, Yang Y, Zhang L, Xiang T, Torr PHS, Hospedales TM (2018) Learning to compare: relation network for few-shot learning In: Proc IEEE Comput Soc Conf Comput Vis Pattern Recognit 2018, pp 1199–1208
  32. Dan I. Image classification using transfer learning from siamese networks based on text metadata similarity. Stanford University, pp 1–13
  33. Zhang A, Li S, Cui Y, et al. (2019) Limited Data Rolling Bearing Fault Diagnosis With Few-Shot Learning IEEE. Access 7:110895–110904
    Article Google Scholar
  34. Feng Y, Chen J, Zhang T, et al. (2021) Semi-supervised meta-learning networks with squeeze-and-excitation attention for few-shot fault diagnosis. ISA Trans 120:383–401
    Article Google Scholar
  35. Wu J, Zhao Z, Sun C et al (2020) Few-shot transfer learning for intelligent fault diagnosis of machine. Measurement 166:108202
    Article Google Scholar
  36. Rusu AA, Rao D, Sygnowski J, Vinyals O, Pascanu R, Osindero S, and Hadsell R (2019) Meta-learning with latent embedding optimization, In International Conference on Learning Representations (ICLR)
  37. Finn C, Abbeel P, Levine S (2017) Model-agnostic meta-learning for fast adaptation of deep networks, 34th Int Conf Mach Learn ICML 2017 (3) 1856–1868
  38. Li C, Li S, Zhang A et al (2021) Meta-learning for few-shot bearing fault diagnosis under complex working conditions. Neurocomputing 439:197
    Article Google Scholar
  39. Yong FA, Jc A, Zy A et al (2021) Similarity-based meta-learning network with adversarial domain adaptation for cross-domain fault identification - sciencedirect. Knowl Based Syst 217:106829
    Article Google Scholar
  40. Sun Q ru, et al. (2019) Meta-transfer learning for few-shot learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 403–412
  41. Guo MH, Xu TX, Liu JJ, et al. (2021) Attention mechanisms in computer vision: a survey. Computational Visual Media, pp 1–38
  42. Xiao Z, Xu X, Xing H et al (2021) RTFN: a robust temporal feature network for time series classification information sciences. Info Sci 571:65–86
    Article Google Scholar
  43. Chen J , Xing H , Xiao Z , et al.(2021) A DRL agent for jointly optimizing computation offloading and resource allocation in MEC IEEE Int Things J PP(99):1–1
  44. Wang Q, Wu B, Zhu P, et al. (2020) ECA-Net: efficient channel attention for deep convolutional neural networks[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) IEEE
  45. Wei Z, Peng G, Li C et al (2017) A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors 17(3):425
    Google Scholar

Download references