Federated Collaborative Graph Neural Networks for Few-shot Graph Classification (original) (raw)

References

  1. H. R. Yang, W. Ni. Continuous-time distributed heavy-ball algorithm for distributed convex optimization over undirected and directed graphs. Machine Intelligence Research, vol. 19, no. 1, pp. 75–88, 2022. DOI: https://doi.org/10.1007/s11633-022-1319-2.
    Article MathSciNet Google Scholar
  2. Y. Xie, Z. G. Qin, M. G. Gong, B. Yu, J. Y. Liang. Random deep graph matching. IEEE Transactions on Knowledge and Data Engineering, to be published. DOI: https://doi.org/10.1109/TKDE.2022.3221084.
  3. Z. Y. Zhao, Z. Yang, C. Li, Q. T. Zeng, W. L. Guan, M. C. Zhou. Dual feature interaction-based graph convolutional network. IEEE Transactions on Knowledge and Data Engineering, to be published. DOI: https://doi.org/10.1109/TKDE.2022.3220789.
  4. T. F. Zhao, W. N. Chen, X. X. Ma, X. K. Wu. Evolutionary computation in social propagation over complex networks: A survey. International Journal of Automation and Computing, vol. 18, no. 4, pp. 503–520, 2021. DOI: https://doi.org/10.1007/s11633-021-1302-3.
    Article Google Scholar
  5. Y. Xie, C. Chen, M. G. Gong, D. Y. Li, A. K. Qin. Graph embedding via multi-scale graph representations. Information Sciences, vol. 578, pp. 102–115, 2021. DOI: https://doi.org/10.1016/j.ins.2021.07.026.
    Article MathSciNet Google Scholar
  6. Y. Xie, Y. F. Liang, M. G. Gong, A. K. Qin, Y. S. Ong, T. T. He. Semisupervised graph neural networks for graph classification. IEEE Transactions on Cybernetics, to be published. DOI: https://doi.org/10.1109/TCYB.2022.3164696.
  7. K. T. Schutt, P. J. Kindermans, H. E. Sauceda, S. Chmiela, A. Tkatchenko, K. R. Muller. SchNet: A continuous-filter convolutional neural network for modeling quantum interactions. In Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, USA, pp. 992–1002, 2017.
    Google Scholar
  8. Y. P. Zheng, X. F. Zhang, S. Y. Chen, X. N. Zhang, X. F. Yang, D. Wang. When convolutional network meets temporal heterogeneous graphs: An effective community detection method. IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 2, pp. 2173–2178, 2023. DOI: https://doi.org/10.1109/TKDE.2021.3096122.
    Google Scholar
  9. M. Deshpande, M. Kuramochi, N. Wale, G. Karypis. Frequent substructure-based approaches for classifying chemical compounds. IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 8, pp. 1036–1050, 2005. DOI: https://doi.org/10.1109/TKDE.2005.127.
    Article Google Scholar
  10. J. Gilmer, S. S. Schoenholz, P. F. Riley, O. Vinyals, G. E. Dahl. Neural message passing for quantum chemistry. In Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia, pp. 1263–1272, 2017.
    Google Scholar
  11. X. L. Fan, M. G. Gong, Y. Wu, A. K. Qin, Y. Xie. Propagation enhanced neural message passing for graph representation learning. IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 2, pp. 1952–1964, 2023. DOI: https://doi.org/10.1109/TKDE.2021.3102964.
    Google Scholar
  12. Y. Xie, C. Y. Yao, M. G. Gong, C. Chen, A. K. Qin. Graph convolutional networks with multi-level coarsening for graph classification. Knowledge-Based Systems, vol. 194, Article number 105578, 2020. DOI: https://doi.org/10.1016/j.knosys.2020.105578.
  13. E. Alsentzer, S. G. Finlayson, M. M. Li, M. Zitnik. Subgraph neural networks. In Processing of the 34th Neural Information Processing Systems, 2020.
    Google Scholar
  14. K. Xu, W. H. Hu, J. Leskovec, S. Jegelka. How powerful are graph neural networks?. In Proceedings of the 7th International Conference on Learning Representations, New Orleans, USA, 2019.
    Google Scholar
  15. F. W. Chen, S. R. Pan, J. Jiang, H. Huo, G. D. Long. DAGcN: Dual attention graph convolutional networks. In Proceedings of International Joint Conference on Neural Networks, Budapest, Hungary, Article number N-19706, 2019. DOI: https://doi.org/10.1109/IJCNN.2019.8851698.
    Google Scholar
  16. Y. G. Wang, M. Li, Z. Ma, G. Montufar, X. S. Zhuang, Y. N. Fan. Haar graph pooling. In Proceedings of the 37th International Conference on Machine Learning, Article number 923, 2020.
    Google Scholar
  17. J. Baek, M. Kang, S. J. Hwang. Accurate learning of graph representations with graph multiset pooling. In Proceedings of the 9th International Conference on Learning Representations, 2021.
    Google Scholar
  18. Z. Y. Wang, S. W. Ji. Second-order pooling for graph neural networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 56, pp. 56870–6880, 2023. DOI: https://doi.org/10.1109/TPAMI.2020.2999032.
    Google Scholar
  19. K. X. Zhou, Q. Q. Song, X. Huang, D. C. Zha, N. Zou, X. Hu. Multi-channel graph neural networks. In Proceedings of the 29th International Joint Conference on Artificial Intelligence, Yokohama, Japan, pp. 1352–1358, 2020.
    Google Scholar
  20. E. Ranjan, S. Sanyal, P. P. Talukdar. ASAp: Adaptive structure aware pooling for learning hierarchical graph representations. In Proceedings of the 34th AAAI Conference on Artificial Intelligence, New York, USA, pp. 5470–5477, 2020. DOI: https://doi.org/10.1609/aaai.v34i04.5997.
    Google Scholar
  21. T. F. Ma, J. Chen. Unsupervised learning of graph hierarchical abstractions with differentiable coarsening and optimal transport. In Proceedings of the 35th AAAI Conference on Artificial Intelligence, pp. 8856–8864, 2021. DOI: https://doi.org/10.1609/aaai.v35i10.17072.
    Google Scholar
  22. A. Narayanan, M. Chandramohan, R. Venkatesan, L. Chen, Y. Liu, S. Jaiswal. graph2vec: Learning distributed representations of graphs. In Proceedings of the 13th International Workshop on Mining and Learning with Graphs, Halifax, Canada, 2017.
    Google Scholar
  23. Z. H. Wu, S. R. Pan, F. W. Chen, G. D. Long, C. Q. Zhang, P. S. Yu. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 1, pp. 4–24, 2021. DOI: https://doi.org/10.1109/TNNLS.2020.2978386.
    Article MathSciNet Google Scholar
  24. J. Chauhan, D. Nathani, M. Kaul. Few-shot learning on graphs via super-classes based on graph spectral measures. In Proceedings of the 8th International Conference on Learning Representations, Addis Ababa, Ethiopia, 2020.
    Google Scholar
  25. C. Yang, C. Liu, X. C. Yin. Weakly correlated knowledge integration for few-shot image classification. Machine Intelligence Research, vol. 19, no. 1, pp. 24–37, 2022. DOI: https://doi.org/10.1007/s11633-022-1320-9.
    Article Google Scholar
  26. K. Lee, S. Maji, A. Ravichandran, S. Soatto. Meta-learning with differentiable convex optimization. In Proceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, USA, pp. 10649–10657, 2019. DOI: https://doi.org/10.1109/CVPR.2019.01091.
    Google Scholar
  27. C. Finn, P. Abbeel, S. Levine. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia, pp. 1126–1135, 2017.
    Google Scholar
  28. Y. Liu, Y. Kang, C. P. Xing, T. J. Chen, Q. Yang. A secure federated transfer learning framework. IEEE Intelligent Systems, vol. 35, no. 4, pp. 70–82, 2020. DOI: https://doi.org/10.1109/MIS.2020.2988525.
    Article Google Scholar
  29. Q. Yang, A. B. Huang, L. X. Fan, C. S. Chan, J. H. Lim, K. W. Ng, D. S. Ong, B. W. Li. Federated learning with privacy-preserving and model IP-right-protection. Machine Intelligence Research, vol. 20, no. 1, pp. 19–37, 2023. DOI: https://doi.org/10.1007/s11633-022-1343-2.
    Article Google Scholar
  30. A. Giuseppi, S. Manfredi, A. Pietrabissa. A weighted average consensus approach for decentralized federated learning. Machine Intelligence Research, vol. 19, no. 4, pp. 319–330, 2022. DOI: https://doi.org/10.1007/s11633-022-1338-z.
    Article Google Scholar
  31. C. Zhang, Y. Xie, H. Bai, B. Yu, W. H. Li, Y. Gao. A survey on federated learning. Knowledge-Based Systems, vol. 216, Article number 106775, 2021. DOI: https://doi.org/10.1016/j.knosys.2021.106775.
  32. J. Snell, K. Swersky, R. Zemel. Prototypical networks for few-shot learning. In Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, USA, pp. 4080–4090, 2017.
    Google Scholar
  33. L. Bertinetto, J. F. Henriques, P. H. S. Torr, A. Vedaldi. Meta-learning with differentiable closed-form solvers. In Proceedings of the 7th International Conference on Learning Representations, New Orleans, USA, 2019.
    Google Scholar
  34. O. Vinyals, C. Blundell, T. Lillicrap, K. Kavukcuoglu, D. Wierstra. Matching networks for one shot learning. In Proceedings of the 30th International Conference on Neural Information Processing Systems, Barcelona, Spain, pp. 3637–3645, 2016.
    Google Scholar
  35. N. Ma, J. J. Bu, J. Y. Yang, Z. Zhang, C. W. Yao, Z. Yu, S. Zhou, X. F. Yan. Adaptive-step graph meta-learner for few-shot graph classification. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pp. 1055–1064, 2020. DOI: https://doi.org/10.1145/3340531.3411951.
    Chapter Google Scholar
  36. S. Y. Jiang, F. L. Feng, W. J. Chen, X. Li, X. N. He. Structure-enhanced meta-learning for few-shot graph classification. AI Open, vol. 2, pp. 160–167, 2021. DOI: https://doi.org/10.1016/j.ai-open.2021.08.001.
    Article Google Scholar
  37. Z. C. Guo, C. X. Zhang, W. H. Yu, J. Herr, O. Wiest, M. Jiang, N. V. Chawla. Few-shot graph learning for molecular property prediction. In Proceedings of the Web Conference, Ljubljana, Slovenia, pp. 2559–2567, 2021. DOI: https://doi.org/10.1145/3442381.3450112.
    Google Scholar
  38. B. McMahan, E. Moore, D. Ramage, S. Hampson, B. A. Y. Arcas. Communication-efficient learning of deep networks from decentralized data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, USA, pp. 1273–1282, 2017.
    Google Scholar
  39. C. He, K. Balasubramanian, E. Ceyani, C. Yang, H. Xie, L. Sun, L. He, L. Yang, P. S. Yu, Y. Rong, P. Zhao, J. Huang, M. Annavaram, S. Avestimehr. Fedgraphnn: A federated learning system and benchmark for graph neural networks. In Proceedings of the 11th International conference on Learning Representations, 2021.
    Google Scholar
  40. Y. Pei, R. Mao, Y. Liu, C. Chen, S. Xu, F. Qiang, B. E. Tech. Decentralized federated graph neural networks. In Proceedings of the 30th International Joint Conference on Artifícial Intelligence, 2021.
    Google Scholar
  41. C. He, E. Ceyani, K. Balasubramanian, M. Annavaram, S. Avestimehr. spreadGNN: Serverless multi-task federated learning for graph neural networks. In Proceedings of the 38th International Conference on Machine Learning, 2022.
    Google Scholar
  42. H. Xie, J. Ma, L. Xiong, C. Yang. Federated graph classification over non-IID graphs. In Proceedings of the 34th Neural Information Processing Systems, 2021.
    Google Scholar
  43. J. Weston, C. Watkins. Support vector machines for multi-class pattern recognition. In Proceedings of the 7th European Symposium on Artifícial Neural Networks, Bruges, Belgium, pp. 219–224, 1999.
    Google Scholar
  44. B. Amos, J. Z. Kolter. OptNet: Differentiable optimization as a layer in neural networks. In Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia, pp. 136–145, 2017.
    Google Scholar
  45. F. Nielsen. On a generalization of the Jensen-shannon divergence and the jensen–shannon centroid. Entropy, vol. 22, no. 2, Article number 221, 2020. DOI: https://doi.org/10.3390/e22020221.
  46. N. Wale, I. A. Watson, G. Karypis. Comparison of descriptor spaces for chemical compound retrieval and classification. Knowledge and Information Systems, vol. 14, no. 3, pp. 347–375, 2008. DOI: https://doi.org/10.1007/s10115-007-0103-5.
    Article Google Scholar
  47. K. Kersting, N. M. Kriege, C. Morris, P. Mutzel, M. Neumann. Benchmark data sets for graph kernels, [Online], Available: https://ls11-www.cs.tu-dortmund.de/staff/morris/graphkerneldatasets, 2016.
    Google Scholar
  48. X. N. Kong, W. Fan, P. S. Yu. Dual active feature and sample selection for graph classification. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, USA, pp. 654–662, 2011. DOI: https://doi.org/10.1145/2020408.2020511.
    Chapter Google Scholar
  49. J. B. Lee, R. Rossi, X. N. Kong. Graph classification using structural attention. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK, pp. 1666–1674, 2018. DOI: https://doi.org/10.1145/3219819.3219980.
    Chapter Google Scholar
  50. B. Knyazev, G. W. Taylor, M. R. Amer. Understanding attention and generalization in graph neural networks. In Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, Canada, Article number 378, 2019.
    Google Scholar
  51. M. Heimann, T. Safavi, D. Koutra. Distribution of node embeddings as multiresolution features for graphs. In Proceedings of IEEE International Conference on Data Mining, Beijing, China, pp. 289–298, 2019. DOI: https://doi.org/10.1109/ICDM.2019.00039.
    Google Scholar
  52. D. P. Kingma, J. Ba. Adam: A method for stochastic optimization. In Proceedings of the 3rd International Conference on Learning Representations, San Diego, USA, 2015.
    Google Scholar

Download references