High-performance Migration Tool for Live Container in a Workflow (original) (raw)

Abstract

As a lightweight virtualization solution, container technology can provide resource-limiting capabilities and can run multiple isolated process sets under a single kernel instance. Multitenant preemption leads to competition in computing, storage, and network resources, resulting in degraded computing service performance. Virtualization service migration can provide a solution to the problem of resource shortage in supercomputing systems. However, the resource overhead and delay in the migration process also reduce the efficiency of high-performance computers. To solve this problem, this dissertation designs a migration tool. Firstly, this dissertation proposes a method of container migration. Secondly, this dissertation optimizes the startup of containers from checkpoints and proposes a multicontainer migration strategy, reducing the migration time by 30% compared to sequential migration. The migration method in this paper provides valuable experience for service migration in supercomputers and data centers.

Access this article

Log in via an institution

Subscribe and save

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ansel, J., Arya, K., Cooperman, G.: DMTCP: transparent checkpointing for cluster computations and the desktop. In: 2009 IEEE International Symposium on Parallel and Distributed Processing. IEEE 1–12 (2009)
  2. Banga, G., Druschel, P., Mogul, J.C.: Resource containers: a new facility for resource management in server systems. OSDI. 99: 45–58 (1999)
  3. Barak, A., La’adan, O.: The MOSIX multicomputer operating system for high performance cluster computing. Futur. Gener. Comput. Syst. 13(4–5), 361–372 (1998)
    Article Google Scholar
  4. Bhattiprolu, S., Biederman, E.W., Hallyn, S., et al.: Virtual servers and checkpoint/restart in mainstream Linux. ACM SIGOPS Oper. Syst. Rev. 42(5), 104–113 (2008)
    Article Google Scholar
  5. Clark, J.: Google:’EVERYTHING at Google runs in a container’[OL]. https://www.theregister.co.uk/2014/05/23/google\\\_containerization\\\_two\\\_billion
  6. Docker[OL]. https://docs.docker.com/get-started/overview/
  7. Douglis, F., Ousterhout, J.: Transparent process migration: design alternatives and the Sprite implementation. Softw.: Pract. Exp. 21(8), 757–785 (1991)
    Google Scholar
  8. Duell, J.: The Design and Implementation of Berkeley Lab’s Linux Checkpoint/Restart. Lawrence Berkeley National Laboratory (2005)
  9. Hargrove, P.H., Duell, J.C.: Berkeley lab checkpoint/restart (BLCR) for Linux clusters. J. Phys. Conf. 46, 494–499 (2006)
    Article Google Scholar
  10. Jul, E., Levy, H., Hutchinson, N., et al.: Fine-grained mobility in the Emerald system. ACM Trans. Comput. Syst. 6(1), 109–133 (1988)
    Article Google Scholar
  11. Kamp, P.H., Watson, R.N.M.: Jails: Confining the omnipotent root. In: Proceedings of the 2nd International SANE Conference 43: 116 (2000)
  12. Kotikalapudi, S.V.N.: Comparing live migration between linux containers and kernel virtual machine: investigation study in terms of parameters (2017)
  13. MacCarty, B.: SELinux-NSA’s open source security enhanced linux: beating the o-day vulnerability threat (2005)
  14. Menage, P.B.: Adding generic process containers to the linux kernel. In: Proceedings of the Linux Symposium, vol. 2, pp. 45–57 (2007)
  15. Morris, J., Smalley, S., Kroah-Hartman, G.: Linux security modules: general security support for the linux kernel. In: USENIX Security Symposium, pp. 17–31. ACM, Berkeley, CA (2002)
  16. Nagar, S., Franke, H., Choi, J., et al.: Class-based prioritized resource control in Linux. In: 2003 Linux Symposium (2003)
  17. Pickartz, S., Eiling, N., Lankes, S., et al.: Migrating LinuX containers using CRIU. In: IEEE International Conference on High Performance Computing, Data, and Analytics, pp. 674–684 (2016)
  18. Pike, R., Presotto, D., Thompson, K., et al.: The use of name spaces in Plan 9. Oper. Syst. Rev. 27(2), 72–76 (1993)
    Article Google Scholar
  19. Powell, M.L., Miller, B.P.: Process migration in DEMOS/MP. ACM SIGOPS Oper. Syst. Rev. 17(5), 110–119 (1983)
    Article Google Scholar
  20. Vasyukov, A., Beklemysheva, K.: Using CRIU with HPC containers field experience. Int. J. Eng. Comput. Sci. 7(07), 24106–24108 (2018)
    Google Scholar

Download references

Funding

This work was supported by National Program on Key Research Project (No.2018YFB0204400), by NSFC (No.61702484 and No.61972380), by CASSPRP (XDB24050200), by CCF-Baidu Open Fund (CCF-BAIDU OF2020015), by Youth Innovation Promotion Association of Chinese Academy of Sciences (No.2021099), by State Grid Corporation of China Headquarters Project (5700-202158261A-0-0-00).

Author information

Authors and Affiliations

  1. University of Chinese Academy of Sciences, Beijing, China
    Zhanyuan Di, En Shao & Guangming Tan
  2. State Key Laboratory of Computer Architecture, Institute of Computing Technology, CAS, Beijing, China
    Zhanyuan Di, En Shao & Guangming Tan

Authors

  1. Zhanyuan Di
  2. En Shao
  3. Guangming Tan

Corresponding author

Correspondence toEn Shao.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

About this article

Cite this article

Di, Z., Shao, E. & Tan, G. High-performance Migration Tool for Live Container in a Workflow.Int J Parallel Prog 49, 658–670 (2021). https://doi.org/10.1007/s10766-021-00697-z

Download citation

Keywords