Deepfake: An Overview (original) (raw)

Abstract

Recent advancements in digital technologies have significantly increased the quality and capability to produce realistic images and videos using highly advanced computer graphics and AI algorithms due to which it becomes difficult to distinguish between the real media and fake media. These computer-generated images or videos have useful applications in real life; however, these can also lead to various threats related to privacy and security. Deepfake is one of the ways which can lead to these threats. Term “Deepfake” is combination of two terms “deep learning” and “fake." Using deepfake, anyone can replace or mask someone else face on another person's face in an image or a video. Not only this, deepfake can change the original voice and facial expressions also in an image or a video. Nowadays, deepfake uses techniques like deep learning and AI to replace the original face, voice, or expressions. It is very hard for a human to detect that the content has been manipulated by deepfake techniques. This paper has attempted to introduce this concept of deepfake and has also discussed different types of deepfakes. The paper has also discussed methods to create and detect deepfake. The motivation behind this paper is to make the society aware about the deepfake tricks along with the treats offered by it.

Similar content being viewed by others

References

  1. Farid H (2009) A survey of image forgery detection. IEEE Signal Process Mag 26(2):25–26
    Article Google Scholar
  2. Redi JA, Taktak W, Dugelay J-L (2011) Digital image forensics: a booklet for beginners. Multimedia Tools Appl 51(1):133–162
    Article Google Scholar
  3. Julliand T, Nozick V, Talbot H (2015) Image noise and digital image forensics. In: 14th International workshop on digital-forensics and watermarking (IWDW 2015). vol 9569. Tokyo, Japan, October 2015 pp 3–17
    Google Scholar
  4. Suwajanakorn S, Seitz SM, Kemelmacher-Shlizerman I (2017) Synthesizing Obama: learning lip sync from audio. ACM Trans Graph 36(4):Article 95
    Google Scholar
  5. Kietzmann J, Lee LW, McCarthy IP, Kietzmann TC (2017) Deepfake: trick or treat. Elsevier 63(2):1–12
    Google Scholar
  6. Guera D, Delp EJ, “Deepfake video detection using recurrent neural networks”, 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) ,1–6, 2018.
    Google Scholar
  7. Laptev I, Marszalek M, Schmid C, Rozenfeld B (2008) Learning realistic human actions from movies. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1–8, June
    Google Scholar
  8. Li Y, Chang MC, Lyu S (2018) Exposing AI created fake videos by detecting eye blinking. In: IEEE International workshop on information forensics and security (WIFS), pp 1–7
    Google Scholar
  9. Hinton GE, Krizhevsky A, Wang SD (2011) Transforming auto-encoders. In: International conference on artificial neural networks (ICANN). Springer, pp 44–51
    Google Scholar
  10. Sabour S, Frosst N, Hinton GE (2017) Dynamic routing between capsules. In: Proceedings of conference on neural information processing systems (NIPS), pp 1–11
    Google Scholar
  11. Hinton GE, Sabour S, Frosst N (2018) Matrix capsules with EM routing. In: International conference on learning representations workshop (ICLRW). pp 1–15
    Google Scholar
  12. Iesmantas T, Alzbutas R (2018) Convolutional capsule network for classification of breast cancer histology images. In: International conference image analysis and recognition ( ICIAR). Springer, pp 853–860
    Google Scholar
  13. Yang M, Zhao W, Ye J, Lei Z, Zhao Z, Zhang S (2018) Investigating capsule networks with dynamic routing for text classification. In: Conference on empirical methods in natural language processing (EMNLP), pp 3110–3119
    Google Scholar
  14. Nguyen HH, Yamagishi J, Echizen I (2019) Capsule forensics: using capsule networks to detect forged images and videos. In: International conference on acoustics, speech and signal processing (ICASSP), IEEE, pp 2307–2311
    Google Scholar
  15. Rahmouni N, Nozick V, Yamagishi J, Echizen I (2017) Distinguishing computer graphics from natural images using convolution neural networks. In: International workshop on information forensics and security (WIFS), IEEE, pp 1–11
    Google Scholar
  16. Nguyen HH, Tieu N-DT, Nguyen-Son H-Q, Nozick V, Yamagishi J, Echizen I (2018) Modular convolutional neural network for discriminating between computer-generated images and photographic images. In: International conference on availability, reliability and security (ARES). ACM, pp 1–10
    Google Scholar
  17. R¨ossler A, Cozzolino D, Verdoliva L, Riess C, Thies J, Nießner M, (2018) Face forensics: a large-scale video dataset for forgery detection in human faces. pp 1–21. arXiv preprint arXiv:1803.09179
  18. R¨ossler A, Cozzolino D, Verdoliva L, Riess C, Thies J, Nießner M (2019) Face forensics++: learning to detect manipulated facial images. In: International conference on computer vision (ICCV). IEEE, pp 1–11
    Google Scholar
  19. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations (ICLR), pp 1–14
    Google Scholar
  20. Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M, Berg AC, Fei-Fei L (2015) ImageNet large scale visual recognition challenge. Int J Comput Vision 115:211–252
    Article MathSciNet Google Scholar
  21. Guera D, Wang Y, Bondi L, Bestagini P, Tubaro S, Delp EJ (2017) A counter-forensic method for CNN-based camera model identification. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 1840–1847
    Google Scholar
  22. Conotter V, Bodnari E, Boato G, Farid H (2014) Physiologically-based detection of computer generated faces in video. In: Proceedings of the IEEE international conference on image processing. pp 248–252
    Google Scholar
  23. Wang W, Farid H (2007) Exposing digital forgeries in interlaced and deinterlaced video. IEEE Trans Inf Forensics Secur 2(3):1–15
    Article Google Scholar
  24. Thies J, Zollhofer M, Stamminger M, Theobalt C, Nießner M (2016) Face2Face: real-time face capture and reenactment of rgb videos. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 2387– 2395
    Google Scholar
  25. Averbuch-Elor H, Cohen-Or D, Kopf J, Cohen MF (2017) Bringing portraits to life. ACM Trans Graph 36(6):196:1–196:13
    Google Scholar
  26. Antipov G, Baccouche M, Dugelay J-L (2017) Face aging with conditional generative adversarial networks. arXiv:1702.01983. 1–5 (2017)
  27. Lu Y, Tai Y-W, Tang C-K (2017) Conditional cyclegan for attribute guided face image generation. arXiv:1705.09966 1–16 (2017)

Download references

Author information

Authors and Affiliations

  1. MRIIRS, Faridabad, Haryana, India
    Anupama Chadha, Vaibhav Kumar, Sonu Kashyap & Mayank Gupta

Authors

  1. Anupama Chadha
    You can also search for this author inPubMed Google Scholar
  2. Vaibhav Kumar
    You can also search for this author inPubMed Google Scholar
  3. Sonu Kashyap
    You can also search for this author inPubMed Google Scholar
  4. Mayank Gupta
    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toAnupama Chadha .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, ABES Engineering College, Ghaziabad, India
    Pradeep Kumar Singh
  2. Institute of Computer Science, Polish Academy of Sciences, Warsaw, Poland
    Sławomir T. Wierzchoń
  3. Department of Computer Science and Engineering, Institute of Technology, Nirma University, Ahmedabad, Gujarat, India
    Sudeep Tanwar
  4. Faculty of Mathematics and Information Science, Warsaw University of Technology, Warsaw, Poland
    Maria Ganzha
  5. Instituto de Telecomunicações, Federal University of Piauí (UFPI), Teresina, Piauí, Brazil
    Joel J. P. C. Rodrigues

Rights and permissions

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Chadha, A., Kumar, V., Kashyap, S., Gupta, M. (2021). Deepfake: An Overview. In: Singh, P.K., Wierzchoń, S.T., Tanwar, S., Ganzha, M., Rodrigues, J.J.P.C. (eds) Proceedings of Second International Conference on Computing, Communications, and Cyber-Security. Lecture Notes in Networks and Systems, vol 203. Springer, Singapore. https://doi.org/10.1007/978-981-16-0733-2\_39

Download citation

Publish with us