Analyzing Online Videos to Create a List of User Interface Elements: A Case for OpenCrane Design System (original) (raw)

Abstract

One of the first steps in developing a design system is to make a list of user interface (UI) elements, which is usually done by reviewing existing graphical user interfaces (GUIs). Doing so can be difficult depending on the context, since designers may not have access to a sufficient number of different GUIs. This paper presents a complementary method for creating a list of UI elements and the context is an ongoing work of developing a design system for remote rubber-tired gantry (RTG) cranes. We analyzed online videos published by the crane manufacturers that fully or partially show the crane GUIs. We included 11 online videos published by three crane manufacturers that met our selection criteria. The analysis of the online videos resulted in 29 UI elements. To evaluate the feasibility of this method, we compared the results with 27 UI elements elicited from a field study at a port that employed remote RTG cranes. The comparison shows that there is a significant overlap between the two sets of UI elements, but also some differences. This suggests that the two methods can complement each other instead of being alternatives. Regarding the order, we recommend conducting a field study first to obtain the necessary domain knowledge to better understand the content of online videos.

Similar content being viewed by others

References

  1. ABB Marine: www.youtube.com/c/abbmarineandports/videos. Accessed 15 Dec 2022
  2. Alho, T., Pettersson, T., Haapa-Aho, M.: The path to automation in an RTG terminal (2018). https://www.kalmarglobal.com/4948ad/globalassets/equipment/rtg-cranes/kalmar-whitepaper-autortg. Accessed 25 Apr 2023
  3. Anthony, L., Kim, Y., Findlater, L.: Analyzing user-generated YouTube videos to understand touchscreen use by people with motor impairments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’13, pp. 1223-1232. ACM, New York (2013). https://doi.org/10.1145/2470654.2466158
  4. Brown, B., Laurier, E.: The trouble with autopilots: Assisted and autonomous driving on the social road. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI ’17, pp. 416-429. ACM, New York (2017). https://doi.org/10.1145/3025453.3025462
  5. Edelberg, J., Kilrain, J.: Design systems: consistency, efficiency & collaboration in creating digital products. In: Proceedings of the 38th ACM International Conference on Design of Communication, SIGDOC ’20, ACM, New York (2020). https://doi.org/10.1145/3380851.3416743
  6. Fusaro, V.A., et al.: The potential of accelerating early detection of autism through content analysis of YouTube videos. PLoS ONE 9(4), 1–6 (2014). https://doi.org/10.1371/journal.pone.0093533
    Article Google Scholar
  7. Giglietto, F., Rossi, L., Bennato, D.: The open laboratory: limits and possibilities of using Facebook, Twitter, and YouTube as a research data source. J. Technol. Hum. Serv. 30(3–4), 145–159 (2012). https://doi.org/10.1080/15228835.2012.743797
    Article Google Scholar
  8. Johanson, F.: How remote can ‘remote’ be? (2015). https://new.abb.com/docs/librariesprovider102/default-document-library/how-remote-can-remote-be.pdf?sfvrsn=2. Accessed 25 Apr 2023
  9. Kalmar: Be in complete control: the new Kalmar remote console. https://www.kalmarglobal.com/491403/globalassets/media/216100/216100_RC-desk-flyer-web.pdf. Accessed 25 Apr 2023
  10. Kalmar Global: www.youtube.com/user/KalmarGlobal/videos. Accessed 15 Dec 2022
  11. Karvonen, H., Koskinen, H., Haggrén, J.: Enhancing the user experience of the crane operator: comparing work demands in two operational settings. In: Proceedings of the 30th European Conference on Cognitive Ergonomics, ECCE ’12, pp. 37-44. ACM, New York (2012). https://doi.org/10.1145/2448136.2448144
  12. Konecranes: https://www.youtube.com/c/konecranes/videos. Accessed 15 Dec 2022
  13. Konecranes: The yard revolution: Automated RTG (2013). https://www.konecranes.com/sites/default/files/download/konecranes_artg_brochure_final_0.pdf. Accessed 25 Apr 2023
  14. Konecranes: Automated container handling references (2015). https://www.konecranes.com/sites/default/files/download/konecraners_references_automated_systems_global_en_2015_0.pdf. Accessed 25 Apr 2023
  15. Nielsen, J.: Coordinating User Interfaces for Consistency. Morgan Kaufmann Publishers, San Francisco (1989)
    Google Scholar
  16. Pace, S.: Citizens on YoutTube: research-method issues. In: Silva, C.N. (ed.) Online Research Methods in Urban and Planning Studies: Design and Outcomes, chap. 15, pp. 249–261. Information Science Reference, Hershey (2012). https://doi.org/10.4018/978-1-4666-0074-4.ch015
  17. Sitompul, T.A.: The impacts of different work locations and levels of automation on crane operators’ experiences: a study in a container terminal in Indonesia. In: Proceedings of the 34th Australian Conference on Human-Computer Interaction, OzCHI ’22, pp. 193-198. ACM, New York (2023). https://doi.org/10.1145/3572921.3572941
  18. Sitompul, T.A., Wallmyr, M.: Analyzing online videos: a complement to field studies in remote locations. In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) Human-Computer Interaction - INTERACT 2019. Lecture Notes in Computer Science(), vol. 11748, pp. 371–389. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29387-1_21
    Chapter Google Scholar
  19. Statista: Hours of video uploaded to YouTube every minute as of February 2022 (2022). https://www.statista.com/statistics/259477/hours-of-video-uploaded-to-youtube-every-minute/. Accessed 26 Apr 2023
  20. Thomas, S.L., Bestman, A., Pitt, H., Deans, E., Randle, M.J.: The marketing of wagering on social media: an analysis of promotional content on YouTube, Twitter and Facebook. Technical report, Victorian Responsible Gambling Foundation, Melbourne, Australia (2015). https://ro.uow.edu.au/cgi/viewcontent.cgi?article=1694 &context=ahsri
  21. Vesselov, S., Davis, T.: Building Design Systems: Unify User Experiences through a Shared Design Language. Apress, New York (2019). https://doi.org/10.1007/978-1-4842-4514-9
  22. Wallmyr, M.: Exploring heavy vehicle interaction interaction design studies of industrial vehicle operators’ information awareness using mixed reality. Ph.D. thesis, Mälardalen University (2020). http://urn.kb.se/resolve?urn=urn%3Anbn%3Ase%3Amdh%3Adiva-52409
  23. Wortmeier, A.K., Calepso, A.S., Kropp, C., Sedlmair, M., Weiskopf, D.: Configuring augmented reality users: analysing YouTube commercials to understand industry expectations. Behav. Inf. Technol. 46, 1–16 (2023). https://doi.org/10.1080/0144929X.2022.2163693
    Article Google Scholar

Download references

Acknowledgments

This research received funding from the Department of Design at NTNU, NTNU Discovery, and the SFI AutoShip Centre (the Research Council of Norway under project number 309230). The authors would also like to thank the port management for giving permission to conduct the field study and the crane operators for the information that they provided.

Author information

Authors and Affiliations

  1. Department of Design, Norwegian University of Science and Technology (NTNU), Trondheim, Norway
    Taufik Akbar Sitompul, Jooyoung Park & Ole Andreas Alsos

Authors

  1. Taufik Akbar Sitompul
  2. Jooyoung Park
  3. Ole Andreas Alsos

Corresponding author

Correspondence toTaufik Akbar Sitompul .

Editor information

Editors and Affiliations

  1. University of York, York, UK
    Anna Bramwell-Dicks
  2. University of York, York, UK
    Abigail Evans
  3. Université Côte d‘Azur, Sophia Antipolis, France
    Marco Winckler
  4. University of York, York, UK
    Helen Petrie
  5. University of West London, London, UK
    José Abdelnour-Nocera

Rights and permissions

© 2024 IFIP International Federation for Information Processing

About this paper

Cite this paper

Sitompul, T.A., Park, J., Alsos, O.A. (2024). Analyzing Online Videos to Create a List of User Interface Elements: A Case for OpenCrane Design System. In: Bramwell-Dicks, A., Evans, A., Winckler, M., Petrie, H., Abdelnour-Nocera, J. (eds) Design for Equality and Justice. INTERACT 2023. Lecture Notes in Computer Science, vol 14535. Springer, Cham. https://doi.org/10.1007/978-3-031-61688-4\_30

Download citation

Keywords

Publish with us