Understanding Simple Stories through Concepts Extraction and Multimedia Elements (original) (raw)

Abstract

Teaching children with intellectual disabilities is a challenging task. Instructors use different methodologies and techniques to introduce the concepts of lessons to the children, motivate them and keep them engaged. These methodologies include reading texts, showing pictures and images, touching items, taking children to sites to see and understand, and even using the taste and smell senses (i.e., hot, cold). The objective of this work is to develop a system that can assist the children with special needs to improve their understanding of simple stories related to the animals and foods domain through multimedia technology. We use formal concepts analysis and a simple ontology to extract the keywords representing characters, actions, and objects from the story text and link them with the corresponding multimedia elements (i.e., images, sounds and clips). These elements are retrieved by querying Google database using Google APIs features. The instructors would have to validate the obtained results and select what is appropriate for the children in the classroom. The system allows the instructor to input the story text and get as output the multimedia story.

Preview

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Alja’am, J.M., Jaoua, A.M., Hasnah, A.M., Hassan, F., Mohamed, H., Mosaid, T., Saleh, H., Abdullah, F., Hassan, C.: Text Summarization based on Conceptual Data Classification. In: Alkhatib, G., Rine, D.D. (eds.) Agent Technologies and Web Engineering: Applications and Systems, pp. 195–209. IGI Global (2008)
    Google Scholar
  2. Elsaddik, A.: Interactive Multimedia Learning. Springer (2001)
    Google Scholar
  3. Evans, D.G., Bowick, L., Johnson, M., Blenkhorn, P.: Using Iconicity to Evaluate Symbol Use. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2006. LNCS, vol. 4061, pp. 874–881. Springer, Heidelberg (2006)
    Chapter Google Scholar
  4. Ganter, B., Wille, R.: Formal Concept Analysis. Springer (1999)
    Google Scholar
  5. Google Ajax Language APIs, http://code.google.com/apis/ajaxlanguage/
  6. Gunther, S., Ströhlein, T.: Relations and Graphs. Springer (1989)
    Google Scholar
  7. Jaoua, A.: Pseudo-Conceptual Text and Web Structuring. In: The Third Conceptual Structures Tool Interoperability Workshop, CS-TIW 2008, pp. 22–32 (2008)
    Google Scholar
  8. Miguel, A.G.R., El-Seoud, S.A., Edwards, A., Alja’am, J.M., Raul, A.S.: Integrating the Sense of Smell in an Educational Human-Computer Interface. In: International Conference on Interactive Collaborative Learning, ICL 2008, pp. 1–7 (2008)
    Google Scholar
  9. Nickull, D., Reitman, L., Ward, J., Wilber, J.: Service Oriented Architecture (SOA) and Specialized Messaging Patterns. Technical White Paper, pp. 1–15, (2007), http://www.adobe.com/enterprise/pdfs/Services_Oriented_Architecture_from_Adobe.pdf

Download references

Author information

Authors and Affiliations

  1. College of Engineering Department of Computer Science and Engineering, Qatar University, Doha, Qatar, P.O. Box 2713
    Masoud Udi Mwinyi, Sahar Ahmad Ismail, Jihad M. Alja’am & Ali M. Jaoua

Authors

  1. Masoud Udi Mwinyi
  2. Sahar Ahmad Ismail
  3. Jihad M. Alja’am
  4. Ali M. Jaoua

Editor information

Editors and Affiliations

  1. Department of Software Engineering, Faculty of Engineering, Lakehead University, 955 Oliver Rd., P7B 5E1, Thunder Bay, Ontario, Canada
    Rachid Benlamri

Rights and permissions

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mwinyi, M.U., Ismail, S.A., Alja’am, J.M., Jaoua, A.M. (2012). Understanding Simple Stories through Concepts Extraction and Multimedia Elements. In: Benlamri, R. (eds) Networked Digital Technologies. NDT 2012. Communications in Computer and Information Science, vol 293. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30507-8\_3

Download citation

Keywords

Publish with us