Identifying Complex Sound Correspondences in Bilingual Wordlists (original) (raw)

Abstract

The determination of recurrent sound correspondences between languages is crucial for the identification of cognates, which are often employed in statistical machine translation for sentence and word alignment. In this paper, an algorithm designed for extracting non-compositional compounds from bitexts is shown to be capable of determining complex sound correspondences in bilingual wordlists. In experimental evaluation, a C++ implementation of the algorithm achieves approximately 90% recall and precision on authentic language data.

Preview

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Y. Al-Onaizan, J. Curin, M. Jahr, K. Knight, J. Lafferty, D. Melamed, F. Och, D. Purdy, N. Smith, and D. Yarowsky. Statistical machine translation. Technical report, Johns Hopkins University, 1999.
    Google Scholar
  2. Leonard Bloomfield. On the sound-system of central Algonquian. Language, 1:130–156, 1925.
    Article Google Scholar
  3. Leonard Bloomfield. Algonquian. In Harry Hoijer et al., editor, Linguistic Structures of Native America, volume 6 of Viking Fund Publications in Anthropology, pages 85–129. New York: Viking, 1946.
    Google Scholar
  4. Ted Dunning. Accurate methods for the statistics of surprise and coincidence. Computational Linguistics, 19(1):61–74, 1993.
    Google Scholar
  5. Jacques B. M. Guy. An algorithm for identifying cognates in bilingual wordlists and its applicability to machine translation. Journal of Quantitative Linguistics, 1(1):35–42, 1994. MS-DOS executable available at http://garbo.uwasa.
    Article MathSciNet Google Scholar
  6. John Hewson. Comparative reconstruction on the computer. In Proceedings of the 1st International Conference on Historical Linguistics, pages 191–197, 1974.
    Google Scholar
  7. John Hewson. A computer-generated dictionary of proto-Algonquian. Hull, Quebec: Canadian Museum of Civilization, 1993.
    Google Scholar
  8. John Hewson. Vocabularies of Fox, Cree, Menomini, and Ojibwa, 1999. Computer file.
    Google Scholar
  9. Kevin Knight and Jonathan Graehl. Machine transliteration. Computational Linguistics, 24(4):599–612, 1998.
    Google Scholar
  10. Philipp Koehn and Kevin Knight. Knowledge sources for word-level translation models. In Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing, pages 27–35, 2001.
    Google Scholar
  11. Grzegorz Kondrak. A new algorithm for the alignment of phonetic sequences. In Proceedings of NAACL 2000: 1st Meeting of the North American Chapter of the Association for Computational Linguistics, pages 288–295, 2000.
    Google Scholar
  12. Grzegorz Kondrak. Identifying cognates by phonetic and semantic similarity. In Proceedings of NAACL 2001: 2nd Meeting of the North American Chapter of the Association for Computational Linguistics, pages 103–110, 2001.
    Google Scholar
  13. Grzegorz Kondrak. Determining recurrent sound correspondences by inducing translation models. In Proceedings of COLING 2002: 19th International Conference on Computational Linguistics, pages 488–494, 2002.
    Google Scholar
  14. John B. Lowe and Martine Mazaudon. The reconstruction engine: a computer implementation of the comparative method. Computational Linguistics, 20:381–417, 1994.
    Google Scholar
  15. Gideon S. Mann and David Yarowsky. Multipath translation lexicon induction via bridge languages. In Proceedings of NAACL 2001: 2nd Meeting of the North American Chapter of the Association for Computational Linguistics, pages 151–158, 2001.
    Google Scholar
  16. I. Dan Melamed. Empirical Methods for Exploiting Parallel Texts. The MIT Press, Cambridge, MA, 2001.
    Google Scholar
  17. Michael P. Oakes. Computer estimation of vocabulary in protolanguage from word lists in four daughter languages. Journal of Quantitative Linguistics, 7(3):233–243, 2000.
    Article Google Scholar
  18. Jörg Tiedemann. Automatic construction of weighted string similarity measures. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora, College Park, Maryland, 1999.
    Google Scholar

Download references

Author information

Authors and Affiliations

  1. Department of Computing Science, University of Alberta, T6G 2E8, Edmonton, AB, Canada
    Grzegorz Kondrak

Editor information

Editors and Affiliations

  1. Centro de Investigación en Computación (CIC), Instituto Politécnico Nacional (IPN), Col. Zacatenco, CP 07738, Mexico D.F., Mexico
    Alexander Gelbukh

Rights and permissions

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kondrak, G. (2003). Identifying Complex Sound Correspondences in Bilingual Wordlists. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2003. Lecture Notes in Computer Science, vol 2588. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-36456-0\_46

Download citation

Keywords

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publish with us