Using Roark-Hollingshead Distance to Probe BERT’s Syntactic Competence (original) (raw)
Related papers
On the evolution of syntactic information encoded by BERT’s contextualized representations
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021
The ambiguity of BERTology: what do large language models represent?
Synthese, 2023
CxGBERT: BERT meets Construction Grammar
2020
What Does BERT Learn about the Structure of Language?
Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics
Does BERT really agree ? Fine-grained Analysis of Lexical Dependence on a Syntactic Task
Findings of the Association for Computational Linguistics: ACL 2022
A Primer in BERTology: What We Know About How BERT Works
Transactions of the Association for Computational Linguistics, 2020
The Universe of Utterances According to BERT
ICWS, 2023
What Does BERT Look at? An Analysis of BERT’s Attention
Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 2019
Three Benchmarks for Statistical Models of Syntax
2021
2022
Investigating BERT’s Knowledge of Language: Five Analysis Methods with NPIs
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019
arXiv (Cornell University), 2022
Exploring Linguistic Properties of Monolingual BERTs with Typological Classification among Languages
arXiv (Cornell University), 2023
An Interpretability Illusion for BERT
2021
Morphosyntactic probing of multilingual BERT models
Natural Language Engineering
A Structural Probe for Finding Syntax in Word Representations
2019
How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTś Attention
2020
Look at that! BERT can be easily distracted from paying attention to morphosyntax
2021
The argument-adjunct distinction in BERT: A FrameNet-based investigation
ICWS, 2023
Do Attention Heads in BERT Track Syntactic Dependencies?
ArXiv, 2019
Mapping the syntax/semantics coastline
BERTops: Studying BERT Representations under a Topological Lens
2022 International Joint Conference on Neural Networks (IJCNN)
2008
On modularity in syntactic processing
Journal of Psycholinguistic Research, 1988
Towards a Brain Compatible Theory of Syntax Based on Local Testability
Topics in Computer Mathematics, 2003
Empirical Evaluation of Tree distances for Parser Evaluation
Do Neural Language Models Show Preferences for Syntactic Formalisms?
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020
The distribution of syntactic dependency distances
arXiv (Cornell University), 2022
Towards a theory of syntactic workspaces: neighbourhoods and distances in a lexicalised grammar
The Linguistic Review
A Measure of Aggregate Syntactic Distance
… of the Workshop on linguistic Distances, 2006