Testing the JANUS model of noun-phrase anaphor interpretation

Lead Research Organisation: University of Sussex
Department Name: Sch of Psychology

Abstract

One of the most obvious features of well-written text and normal conversation is that the same people, places, and things are referred to a number of times. Surprisingly, from a scientific perspective, such repeated references often use different linguistic expressions. So, for example, someone referred to initially as "the person serving in the butcher's shop" might later be referred to as "the man" or simply "he", using what are called "anaphoric" expressions, or expressions that refer back to the previous text. To a language user these changes of linguistic expression seem perfectly natural, but what is the underlying explanation for such variation? In recent years there have been a few tentative attempts to provide an overall account, in scientific terms, of how reference and co-reference work in language understanding and language production. One of these accounts was developed by our group on a previous ESRC-funded project. It is called JANUS, because it says that to understand how an expression such as "the man" or "he" works in text it is necessary to take account of both how they link to what has already been said and to what might be said in the upcoming text. The main way of linking back to what has already been said is to identify previous words that refer to the same person or thing as the current word (or sometimes to link up to that person or thing in a less direct way). How we make links to what might be said has not been studied so much, but might include such things as anticipating a change in perspective on a person or thing. The JANUS model claims that when something like a change in perspective is anticipated, the word used will be different from what it otherwise might have been. Generally, it will be more specific (e.g., if the person working in the butchers is referred to as "the footballer", rather than just "he", the text is probably going to go on to talk about his sporting activities, rather than his work).

Understanding the basic processes of text comprehension allows the design of texts that are easy to understand. Such texts are increasingly important in a world in which much of our comprehension takes place in impersonal contexts, such as the internet (e.g, web browsing, and on-line form-filling). In the longer term, our work will have implications for designing tools for extracting information from text automatically. Another important applied issue on which our research bears is the understanding of how comprehension breaks down, for example, in cases of brain injury or degenerative disease, and hence it may suggest ways of helping people with comprehension problems.

This project will try to provide empirical support for the JANUS model. It will test some specific claims of that model about how links to what has already been said are made: claims about, for example, which people and things mentioned in a text are considered as the person or thing now being talked about. Some of these claims contrast with those made in other, rival, framework's, such as Amit Almor's Informational Load Hypothesis (ILH). It will also consider a specific prediction from JANUS about links to what might be said. If using an expression that is more specific than expected signals a change in perspective on the person or thing referred to, then following information that is consistent with that change of perspective (e.g. something about a football match, when a person is unexpectedly called a footballer) should be easy to understand. On the other hand, if the next bit of information is not about football, comprehension should be slightly more difficult than it otherwise would have been.

Planned Impact

The research addresses one of the most basic questions about text and discourse comprehension (and the production of comprehensible discourse). How are links made between very different expressions referring to the same person or thing (e.g. "the London Eye" and "it") and what factors make these links easy or difficult to discern for the listener or reader. It aims to test a theory of the processes underlying the making of these links, based on a small number of general psychological principles. The most immediate impacts of the research will, inevitably, be on academic researchers carrying out similar research. However, the research has broader implications within psycholinguistics and cognitive psychology more generally. A proper theory of coreference processing has implications, for example, for developmental theories of how discourse comprehension develops, and provides a framework for describing the different skills that children have at different ages, as their comprehension abilities develop. Such a theory also has implications for what goes wrong in comprehension for people with various types of brain damage or degenerative diseases. For example, Amit Almor, author of one of the rival theories to JANUS (the ILH or informational load hypothesis) has applied his ideas to the breakdown of comprehension seem in patients with advance Alzheimer-type dementia.

Work on coreference processing can also have implication for linguistic analyses. Peter Gordon, author of another rival theory (derived from Centering Theory, as developed in computational linguistics) has used his work with Randall Hendrick to question an account of coreference based on Chomsky's theory of Government and Binding.

Casting a wider net, comprehensible text is increasingly important in everyday life, as more and more interpersonal communication is replaced by computer-based communication. Given that people have to understand information presented via computers with no help or with further computer-based help, it is important that the "design" of the material presented via computer-based system takes account of the way that people typically process text. For example, our JANUS model predicts that expressions that appear to be more specific than they need to be serve specific functions, such as emphasis or change of perspective. If no change of perspective is intended, an overspecific expression may be misleading. The results of our research will be of use to people who design text for the internet.

Publications

10 25 50

publication icon
Ian Finlayson (Author) (2013) Testing the JANUS model: The role of focus in noun phrase anaphor resolution in 19th Annual Conference on Architectures and Mechanisms for Language Processing (AMLaP-2013),

 
Description In any text or conversations the same thing may be mentioned several times. Our theory, JANUS, is a theory about what form the second or later reference should take, in light of the way the person or thing was first described, and why some ways of making those later references are easier to understand than others. As an example, a person called John might later be referred to as "he", but if two males are being talked about, "he" could be ambiguous, and it might be necessary to repeat the name John.

Our project tested three predictions made by JANUS.

The first prediction relates to potential problems caused by expressions being overspecific (repeating John, for example, when only one man is under discussion).

While there was evidence from two experiments that readers experience difficulty when a repeated name is used to refer to a salient character, neither experiment showed evidence that overspecificity of an anaphor can pose problems for readers (compared with the case when "John" is needed to avoid ambiguity).

The second prediction relates to the fact that texts and conversations typically develop in a certain way, with characters at the focus of attention being discussed further. However, at some point attention shifts to someone else. When a shift occurs, it is necessary to work out that the current referring expression does not refer to the (previously) focused person (or thing). So, properties of that person should affect processing.

Specifically, if readers encounter a gendered pronoun (e.g. "he" or "she") then they will expect the gender of the antecedent to match the gender of the pronoun. Following a shift, if the focused character does not match then readers should experience a cost while they search for an alternative. However, if they do match then there will be no cost as readers will wrongly assume that no shift has taken place. Contrary to this prediction, our experiment found that when a shift took place (i.e. when an antecedent was unfocused) participants experienced difficulty when characters did share a gender.

The third prediction is that the form of an expression used to refer to a person may, in addition to ensuring a clear reference to that person in context, signal that a change of perspective on that person is about to take place. Overspecificity, for example, which might prove initially problematic (prediction 1 above) may later turn out to be justified as it signals a change of perspective (e.g from the home life to the professional life of a person).

Contrary to this prediction, we found no evidence of the expected pattern of results - initial difficulty with overspecificity, but a later advantage in the change of perspective condition following an overspecific reference. Rather, our results showed that although the overspecific anaphors did cause problems, at a later point a change of perspective caused difficulties, regardless of the form of the referring expression.
Exploitation Route A proper understanding of the problems that people have with language comprehension is crucial to developing effective treatment or rehabilitation plans for those people. Such work must be carried out by those who have a sound grasp of the aetiology and symptomology of the patients, and skills in how to interact with them.

The use of principles from the study of discourse processes to the design of information for computer-based systems is another area in which our findings could prove useful. Again, such work is best carried out by people who design the computer systems, as the relevant considerations about discourse processing have to be integrated with a wide range of other factors that influence web design. The project is one of basic research on a fundamental question about text and discourse comprehension (and the production of comprehensible discourse). How are links made between different expressions referring to the same person or thing (e.g. "the London Eye" and "it") and what factors make these links easy or difficult to discern for the listener or reader? The most immediate impacts of the research will be academic, and will be achieved via conference presentations and publications in academic journals. As well as having a direct impact within psycholinguistics, we anticipate that a proper theory of coreference processing will have implications, for example, for developmental theories of discourse comprehension. Such a theory also has implications for the comprehension problems seen in people with brain damage or degenerative diseases. Beyond psychology, work on coreference also has implication for linguistic analyses, as illustrate by the work of Peter Gordon and Randall Hendrick.

More broadly, comprehensible text is increasingly important in everyday life, as more and more interpersonal communication is replaced by computer-based communication. Given that people have to understand information presented via computers with no help or with further computer-based help, it is important that the "design"; of the material presented via computer-based system takes account of the way that people typically process text. For example, our JANUS model predicts that expressions that are more specific than they need to be for specifying what is referred to serve specific functions, such as emphasis or change of perspective. If no change of perspective is intended, an overspecific expression may be misleading. The availabilty of our results in the academic literature will enable people who design text for the internet to take the appropriate psychological findings into account.
Sectors Digital/Communication/Information Technologies (including Software),Healthcare

 
Description The project was designed to investigate a core problem in text comprehension and design: what makes second and later references to a person or thing in a text easy or difficult to understand. In particular the project was designed to test predictions from a theoretical account of these processes (JANUS) developed in an earlier ESRC grant (R000239362). We expected the immediate impacts of this research to be in the academic community, specifically among researchers in the field of the Psychology of Language. To this end, we presented the findings at one of the two leading international Psychology of Language Conferences, AMLaP (Architectures and Mechanisms of Language Processing - 2013 Conference, Marseille). The poster was presented by the Postdoctoral Research Fellow, Ian Finlayson. It generated some interest at the conference, both in the formal presentation and in informal conversations. Our work in this domain is widely known in the relevant academic community and continues to inform both my own current work (particularly in one PhD project) and work of other researchers in psycholinguistics. Unfortunately, the results presented in the poster and those from the remaining part of the project did not provide clear support for our account (JANUS). Nor did they have obvious implications for other accounts. Ian Finlayson has worked on other, unrelated, projects since the grant ended, and so we have not, to date, prepared the results for publication. If and when we do so, we will target an academic journal aimed at psycholinguists and we will expect any immediate impact to be in this domain. As discussed on the Key Findings page, there are a number of domains in which our findings might be used: rehabilitation, design of forms, design of computer-based systems that interact via text or conversation, theories of language development, linguistic theories of anaphora. With reference to the current project, we will need to develop a clear account of the results obtained, before their specific potential impacts can be assessed.
First Year Of Impact 2013
Sector Education