The Dynamics of Conversational DialogueES/F027117/1

Lead Research Organisation: King's College London
Department Name: Philosophy

Abstract

Abstracts are not currently available in GtR for all funded research. This is normally because the abstract was not required at the time of proposal submission, but may be because it included sensitive information such as personal details.

Publications

10 25 50

publication icon
Chatzikyriakidis S (2011) Standard Modern and Pontic Greek Person Restrictions: A Feature-Free Dynamic Account in Journal of Greek Linguistics

publication icon
Colman M. (2008) Quantifying ellipsis in dialogue : an index of mutual understanding in Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue

publication icon
Eshghi A. (2013) Probabilistic Induction for an Incremental Semantic Grammar in Proceedings of the 10th International Conference on Computational Semantics (IWCS)

publication icon
Eshghi A. (2012) Inducing Lexical Entries for an Incremental Semantic Grammar in Proceedings of Constraint Solving and Language Processing (CSLP)

publication icon
Eshghi A. (2011) Incremental Turn Processing in Dialogue in Proceedings of Architectures and Mechanisms for Language Processing (AMLAP) 2010

publication icon
Eshghi A; Hough J; Purver M; Kempson R; Gregoromichelaki E (2012) From Quantification to Conversation

 
Description People process language incrementally, understanding and/or producing sentences on a piece by piece basis. Thus hearers can understand partial sentences and switch roles to become speakers, offering continuations/clarifications/corrections, with no trouble responding to such modifications. Modelling these "split" utterances is inexpressible in orthodox grammars, as it requires models in which interlocutors incrementally collaborate to build a structure on a word-by-word basis. DynDial successfully modelled such phenomena as part of its development of a model of dialogue with Dynamic Syntax (DS: Kempson et al 2001, Cann et al 2005) as the background, in which incrementality plays a central role. Corpus study confirmed that these phenomena are common: results showed 20% of corpus data involved splits. Experimental work developed three new experimental manipulations: artificial splits, incremental clarifications and induced completions. Using these, we produced the first experimental demonstration of the relevance of syntactic increments in dialogue processing. DS was extended to record speaker-switch points, adapting Cooper's Type Theory with Records (Cooper 2008) and capturing major fragment types. This model was then used to produce a working computational dialogue system DyLan, based around Skantze & Hjalmarsson (2010)'s dialogue manager Jindigo: DyLan is the first system which produces and processes representations of meaning on a strictly incremental, word-by-word basis in both parsing and production, allowing it to handle major split utterance and other ellipsis types. The research thus extends ongoing work to yield wholly novel results.
Exploitation Route The modelling of compound utterances in which people switch roles between speaking and hearing is not expressible in orthodox grammars, but emerges naturally from a grammar formalism incorporating the progressive building of representations of content, in which the grammar architecture and performance model are notably simpler. A Corpus study confirming how common these phenomena are is freely available. Experimental work developed three new experimental manipulations: artificial splits, incremental clarifications and induced completions. Using these, we produced the first experimental demonstration of the relevance of syntactic increments in dialogue processing, all of which are available, as is the working computational dialogue system DyLan, based around Skantze & Hjalmarsson (2010)'s dialogue manager Jindigo: DyLan is the first system which produces and processes representations of meaning on a strictly incremental, word-by-word basis in both parsing and production, allowing it to handle major split utterance and other ellipsis types.
Sectors Digital/Communication/Information Technologies (including Software),Education,Healthcare

URL http://www.kcl.ac.uk/innovation/groups/ds/publications/index.aspx
 
Description Naturalistic human-computer interactions need computer models that reflect the word-by-word way people interact in conversation. DynDial is uniquely based on a grammar reflecting this, increasing naturalness for English/Swedish/German dialogue models. DynDial impact includes two projects: (a) RISER (EPSRC, Purver principal investigator): developing the system for general dialogue applications, (b) PPAT (EPSRC, Purver principal investigator): applying DynDial methodologies to analyse dialogues between schizophrenic patients and clinicians. Commercial applications are under development by QMUL spinout company Chatterbox Analytics, formed Nov 2011.
First Year Of Impact 2010
Sector Digital/Communication/Information Technologies (including Software),Healthcare
Impact Types Cultural,Societal

 
Description Predicting patient adherence to treatment from consultation transcripts (PPAT)
Amount £23,571 (GBP)
Funding ID EP/J501360/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 01/2012 
End 06/2012
 
Description Robust incremental semantic resources for dialogue (RISER)
Amount £120,288 (GBP)
Funding ID EP/J010383/1 
Organisation Engineering and Physical Sciences Research Council (EPSRC) 
Sector Public
Country United Kingdom
Start 01/2012 
End 03/2013
 
Title DynDial ellipsis corpus 
Description A set of annotations for ellipsis and compound contributions, including details of category and antecedent. Contributed to ESDS 
Type Of Material Database/Collection of data 
Year Produced 2010 
Provided To Others? Yes  
Impact Improved models for linguistic processing, outlined in papers in SIGDIAL 2009, Dialogue & Discourse 2011 
 
Title DYLAN 
Description An open-source software platform for incremental dialogue modelling, including natural language understanding and generation, and data-driven grammar induction. 
Type Of Technology Software 
Year Produced 2012 
Open Source License? Yes  
Impact Use by other international teams in research 
URL http://dylan.sf.net
 
Description Language and Outcome Prediction in Patient-Clinician Dialogues 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Local
Primary Audience Postgraduate students
Results and Impact Talk presented a pilot project which led directly from the DynDial work in an applied domain (patient-clinician dialogue)

Raised awareness of potential for practical applications
Year(s) Of Engagement Activity 2013
URL http://www.eecs.qmul.ac.uk/~mpurver/papers/purver-et-al12kcl-talk.pdf
 
Description A dynamic perspective on left-right asymmetries : CLLD and clitic doubling in Greek 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Participants in your research and patient groups
Results and Impact Various interpretational effects and structural restrictions can be observed in the doubling of arguments by clitics in languages like Modern Greek. The fact that some of these operate differentially depending on whether the doubling occurs in the left or right periphery has led to the postulation of supposedly distinct phenomena. We examine these asymmetries from the perspective of Dynamic Syntax (DS), a grammar formalism which reflects the dynamics of incrementally mapping a string of words to a semantic representation. In DS no separate level of syntactic representation is assumed, and structural constraints are analysable as due to timing of construction processes and their interaction with the context of utterance. In particular, left-right asymmetries in clitic distribution are shown to be derived without ambiguity, their variation explicable from interaction of the multiple stages during construction of semantic structure, following directly from the incremental parsing dynamics relative to the evolving context.

Interaction with colleagues in Greece.
Year(s) Of Engagement Activity 2011
 
Description Coordination of agents workshop 
Form Of Engagement Activity A formal working group, expert panel or dialogue
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Health professionals
Results and Impact Exchange of information about research activities, discussions about collaborations.

International networks of collaboration; staff mobility among international sites
Year(s) Of Engagement Activity 2008
URL http://www.kcl.ac.uk/innovation/groups/ds/events/coord.aspx
 
Description Divergence in dialogue 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Participants in your research and patient groups
Results and Impact Given that the talk provided counter-evidence to an view influential at the host institution, there was stimulating discussion afterwards.

Changing understanding of some aspects of utterance processing and its interactivity effects.
Year(s) Of Engagement Activity 2011
 
Description Extending and Learning an Incremental Semantic Grammar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact We introduce a method for data-driven learning of lexical entries in an inherently incremental semantic grammar formalism, Dynamic Syntax (DS). Lexical actions in DS are constrained procedures for the incremental projection of compositional semantic structure. Here, we show how these can be induced directly from sentences paired with their complete propositional semantic structures. Checking induced entries over an artificial dataset generated using a known grammar demonstrates that the method learns lexical entries compatible with those defined by linguists, with different versions of the DS framework induced by varying only general tree manipulation rules. This is achieved without requiring annotation at the level of individual words, via a method compatible with work on linguistic change and routinisation.

Talk led to discussion of issues of modelling dialogue phenomena and potential future collaborations
Year(s) Of Engagement Activity 2013
URL http://www.eecs.qmul.ac.uk/~mpurver/papers/purver-et-al12potsdam-talk.pdf
 
Description FACULTI online video 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Public/other audiences
Results and Impact An online video describing the project research, for public information, was recorded & released via FACULTI Media
Year(s) Of Engagement Activity 2013
URL http://facultimedia.com/data-driven-learning-in-an-incremental-grammar-framework/
 
Description General Linguistics Seminar: Language, Music and Interaction 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Given that this promotes a wholly new perspective on music and language, the talk sparked a lot of discussion afterwards

People reported change of minds.
Year(s) Of Engagement Activity 2013
 
Description Grammar Induction in an Incremental Type-Theoretic Framework 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact In this paper, we set out the case for combining the Type Theory with Records framework (TTR, Cooper (2005)) with Dynamic Syntax (DS, Kempson, Meyer-Viol, and Gabbay (2001); Cann, Kempson, and Marten (2005)) in a single model (DS-TTR). In a nutshell, this fusion captures a phenomenon inexpressible in any direct way by frameworks grounded in orthodox sententialist assumptions - the dynamics of how, in ordinary conversations, we build up information together, incrementally, bit by bit, through half starts, suggested add-ons, possible modifications to the emergent structure which we are apparently collaborating on, all the while allowing that we might be uncertain as to the final outcome, or even in fierce disagreement. We then go on to present a probabilistic method for data-driven learning of DS-TTR grammars from sentences paired with their logical form.

This talk fostered discussion with potential future collaborators.
Year(s) Of Engagement Activity 2013
URL http://www.eecs.qmul.ac.uk/~mpurver/papers/purver-et-al12iwttr-talk.pdf
 
Description Grammars as Mechanisms for Real-Time Tree-Growth: Explaining Clitic Pronouns 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Grammars as Mechanisms for Real-Time Tree-Growth: Explaining Clitic Pronouns

After my talk, there were expressions of interest from those in formal computational modelling of language.
Year(s) Of Engagement Activity 2012,2013
 
Description Grammars as Mechanisms for Real-Time Tree-Growth: Explaining Clitic Pronouns 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Grammars as Mechanisms for Real-Time Tree-Growth: Explaining Clitic Pronouns

After my talk, people expressed interest in pursuing these ideas.
Year(s) Of Engagement Activity 2012
 
Description Helping the medicine go down? Repair and adherence in patient-clinician dialogues 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach Regional
Primary Audience Postgraduate students
Results and Impact Repair is crucial in achieving and maintaining shared understanding in dialogue. Recent work on consultations between patients with schizophrenia and psychiatrists has shown that adherence to treatment correlates with patterns of repair. We show that distributions of repair in consultation dialogues are different to those in general conversation.We investigate whether particular types of repair can be detected from highlevel dialogue features and/or lexical content, with encouraging results. We further explore whether we can predict adherence

directly from these features. The results indicate that prediction appears to be possible from low-level lexical content.

Raised awareness of practical applications of dialogue research and sparked discussions.
Year(s) Of Engagement Activity 2013
URL http://www.eecs.qmul.ac.uk/~mpurver/papers/purver-et-al12cambridge-talk.pdf
 
Description Incremental turn processing in dialogue 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Participants in your research and patient groups
Results and Impact The talk showed a computational model of grammar framework expressing incremental interactive understanding, a novel move which sparked questions and discussion afterwards

The talk contributed to the general increasing recognition that incrementality and interaction not only are crucial to explanations of language, but can be directly computationally modelled.
Year(s) Of Engagement Activity 2010
URL http://www.kcl.ac.uk/research/groups/ds/events/intentions.html
 
Description Incrementality, representationalism and intention recognition in dialogue processing 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Since this talk set out split-utterance data, which orthodox frameworks, syntactic, semantic and pragmatic have extreme difficulty in modelling, with a radical new framework in which syntax involves monotonic and incremental growth of semantic representation reflecting time-linearity, the talk sparked questions and discussion afterwards

Increase in international recognition that modelling incrementality and participant interaction are crucial to explanations of language.
Year(s) Of Engagement Activity 2012
 
Description Invited Talk 'Poeticon Project, Athens' European Commission Framework Programme 7, POETICON ILSP talks (Gregoromichelaki) 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Discussions about collaboration and joint research projects.


After the talk there were discussions about sharing of data and analysis under the presented framework. Input received led to modifications of assumptions to fit the objective of DS formalism meshing with POETICON objectives of associating symbolic representations with corresponding sensorimotor representations enriched with information on patterns among these representations for forming conceptual structures.
Year(s) Of Engagement Activity 2009
URL http://www.csri.gr/Poeticon/ilsp_talks/gregoromichelaki-present.pdf/view
 
Description Joint utterances in Greek: their implications for linguistic modelling 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Participants in your research and patient groups
Results and Impact Joint utterances in Greek: their implications for linguistic modelling

Expression of interest from colleagues in Greece
Year(s) Of Engagement Activity 2013
 
Description Joint utterances: their implication for linguistic modelling 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Talk sparked questions and discussions afterwards.

There was useful but nebulous discussion.
Year(s) Of Engagement Activity 2012
 
Description LOCI workshop II : type dependency, type theory with records, and natural-language flexibility 
Form Of Engagement Activity Scientific meeting (conference/symposium etc.)
Part Of Official Scheme? No
Type Of Presentation keynote/invited speaker
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact There has recently been a surge of interest in the use of rich type systems (with, variously, record types, subtyping, and/or dependent intersections) in order to express various linguistic phenomena at various levels: subsententially there are applications to lexical semantics, sententially one sees accounts of syntax, and in the realm of which is traditionally called pragmatics one finds accounts of dialogue that are markedly more subtle than the usual pragmatic treatment. Something is surely being done right.



Questions, however, remain. Scope, and other syntactic issues, still seem to be quite tricky, and the complexity of the type systems that are being used makes it difficult to say whether the difficulties are problems in principle or merely problems of implementation. The question of the semantics of these systems -- that is, semantics in the everyday sense, rather than semantics in the sense of model theory -- remains largely unexamined, and the field remains quite open: it is not clear whether we need a semantics in the traditional sense (possibly enriched with vector spaces or the like), or whether proof theory might not be a more suitable way of connecting these formalisms to the observed phenomena of linguistics. Proof theory seems, prima facie, to be more philosophically appealing, but at the cost of greater technical difficulty. Finally, there is the question of how these approaches are connected with more algebraic approaches to syntax, which also have their appeal.



This workshop will explore these problems in some depth, endeavouring to respect both the technical issues and the empirical reality of linguistics: we have assembled a group of speakers of a variety of backgrounds but all of them with something to say to each other.

Colleagues from Paris expressed considerable support and interest
Year(s) Of Engagement Activity 2013
 
Description Language (and Music) as Mechanisms for Interaction 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Participants in your research and patient groups
Results and Impact Informal conversations are essentially interactive. We can take up often radically incomplete structures which someone else offers and turn it into something different, with seamless switching between speaker and hearer roles at arbitrary points. This phenomenon of "compound utterances" is intransigent for all orthodox frameworks based on wellformedness of complete sentences, but follows as a direct consequence of the grammar if syntax is defined as mechanisms for context-dependent gro

Enquiry for further research results/plans
Year(s) Of Engagement Activity 2014
 
Description Language (and Music): Mechanisms for Social Interaction 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Talking about Language (and Music) both as mechanisms for social Interaction sparked useful subsequent discussion

This and other talks is leading to a growth of interest in the modelling of language and music activities as essentially interactive.
Year(s) Of Engagement Activity 2013
 
Description Language and conversation : the dynamics of interaction 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact As an invited talk in China, the main purpose of this talk was to spark questions and discussion afterwards about why the modelling of conversational interaction should be goal for all language modelling, illustrated with both English and Chines, and the talk successfully sparked subsequent debate. In conversation, as I show using Chinese and English data, we interactively build up structures together, with free switching of speaker/hearer roles both within and across sentence boundaries.

The result of the talk was plans to keep in touch over future research.
Year(s) Of Engagement Activity 2011
 
Description Language as Mechanisms for Interaction 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact The talk sparked useful discussion.

No notable impact
Year(s) Of Engagement Activity 2013
 
Description Language, Music and Interaction: One-day Symposium of the Philological Society 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach National
Primary Audience Participants in your research and patient groups
Results and Impact With the conventional assumption that language ability has to be seen as separate from language use, there is now a familiar divide between explanations of language as a system (language competence) and explanations of language use (performance). Nonetheless, in socio-linguistics, pragmatics and historical linguistics, it has continued to be assumed that explanations of social aspects of language and language change must make reference to how language is used in social interactions. Moreover, si

Interest expressed by colleagues from entirely different disciplines
Year(s) Of Engagement Activity 2013
 
Description On making syntax dynamic and the modelling of dialogue 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Given that we were arguing for a perspective shift in adopting a grammar framework much closer to the dynamics of interaction in conversation, the talk sparked considerable discussion afterwards.

Interest expressed in keeping in touch at a research level
Year(s) Of Engagement Activity 2009
 
Description On making syntax dynamic, dialogue modelling, and the nature of linguistic knowledge 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Public/other audiences
Results and Impact Given the talk was to persuade Greek researchers that modelling conversational interaction is not only possible but the optimal way of capturing linguistic knowledge, with a much closer link made possible between grammar formalism and empirical data, there was substantial subsequent discussion.

After the talk, interest was expressed in shifting grammar perspective
Year(s) Of Engagement Activity 2009
 
Description Probabilistic Induction for an Incremental Semantic Grammar 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact We describe a method for learning an incremental semantic grammar from a corpus in which sentences are paired with logical forms as predicate-argument structure trees. Working in the framework of Dynamic Syntax, and assuming a set of generally available compositional mechanisms, we show how lexical entries can be learned as probabilistic procedures for the incremental projection of semantic structure, providing a grammar suitable for use in an incremental probabilistic parser. By inducing these from a corpus generated using an existing grammar, we demonstrate that this results in both good coverage and compatibility with the original entries, without requiring annotation at the word level. We show that this semantic approach to grammar induction has the novel ability to learn the syntactic and semantic constraints on pronouns.

This invited talk triggered discussion of issues related to dialogue and highlighted a number of potential future collaborations.
Year(s) Of Engagement Activity 2013
URL http://www.eecs.qmul.ac.uk/~mpurver/papers/purver-et-al12bielefeld-talk.pdf
 
Description The dynamics of conversation 
Form Of Engagement Activity A talk or presentation
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Undergraduate students
Results and Impact Given that the talk was to Beijing students, using Chinese and English the aim which was successful was to spark questions, and fruitful discussion followed.

After my talk, many people expressed enthusiastic interest in altering their perspective on language.
Year(s) Of Engagement Activity 2011
 
Description Tracking the dative alternation in conversation 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Postgraduate students
Results and Impact Evidence for structural alignment in dialogue comes from experimental studies of task-oriented dialogue and corpus studies that track frequency of use of particular constructions. However, the data used in these studies is not adequately representative of ordinary dialogue and, as these studies have tended to track the frequency of use of specific constructions across participants and time, the chance level of structural matching is unknown. To address these issues, we conducted two experiments which tested the degree of match of dative alternation structures in the Diachronic Corpus of Present-Day Spoken English (DCPSE). We compared this measure to control conditions for the same genuine conversational data manipulated to create fake dialogues from turns actually occurring in different conversations. The results show that in ordinary conversation, there is no unequivocal evidence of syntactic priming effects for the dative alternation. Individuals do tend to repeat the same structure, however, they are no more likely to converge on the same version of each structure with their conversational partners than would be expected by chance. In addition, the overall likelihood of a match in syntactic structure across turns appears to be accounted for by the repetition of specific words. While there is insufficient data in the DCPSE corpus to definitively prove that structural priming effects are absent in ordinary conversation, these results indicate that the strength and ubiquity of structural priming may have been overstated.

This work was presented at a psycholinguistics conference, to spread information about our methods and results to a wider audience who do not usually consider the issues around dialogue.
Year(s) Of Engagement Activity 2011
 
Description What do words do for us? 
Form Of Engagement Activity Participation in an activity, workshop or similar
Part Of Official Scheme? No
Geographic Reach International
Primary Audience Other academic audiences (collaborators, peers etc.)
Results and Impact Sparked discussion amongst philosophers

Increased exposure of leading philosophers to re-thinking the nature of word meaning within dynamic perspective.
Year(s) Of Engagement Activity 2014
 
Description  
Form Of Engagement Activity
Part Of Official Scheme? No
Primary Audience
Year(s) Of Engagement Activity