Logo image
Fine-tuning BERT for generative dialogue domain adaptation
Conference proceeding   Peer reviewed

Fine-tuning BERT for generative dialogue domain adaptation

Tiziano Labruna and B Magnini
Text, Speech, and Dialogue: 25th International Conference, TSD 2022; Proceedings, pp.513-524
25th International Conference: TSD 2022 (Brno, 06/09/2022–09/09/2022)
2022
Handle:
https://hdl.handle.net/10863/51375

Abstract

Current data-driven Dialogue State Tracking (DST) models exhibit a poor capacity to adapt themselves to domain changes, resulting in a significant degradation in performance. We propose a methodology, called Generative Dialogue Domain Adaptation, which significantly simplifies the creation of training data when a number of changes (e.g., new slot-values or new instances) occur in a domain Knowledge Base. We start from dialogues for a source domain and apply generative methods based on language models such as BERT, fine-tuned on task-related data and generate slot-values substitutions for a target domain. We have experimented dialogue domain adaptation in a few-shot setting showing promising results, although the task is still very challenging. We provide a deep analysis of the quality of the generated data and of the features that affect this task, and we emphasise that DST models are very sensitive to the distribution of slot-values in the corpus.
url
https://link.springer.com/chapter/10.1007/978-3-031-16270-1_42View

Details

Metrics

1 Record Views
Logo image