A growing number of papers on style transfer for texts rely on information decomposition. The performance of the resulting systems is usually assessed empirically in terms of the output quality or requires laborious experiments. This paper suggests a straightforward information theoretical framework to assess the quality of information decomposition for latent representations in the context of style transfer. Experimenting with several state-of-the-art models, we demonstrate that such estimates could be used as a fast and straightforward health check for the models instead of more laborious empirical experiments.
Original languageEnglish
Article number322
JournalEntropy
Volume25
Issue number2
DOIs
Publication statusPublished - 2023

    WoS ResearchAreas Categories

  • Physics, Multidisciplinary

    ASJC Scopus subject areas

  • Information Systems
  • Electrical and Electronic Engineering
  • Mathematical Physics
  • Physics and Astronomy(all)
  • Physics and Astronomy (miscellaneous)

ID: 35511404