Skip to main content

Synthesis Evaluation

Aims​

Improve the method of evaluation for ABAIR synthetic voices.

Method​

  • Understand the current workflow for evaluating voices.
  • Identify weaknesses.
  • Propose improvements.

Workflow​

Below, the current and proposed workflows are displayed side-by-side as flow charts.

Workflow Diagram​

My image

Notes​

  • New voices come out only a few times per year.
  • No clear system for notifying hr.
  • Need procedure for updating live voices and communicating to others
  • Need to assign this role to 2 hr.
  • Bank of sentences (created by Amanda).
  • Created to be phonemically representative of each dialect.Ulster - 90, Conemara - 97, Munster - TBD
  • Consider some automation, next step - use ASR and WER
  • Sentences require numbers, acronyms etc.
  • Need some form of a progress path, so each group knows where the other is at with the task.
  • Include all stakeholders.
  • Need some form of check that all these are done.