fix a bug of transformertts when use data parallel.

9b86f200 · lifuchen · 6428ce54 · 9b86f200
显示空白变更内容
内联并排

Showing with 11 addition and 5 deletion

examples/transformer_tts/train_transformer.py examples/transformer_tts/train_transformer.py +11 -5

未找到文件。
--- a/examples/transformer_tts/train_transformer.py
+++ b/examples/transformer_tts/train_transformer.py
@@ -94,6 +94,12 @@ def main(args):
                    if args.stop_token:
                        writer.add_scalar('stop_loss', stop_loss.numpy(), global_step)

+                    if args.use_data_parallel:
+                        writer.add_scalars('alphas', {
+                            'encoder_alpha':model._layers.encoder.alpha.numpy(),
+                            'decoder_alpha':model._layers.decoder.alpha.numpy(),
+                        }, global_step)
+                    else:
                        writer.add_scalars('alphas', {
                            'encoder_alpha':model.encoder.alpha.numpy(),
                            'decoder_alpha':model.decoder.alpha.numpy(),