Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Minor typo in the description of Adam's beta 2 (#4715) 

Adam's beta 2 parameter was mistakenly referred to as the first order momentum of the gradient, whereas it should be the second order momentum. This has no effect on the correct working of the example.
This commit is contained in:
Ludger Paehler 2020-11-17 17:00:36 +01:00 committed by GitHub
parent c208ac68c8
commit 7c4356464c
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
pl_examples/domain_templates/generative_adversarial_net.py
View File

@ -76,7 +76,7 @@ class GAN(LightningModule):
parser.add_argument("--b1", type=float, default=0.5, parser.add_argument("--b1", type=float, default=0.5,
help="adam: decay of first order momentum of gradient") help="adam: decay of first order momentum of gradient")
parser.add_argument("--b2", type=float, default=0.999, parser.add_argument("--b2", type=float, default=0.999,
help="adam: decay of first order momentum of gradient") help="adam: decay of second order momentum of gradient")
parser.add_argument("--latent_dim", type=int, default=100, parser.add_argument("--latent_dim", type=int, default=100,
help="dimensionality of the latent space") help="dimensionality of the latent space")