Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

“instancenorm” in encode stage #10

Open
amberhappy opened this issue Jan 28, 2021 · 1 comment
Open

“instancenorm” in encode stage #10

amberhappy opened this issue Jan 28, 2021 · 1 comment

Comments

@amberhappy
Copy link

amberhappy commented Jan 28, 2021

The instancenorm para about "track_running_states=True" and "affine=True".

In the training stage, should I set "track_running_states=True" and "affine=True"?

@Rivendile
Copy link
Collaborator

In our experiment, we leave these two parameters as False, which is default in PyTorch.
When set track_running_states=True, it will track the mean and variance. When False, it will only use batch statics.
When set affine=True, it will have some learnable parameters in instance norm.
You can try these settings if interested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants