Breaking News: Grepper is joining You.com. Read the official announcement!

pytorch initialize weights

Elias Foramitti answered on February 20, 2024 Popularity 5/10 Helpfulness 2/10

answer pytorch initialize weights

pytorch initialize weights

Comment

To initialize the weights of a single layer, use a function from torch.nn.init. For instance:

conv1 = torch.nn.Conv2d(...)
torch.nn.init.xavier_uniform(conv1.weight)

Alternatively, you can modify the parameters by writing to conv1.weight.data (which is a torch.Tensor). Example:

conv1.weight.data.fill_(0.01)

The same applies for biases:

conv1.bias.data.fill_(0.01)

Popularity 5/10 Helpfulness 2/10 Language python

Source: stackoverflow.com

Tags: python pytorch

Link to this answer
Share Copy Link