Deep learning for NeuroImaging in Python.

Note

This page is a reference documentation. It only explains the class signature, and not how to use it. Please refer to the gallery for the big picture.

class nidl.estimators.ssl.utils.projection_heads.SimCLRProjectionHead(input_dim: int = 2048, hidden_dim: int = 2048, output_dim: int = 128)[source]¶

Bases: ProjectionHead

Projection head used for SimCLR.

“We use a MLP with one hidden layer to obtain :math: zi = g(h) = W_2 * sigma (W_1 * h) where :math: sigma is a ReLU non-linearity.” [1]

[1] SimCLR, 2020, https://arxiv.org/abs/2002.05709

Initialize internal Module state, shared by both nn.Module and ScriptModule.