MolecularDiffusion.modules.layers.tabasco.common¶
Classes¶
SwiGLU activation function. |
Module Contents¶
- class MolecularDiffusion.modules.layers.tabasco.common.SwiGLU¶
Bases:
torch.nn.ModuleSwiGLU activation function.
- forward(x: torch.Tensor) torch.Tensor¶