iganet::ActivationFunction Class Reference

Abstract activation function structure. More...

#include </home/runner/work/iganet/iganet/include/net/activation.hpp>

Inheritance diagram for iganet::ActivationFunction:

Public Member Functions
	~ActivationFunction () override=default
virtual torch::Tensor	apply (const torch::Tensor &) const =0
	Applies the activation function to the given input.
void	pretty_print (std::ostream &os) const noexcept override=0
	Returns a string representation of the activation function.
virtual torch::serialize::InputArchive &	read (torch::serialize::InputArchive &archive, const std::string &key)=0
	Reads the activation function from a torch::serialize::InputArchive object.
virtual torch::serialize::OutputArchive &	write (torch::serialize::OutputArchive &archive, const std::string &key) const =0
	Writes the activation function into a torch::serialize::OutputArchive object.

Additional Inherited Members
Protected Member Functions inherited from iganet::utils::FullQualifiedName
virtual	~FullQualifiedName ()=default
virtual const std::string &	name () const noexcept
	Returns the full qualified name of the object.
Protected Attributes inherited from iganet::utils::FullQualifiedName
at::optional< std::string >	name_
	String storing the full qualified name of the object.

Detailed Description

Abstract activation function structure.

Constructor & Destructor Documentation

~ActivationFunction()

iganet::ActivationFunction::~ActivationFunction ( )

overridedefault

Member Function Documentation

apply()

virtual torch::Tensor iganet::ActivationFunction::apply ( const torch::Tensor &  ) const

pure virtual

Applies the activation function to the given input.

Implemented in iganet::None, iganet::BatchNorm, iganet::CELU, iganet::ELU, iganet::GELU, iganet::GLU, iganet::GroupNorm, iganet::GumbelSoftmax, iganet::Hardshrink, iganet::Hardsigmoid, iganet::Hardswish, iganet::Hardtanh, iganet::InstanceNorm, iganet::LayerNorm, iganet::LeakyReLU, iganet::LocalResponseNorm, iganet::LogSigmoid, iganet::LogSoftmax, iganet::Mish, iganet::Normalize, iganet::PReLU, iganet::ReLU, iganet::ReLU6, iganet::RReLU, iganet::SELU, iganet::Sigmoid, iganet::SiLU, iganet::Softmax, iganet::Softmin, iganet::Softplus, iganet::Softshrink, iganet::Softsign, iganet::Tanh, iganet::Tanhshrink, and iganet::Threshold.

pretty_print()

void iganet::ActivationFunction::pretty_print ( std::ostream &  os ) const

overridepure virtualnoexcept

Returns a string representation of the activation function.

Implements iganet::utils::FullQualifiedName.

Implemented in iganet::None, iganet::BatchNorm, iganet::CELU, iganet::GELU, iganet::GLU, iganet::LayerNorm, iganet::LeakyReLU, iganet::LocalResponseNorm, iganet::LogSigmoid, iganet::LogSoftmax, iganet::Mish, iganet::Normalize, iganet::PReLU, iganet::ReLU, iganet::ReLU6, iganet::RReLU, iganet::SELU, iganet::Sigmoid, iganet::SiLU, iganet::Softmax, iganet::Softmin, iganet::Softplus, iganet::Softshrink, iganet::Softsign, iganet::Tanh, iganet::Tanhshrink, iganet::Threshold, iganet::ELU, iganet::GroupNorm, iganet::GumbelSoftmax, iganet::Hardshrink, iganet::Hardsigmoid, iganet::Hardswish, iganet::Hardtanh, and iganet::InstanceNorm.

read()

virtual torch::serialize::InputArchive & iganet::ActivationFunction::read ( torch::serialize::InputArchive &  archive, const std::string &  key  )

pure virtual

Reads the activation function from a torch::serialize::InputArchive object.

Implemented in iganet::BatchNorm, iganet::CELU, iganet::ELU, iganet::GELU, iganet::GLU, iganet::GroupNorm, iganet::GumbelSoftmax, iganet::Hardshrink, iganet::Hardsigmoid, iganet::Hardswish, iganet::Hardtanh, iganet::InstanceNorm, iganet::LayerNorm, iganet::LeakyReLU, iganet::LocalResponseNorm, iganet::LogSigmoid, iganet::LogSoftmax, iganet::Mish, iganet::None, iganet::Normalize, iganet::PReLU, iganet::ReLU, iganet::ReLU6, iganet::RReLU, iganet::SELU, iganet::Sigmoid, iganet::SiLU, iganet::Softmax, iganet::Softmin, iganet::Softplus, iganet::Softshrink, iganet::Softsign, iganet::Tanh, iganet::Tanhshrink, and iganet::Threshold.

write()

virtual torch::serialize::OutputArchive & iganet::ActivationFunction::write ( torch::serialize::OutputArchive &  archive, const std::string &  key  ) const

pure virtual

Writes the activation function into a torch::serialize::OutputArchive object.

Implemented in iganet::BatchNorm, iganet::CELU, iganet::ELU, iganet::GELU, iganet::GLU, iganet::GroupNorm, iganet::GumbelSoftmax, iganet::Hardshrink, iganet::Hardsigmoid, iganet::Hardswish, iganet::Hardtanh, iganet::InstanceNorm, iganet::LayerNorm, iganet::LeakyReLU, iganet::LocalResponseNorm, iganet::LogSigmoid, iganet::LogSoftmax, iganet::Mish, iganet::None, iganet::Normalize, iganet::PReLU, iganet::ReLU, iganet::ReLU6, iganet::RReLU, iganet::SELU, iganet::Sigmoid, iganet::SiLU, iganet::Softmax, iganet::Softmin, iganet::Softplus, iganet::Softshrink, iganet::Softsign, iganet::Tanh, iganet::Tanhshrink, and iganet::Threshold.

---

The documentation for this class was generated from the following file:

• include/net/activation.hpp