Model Zoo Reference


                    
                    
                    Transformer

Transformer as introduced by Attention Is All You Need.

The transformer model shares an embedding matrix between the encoder and decoder and reuses the embedding weights to compute the decoder output distribution. Outputs of the transformer are normalized using log softmax.

Declaration

Swift

public struct Transformer<Element, Device> : LayerType, Codable where Element : RandomizableType, Device : DeviceType


                    
                    
                    AlexNet

AlexNet image classification network.

Batch normalization has been added to this implementation.

https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf

Declaration

Swift

public struct AlexNet<Element, Device> : LayerType, Codable where Element : RandomizableType, Device : DeviceType


                    
                    
                    ResNet18

Residual neural network with 18 layers (17 convolutional, 1 dense)

Declaration

Swift

public struct ResNet18<Element, Device> : LayerType where Element : RandomizableType, Device : DeviceType


                    
                    
                    ResidualBlock

Residual block with two convolution and batch normalization layers as well as an optional downsampling block.

Declaration

Swift

public struct ResidualBlock<Element, Device> : LayerType where Element : RandomizableType, Device : DeviceType


                    
                    
                    VGG11

Undocumented

Declaration

Swift

public struct VGG11<E, D> : VGGBase where E : RandomizableType, D : DeviceType


                    
                    
                    VGG13

Undocumented

Declaration

Swift

public struct VGG13<E, D> : VGGBase where E : RandomizableType, D : DeviceType


                    
                    
                    VGG16

Undocumented

Declaration

Swift

public struct VGG16<E, D> : VGGBase where E : RandomizableType, D : DeviceType


                    
                    
                    VGG19

Undocumented

Declaration

Swift

public struct VGG19<E, D> : VGGBase where E : RandomizableType, D : DeviceType