Positional

Module: generative_models.core.layers.positional

Source: generative_models/core/layers/positional.py

Overview

Positional encoding implementations for transformers - CORRECTED VERSION.

This module provides various positional encoding implementations that can be used with transformer models using Flax NNX.

Classes

LearnedPositionalEncoding

class LearnedPositionalEncoding

PositionalEncoding

class PositionalEncoding

RotaryPositionalEncoding

class RotaryPositionalEncoding

SinusoidalPositionalEncoding

class SinusoidalPositionalEncoding

Functions

call

def __call__()

call

def __call__()

call

def __call__()

call

def __call__()

init

def __init__()

init

def __init__()

init

def __init__()

init

def __init__()

Module Statistics

• Classes: 4
• Functions: 8
• Imports: 4