Skip to content

Workshop

Parallelism

mahdi-shafiei/workshop

Workshop

mahdi-shafiei/workshop

Home
Getting Started
Getting Started
User Guide
User Guide
- Concepts
  Concepts
- Models
  Models
- Training
  Training
- Data
  Data
  - Data Loading Overview
  - Data Loading Guide
- Modalities
  Modalities
- Inference
  Inference
- Advanced
  Advanced
- Integrations
  Integrations
API Reference
API Reference
- Core
  Core
- Models
  Models
  - VAE
  - GAN
  - Diffusion
  - Flow
- Training
  Training
  - Trainer
- Data
  Data
  - Data Loaders
Examples
Examples
- Overview
- Diffusion Models
  Diffusion Models
  - Simple Diffusion
  - DiT Demo
- Energy-Based Models
  Energy-Based Models
  - Simple EBM
- Basic Tutorials
  Basic Tutorials
- Advanced Tutorials
  Advanced Tutorials
- VAE Models
  VAE Models
  - Multi-Beta VAE Benchmark
- Protein Modeling
  Protein Modeling
- Geometric Models
  Geometric Models
- Audio Generation
  Audio Generation
  - Simple Audio Generation
- Text Generation
  Text Generation
  - Simple Text Generation
- Multimodal Models
  Multimodal Models
  - Simple Image-Text
- Framework Features
  Framework Features
  - Framework Features Demo
- Loss Functions
  Loss Functions
  - Loss Examples
- Sampling Methods
  Sampling Methods
- All Examples
Generative Models
Generative Models
Training
Training
Data & Modalities
Data & Modalities
Inference & Generation
Inference & Generation
- Inference Pipeline
- Sampling Methods
Evaluation
Evaluation
Advanced Topics
Advanced Topics
Development
Development
- Command Line Interface
- Utilities
Community
Community
- Contributing
- FAQ

Parallelism¤

Module: generative_models.core.parallelism

Source: generative_models/core/parallelism.py

Overview¤

Utilities for distributed and parallel training in JAX.

This module provides functions for setting up device meshes, sharding strategies, and other utilities for distributed training of large models.

Module Statistics¤

Classes: 0
Functions: 0
Imports: 0