FBGEMM GenAI

FBGEMM GenAI (FBGEMM Generative AI Kernels Library) is a collection of PyTorch GPU operator libraries that are designed for generative AI applications, such as FP8 row-wise quantization and collective communications.

FBGEMM GenAI Development

• Build Instructions
  • Set Up an Isolated Build Environment
  • Other Pre-Build Setup
  • CUDA Build
  • Post-Build Checks (For Developers)
• Installation Instructions
  • Set Up Runtime Environment
  • Install the FBGEMM GenAI Package
  • Post-Installation Checks
• Test Instructions
  • Set Up the FBGEMM GenAI Test Environment
  • Running FBGEMM GenAI Tests
  • Running FBGEMM GenAI Benchmarks