.. _gpu:

Accelerator: GPU training
=========================

.. raw:: html

    <div class="display-card-container">
        <div class="row">

.. Add callout items below this line

.. displayitem::
   :header: Prepare your code (Optional)
   :description: Prepare your code to run on any hardware
   :col_css: col-md-4
   :button_link: accelerator_prepare.html
   :height: 150
   :tag: basic

.. displayitem::
   :header: Basic
   :description: Learn the basics of single and multi-GPU training.
   :col_css: col-md-4
   :button_link: gpu_basic.html
   :height: 150
   :tag: basic

.. displayitem::
   :header: Intermediate
   :description: Learn about different distributed strategies, torchelastic and how to optimize communication layers.
   :col_css: col-md-4
   :button_link: gpu_intermediate.html
   :height: 150
   :tag: intermediate

.. displayitem::
   :header: Advanced
   :description: Train models with billions of parameters
   :col_css: col-md-4
   :button_link: gpu_advanced.html
   :height: 150
   :tag: advanced

.. displayitem::
   :header: Expert
   :description: Develop new strategies for training and deploying larger and larger models.
   :col_css: col-md-4
   :button_link: gpu_expert.html
   :height: 150
   :tag: expert

.. displayitem::
   :header: FAQ
   :description: Frequently asked questions about GPU training.
   :col_css: col-md-4
   :button_link: gpu_faq.html
   :height: 150

.. raw:: html

        </div>
    </div>