64 lines
1.4 KiB
ReStructuredText
64 lines
1.4 KiB
ReStructuredText
.. _gpu:
|
|
|
|
Accelerator: GPU training
|
|
=========================
|
|
|
|
.. raw:: html
|
|
|
|
<div class="display-card-container">
|
|
<div class="row">
|
|
|
|
.. Add callout items below this line
|
|
|
|
.. displayitem::
|
|
:header: Prepare your code (Optional)
|
|
:description: Prepare your code to run on any hardware
|
|
:col_css: col-md-4
|
|
:button_link: accelerator_prepare.html
|
|
:height: 150
|
|
:tag: basic
|
|
|
|
.. displayitem::
|
|
:header: Basic
|
|
:description: Learn the basics of single and multi-GPU training.
|
|
:col_css: col-md-4
|
|
:button_link: gpu_basic.html
|
|
:height: 150
|
|
:tag: basic
|
|
|
|
.. displayitem::
|
|
:header: Intermediate
|
|
:description: Learn about different distributed strategies, torchelastic and how to optimize communication layers.
|
|
:col_css: col-md-4
|
|
:button_link: gpu_intermediate.html
|
|
:height: 150
|
|
:tag: intermediate
|
|
|
|
.. displayitem::
|
|
:header: Advanced
|
|
:description: Train 1 trillion+ parameter models with these techniques.
|
|
:col_css: col-md-4
|
|
:button_link: gpu_advanced.html
|
|
:height: 150
|
|
:tag: advanced
|
|
|
|
.. displayitem::
|
|
:header: Expert
|
|
:description: Develop new strategies for training and deploying larger and larger models.
|
|
:col_css: col-md-4
|
|
:button_link: gpu_expert.html
|
|
:height: 150
|
|
:tag: expert
|
|
|
|
.. displayitem::
|
|
:header: FAQ
|
|
:description: Frequently asked questions about GPU training.
|
|
:col_css: col-md-4
|
|
:button_link: gpu_faq.html
|
|
:height: 150
|
|
|
|
.. raw:: html
|
|
|
|
</div>
|
|
</div>
|