From c5ab34876ba3f9d384dc97dfd5be4e22fd15abe1 Mon Sep 17 00:00:00 2001
From: awaelchli <aedu.waelchli@gmail.com>
Date: Sun, 18 Feb 2024 00:37:35 +0100
Subject: [PATCH] Document optional steps for converting Fabric code (#19486)

---
 docs/source-fabric/fundamentals/convert.rst | 15 +++++++++++++++
 1 file changed, 15 insertions(+)

diff --git a/docs/source-fabric/fundamentals/convert.rst b/docs/source-fabric/fundamentals/convert.rst
index 8b80cb4fd1..6f1a175eef 100644
--- a/docs/source-fabric/fundamentals/convert.rst
+++ b/docs/source-fabric/fundamentals/convert.rst
@@ -90,6 +90,21 @@ Check out our before-and-after example for `image classification <https://github
 ----
 
 
+****************
+Optional changes
+****************
+
+Here are a few optional upgrades you can make to your code, if applicable:
+
+- Replace ``torch.save()`` and ``torch.load()`` with Fabric's :doc:`save and load methods <../guide/checkpoint/checkpoint>`.
+- Replace collective operations from ``torch.distributed`` (barrier, broadcast, etc.) with Fabric's :doc:`collective methods <../advanced/distributed_communication>`.
+- Use Fabric's :doc:`no_backward_sync() context manager <../advanced/gradient_accumulation>` if you implemented gradient accumulation.
+- Initialize your model under the :doc:`init_module() <../advanced/model_init>` context manager.
+
+
+----
+
+
 **********
 Next steps
 **********