34f036917d
Document `ddp_find_unused_parameters_true` in Fabric ( #19564 )
2024-03-04 06:10:38 -05:00
4bcc4f1cf7
Document the return value of `Fabric.clip_gradients()` ( #19457 )
2024-02-13 11:32:47 +01:00
7cc79fe7ba
Reapply `torch.compile` in Fabric.setup() ( #19280 )
2024-01-23 21:17:41 -05:00
a4ecf8d5c8
Dedicated docs page for distributed checkpoints ( #19287 )
2024-01-16 08:44:10 -05:00
45c2fcb341
Add AttributeDict container for Fabric ( #18943 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-11-18 09:25:26 -05:00
ad93f64d35
Bitsandbytes docs improvements ( #18903 )
2023-11-02 15:50:54 +01:00
800b87eb46
Add throughput utilities to Fabric and the Trainer ( #18848 )
2023-10-30 17:10:29 +01:00
e02bb391af
Utility to disable all instances of `PossibleUserWarning` ( #18744 )
...
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-10-10 06:53:32 -04:00
5120ad20f2
Bitsandbytes precision plugin ( #18655 )
...
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-09-29 19:17:18 +02:00
f83ad093e5
Utility function to check shared filesystem ( #18586 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-09-25 15:49:52 -04:00
57f5268eb3
Improve the suggested `num_workers` warning ( #18591 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-09-21 09:38:25 -04:00
c1ee22a687
Optimize import paths for optional dependencies ( #18561 )
...
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-09-15 17:04:19 -04:00
756e481969
Support the TransformerEngine precision plugin with the Trainer ( #18459 )
...
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-09-07 19:21:00 +02:00
d3ee410100
Add dedicated docs page for init-module ( #18416 )
2023-08-28 11:28:38 -04:00
547e7aa393
docs: 1/3 enable Sphinx nitpicky [fabric] ( #18069 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-08-23 10:31:20 +02:00
071f85842e
Support NVIDIA's Transformer Engine as a precision plugin ( #17597 )
2023-07-19 18:21:58 +02:00
dab373de54
Support loading a raw PyTorch state-dict checkpoint in Fabric ( #18049 )
...
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-07-18 14:06:17 -04:00
c8656f1a27
docs: `fabric_methods.rst` using deprecated parameters ( #18015 )
2023-07-07 11:32:09 +02:00
1204006637
Document tensor shape requirements in `all_gather` ( #17816 )
2023-06-15 17:30:02 +02:00
24a3115995
Support empty weight initialization in `Fabric.init_module()` ( #17627 )
2023-06-07 18:33:53 +00:00
88cd100369
Address feedback for `Fabric.init_module()` (1/4) ( #17721 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-05-31 14:05:29 +00:00
54e8095a78
Split `init_module` into `init` + `sharded_model` ( #17488 )
2023-05-05 15:54:52 +02:00
6ec9a6bd9e
[TPU] Rename classes to use XLA instead of TPU ( #17383 )
2023-04-28 12:36:22 -04:00
614dcdf502
True half-precision support in Fabric ( #17287 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-27 12:37:33 +00:00
4d17b5fe77
Improved model initialization API for Fabric ( #17462 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-04-26 11:25:33 -04:00
d48ec08d76
Update gradient clipping docs in Fabric ( #17470 )
2023-04-25 20:20:05 +00:00
20303e4736
Add Fabric.launch to Fabric methods section ( #17437 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-04-24 10:28:52 +02:00
1aa23267ab
Various Fabric documentation updates ( #17236 )
2023-04-11 23:05:57 +00:00
c886317c0c
Restructure Fabric docs (2/n) ( #17126 )
...
Co-authored-by: edenlightning <66261195+edenlightning@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-03-20 18:11:26 -04:00
ea708da55a
Add `is_wrapped` utility function for Fabric ( #16953 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-03-14 13:03:38 +00:00
1e42783973
Miscellaneous updates in Fabric docs ( #16980 )
2023-03-07 15:43:47 +00:00
54147e0745
Update Fabric docs navigation ( #16957 )
2023-03-06 16:13:51 +01:00
f2caa01bb3
Document gradient clipping in Fabric ( #16943 )
2023-03-05 17:03:57 +00:00
0e8ac7e1c9
docs: move fabric on its own ( #16742 )
...
* docs: move fabric to Lai
* update imports
* links
* drop link to Trainer
* own docs
* ci
* trigger
* prune cross-links
* cleaning
* cleaning
* template
* imports
* template
* path
* links
* tensorboardX
* plugins
* label
* drop fixme
* drop copy nb + examples
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Apply suggestions from code review
* try again
* rev
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-03-01 12:36:14 +01:00
Leng Yue