b79b68481e
Clarify setup of optimizer when using `empty_init=True` ( #19067 )
2023-11-26 11:04:36 +01:00
af852ff590
Handle checkpoint dirpath suffix in NeptuneLogger ( #18863 )
...
Co-authored-by: Siddhant Sadangi <siddhant.sadangi@gmail.com>
Co-authored-by: Sabine <sabine.nyholm@neptune.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-11-25 08:39:46 -05:00
1fcb4ae637
Cast to >=float32 tensor when passing scalar to self.log ( #19046 )
...
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-11-23 20:01:48 -05:00
90043798e4
Clarify `self.log(..., rank_zero_only=True|False)` ( #19056 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-11-23 13:02:21 -05:00
a6da1e3351
Add fault tolerance Streaming Dataset 2/n ( #19052 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-23 17:40:04 +00:00
bf54a1de77
Remove outdated "optimized installation" section from docs ( #19057 )
2023-11-23 15:58:48 +01:00
58c905b940
Fix ModelCheckpoint dirpath expanding home prefix ( #19058 )
2023-11-23 09:11:43 -05:00
85adf17328
Fix docs for 'nn.Module from checkpoint' ( #19053 )
2023-11-23 04:23:24 +01:00
9a26da8081
Make `ModelCheckpoint._format_checkpoint_name` an instance method ( #19054 )
2023-11-22 19:05:48 -05:00
dbea69be61
Add `@override` for files in `src/lightning/pytorch/trainer/callbacks` ( #19006 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-11-23 00:56:52 +01:00
da79480054
PyTest random order for Fabric tests ( #19040 )
2023-11-22 16:41:49 -05:00
c6e5e34d1f
Add `@override` for files in `src/lightning/pytorch/plugins` ( #19025 )
...
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-11-22 14:14:46 -05:00
7eca9c1642
Add numpy support for the StreamingDataset 1/2 ( #19050 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-22 18:00:15 +00:00
1073276a58
Add fault tolerance for the StreamingDataset 1/n ( #19049 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-22 17:22:00 +00:00
bc1658039f
Add direct s3 support to the streaming dataset ( #19044 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-22 01:17:49 +00:00
67d3844818
Fix last checkpoint finding in filtered files with correct extension ( #17072 )
...
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-11-21 17:12:02 -05:00
d4614d043e
Address test flakiness ( #19022 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-11-21 17:11:00 -05:00
e3be762538
Re-enable dynamo tests that were fixed in PyTorch 2.1 ( #19038 )
2023-11-21 16:30:20 -05:00
d3df1273b6
Add disk usage check before downloading files ( #19041 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-21 20:10:18 +00:00
49caddde6e
Call `configure_model()` in `LM.load_from_checkpoint()` ( #19036 )
2023-11-21 09:44:18 -05:00
aebac09397
Call `find_free_network_port` only if necessary ( #19037 )
2023-11-21 07:49:11 -05:00
6cbe9ceb56
ThroughputMonitor Trainer callback fixes ( #19027 )
2023-11-21 02:40:13 -05:00
dd206a20d8
Remove unnecessary torch.cuda.manual_seed_all() ( #19034 )
2023-11-20 15:55:16 -05:00
f652e6c00e
Fix `rank_zero_only` rank not set in ddp-spawn based strategies ( #19030 )
2023-11-20 10:49:14 -05:00
4789905880
Bump Lightning-AI/utilities from 0.9.0 to 0.10.0 ( #19031 )
...
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-20 05:52:30 -05:00
4f4c890cd7
Improve handling the positional encoding in Transformer example ( #18987 )
2023-11-19 14:37:31 +01:00
61a286d62b
Make input dir in DataProcessor required ( #18910 )
2023-11-18 12:24:30 -05:00
b757edc401
Add `@override` for files in `src/lightning/pytorch/profilers` ( #19020 )
2023-11-18 09:26:51 -05:00
45c2fcb341
Add AttributeDict container for Fabric ( #18943 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-11-18 09:25:26 -05:00
8c1e9e499d
Add `@override` for files in `src/lightning/pytorch/tuner` ( #19005 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2023-11-18 08:58:07 -05:00
de7faf976b
Update evaluation logging test ( #18896 )
2023-11-18 08:56:47 +01:00
b8a96fe5d6
Fix fsspec local file protocol checks for new fsspec version ( #19023 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-11-18 08:51:37 +01:00
4e72dcc8db
Reduce lightning data's dependencies ( #19026 )
2023-11-17 16:52:14 -05:00
6e10642668
docs: update chlog with `2.1.1` & `2.1.2` ( #19021 )
...
* docs: update chlog with `2.1.1` & `2.1.2`
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Added
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-11-17 16:05:52 -05:00
6e517bd55b
Resolve Item Loader bugs ( #19017 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-11-16 18:06:58 -05:00
3d448ac48d
Remember the eval mode of submodules when switching trainer stages ( #18951 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-11-16 16:32:27 -05:00
792cb73fc6
Remove the LightningDataset relying on un-maintained torchdata ( #19019 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-16 16:08:15 -05:00
b80107e7ba
ci/docs: upload with dispatch ( #19018 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-11-16 21:08:10 +01:00
46ec46bdcc
Adding test for legacy checkpoint created with 2.1.x ( #18789 )
...
Co-authored-by: Borda <Borda@users.noreply.github.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Jirka B <j.borovec+github@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-11-16 20:41:45 +01:00
beca90933c
docs: enable retro dispatch build ( #19016 )
2023-11-16 12:14:42 -05:00
ca7368c5e1
ci/doc: enable build docs on spec version ( #19013 )
2023-11-16 17:40:13 +01:00
e2b047eb53
docs: fix inter-sphinx to `numpy` ( #19014 )
2023-11-16 11:30:38 -05:00
14cbd3fbeb
docs: pin some linked ipynb to 2.1.0 ( #19012 )
2023-11-16 17:15:03 +01:00
eedff1256c
ci: minor formatting update ( #19008 )
2023-11-15 23:15:01 -05:00
008a83ed5a
Improve media logging support in WandbLogger ( #18164 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Bharat Ramanathan <ramanathan.parameshwaran@gohuddl.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: awaelchli <aedu.waelchli@gmail.com>
2023-11-15 00:29:34 -05:00
54593b0eeb
Implement todos in tensorboard docs ( #18894 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2023-11-14 19:58:15 -05:00
ed76bb74c6
ci: add labels for data & store ( #18961 )
2023-11-14 20:39:01 +01:00
fc021f1a32
Add `@override` for files in `src/lightning/pytorch/trainer/connectors` ( #18997 )
2023-11-14 10:24:04 -05:00
cb23fc2dd4
Update auto_encoder.py to accomodate torchvision breaking change ( #18996 )
...
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-13 15:32:16 -05:00
7288302186
Add multiple uploaders to the map, optimize ( #18989 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: thomas <thomas@thomass-MacBook-Pro.local>
2023-11-13 14:27:50 -05:00
Adrian Wälchli