ananthsub
fec4f283bc
Update DataModule docs following property deprecations ( #8864 )
2021-08-12 10:02:26 -07:00
B. Kerim Tshimanga
24f0124ddd
Deprecate DataModule properties: train_transforms, val_transforms, test_transforms, dims, and size ( #8851 )
...
* Deprecate DataModule properties: train_transforms, val_transforms, test_transforms, dims, and size
2021-08-11 08:52:27 -07:00
Carlos Mocholí
a64cc37394
Replace `yapf` with `black` ( #7783 )
...
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2021-07-26 13:37:35 +02:00
Kaushik B
9ed6783357
Move mixin to core ( #8396 )
...
* Move mixin to core
* Move mixin to core
2021-07-19 10:15:59 +02:00
Tilman Krokotsch
09ff295177
Hyperparameters for datamodule ( #3792 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Tilman Krokotsch <tilman.krokotsch@iav.de>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Ethan Harris <ethanwharris@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
2021-07-09 15:10:00 +00:00
Carlos Mocholí
8fead58273
Add `functools.wraps` support for `is_overridden` ( #8296 )
2021-07-06 10:40:54 +02:00
Carlos Mocholí
dd340a6598
Actually show deprecation warnings and their line level [2/2] ( #8002 )
...
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-06-21 18:51:53 +02:00
Max Ehrlich
6856ccedfd
Remove rank_zero_only on DataModule prepare_data ( #7945 )
...
Signed-off-by: Max Ehrlich <max.ehr@gmail.com>
2021-06-12 12:50:29 +02:00
ananthsub
6fee9262ff
Deprecate `LightningDataModule` lifecycle properties ( #7657 )
...
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-06-09 12:30:40 +00:00
Christopher Ehmann
b9a52fa2ef
added stage param to LightningDataModule.setup example ( #7483 )
...
Co-authored-by: Sileadim <christopher@omnius.com>
2021-05-11 23:43:22 +05:30
Carlos Mocholí
b65ae79478
Automatically check `DataModule.has_{setup,teardown,prepare_data}` [2/2] ( #7238 )
...
* Automatically check `DataModule.has_{setup,teardown,prepare_data}`
* Use variable
* Spacing
* Docs
* Update CHANGELOG
* Remove `_DataModuleWrapper`
* Add test
* Update docs/source/extensions/datamodules.rst
* Bad merge
* add test for invalid name
* Remove ValueError
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-05-11 10:53:00 +02:00
Carlos Mocholí
3fdb61ac1b
Replace `_DataModuleWrapper` with `__new__` [1/2] ( #7289 )
...
* Remove `_DataModuleWrapper`
* Update pytorch_lightning/core/datamodule.py
* Update pytorch_lightning/core/datamodule.py
* Replace `__reduce__` with `__getstate__`
2021-05-04 08:00:24 +00:00
Carlos Mocholí
5af086ab9f
Attach data refactor and tuner bugs [4/n] ( #7258 )
...
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
2021-04-30 13:54:58 +00:00
Seongmin Park
7fe8d18477
Do not `shuffle` in `LightningDataModule.from_datasets` for `IterableDataset` ( #7053 )
...
* Expose shuffle argument in LightningDataModule.from_datasets
* Add test for DataModule initialization with iterable datasets
* Add changelog
* Remove trailing whitespace
* Add more tests for coverage
* Fix sequence dataset coverage
* Fix Sequence dataset tests
* Directly check whether each passed dataset is an IterableDataset
* Expose shuffle argument in LightningDataModule.from_datasets
* Add test for DataModule initialization with iterable datasets
* Add changelog
* Remove trailing whitespace
* Add more tests for coverage
* Fix sequence dataset coverage
* Fix Sequence dataset tests
* Directly check whether each passed dataset is an IterableDataset
* Fix changelog to reflect review direction
* Update CHANGELOG.md
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Fix changelog to reflect review direction (2)
* Add suggested braces
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Reuse isinstance check
* Merged tests with parametrize. Use mocks
Co-authored-by: Seongmin Park <seongmin.park@actionpower.kr>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2021-04-27 12:53:49 -04:00
thomas chaton
e147127c0e
[feat] Add better support for predict + ddp 2/3 ( #7215 )
...
* wip
* update
* update
* update
* update
* update
* typo
* update on comments
* update
* update
* update
* update
* update changelog
* update
* Fix merge
* Fix merge
* move code
* resolve test
* add extra test
* add an extra test
* update on comments
* add typing
* resolve flake8
* Refactor and Docs
* Fix tests
* Fix tests
* Fix tests
* Duplicate
* Fix tests
* resolve bug
* update
* update on comments
* update
* update changelog
* update
* update
* remove tpu
* resolve flake8
* update on comments
* update on comments
* update on comment
* resolve flake8
* add a cpu test for predict
* add None test
* update
* Update CHANGELOG.md
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* resolve tests
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-04-27 08:46:45 -04:00
Adrian Wälchli
2b232d3fbd
fix docs rendering in datamodule ( #7064 )
...
* [docs]: add newline to correctly render Example
* whitespace
Co-authored-by: Matthew Sarmiento <matthewcs@me.com>
2021-04-19 10:08:09 -04:00
ananthsub
40976e4eba
Support teardown hook on DataModule ( #4673 )
...
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: chaton <thomas@grid.ai>
2021-03-25 07:51:55 -05:00
Eric Cousineau
e886d55ac1
argparse: Add use_argument_group=True ( #6088 )
...
* argparse: Add inplace option
Replicate in GAN model
* datamodule: Deduplicate logic w/ argparser utilities
* Update pl_examples/domain_templates/generative_adversarial_net.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
* Keep docstrings
* Correct name
* Whitespace
* Consistency
* fix weird type stuff
* try alt - use_argument_group
* fix syntax + lint
* fix ci errs
* fix ci
* change examples... still failing w/ "unrecognized arguments: --batch_size"
* address review
* mnist_datamodule: add some docstrings
* argparse: check cls or cls.__init__ for param
didn't capture issue, but meh
* fix lint
* fix no-doc edge case
* address review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-03-11 10:50:49 -05:00
Carlos Mocholí
efd272a3ca
Pass {fit,validate,test,predict} to setup() and teardown() ( #6386 )
2021-03-08 15:27:07 +01:00
Jirka Borovec
7e8f4b9cee
try to fix imports for parsing ( #6256 )
...
* try to fix imports
* legacy 1.2.1
2021-03-02 11:08:29 -05:00
Rohit Gupta
bcc0004955
Add before_batch_transfer and after_batch_transfer hooks ( #3671 )
...
* add hooks
* comment
* docs
* add tests
* make it private
* fix tests
* docs
* chlog
* testcode
* codefactor
* fix doctest
* fix doctest
* suggestions
* is always overriden
* pep and BoringModel
* BoringModel
* docs
* docs
* docs
* fix
* rebase
* rebase
* suggestions
* docs
* suggestions
* try fix docs
* docs
* update name
* yapf
* docs
* rebase
* yapf
2021-02-18 06:58:12 -05:00
chaton
e982800b81
Add PredictLoop ( #5752 )
...
* integrate distrib_type
* sync changes
* sync
* fixes
* add forgotten generators
* add missing logic
* update
* import
* missed imports
* import fixes
* isort
* mv f
* changelog
* format
* move helper to parallel plugin
* d
* add world size
* clean up
* duplicate
* activate ddp_sharded and tpu
* set nvidia flags
* remove unused colab var
* use_tpu <-> on_tpu attrs
* make some ddp_cpu and clusterplugin tests pass
* Ref/accelerator connector (#5742 )
* final cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* connector cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* trainer cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* accelerator cleanup + missing logic in accelerator connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add missing changes to callbacks
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* reflect accelerator changes to lightning module
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* clean cluster envs
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* cleanup plugins
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add broadcasting
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* yapf
* remove plugin connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* plugins
* add predict_loop
* manual optimization
* clean predictloop
* update optimizer routing
* add predict loop on new accelerator
* resolve a bug
* add rank to torchelastic
* add predict_loop
* add predict loop on new accelerator
* resolve a bug
* fix memory mixed precision
* update
* setstate on trainer for pickling in ddp spawn
* add predict_loop
* clean predictloop
* add predict loop on new accelerator
* resolve a bug
* add predict_loop
* add predict loop on new accelerator
* resolve a bug
* add predict_loop
* add predict loop on new accelerator
* resolve a bug
* add predict_loop
* add predict loop on new accelerator
* resolve a bug
* add predict_loop
* clean predictloop
* add predict loop on new accelerator
* resolve a bug
* add predict_loop
* add predict loop on new accelerator
* resolve a bug
* resolve tests
* add predict method
* add back commented accelerator code
* adapt test for sync_batch_norm to new plugin
* fix deprecated tests
* fix ddp cpu choice when no num_processes are given
* yapf format
* skip a memory test that cannot pass anymore
* remove sanetize
* rename train to run_train
* remove useless hooks
* add misconfigurationException
* remove wrong naming
* resolve some legacy
* udpate docstring
* fix pickle error in spawn plugin
* x
* avoid
* x
* fix cyclic import in docs build
* add support for sharded
* update typing
* add sharded and sharded_spawn to distributed types
* make unwrap model default
* refactor LightningShardedDataParallel similar to LightningDistributedDataParallel
* update sharded spawn to reflect changes
* update sharded to reflect changes
* Merge 1.1.5 changes
* fix merge
* fix merge
* yapf isort
* fix merge
* yapf isort
* fix indentation in test
* copy over reinit scheduler implementation from dev1.2
* fix apex tracking calls with dev_debugger
* reduce diff to dev1.2, clean up
* fix trainer config test when gpus>0 and num_processes >0 and ddp_cpu
* sort plugin tests legacy/new
* fix error handling for amp on cpu
* fix merge
fix merge
fix merge
* [Feat] Resolve manual_backward (#5837 )
* resolve manual_backward
* resolve flake8
* update
* resolve for ddp_spawn
* resolve flake8
* resolve flake8
* resolve flake8
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* fix tests/accelerator tests on cpu
* [BugFix] Resolve manual optimization (#5852 )
* resolve manual_optimization
* update
* update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* Remove copy trainer parameters to happen earlier within the loop and add safe guard to get ref model (#5856 )
* resovle a bug
* Accelerator refactor sharded rpc (#5854 )
* rpc branch
* merge
* update handling of rpc
* make devices etc. Optional in RPC
* set devices etc. later if necessary
* remove devices from sequential
* make devices optional in rpc
* fix import
* uncomment everything
* fix cluster selection
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* resolve bug
* fix assert in rpc test
* resolve a test
* fix docs compilation
* accelerator refactor - fix for sharded parity test (#5866 )
* fix memory issue with ddp_spawn
* x
x
x
x
x
x
x
x
x
* x
* Remove DDP2 as this does not apply
* Add missing pre optimizer hook to ensure lambda closure is called
* fix apex docstring
* [accelerator][BugFix] Resolve some test for 1 gpu (#5863 )
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* update
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* revert init
* update
* resolve flake8
* update
* update
* update
* update
* update
* all_gather
* update
* make plugins work, add misconfig for RPC
* update
* update
* remove breaking test
* resolve some tests
* resolve flake8
* revert to ddp_spawn
Co-authored-by: root <root@ip-172-31-88-60.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
Co-authored-by: Justus Schock <justus.schock@rwth-aachen.de>
* yapf isort
* resolve flake8
* fix apex doctests
* fix apex doctests 2
* resolve docs
* update drone
* clean env
* update
* update
* update
* update
* merge
* Fix RPC related tests, clean out old API, update for new accelerator API [skip ci] (#5881 )
* Fix RPC related tests, clean out old API, update for new accelerator API
* Move tests out of legacy folder, update paths and names
* Update test_remove_1-4.py
* Expose properties for tpu cores/gpus/num_gpus
* Add root GPU property
* Move properties to properties.py
* move tests that were previously in drone
* Fix root GPU property (#5908 )
* Move root GPU to property, remove horovod set as this is handled in horovod plugin, ensure we mock correctly to set GPU accelerator
* Add missing tests back
* fix best model path transfer when no checkpoint callback available
* Fix setup hook order [wip] (#5858 )
* Call trainer setup hook before accelerator setup
* Add test case
* add new test
* typo
* fix callback order in test
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* rename ddp sequential -> rpc sequential for special test
* revert
* fix stupid merge problem
* Use property in connector for sampler (#5913 )
* merge the import conflicts
* fix spawning of processes in slurm
* [wip] Fix some bugs for TPU [skip ci] (#5878 )
* fixed for single tpu
* fixed spawn
* fixed spawn
* update
* update
* wip
* resolve bugs
* resolve bug
* update on comment
* removed decorator
* resolve comments
* set to 4
* update
* update
* need cleaning
* update
* update
* update
* resolve flake8
* resolve bugs
* exclude broadcast
* resolve bugs
* change test
* update
* update
* skip if meet fails
* properly raise trace
* update
* add catch
* wrap test
* resolve typo
* update
* typo
Co-authored-by: Lezwon Castelino <lezwon@gmail.com>
Co-authored-by: Your Name <you@example.com>
* resolve some tests
* update
* fix imports
* update
* resolve flake8
* update azure pipeline
* skip a sharded test on cpu that requires a gpu
* resolve tpus
* resolve bug
* resolve flake8
* update
* updat utils
* revert permission change on files
* suggestions from carlos
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* remove unrelated formatting changes
* remove incomplete comment
* Update pytorch_lightning/accelerators/__init__.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* remove unrelated formatting change
* add types
* warn 1.7 ddp manual backward only if ddp kwarg unset
* yapf + isort
* pep8 unused imports
* fix cyclic import in docs
* Apply suggestions from code review
* typer in accelerator.py
* typo
* resolve flake8
* update code
* update
* Update pytorch_lightning/trainer/predict_loop.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/trainer/predict_loop.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* fix merge
* fix merge
* reset legacy accelerator
* add missing rename dispatch
* rename post traning
* update code
* resolved comments
* typo
* typo
* add flow description
* resolve comments
* update on comments
* update flow
* add backticks
* resolve tpu
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: justusschock <justus.schock@posteo.de>
Co-authored-by: Justus Schock <justus.schock@rwth-aachen.de>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: root <root@ip-172-31-88-60.ec2.internal>
Co-authored-by: Lezwon Castelino <lezwon@gmail.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-02-16 17:11:56 -05:00
Kaushik B
4857546c25
Fix: Failing test in data_modules(dp) ( #5924 )
...
* Update test_datamodules.py
* fix code format issue
* fix test restore
* fix code format issue
2021-02-11 17:32:46 +00:00
Teddy Koker
253e57c2c2
Feature: LightningDataModule.from_datasets(...) ( #5133 )
...
* add class method
* add tests
* docstring
* pep
* Add type annotations
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* pep
* fix import
* remove num_workers inference
* Update pytorch_lightning/core/datamodule.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* Update pytorch_lightning/core/datamodule.py
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* Update pytorch_lightning/core/datamodule.py
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* fix syntax
* typing fix
* list -> sequence
* list -> sequence
* missing import
* fix test
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2021-02-11 14:32:41 +00:00
Jirka Borovec
58c90ba7b7
formatting 5/n: Core ( #5721 )
...
* yapf core
* Update pytorch_lightning/core/lightning.py
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-02-08 14:29:43 -05:00
Arnaud Gelas
8dfcc078c4
Fix isort failures in core ( #5526 )
...
Remove from skipped module in pyproject.toml and fix failures on:
- pytorch_lightning/core/*.py
2021-01-27 05:02:16 -05:00
Jirka Borovec
2846322f60
fix docs render ( #5610 )
2021-01-25 20:21:00 -05:00
Jeff Yang
baa8558cc0
logger docs and api docs ( #3950 )
...
* logger and api docs
* remove gpu_usage_logger, lr_logger
* update docstring
* fix wandb example
* remove step result
* charts
* add some charts info
Co-authored-by: Teddy Koker <teddy.koker@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
2020-11-13 20:35:54 +05:30
ananthsub
1eb1d17e25
Add trainer attribute to datamodule ( #3749 )
...
* Split out changes from #3563 to make that PR easier to review. This formats the file according to the Black formatter
* Store a reference to the trainer on the datamodule
Fixes #3682
* Update data_connector.py
* Update data_connector.py
* Update test_datamodules.py
* Add attribute to datamodule for trainer
2020-10-01 00:41:19 +05:30
ananthsub
3dcf7130c5
Support checkpoint hooks on data module ( #3563 )
...
* Split out changes from #3563 to make that PR easier to review. This formats the file according to the Black formatter
* Store a reference to the trainer on the datamodule
Fixes #3682
* Update data_connector.py
* Update data_connector.py
* Update test_datamodules.py
* Split out changes from #3563 to make that PR easier to review. This formats the file according to the Black formatter
* support checkpoint hooks for datamodule
refactor on_{save/load}_checkpoint to a separate hook class that both the lightning module and data module inherit
add spots in callback connector to call new datamodule hooks if available
* hooks formatting
* Update hooks.py
* Update checkpoint_connector.py
* Update lightning.py
* update based on upstream/master
checkout upstream/master
* Update checkpoint_connector.py
* add tests
* undo format revert
* Updated CHANGELOG.md
* add checkpoint hooks
* add Dict type
* import CheckpointHooks
2020-09-29 19:51:44 +02:00
William Falcon
ddd11075bd
[WIP] ref: deprecated results obj, added support for simpler comms (1/n) ( #3681 )
...
* ref: deprecated results obj, added support for simpler comms. Decouples logging from loops
* ref: deprecated results obj, added support for simpler comms. Decouples logging from loops
* ref: deprecated results obj, added support for simpler comms. Decouples logging from loops
* ref: deprecated results obj, added support for simpler comms. Decouples logging from loops
* ref: deprecated results obj, added support for simpler comms. Decouples logging from loops
* ref: deprecated results obj, added support for simpler comms. Decouples logging from loops
* fix global step err
* fix global step err
* fix global step err
* fix global step err
* fix global step err
* fix typing err
* fix str
* fix typing err
2020-09-27 23:19:46 -04:00
William Falcon
ff2bab0996
ref: (results 1/n) enable tracking original metric when step and epoch are both true ( #3685 )
...
* enable tracking original metric when step and epoch are both true
2020-09-27 22:08:31 -04:00
Antoine Broyelle
17c8c95fbc
Wrap prepare_data and setup only once inside DataModule ( #3654 )
...
Fix #3652
2020-09-25 07:09:50 -04:00
ananthsub
c346679f81
Black format pytorch_lightning/core/datamodule.py ( #3574 )
...
Split out changes from #3563 to make that PR easier to review
2020-09-20 23:00:00 -04:00
Nathan Raw
00ab67edc3
Make dims a property in datamodule ( #3547 )
...
* 🐛 make dims a property
* 🐛 fix
2020-09-18 23:30:49 +02:00
Adrian Wälchli
7bd2f946d9
Ref: Pull duplicate data interface definition up into DataHooks class ( #3344 )
...
* pull data hooks up into a common interface
* fix multiple inheritance ordering
* docs reference datahooks
2020-09-04 06:04:45 -04:00
Carlos Mocholí
cc80749c7e
Parse Union[bool, str] arguments ( #3235 )
...
* Parse Union[bool, str] arguments
* Address review
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-08-29 10:39:42 -04:00
Nathan Raw
bab89b8d21
Add transfer_batch_to_device hook to DataModule ( #3038 )
...
* ✨ add dm to_device logic in trainer
* 🔥 remove unnecessary comment
* ✨ add to_device logic to datamodule
* ✅ add test
* updated docs
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-08-20 08:47:11 -04:00
William Falcon
48f658fbb5
Fixes #2943 ( #2970 )
2020-08-13 21:44:55 -04:00
Nathan Raw
036bcea499
Call DataModule hooks implicitly in trainer ( #2755 )
...
* ✨ call dm hooks in trainer implicitly
* ✅ update tests
* 📝 remove unused stage arg from dm docs
* ✅ update tests
* ✅ update tests
* 🚧 include stage in datamodule.setup
* 📝 docs
* 📝 docs
* added more dm tests
* added more dm tests
* 🐛 call dm.setup everywhere
* 🔥 pickle tests now implied by accelerator tests
* 🎨 set dm as attr of trainer
* 🐛 .
* 🚧 wip
* add can prepare test
* add can prepare test
* verified setup in fit
* fixed setup call
* fixed setup call
* fixed setup call
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-08-01 20:17:57 -04:00
William Falcon
071e09fe38
refactor 1/n for v1.0.0 ( #2704 )
...
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
* reactor into gpu accelerator
2020-07-25 14:38:51 -04:00
Nathan Raw
1caf8beb2c
Datamodule ( #2668 )
...
* ✨ Add copy of pl_bolts datamodule to lightning
* ✨ add datamodule to necessary init files
* 🚧 add datamodule property to LightningModule
* 🚧 .
* 🎨 Let DataModule do its own thing
* 🚧 add back setup and run both hooks implicitly
* 🚧 .
* 🐛 fix add_argparse_args
* 💄 apply black formatting and isort
* 📝 docstrings
* 📝 .
* 📝 .
* 🐛 overwrite cls prepare_data instead of instance
* 📝 .
* ✅ add some tests
* Update datamodule.py
* Update datamodule.py
* Update datamodule.py
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-07-24 11:42:15 -04:00