Jirka Borovec
ff1f8ef400
Test deprecated API for 0.8.0 and 0.9.0 ( #1071 )
...
* till 0.8
* refactor
* fix tests
* fix tests
* deprx till 0.9
* Update trainer.py
* Apply suggestions from code review
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-06 21:36:44 +01:00
Jirka Borovec
9785a3e78e
Refactor: name modules ( #548 )
...
* refactor: rename some modules
* add deprecation warnings
* fix paths
2019-11-26 22:39:18 -05:00
William Falcon
3e38005a61
Ddp2 fix ( #448 )
...
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* allow ddp and apex to be configured
* allow ddp and apex to be configured
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* added eval and train for redundancy
* added eval and train for redundancy
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* added training_end
* allow ddp and apex to be configured
* allow ddp and apex to be configured
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* bananas
* added eval and train for redundancy
* added eval and train for redundancy
2019-11-05 10:01:52 -05:00
William Falcon
8fbaccddae
added eval and train for redundancy ( #464 )
2019-11-05 09:14:33 -05:00
Ir1dXD
5a9afb11cc
change print to logging ( #457 )
...
* change print to logging
* always use logging.info
* use f-strings
* update code style
* set logging configs
* remove unused code
2019-11-05 08:43:21 -05:00
Tullie Murrell
248495b1d1
Add tbptt ( #429 )
...
* Add truncated bptt
* Fix rebase error
* AutoPep8
* Address comments, incl default bptt_split impl
* Add tbptt test
* Add default split for lists/tuples
* Add tbptt docs
* Fix trainer spacing
* Update RequiredTrainerInterface.md
2019-10-31 06:45:28 -04:00
Nic Eggert
05cea3ff8b
Save / Load Hyperparameters with checkpoint ( #415 )
...
* Save and load hparams from checkpoints
* Update docs
* Add warning when not saving hparams
* Missing import
* Update .run_local_tests.sh
* Update lm_test_module_mixins.py
* Update lightning_module_template.py
2019-10-23 04:48:24 -04:00
Jirka Borovec
f18aee30a5
Minor imports cleaning ( #402 )
...
* code cleaning
* drop unused imports
* optimize imports
2019-10-22 11:32:40 +03:00
tamyiuchau
4103a5ca73
Provide backward compatibility for #124 ( #400 )
...
* Provide backward compatibility for e681253
* typo fix
2019-10-21 08:16:55 +02:00
Adrian Wälchli
6e3e740a7f
Param printing ( #336 )
...
* print thousands as K, M, B, T, ...
* add option to print top-level modules only
* added doc string and added spacing
* do not print summary if neither "full" nor "top"
* updated docs showing summary print options
* fix line length for travis
2019-10-08 15:30:06 -04:00
William Falcon
967957e55c
added lbfgs support
2019-10-05 10:47:18 -04:00
William Falcon
a578de511d
clean up docs around loggers ( #304 )
2019-10-04 18:53:38 -04:00
William Falcon
a60a24d11b
disable auto gpu loading when restoring weights to avoid OOM ( #242 )
...
* Update root_module.py
* Update root_module.py
* Update root_module.py
* tests fix
* tests fix
2019-10-04 16:18:43 -04:00
Alok Singh
b0a0a47a0b
Rename variables ( #124 )
...
- data_batch → batch
- batch_i → batch_idx
- dataloader_i → dataloader_idx
- tng → training
- training_dataloader → train_dataloader
- add_log_row_interval → row_log_interval
- gradient_clip → gradient_clip_val
- prog → progress
- tqdm_dic → tqdm_dict
2019-09-25 19:05:06 -04:00
William Falcon
55e7322747
Metrics load ( #228 )
...
* load from metrics defaults to CPU
* load from metrics defaults to CPU
* load from metrics defaults to CPU
2019-09-16 10:47:19 -04:00
William Falcon
7099f8dbfb
split trainer mixins ( #209 )
...
* split trainer mixins
* Update multi_node_cluster_template.py
* Update single_cpu_template.py
* Update single_gpu_node_16bit_template.py
* Update single_gpu_node_ddp_template.py
* Update single_gpu_node_dp_template.py
* Update trainer_cpu_template.py
* Update trainer_io.py
* split trainer mixins
* Update multi_node_cluster_template.py
* deconflicted
* deconflicted
* deconflicted
2019-09-06 14:11:07 -04:00
Verena Haunschmid
25d5b25792
Expectopatronum implement #89 ( #182 )
...
* rename validate -> evaluate; implement test logic; allow multiple test_loaders
* add test_step and test_end to LightningModule
* add in_test_mode to pretraining to implement case 2 (test pretrained model)
* fix code style issues
* LightningTestModel: add optional second test set, implement test_step and test_end
* implemented test for multiple test_dataloaders; fixed typo
* add two test cases for #89
* add documentation for test_step, test_end; fix computation of loss in validation_step example
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Added proper dp ddp routing calls for test mode
* Update trainer.py
* Update test_models.py
* Update trainer.py
* Update trainer.py
* Update override_data_parallel.py
* Update test_models.py
* Update test_models.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update test_models.py
* Update test_models.py
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* debug
* Update trainer.py
* Update override_data_parallel.py
* Update debug.py
* Update lm_test_module.py
* Update test_models.py
2019-09-02 07:15:27 -04:00
William Falcon
4104a0fc47
cleaned up progbar ( #165 )
...
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* cleaned up progbar
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* updated base files
* flake 8
2019-08-23 21:23:27 -04:00
William Falcon
7f53e7bfb3
Val idx optional in validation_step ( #108 )
...
* made dataset_i only available with multiple datasets
* updated interface signature
* updated tests
2019-08-13 11:37:37 -04:00
William Falcon
905a2e5a12
allow user to control optimizer step for every optimizer
...
* added custom hook for user defined optimizer step
* refactored to allow multiple optimizers different training_step
* refactored to allow multiple optimizers different training_step
* refactored to allow multiple optimizers different training_step
* refactored to allow multiple optimizers different training_step
* refactored to allow multiple optimizers different training_step
* pep8
2019-08-13 09:32:45 -04:00
William Falcon
e5805bf8ff
val and test are optional now ( #95 )
...
* made validation step optional
* added no val model
* val_step can be implemented but not validation_end
* added no val end model
* added tests
* added tests
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* remove class
* updated docs
* updated docs
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* updated test
* fix pep8
2019-08-11 10:01:57 -04:00
William Falcon
10e4b18452
made imports absolute
2019-08-07 10:14:59 -04:00
Jiri BOROVEC
c44966a8bf
apply PEP8
2019-08-06 22:45:27 +02:00
Jiri BOROVEC
469941a528
pkg relative imports
...
* split requirements.txt
* pytest verbose
2019-08-05 10:52:09 +02:00
williamFalcon
5db28899aa
merged
2019-07-28 05:39:25 -07:00
William Falcon
64de447545
fixed hpc save, load. cleaned apu
2019-07-26 22:07:02 -04:00
William Falcon
e2c7fa44b7
auto state-dict and remove the way the model is loaded during hpc
2019-07-26 21:37:06 -04:00
Phuc Le
7d97e3e6e4
Support any lr_scheduler
2019-07-26 11:03:44 +07:00
William Falcon
20227b1382
removed hparams req
2019-07-25 12:08:00 -04:00
William Falcon
b0d38d532d
updated docs
2019-07-25 12:01:52 -04:00
William Falcon
d272f29c88
updated docs
2019-07-25 11:52:54 -04:00
William Falcon
09dba13cde
updated test models with lazy decorators
2019-07-25 11:01:08 -04:00
William Falcon
42a45bb273
updated test models with lazy decorators
2019-07-25 11:00:35 -04:00
William Falcon
24a3246bc1
updated test models with lazy decorators
2019-07-25 10:56:03 -04:00
William Falcon
39b15855ed
added lazy decorator
2019-07-25 10:39:48 -04:00
William Falcon
63a4af3ba7
added testing for metrics
2019-07-24 20:33:31 -04:00
William Falcon
c72a189c54
dp doesnt support amp with any setting
2019-07-24 19:48:48 -04:00
William Falcon
a3ad0e0ac1
ignoring dist parallel forward
2019-07-24 19:23:11 -04:00
William Falcon
f3b0cbf998
removed dead code in grads
2019-07-24 16:19:19 -04:00
William Falcon
74d714f159
removed opt check
2019-07-24 15:33:08 -04:00
William Falcon
ab00514ef6
fixed metrics request not forced anymore
2019-07-15 13:03:08 -04:00
Cinjon Resnick
3de053c903
root_module: fix comma splits.
2019-07-12 12:38:39 -04:00
William Falcon
611fbdea3e
removed from_lightning flag
2019-07-08 20:14:56 -04:00
William Falcon
0bcc858cef
moved sampler
2019-07-08 19:11:16 -04:00
William Falcon
770aff5fc7
testing slurm ddp
2019-07-08 11:32:01 -04:00
William Falcon
cd11b7de98
remove default tensor
2019-07-02 09:23:47 -04:00
William Falcon
f2134a4ddd
integrated tensorboardx test-tube
2019-06-29 15:58:47 -04:00
William Falcon
0bdb8533c6
added module properties docs
2019-06-28 18:42:53 -04:00
William Falcon
39af973bd4
added trainer docs
2019-06-27 11:03:53 -04:00
William Falcon
3b7c7c65e4
added lightning model docs
2019-06-27 10:05:47 -04:00