8211256c46
data transfer model hook (+ refactor) ( #1756 )
...
* refactor and added hook
variant a
variant b
add test
revert rename
add changelog
docs
* resolve merge duplication
* overridden typo
* fix test
* tpu id
* raise if TPU not available
* re-use apply_to_collection function for parsing collections
* comment
* make utility function available to user
* documentation
* move changelog entry to top
* fix tpu transfer call
* fix call
* remove hardcoded string
* improve test
* call model hook by default
* Apply suggestions from code review
* rename utility function
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-06-02 21:45:19 -04:00
3af3f37d43
Add toma comments to auto_scale_batch_size ( #1994 )
...
* Add source comments
* Update training_tricks.rst
2020-05-29 05:57:50 +00:00
9b629637b8
New metric classes ( #1326 ) ( #1877 )
...
* New metric classes (#1326 )
* Create metrics package
* Create metric.py
* Create utils.py
* Create __init__.py
* add tests for metric utils
* add docstrings for metrics utils
* add function to recursively apply other function to collection
* add tests for this function
* update test
* Update pytorch_lightning/metrics/metric.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* update metric name
* remove example docs
* fix tests
* add metric tests
* fix to tensor conversion
* fix apply to collection
* Update CHANGELOG.md
* Update pytorch_lightning/metrics/metric.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* remove tests from init
* add missing type annotations
* rename utils to convertors
* Create metrics.rst
* Update index.rst
* Update index.rst
* Update pytorch_lightning/metrics/convertors.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/metrics/convertors.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/metrics/convertors.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/metrics/metric.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update tests/utilities/test_apply_to_collection.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update tests/utilities/test_apply_to_collection.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update tests/metrics/convertors.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Apply suggestions from code review
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* add doctest example
* rename file and fix imports
* added parametrized test
* replace lambda with inlined function
* rename apply_to_collection to apply_func
* Separated class description from init args
* Apply suggestions from code review
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* adjust random values
* suppress output when seeding
* remove gpu from doctest
* Add requested changes and add ellipsis for doctest
* forgot to push these files...
* add explicit check for dtype to convert to
* fix ddp tests
* remove explicit ddp destruction
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* move dtype device mixin to more general place
* refactor to general device dtype mixin
* add initial metric package description
* change default to none for mac os
* pep8
* fix import
* Update index.rst
* Update ci-testing.yml
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update CHANGELOG.md
* Update pytorch_lightning/metrics/converters.py
* readme
* Update metric.py
* Update pytorch_lightning/metrics/converters.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-05-19 11:05:07 -04:00
4970927ec8
Feature: auto scale batch size ( #1638 )
...
* auto batch finder
* fix styling
* add description
* add different modes
* fix copy paste error
* better organised code
* fix styling
* add tests
* fix
* fix
* add some documentation
* added CHANGELOG.md
* some documentation
* update based on review
* Update trainer.py
* Update docs/source/training_tricks.rst
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* Update tests/trainer/test_trainer_tricks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Update tests/trainer/test_trainer_tricks.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* use EvalModelTemplate
* param tests
* rename
* wrap params
* rename function
* rename
* rename param
* fix
* abs
* rename
* refactor code
* add docs
* try
* arg
* loop
* exept
* loop
* drop bool
* docs
* docs
* added check and test for passing dataloader to fit
* styling fix
* update based on review
Co-authored-by: Nicki Skafte <nugginea@gmail.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2020-05-09 08:28:36 -04:00
6e86b59d21
ddp pickle
2020-04-27 06:51:42 -04:00
4755ded863
Clean up Argparse interface with trainer ( #1606 )
...
* fixed distutil parsing
* fixed distutil parsing
* Apply suggestions from code review
* log
* fixed distutil parsing
* fixed distutil parsing
* fixed distutil parsing
* fixed distutil parsing
* doctest
* fixed hparams section
* fixed hparams section
* fixed hparams section
* formatting
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-26 09:20:06 -04:00
58a467dd68
model checkpint on rank_zero_only & global rank state ( #1408 )
...
* try delete in async or DDP us0-ecase
* changelog
* add model chekpoint rank
* simple delete
* flake8
* use global rank
* chnagelog
* fix review
* fix import
* proposal
* proposal
* proposal
* improve proposal (fix problems with method call self)
* cleaning
Co-authored-by: Adrian Wälchli <adrian.waelchli@students.unibe.ch>
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-04-24 17:21:00 -04:00
29c7d2f195
Revert namespace package search to normal package search ( #1545 )
...
* Revert this
* typos
* version++
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-21 08:26:47 -04:00
ae2e14e3ed
fixed memory leak from opt return ( #1528 )
...
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
* fixed memory leak from opt return
2020-04-19 16:41:54 -04:00
17f58d2e11
add rank warning ( #1428 )
...
* add rank warning
* changelog
* use rank_zero_warn
* user trainer_init
* replace warnings
* fix test
* flake8
* docs
* changelog
* bug lol
2020-04-09 14:05:46 -04:00
6ddb03922a
Profiler summary ( #1259 )
...
* refactor and add types
* add Prorfiler summary
* fix imports
* Revert "refactor and add types"
This reverts commit b4c552fa
* changelog
* revert rename
* fix test
* mute verbose
2020-03-31 08:57:48 -04:00
c32e3f3ea5
coverage increase ( #1167 )
...
* fixed docs
* Docs (#1164 )
* fixed docs
* fixed docs
* fixed docs
* fixing Win failed import (#1163 )
* version
* try fix distrib
* update try import
* fixed docs
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-03-16 21:43:43 -04:00
1051c189e1
Simplify variables: step, epoch, max_epochs, min_epochs ( #589 )
2019-12-07 08:50:21 -05:00
3a58937d8b
rename variables nb -> num ( #567 )
...
* rename nb -> num
* flake8
* batch_nb, epoch_nb, gpu_nb, split_nb
* add _num deprecations
2019-12-04 06:57:10 -05:00
d71556e7a1
Sphinx generated documentation ( #521 )
...
* upgrade req.
* move MkDocs
* create Sphinx
* init Sphinx
* move md from MkDocs to Sphinx
* CI: build docs
* build Sphinx
formatting
move docs from MD to docstring in particular package/modules
formatting
add Sphinx ext.
rename root_module to core
drop implicit name "_logger"
drop duplicate name "overwrite"
fix imports
use pytorch theme
add sample link mapping
try fix RTD build
use forked template
fix some docs warnings
fix paths
add deprecation warnings
fix flake8
fix paths
revert refactor
revert MLFlowLogger
* revert example import
* update link
* Update lightning_module_template.py
2019-11-28 12:48:55 -05:00
89f7a82157
Escape percentage symbol in argparse ( #499 )
2019-11-13 06:03:38 -05:00
f18aee30a5
Minor imports cleaning ( #402 )
...
* code cleaning
* drop unused imports
* optimize imports
2019-10-22 11:32:40 +03:00
b0a0a47a0b
Rename variables ( #124 )
...
- data_batch → batch
- batch_i → batch_idx
- dataloader_i → dataloader_idx
- tng → training
- training_dataloader → train_dataloader
- add_log_row_interval → row_log_interval
- gradient_clip → gradient_clip_val
- prog → progress
- tqdm_dic → tqdm_dict
2019-09-25 19:05:06 -04:00
d9bfe964f9
update by flake8
2019-08-06 22:45:46 +02:00
c44966a8bf
apply PEP8
2019-08-06 22:45:27 +02:00
01caefb4e6
Update arg_parse.py
2019-08-05 14:14:28 -04:00
2b31ced060
Update debugging.py
2019-08-05 14:13:23 -04:00
469941a528
pkg relative imports
...
* split requirements.txt
* pytest verbose
2019-08-05 10:52:09 +02:00
92f8c57ff5
cutout examples
2019-08-05 09:51:47 +02:00
Adrian Wälchli