2019-03-31 20:00:41 +00:00
|
|
|
# project
|
|
|
|
|
.DS_Store
|
|
|
|
|
run_configs/
|
|
|
|
|
model_weights/
|
|
|
|
|
app/models/
|
2019-04-21 17:13:09 +00:00
|
|
|
pip-wheel-metadata/
|
2019-10-16 13:33:58 +00:00
|
|
|
lightning_logs/
|
2020-02-23 02:45:34 +00:00
|
|
|
.vscode/
|
2020-01-21 20:18:32 +00:00
|
|
|
|
2020-01-20 19:50:31 +00:00
|
|
|
# Test-tube
|
|
|
|
|
test_tube_logs/
|
|
|
|
|
test_tube_data/
|
|
|
|
|
test_tube_exp/
|
|
|
|
|
|
|
|
|
|
# Documentations
|
2020-05-04 20:53:06 +00:00
|
|
|
docs/source/api
|
2020-02-16 15:50:00 +00:00
|
|
|
docs/source/*.md
|
2020-10-06 21:28:45 +00:00
|
|
|
docs/source/generated
|
2021-01-26 20:07:07 +00:00
|
|
|
docs/source/*/generated
|
2019-03-31 20:00:41 +00:00
|
|
|
|
|
|
|
|
# Byte-compiled / optimized / DLL files
|
|
|
|
|
__pycache__/
|
|
|
|
|
*.py[cod]
|
|
|
|
|
*$py.class
|
|
|
|
|
timit_data/
|
|
|
|
|
|
2020-01-21 20:18:32 +00:00
|
|
|
|
2019-03-31 20:00:41 +00:00
|
|
|
# C extensions
|
|
|
|
|
*.so
|
|
|
|
|
|
2021-01-08 15:36:49 +00:00
|
|
|
# PyCharm
|
2019-03-31 20:00:41 +00:00
|
|
|
.idea/
|
|
|
|
|
|
|
|
|
|
# Distribution / packaging
|
|
|
|
|
.Python
|
|
|
|
|
ide_layouts/
|
|
|
|
|
build/
|
2020-11-10 19:44:51 +00:00
|
|
|
_build/
|
2019-03-31 20:00:41 +00:00
|
|
|
develop-eggs/
|
|
|
|
|
dist/
|
|
|
|
|
downloads/
|
|
|
|
|
eggs/
|
|
|
|
|
.eggs/
|
|
|
|
|
lib/
|
|
|
|
|
lib64/
|
|
|
|
|
parts/
|
|
|
|
|
sdist/
|
|
|
|
|
wheels/
|
|
|
|
|
*.egg-info/
|
|
|
|
|
.installed.cfg
|
|
|
|
|
*.egg
|
|
|
|
|
|
|
|
|
|
# PyInstaller
|
|
|
|
|
# Usually these files are written by a python script from a template
|
|
|
|
|
# before PyInstaller builds the exe, so as to inject date/other infos into it.
|
|
|
|
|
*.manifest
|
|
|
|
|
*.spec
|
|
|
|
|
|
|
|
|
|
# Installer logs
|
|
|
|
|
pip-log.txt
|
|
|
|
|
pip-delete-this-directory.txt
|
|
|
|
|
|
|
|
|
|
# Unit test / coverage reports
|
|
|
|
|
htmlcov/
|
|
|
|
|
.tox/
|
|
|
|
|
.coverage
|
|
|
|
|
.coverage.*
|
|
|
|
|
.cache
|
|
|
|
|
nosetests.xml
|
|
|
|
|
coverage.xml
|
|
|
|
|
*.cover
|
|
|
|
|
.hypothesis/
|
2020-01-20 19:50:31 +00:00
|
|
|
tests/tests_tt_dir/
|
|
|
|
|
tests/save_dir
|
|
|
|
|
tests/tests/
|
2019-03-31 20:00:41 +00:00
|
|
|
|
|
|
|
|
# Translations
|
|
|
|
|
*.mo
|
|
|
|
|
*.pot
|
|
|
|
|
|
|
|
|
|
# Django stuff:
|
|
|
|
|
*.log
|
|
|
|
|
local_settings.py
|
|
|
|
|
|
|
|
|
|
# Flask stuff:
|
|
|
|
|
instance/
|
|
|
|
|
.webassets-cache
|
|
|
|
|
|
|
|
|
|
# Scrapy stuff:
|
|
|
|
|
.scrapy
|
|
|
|
|
|
|
|
|
|
# Sphinx documentation
|
2020-01-20 19:50:31 +00:00
|
|
|
docs/build/
|
2019-03-31 20:00:41 +00:00
|
|
|
|
|
|
|
|
# PyBuilder
|
|
|
|
|
target/
|
|
|
|
|
|
|
|
|
|
# Jupyter Notebook
|
|
|
|
|
.ipynb_checkpoints
|
|
|
|
|
|
|
|
|
|
# pyenv
|
|
|
|
|
.python-version
|
|
|
|
|
|
|
|
|
|
# celery beat schedule file
|
|
|
|
|
celerybeat-schedule
|
|
|
|
|
|
|
|
|
|
# SageMath parsed files
|
|
|
|
|
*.sage.py
|
|
|
|
|
|
|
|
|
|
# dotenv
|
|
|
|
|
.env
|
|
|
|
|
|
|
|
|
|
# virtualenv
|
|
|
|
|
.venv
|
2020-01-20 19:50:31 +00:00
|
|
|
env/
|
2019-03-31 20:00:41 +00:00
|
|
|
venv/
|
|
|
|
|
ENV/
|
|
|
|
|
|
|
|
|
|
# Spyder project settings
|
|
|
|
|
.spyderproject
|
|
|
|
|
.spyproject
|
|
|
|
|
|
|
|
|
|
# Rope project settings
|
|
|
|
|
.ropeproject
|
|
|
|
|
|
|
|
|
|
# mkdocs documentation
|
|
|
|
|
/site
|
|
|
|
|
|
|
|
|
|
# mypy
|
|
|
|
|
.mypy_cache/
|
2021-01-08 15:36:49 +00:00
|
|
|
# pytest
|
|
|
|
|
.pytest_cache/
|
2019-06-25 23:42:15 +00:00
|
|
|
|
|
|
|
|
# data
|
2020-01-20 19:50:31 +00:00
|
|
|
.data/
|
2020-09-22 02:14:39 +00:00
|
|
|
Datasets/
|
2019-07-25 00:39:20 +00:00
|
|
|
mnist/
|
2021-01-08 15:36:49 +00:00
|
|
|
legacy/checkpoints/
|
2020-04-23 19:03:39 +00:00
|
|
|
|
|
|
|
|
# pl tests
|
|
|
|
|
ml-runs/
|
2020-09-22 02:14:39 +00:00
|
|
|
mlruns/
|
2020-04-23 19:03:39 +00:00
|
|
|
*.zip
|
2020-07-25 16:57:40 +00:00
|
|
|
*.ckpt
|
2020-05-24 22:59:08 +00:00
|
|
|
pytorch\ lightning
|
2020-09-22 02:14:39 +00:00
|
|
|
test-reports/
|
2020-10-26 11:57:03 +00:00
|
|
|
wandb
|
2020-11-12 19:22:06 +00:00
|
|
|
.forked/
|
2021-01-26 11:48:54 +00:00
|
|
|
*.prof
|
2021-02-04 18:36:54 +00:00
|
|
|
*.tar.gz
|
|
|
|
|
|
|
|
|
|
# dataset generated from bolts in examples.
|
|
|
|
|
cifar-10-batches-py
|
PoC: Accelerator refactor (#5743)
* restoring the result from subprocess
* fix queue.get() order for results
* add missing "block_backward_sync" context manager
* add missing "block_backward_sync" context manager
* fix sync_batchnorm
* fix supported gpu-ids for tuple
* fix clip gradients and inf recursion
* accelerator selection: added cluster_environment plugin
* fix torchelastic test
* fix reduce early stopping decision for DDP
* fix tests: callbacks, conversion to lightning optimizer
* fix lightning optimizer does not pickle
* fix setting benchmark and deterministic option
* fix slurm amp test
* fix prepare_data test and determine node_rank
* fix retrieving last path when testing
* remove obsolete plugin argument
* fix test: test_trainer_config
* fix torchscript tests
* fix trainer.model access
* move properties
* fix test_transfer_batch_hook
* fix auto_select_gpus
* fix omegaconf test
* fix test that needs to simulate slurm ddp
* add horovod plugin
* fix test with named arguments
* clean up whitespace
* fix datamodules test
* remove old accelerators
* fix naming
* move old plugins
* move to plugins
* create precision subpackage
* create training_type subpackage
* fix all new import errors
* fix wrong arguments order passed to test
* fix LR finder
* Added sharded training type and amp plugin
* Move clip grad to precision plugin
* Added sharded spawn, select accelerators based on distributed_backend + enable custom fp16 plugin automatically
* Fix import issue, attempting to fix tests
* Fix initial test
* Reflect hook logic from master, should wrap model after move to device
* Optional state consolidation, since master has optimizers not wrapped
* change attribute for instance test
* reset optimizers
optimizers are not used in main process, so state would be wrong.
* legacy
* imports in accel
* legacy2
* trainer imports
* fix import errors after rebase
* move hook to new setup location
* provide unwrapping logic
* fix trainer callback system
* added ddp2 implementation
* fix imports .legacy
* move plugins
* restore legacy
* drop test.py from root
* add tpu accelerator and plugins
* fixes
* fix lightning optimizer merge
* reset bugreportmodel
* unwrapping
* step routing forward
* model access
* unwrap
* opt
* integrate distrib_type
* sync changes
* sync
* fixes
* add forgotten generators
* add missing logic
* update
* import
* missed imports
* import fixes
* isort
* mv f
* changelog
* format
* move helper to parallel plugin
* d
* add world size
* clean up
* duplicate
* activate ddp_sharded and tpu
* set nvidia flags
* remove unused colab var
* use_tpu <-> on_tpu attrs
* make some ddp_cpu and clusterplugin tests pass
* Ref/accelerator connector (#5742)
* final cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* connector cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* trainer cleanup
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* accelerator cleanup + missing logic in accelerator connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add missing changes to callbacks
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* reflect accelerator changes to lightning module
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* clean cluster envs
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* cleanup plugins
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* add broadcasting
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* yapf
* remove plugin connector
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* plugins
* manual optimization
* update optimizer routing
* add rank to torchelastic
* fix memory mixed precision
* setstate on trainer for pickling in ddp spawn
* add predict method
* add back commented accelerator code
* adapt test for sync_batch_norm to new plugin
* fix deprecated tests
* fix ddp cpu choice when no num_processes are given
* yapf format
* skip a memory test that cannot pass anymore
* fix pickle error in spawn plugin
* x
* avoid
* x
* fix cyclic import in docs build
* add support for sharded
* update typing
* add sharded and sharded_spawn to distributed types
* make unwrap model default
* refactor LightningShardedDataParallel similar to LightningDistributedDataParallel
* update sharded spawn to reflect changes
* update sharded to reflect changes
* Merge 1.1.5 changes
* fix merge
* fix merge
* yapf isort
* fix merge
* yapf isort
* fix indentation in test
* copy over reinit scheduler implementation from dev1.2
* fix apex tracking calls with dev_debugger
* reduce diff to dev1.2, clean up
* fix trainer config test when gpus>0 and num_processes >0 and ddp_cpu
* sort plugin tests legacy/new
* fix error handling for amp on cpu
* fix merge
fix merge
fix merge
* [Feat] Resolve manual_backward (#5837)
* resolve manual_backward
* resolve flake8
* update
* resolve for ddp_spawn
* resolve flake8
* resolve flake8
* resolve flake8
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* fix tests/accelerator tests on cpu
* [BugFix] Resolve manual optimization (#5852)
* resolve manual_optimization
* update
* update
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* Remove copy trainer parameters to happen earlier within the loop and add safe guard to get ref model (#5856)
* resovle a bug
* Accelerator refactor sharded rpc (#5854)
* rpc branch
* merge
* update handling of rpc
* make devices etc. Optional in RPC
* set devices etc. later if necessary
* remove devices from sequential
* make devices optional in rpc
* fix import
* uncomment everything
* fix cluster selection
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
* resolve bug
* fix assert in rpc test
* resolve a test
* fix docs compilation
* accelerator refactor - fix for sharded parity test (#5866)
* fix memory issue with ddp_spawn
* x
x
x
x
x
x
x
x
x
* x
* Remove DDP2 as this does not apply
* Add missing pre optimizer hook to ensure lambda closure is called
* fix apex docstring
* [accelerator][BugFix] Resolve some test for 1 gpu (#5863)
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* update
* update
* revert init
* resolve a bug
* update
* resolve flake8
* update
* update
* update
* revert init
* update
* resolve flake8
* update
* update
* update
* update
* update
* all_gather
* update
* make plugins work, add misconfig for RPC
* update
* update
* remove breaking test
* resolve some tests
* resolve flake8
* revert to ddp_spawn
Co-authored-by: root <root@ip-172-31-88-60.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
Co-authored-by: Justus Schock <justus.schock@rwth-aachen.de>
* yapf isort
* resolve flake8
* fix apex doctests
* fix apex doctests 2
* resolve docs
* update drone
* clean env
* update
* update
* update
* update
* merge
* Fix RPC related tests, clean out old API, update for new accelerator API [skip ci] (#5881)
* Fix RPC related tests, clean out old API, update for new accelerator API
* Move tests out of legacy folder, update paths and names
* Update test_remove_1-4.py
* Expose properties for tpu cores/gpus/num_gpus
* Add root GPU property
* Move properties to properties.py
* move tests that were previously in drone
* Fix root GPU property (#5908)
* Move root GPU to property, remove horovod set as this is handled in horovod plugin, ensure we mock correctly to set GPU accelerator
* Add missing tests back
* fix best model path transfer when no checkpoint callback available
* Fix setup hook order [wip] (#5858)
* Call trainer setup hook before accelerator setup
* Add test case
* add new test
* typo
* fix callback order in test
Co-authored-by: tchaton <thomas@grid.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* rename ddp sequential -> rpc sequential for special test
* revert
* fix stupid merge problem
* Use property in connector for sampler (#5913)
* merge the import conflicts
* fix spawning of processes in slurm
* [wip] Fix some bugs for TPU [skip ci] (#5878)
* fixed for single tpu
* fixed spawn
* fixed spawn
* update
* update
* wip
* resolve bugs
* resolve bug
* update on comment
* removed decorator
* resolve comments
* set to 4
* update
* update
* need cleaning
* update
* update
* update
* resolve flake8
* resolve bugs
* exclude broadcast
* resolve bugs
* change test
* update
* update
* skip if meet fails
* properly raise trace
* update
* add catch
* wrap test
* resolve typo
* update
* typo
Co-authored-by: Lezwon Castelino <lezwon@gmail.com>
Co-authored-by: Your Name <you@example.com>
* resolve some tests
* update
* fix imports
* update
* resolve flake8
* update azure pipeline
* skip a sharded test on cpu that requires a gpu
* resolve tpus
* resolve bug
* resolve flake8
* update
* updat utils
* revert permission change on files
* suggestions from carlos
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* remove unrelated formatting changes
* remove incomplete comment
* Update pytorch_lightning/accelerators/__init__.py
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
* remove unrelated formatting change
* add types
* warn 1.7 ddp manual backward only if ddp kwarg unset
* yapf + isort
* pep8 unused imports
* fix cyclic import in docs
* Apply suggestions from code review
* typer in accelerator.py
* typo
* Apply suggestions from code review
* formatting
* update on comments
* update typo
* Update pytorch_lightning/trainer/properties.py
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* update
* suggestion from code review
* suggestion from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: SeanNaren <sean@grid.ai>
Co-authored-by: Jirka Borovec <jirka.borovec@seznam.cz>
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-88-60.ec2.internal>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
Co-authored-by: root <root@ip-172-31-88-60.ec2.internal>
Co-authored-by: Lezwon Castelino <lezwon@gmail.com>
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-02-12 20:48:56 +00:00
|
|
|
*.pt
|
2021-02-08 08:35:07 +00:00
|
|
|
# ctags
|
2021-02-16 21:01:04 +00:00
|
|
|
tags
|