a783e75dc3
Fix tpu cleanup ( #3056 )
...
* Only try to delete jobs if there are any to delete.
* Reorder jobs.
* Remove cleanup from the jobs that run on every commit.
2020-08-24 11:04:20 +02:00
580a5bd1df
Use kubectl to get logs from TPU CI instead of gcloud logging. ( #2918 )
...
* Use kubectl to get logs from TPU CI instead of gcloud logging.
* Update Github Action to read logs from kubectl rather than gcloud logging.
2020-08-11 19:30:56 -04:00
35a3fd2f97
Add missing arg to docker build. ( #2905 )
2020-08-10 18:37:36 +00:00
2242af11b6
another try to filter master from CircleCI jobs ( #2734 )
...
* circleci config
* Apply suggestions from code review
* miss
2020-08-05 21:43:33 +02:00
eca7d0a6d3
Check CI_PULL_REQUEST and set GITHUB_REF accordingly. ( #2741 )
2020-07-29 18:35:32 -04:00
40337cce58
freeze PT 1.5 for Horovod issue ( #2744 )
...
* freeze pt 1.5
* torchtext
* Apply suggestions from code review
Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>
* timeout
Co-authored-by: Peter Yu <2057325+yukw777@users.noreply.github.com>
2020-07-28 15:52:23 -04:00
a3aebc1350
skip CircleCI config on master ( #2732 )
...
* circleci config
* circleci config
* circleci config
* circleci config
2020-07-28 06:34:01 -04:00
0fe933e23d
fixing TPU tests ( #2632 )
...
* init
* rename
* tpu_core_idx
* idx 8
* idxs
* @pl_multi_process_test
* assert
* assert
* deamon
* no close
* imort
* msg
* use_single_gpu
* dataset
* idx
* fix idx
* dataset
* format
* add pickable
* typo
* apex
* typo
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* docs
* typo
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* tests
* docs
* docs
* Apply suggestions from code review
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
* Apply suggestions from code review
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
* docs
* Apply suggestions from code review
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2020-07-27 19:07:09 -04:00
3f2c1022ab
Add a GKE cleanup workflow to run once per hour. ( #2682 )
...
* Add a GKE cleanup workflow to run once per hour.
* Add fixes. Temp use workflow as triggered by commit so we can see that command works.
* Add back in schedule.
2020-07-26 09:44:57 -04:00
d0b8e850a4
integrate with CircleCI ( #2486 )
...
* add circleCI
* wip
* CircleCI setup that worked on my private repo. Use a working pytorch-lightning commit
* Fix the orb imports
* Update circleci header comment
* Try to pull the GITHUB_REF from the CI_PULL_REQUEST
* Use null instead of space for 'sed'
* Add TODO for codecov
* Remove echo of GKE_CLUSTER since it will be redacted by CircleCI.
* Try running codecov upload.
* Try using codecov orb
* Use pip install codecov
* Use codecov orb again since it should be approved
* dockers/tpu-tests/Dockerfile
* action
* suggestions
* drop suggestion
* suggestion
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
2020-07-23 12:13:10 -04:00
548dbd171b
add simple CircleCI ( #2609 )
...
* add simple CircleCI
* ignore some
* note
2020-07-14 14:04:04 -04:00
d4a02e3bd8
tests: drop CircleCI ( #2412 )
...
* drop CircleCI
* add PT testing
* fix
* cpu
* conda
* conda
* req
* base
* conda
* conda
* conda
* conda
* conda
* conda
* conda
* name
* req
* info
* tests
* pt 1.6
* drop 1.6
* info
2020-06-30 10:56:05 -04:00
73a78a13c7
CI: partial move from CircleCI ( #2378 )
...
* move from CircleCI
* req
* tex
* tex
* sudo
* extra
* recom
* pic
* dvipng
2020-06-27 16:25:33 -04:00
0be78d13aa
native amp ( #2373 )
...
* native amp
* typo
* imports
* apex
2020-06-26 21:45:13 -04:00
bfaabd7b7f
clean requirements ( #2128 )
...
* clean requirements
* missing
* missing
* req
* min
* default >> base
* base.txt
2020-06-13 10:15:22 -04:00
bd49b07fbb
Rework of Sklearn Metrics ( #1327 )
...
* Create utils.py
* Create __init__.py
* redo sklearn metrics
* add some more metrics
* add sklearn metrics
* Create __init__.py
* redo sklearn metrics
* New metric classes (#1326 )
* Create metrics package
* Create metric.py
* Create utils.py
* Create __init__.py
* add tests for metric utils
* add docstrings for metrics utils
* add function to recursively apply other function to collection
* add tests for this function
* update test
* Update pytorch_lightning/metrics/metric.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* update metric name
* remove example docs
* fix tests
* add metric tests
* fix to tensor conversion
* fix apply to collection
* Update CHANGELOG.md
* Update pytorch_lightning/metrics/metric.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* remove tests from init
* add missing type annotations
* rename utils to convertors
* Create metrics.rst
* Update index.rst
* Update index.rst
* Update pytorch_lightning/metrics/convertors.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update pytorch_lightning/metrics/convertors.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* add doctest example
* rename file and fix imports
* added parametrized test
* replace lambda with inlined function
* rename apply_to_collection to apply_func
* Separated class description from init args
* Apply suggestions from code review
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* adjust random values
* suppress output when seeding
* remove gpu from doctest
* Add requested changes and add ellipsis for doctest
* forgot to push these files...
* add explicit check for dtype to convert to
* fix ddp tests
* remove explicit ddp destruction
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* add sklearn metrics
* start adding sklearn tests
* fix typo
* return x and y only for curves
* fix typo
* add missing tests for sklearn funcs
* imports
* __all__
* imports
* fix sklearn arguments
* fix imports
* update requirements
* Update CHANGELOG.md
* Update test_sklearn_metrics.py
* formatting
* formatting
* format
* fix all warnings and formatting problems
* Update environment.yml
* Update requirements-extra.txt
* Update environment.yml
* Update requirements-extra.txt
* fix all warnings and formatting problems
* Update CHANGELOG.md
* docs
* inherit
* docs inherit.
* docs
* Apply suggestions from code review
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
* docs
* req
* min
* Apply suggestions from code review
Co-authored-by: Tullie Murrell <tulliemurrell@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka@pytorchlightning.ai>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Nicki Skafte <skaftenicki@gmail.com>
Co-authored-by: Tullie Murrell <tulliemurrell@gmail.com>
2020-06-10 15:43:12 +02:00
c438d0dd90
increase acc ( #2039 )
...
* increase acc
* try 0.45
* @pytest
* @pytest
* try .50
* duration
* pytest
2020-06-03 08:28:19 -04:00
ceecf1cea9
Graceful shutdown on python interpreter exit ( #1631 )
...
* Fraceful shutdown on python interpreter exit
* Update CHANGELOG.md
* Update training_loop.py
* Update training_loop.py
* Update CHANGELOG.md
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* pep8, move to constant
* Update training_loop.py
* Update training_loop.py
* Update training_loop.py
* pep8, move to constant
* pep8
* timeout
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2020-05-29 16:20:04 +02:00
033ddc0c29
update min req ( #1934 )
2020-05-25 07:43:17 -04:00
d610f3bb53
set min PT 1.3 ( #1917 )
...
* set min PT 1.3
* circleCI
* mergify
* min
* chlog
* skip
2020-05-22 07:14:08 -04:00
1c10560531
Fix failing docs ( #1821 )
...
* missing pkg
* update CI
* strict RTD
* strict RTD
* make
* missing
* ignore
* ignore
* mock
* typo
2020-05-14 08:25:06 -04:00
a6de1b8d75
doctest for .rst files ( #1511 )
...
* add doctest to circleci
* Revert "add doctest to circleci"
This reverts commit c45b34ea911a81f87989f6c3a832b1e8d8c471c6.
* Revert "Revert "add doctest to circleci""
This reverts commit 41fca97fdcfe1cf4f6bdb3bbba75d25fa3b11f70.
* doctest docs rst files
* Revert "doctest docs rst files"
This reverts commit b4a2e83e3da5ed1909de500ec14b6b614527c07f.
* doctest only rst
* doctest debugging.rst
* doctest apex
* doctest callbacks
* doctest early stopping
* doctest for child modules
* doctest experiment reporting
* indentation
* doctest fast training
* doctest for hyperparams
* doctests for lr_finder
* doctests multi-gpu
* more doctest
* make doctest drone
* fix label build error
* update fast training
* update invalid imports
* fix problem with int device count
* rebase stuff
* wip
* wip
* wip
* intro guide
* add missing code block
* circleci
* logger import for doctest
* test if doctest runs on drone
* fix mnist download
* also run install deps for building docs
* install cmake
* try sudo
* hide output
* try pip stuff
* try to mock horovod
* Tranfer -> Transfer
* add torchvision to extras
* revert pip stuff
* mlflow file location
* do not mock torch
* torchvision
* drone extra req.
* try higher sphinx version
* Revert "try higher sphinx version"
This reverts commit 490ac28e46d6fd52352640dfdf0d765befa56988.
* try coverage command
* try coverage command
* try undoc flag
* newline
* undo drone
* report coverage
* review
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* remove torchvision from extras
* skip tests only if torchvision not available
* fix testoutput torchvision
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2020-05-04 22:16:54 -04:00
0b22b64a10
Tests/docker ( #1573 )
...
* devel image
* try parallel
* new image
2020-04-23 12:52:59 -04:00
7024177f7d
Added Horovod distributed backend ( #1529 )
...
* Initial commit of Horovod distributed backend implementation
* Update distrib_data_parallel.py
* Update distrib_data_parallel.py
* Update tests/models/test_horovod.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Update tests/models/test_horovod.py
Co-Authored-By: Jirka Borovec <Borda@users.noreply.github.com>
* Fixed tests
* Added six
* tests
* Install tox for GitHub CI
* Retry tests
* Catch all exceptions
* Skip cache
* Remove tox
* Restore pip cache
* Remove the cache
* Restore pip cache
* Remove AMP
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: J. Borovec <jirka.borovec@seznam.cz>
2020-04-22 17:39:08 -04:00
4d24032ea5
tests for pytorch 1.5 ( #1552 )
...
* tests for pytorch 1.5
* up Win
* win
* win
* win
* win
* win
* win
2020-04-22 10:10:23 -04:00
7131685ae3
CI: Docs build preview in each PR ( #1494 )
...
* store html artifacts in circle ci
* add note to contributing.md
2020-04-19 17:07:16 -04:00
724b787cd1
faster CI testing ( #1323 )
...
* MNIST digits
* increase test acc
* smaller parity
* drone builds
* increase GH action timeout
* drone format
* fix paths
* drone cache
* circle cache
* fix test
* lower nb epochs
* circleCI
* user orb
* fix test
* fix test
* circle cache
* circle cache
* circle cache
* comment caches
* benchmark batch size
* cache dataset
* smaller dataset
* smaller dataset
* fix nb samples
* batch size
* fix test
2020-04-02 12:28:44 -04:00
45d671a4a8
CI: split tests-examples ( #990 )
...
* CI: split tests-examples
* tests without template
* comment depends
* CircleCI typo
* add doctest
* update test req.
* CI tests
* setup macOS
* longer train
* lover pred acc
* fix model
* rename default model
* lower tests acc
* typo
* imports
* fix test optimizer
* update calls
* fix Win
* lower Drone image
* fix call
* pytorch image
* fix test
* add dev image
* add dev image
* update image
* drone volume
* lint
* update test notes
* rename tests/models >> tests/base
* group models
* conftest
* optim imports
* typos
* fix import
* fix tests
* install AMP
* tests
* fix import
2020-03-25 07:46:27 -04:00
792962ecc9
CI: Force docs warnings to be raised as errors (+ fix all) ( #1191 )
...
* add argument to force warn
* fix automodule error
* fix permalink error
* fix indentation warning
* fix warning
* fix import warnings
* fix duplicate label warning
* fix bullet point indentation warning
* fix duplicate label warning
* fix "import not top level" warning
* line too long
* fix indentation
* fix bullet points indentation warning
* fix hooks warnings
* fix reference problem with excluded test_tube
* fix indentation in print
* change imports for trains logger
* remove pandas type annotation
* Update pytorch_lightning/core/lightning.py
* include bullet points inside note
* remove old quick start guide (unused)
* fix unused warning
* fix formatting
* fix duplicate label issue
* fix duplicate label warning (replaced by class ref)
* fix tick
* fix indentation warnings
* docstring ticks
* remove obsolete docstring typing
* Revert "remove old quick start guide (unused)"
This reverts commit d51bb40695
2020-03-20 20:49:01 +01:00
479a35d94e
fix docs ( #982 )
2020-02-28 18:48:07 -05:00
6029fad989
fix test pkg create ( #873 )
2020-02-16 21:08:20 -05:00
c48541dedc
fix missing PyPI images & CI badges ( #853 )
2020-02-15 20:30:00 -05:00
21d0f32047
Add GitHub Actions build ( #823 )
...
* init GH building
* try run
* circleci: install
* add cache
* add artifacts
* fix cache
* update
2020-02-12 11:28:47 -05:00
f72e354ee6
fixing TensorBoard ( #687 )
...
* flake8
* fix typo
* fix tensorboardlogger
drop test_tube dependence
* formatting
* fix tensorboard & tests
* upgrade Tensorboard
* test formatting separately
* try to fix JIT issue
* add tests for 1.4
2020-01-16 07:22:29 -05:00
89ececb32b
fix for pyTorch 1.1 ( #552 )
...
* min pyTorch 1.1
* try fixed test-tube
* try fixed test-tube
* try fixed test-tube
* cleaning
* Update requirements.txt
2019-12-01 03:42:33 -05:00
d71556e7a1
Sphinx generated documentation ( #521 )
...
* upgrade req.
* move MkDocs
* create Sphinx
* init Sphinx
* move md from MkDocs to Sphinx
* CI: build docs
* build Sphinx
formatting
move docs from MD to docstring in particular package/modules
formatting
add Sphinx ext.
rename root_module to core
drop implicit name "_logger"
drop duplicate name "overwrite"
fix imports
use pytorch theme
add sample link mapping
try fix RTD build
use forked template
fix some docs warnings
fix paths
add deprecation warnings
fix flake8
fix paths
revert refactor
revert MLFlowLogger
* revert example import
* update link
* Update lightning_module_template.py
2019-11-28 12:48:55 -05:00
47659daa5f
speed-up testing ( #504 )
...
* extend CI timeout
* add short MNIST
* lower dataset and stop thr
* refactor imports
* formatting
* early stop
* play params
* play params
* minor refactoring
# Conflicts:
# pytorch_lightning/testing/__init__.py
# pytorch_lightning/testing/lm_test_module.py
# pytorch_lightning/testing/lm_test_module_base.py
# pytorch_lightning/testing/lm_test_module_mixins.py
# pytorch_lightning/testing/model.py
# pytorch_lightning/testing/model_base.py
# pytorch_lightning/testing/model_mixins.py
# pytorch_lightning/testing/test_module.py
# pytorch_lightning/testing/test_module_base.py
# pytorch_lightning/testing/test_module_mixins.py
* typo
Co-Authored-By: Ir1dXD <sirius.caffrey@gmail.com>
* Revert "refactor imports"
This reverts commit b86aee92
2019-11-28 12:06:05 -05:00
7aaaefc4d9
Add circle CI for building PyTorch 1.1/1.2/1.3 ( #502 )
...
* add CircleCI config
* fix CircleCI
* fix CircleCI
2019-11-13 06:03:13 -05:00
zcain117