fa41c588f4
Remove ProfilerConnector class ( #7654 )
...
* Remove ProfilerConnector class
* Update trainer.py
* Update CHANGELOG.md
* Update trainer.py
* Update trainer.py
* tests
2021-05-24 08:58:15 -07:00
a1a655d006
Reduce log output size in special tests ( #7481 )
2021-05-11 17:36:20 +02:00
1a6dcbd422
[bugfix] Resolve Kineto Profiler for Conda ( #7376 )
2021-05-05 11:54:16 +00:00
ef5feac7ba
fix version + yapf ( #6999 )
2021-04-22 18:25:51 +00:00
fd5cb7fcc3
Add PyTorch 1.8 Profiler 5/5 ( #6618 )
...
* Refactor profilers
* Update PassThrough
* WIP - This is broken and will change
* Update pytorch_lightning/profiler/pytorch.py
Co-authored-by: thomas chaton <thomas@grid.ai>
* resolve tests
* resolve tests
* find output
* try something
* update
* add support for test and predict
* update
* update
* use getattr
* test
* test
* update
* tests
* update
* update
* update
* update
* update
* remove file
* update
* update
* update
* update
* update
* test
* update#
* update
* update tests
* update
* add suport for 1.8
* rename records
* add support for 1.8
* update
* resolve flake8
* resolve test
* Refactor basic profilers
* Fixes
* Unused import
* Introduce setup
* Profile on all ranks. Print to stdout on 0
* Introduce dirpath + filename
* CHANGELOG
* Add tests. Address comments
* add `on_run_stage_setup`
* add on_run_stage_setup function
* update
* add test for RegisterRecordFunction
* update lightnng flow direction
* move variable to private
* remove trace
* Undo code that should be in 3/4
* Multi-stage multi-rank
* 2/5 changes
* Pass stage in __del__
* Remove TODOs
* Describe on_evaluation_end. Add tests
* Typo
* Address comments
* deepcopy tests
* Advanced teardown
* Fix teardown test
* Fix tests
* Minor change
* Update CHANGELOG.md
* Fix test
* Quick fixes
* Fix 6522
* resolve ddp tests
* resolve tests
* resolve some tests
* update tests
* resolve tests
* update
* resolve tests
* resolve some tests
* Missed fixes from 3/5
* Fixes
* resolve some tests
* resolve test for 1.7.1
* Broken refactor
* Missed stage
* Minor changes
* resolve tests
* Update CHANGELOG
* resolve bug
* remove print
* Typo
* Cleanup
* resolve ddp test
* remove barrier
* update profiler
* update
* Smaller model
* update
* resolve tests
* update
* Minor changes. CHANGELOG
* Minimize diff
* update to 1.8.1
* RunIf. Extra code. Check segfault
* resolve tests
* Typo. Bad merge
* Fixing a bad merge
* replace for kineto
* Update pytorch_lightning/profiler/pytorch.py
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* Update pytorch_lightning/profiler/pytorch.py
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
* Minor changes
* Bad merge
* Use lists for flexibility
* Use sets
* predict_step
* Ananth's suggestion
* update
* Docs
* Update pl_examples/basic_examples/profiler_example.py
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
* update example
* update example
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-23 20:43:21 +00:00
51b10f78f4
Refactor PyTorch profiler 4/5 ( #6349 )
...
Co-authored-by: thomas chaton <thomas@grid.ai>
2021-03-23 18:13:29 +01:00
36d180e532
Refactor base profilers 3/5 ( #6621 )
...
Co-authored-by: tchaton <thomas@grid.ai>
2021-03-23 10:07:35 +00:00
2064ece582
[refactor] Add setup to profilers + _run_stage_setup to trainer 2/5 ( #6633 )
...
* add setup
* update
* updates on comment
* Minor changes
* Extra import
* Docs
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
2021-03-22 14:32:31 -04:00
e2e1de0fb7
Add teardown method to BaseProfiler. ( #6370 )
...
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
2021-03-22 11:49:06 +00:00
51c9260fad
Move profiler tests ( #6619 )
2021-03-21 23:39:55 +00:00
55dd3a4c64
Typing for tests 1/n ( #6313 )
...
* typing
* yapf
* typing
2021-03-09 11:27:15 +00:00
bc577ca792
fix duplicate console logging bug v2 ( #6275 )
...
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2021-03-02 15:17:55 +05:30
f83cca6107
formatting flake8 & isort ( #5824 )
...
* formatting
* isort
* make
* yapf
* isort
2021-02-05 18:33:12 -05:00
53b0cb910b
update isort config ( #5335 )
...
* update isort config
* apply
(cherry picked from commit 724f1051f0
2021-01-06 12:49:23 +01:00
151d86e40b
Update isort config ( #5142 )
...
* Update isort config
* Apply isort with new config
* Fix typo in isort config
* fix rebase
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
2021-01-05 09:57:37 +01:00
35401706bf
add copyright to tests ( #5143 )
2021-01-05 09:57:37 +01:00
9d2df24d6b
RC & Docs/changelog ( #1776 )
...
* missing
* RC
* tol
* Apply suggestions from code review
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
* test
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2020-05-11 21:57:53 -04:00
134eb61e1a
Tests: refactor cleanup ( #1744 )
...
* wip
* cleaning
* optim imports
* -
* default hparams
* fix restore
* fix imports
2020-05-10 13:15:28 -04:00
c1c6e3b6c9
default test logger ( #1478 )
...
* default test logger
* fix tests
* spawn
* try
* simplify tests
* simplify tests
* formatting
* loggers
* loggers
* revert to TestTube
* default
* default
* wraps
* world size
* optim imports
2020-04-21 20:33:10 -04:00
6ddb03922a
Profiler summary ( #1259 )
...
* refactor and add types
* add Prorfiler summary
* fix imports
* Revert "refactor and add types"
This reverts commit b4c552fa
* changelog
* revert rename
* fix test
* mute verbose
2020-03-31 08:57:48 -04:00
09167efdb5
Checkpointing interval ( #1272 )
...
* formatting
* formatting
* fix interval
* fix train loop
* fix test
* parametrize test
* Apply suggestions from code review
Co-Authored-By: Adrian Wälchli <adrian.waelchli@students.unibe.ch>
* fix calling
* flake8
* add types
Co-authored-by: Adrian Wälchli <adrian.waelchli@students.unibe.ch>
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-03-30 18:37:02 -04:00
54507f417e
fix logging config and add profiler test ( #1267 )
2020-03-29 14:56:36 -04:00
4c2026bf9a
increase profiler test coverage ( #1208 )
...
* increase profiler test coverage
* fix line length
* tests for valueerror assertions
2020-03-24 09:15:16 -04:00
514d182b7f
cleaning imports ( #1032 )
2020-03-12 12:41:37 -04:00
563e2ba2c6
resolving documentation warnings ( #833 )
...
* add more underline
* fix LightningMudule import error
* remove unneeded blank line
* escape asterisk to fix inline emphasis warning
* add PULL_REQUEST_TEMPLATE.md
* add __init__.py and import imagenet_example
* fix duplicate label
* add noindex option to fix duplicate object warnings
* remove unexpected indent
* refer explicit LightningModule
* fix minor bug
* refer EarlyStopping explicitly
* restore exclude patterns
* change the way how to refer class
* remove unused import
* update badges & drop Travis/Appveyor (#826 )
* drop Travis
* drop Appveyor
* update badges
* fix missing PyPI images & CI badges (#853 )
* docs - anchor links (#848 )
* docs - add links
* add desc.
* add Greeting action (#843 )
* add Greeting action
* Update greetings.yml
Co-authored-by: William Falcon <waf2107@columbia.edu>
* add pep8speaks (#842 )
* advanced profiler describe + cleaned up tests (#837 )
* add py36 compatibility
* add test case to capture previous bug
* clean up tests
* clean up tests
* Update lightning_module_template.py
* Update lightning.py
* respond lint issues
* break long line
* break more lines
* checkout conflicting files from master
* shorten url
* checkout from upstream/master
* remove trailing whitespaces
* remove unused import LightningModule
* fix sphinx bot warnings
* Apply suggestions from code review
just to trigger CI
* Update .github/workflows/greetings.yml
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: William Falcon <waf2107@columbia.edu>
Co-authored-by: Jeremy Jordan <13970565+jeremyjordan@users.noreply.github.com>
2020-02-27 16:07:51 -05:00
ea8878bc14
clean up tests/test_profiler.py ( #867 )
...
* cleanup docstrings, _get_total_cprofile_duration in module
* relax profiler overhead tolerance
2020-02-19 07:09:28 -05:00
4ae31cd1d5
advanced profiler describe + cleaned up tests ( #837 )
...
* add py36 compatibility
* add test case to capture previous bug
* clean up tests
* clean up tests
2020-02-15 23:43:43 -05:00
fc0ad03008
fix test for profiler ( #800 )
...
* fix test for profiler
* use allclose
* user relative tol
2020-02-09 17:48:37 -05:00
1cf430f7bc
new feature for profiling training runs ( #782 )
...
* initial implementation
* formatting, pass through profiler, docstring
* call profiler during training
* add initial tests
* report stats when training is done
* fix formatting
* error handling, bugfix in passthroughprofiler
* finish documenting profiler arg in Trainer
* relax required precision for profiling tests
* option to dump cProfiler results to text file
* use logging, format with black
* include profiler in docs
* improved logging and better docs
* appease the linter
* better summaries, wrapper for iterables
* fix typo
* allow profiler=True creation
* more documentation
* add tests for advanced profiler
* Update trainer.py
* make profilers accessible in pl.utilities
* reorg profiler files
* change import for profiler tests
Co-authored-by: William Falcon <waf2107@columbia.edu>
2020-02-06 22:01:21 -05:00
ananthsub