Rooba
/
lightning
mirror of https://github.com/Lightning-AI/lightning.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,859 Commits 55 Branches 212 Tags 375 MiB
Commit Graph

31 Commits

Author SHA1 Message Date
William Falcon 908e05880d
docs refactor 3/n (#12795) 
* updated titles + css

* updated titles + css

* levels structure

* levels structure

* levels structure

* adding level indexes

* finished intro guide layout

* finished intro guide layout

* general titles

* general titles

* added movie

* added movie

* finished 15 mins

* levels

* added core levels

* added core levels

* fixed api reference on the left

* gpu guides

* gpu guides

* gpu guides

* gpu guides

* precision

* hpu guide

* added ipu

* added ipu

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* intermediate

* intermediate

* fixed

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* fixed margins

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* added logger stuff

* ic

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* added inconsolata

* updated menu

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* added basic cloud docs

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* ic

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* added demos folder

* twocolumns directive

* twocols

* twocols

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* registry

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* cleaning up

* updated titles + css

* levels structure

* adding level indexes

* finished intro guide layout

* general titles

* added movie

* finished 15 mins

* levels

* added core levels

* fixed api reference on the left

* gpu guides

* precision

* hpu guide

* added ipu

* added ckpt docs

* finished basic logging

* intermediate

* fixed margins

* added logger stuff

* ic

* added inconsolata

* updated menu

* added basic cloud docs

* ic

* added demos folder

* twocolumns directive

* registry

* cleaning up

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* deconflict

* deconflict

* deconflict

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add testsetup sections wherever needed; fix errors in building docs

* pre-commit fixes

* Fix duplicate label

* minor nit with pre-commit

* Fix labels

* More changes...

* require

* debug & cli

* prec & model & visu

* fix references

* fix references

* fix refs

* fix refs - model_parallel

* fix references

* prune testsetup with global

* refs in index

* Fix duplicate label errors

* Update orphan docs

* Update orphan docs

* Update orphan docs

* fix links

* Fix genindex and search index

* fix refs

* fix refs

* Fix index rst related issues

* fix refs

* inc to rst

* Fix links ref

* fix more references

* fix refs

* deconflict

* errors

* errors

* errors

* fix refs

* fix refs

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix warnings

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* Fix LightningCLI errors

* fix doc build

* Duplicate Label fix (docs) (#12800)

Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>

* ignore typing in demo folder

* Ignore demos for mypy

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Kushashwa Ravi Shrimali <kushashwaravishrimali@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: otaj <ota@grid.ai>
 2022-04-19 14:15:47 -04:00
Ankita Sharma 313eee00ee
Remove deprecated `XLAStatsMonitor` (#12688) 
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
 2022-04-12 15:35:43 +00:00
Ray Schireman 3f0f277d5b
Remove deprecated `GPUStatsMonitor` callback (#12554) 
Co-authored-by: Aki Nitta <nitta@akihironitta.com>
Co-authored-by: Raymond G Schireman <raymond.schireman@uvm.edu>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Rohit Gupta <rohitgr1998@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
 2022-04-10 14:35:51 +00:00
jjenniferdai ec7fa1e2d8
[docs] Update `checkpointing.rst` and `callbacks.rst` for Stateful support (#12351) 2022-03-24 17:20:21 -07:00
Kaushik B f3c2a1338c
Update API references for Callbacks (#11350) 
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
 2022-03-01 13:53:03 +00:00
Krishna Kalyan 29d5afbda6
Deprecate callback hooks `on_pretrain_routine_{start,end}` (#11794) 
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
 2022-02-24 19:32:48 +00:00
Rohit Gupta 581bf7f2f2
Deprecate `on_epoch_start/on_epoch_end` hook (#11578) 2022-02-07 14:15:27 +00:00
Krishna Kalyan f509e40ae3
Deprecate `on_before_accelerator_backend_setup` callback hook (#11655) 
Co-authored-by: rohitgr7 <rohitgr1998@gmail.com>
 2022-02-07 11:07:21 +00:00
Rohit Gupta 4d72110b51
Deprecate `on_batch_start/on_batch_end` callback hooks (#11577) 2022-02-03 19:51:56 +00:00
Thomas Vetterli 0fbb419c68
Replacing latest tag with 0.4.0 for lightning-bolts links (#10440) 2022-01-18 16:47:48 +01:00
Rohit Gupta 9771e7dff6
Update introduction docs (#11140) 2022-01-13 21:11:43 +00:00
Danielle Pintz 01f5f99919
Deprecate callback hooks `on_init_start` and `on_init_end` (#10940) 2021-12-08 07:42:19 +00:00
Rohit Gupta ce95891f6a
Update extensions doc (#10778) 
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
 2021-11-29 20:38:23 +00:00
Adrian Wälchli 225989363b
update links in callback examples pointing to bolts (#10117) 2021-10-25 10:27:14 +00:00
Danielle Pintz 940b910d27
[2/4] Add DeviceStatsMonitor callback (#9712) 
Co-authored-by: ananthsub <ananth.subramaniam@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
Co-authored-by: Kaushik B <kaushikbokka@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
 2021-10-13 18:29:36 +00:00
Kaushik B 2ec39e275e
Add `RichModelSummary` callback (#9546) 2021-09-17 10:54:16 +00:00
Danielle Pintz 83bff01595
Add on_exception hook to documentation (#9365) 
* Small doc fixes

* remove space

* small fix

* Apply suggestions from code review

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-09-11 23:25:42 +00:00
Kaushik B a7461bfc3b
Add missing callbacks to `callbacks.rst` (#9223) 2021-09-03 00:14:36 +00:00
Adrian Wälchli b9443a07b9
[2 / 3] improvements to saving and loading callback state (#7187) 
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2021-08-24 17:35:19 +00:00
Jirka Borovec 0a71fe2859
CI: black docs (#8566) 
* black docs

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2021-07-28 18:08:31 +02:00
Dusan Drevicky 1b06edf2f2
Add the `on_before_optimizer_step` hook (#8048) 
Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
 2021-07-09 13:30:52 +02:00
thomas chaton 1c825a2a9c
Add the `on_before_backward` hook (#7865) 
* Add callback to hook tests and add predict test

* Fix lambda callback test

* Simplify lambda call test

* Use LambdaCallback

* Dynamically append to called for the model

* Remove print

* Consistency

* Consistency

* Prepare args/kwargs testing

* yapf doesn't like dict literals

* Add arguments for fit no val test

* Add arguments for fit no val test

* add before_backward_hook

* add test

* resolve flake8

* resolve tests

* update changelog

* add on_before_backward to LightningModule

* update on comments

* Test arguments

* Datamodule refactor

* Fix eval test

* remove extra file

* resolve bug

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* move to hooks

* update

* resolve flake8

* update on comments

* Update full fit + val test

* Update test

* Remove FIXME

* Remove FIXME

* Undo change

* Fix

* Parametrize fit hook test

* Comment

* Parametrize fit hook test with different precision plugins

* Fix tests

* Parametrize fit hook test with manual optimization

* Unnecessary parenthesis

* WIP

* Comments

* Fix message

* Test CI error

* Revert "Test CI error"

This reverts commit 39c4a85a83.

* Add ddp training type teardown

* Update CHANGELOG

* Adrian's fix

* Use destructor

* Update CHANGELOG.md

* RPC destructor

* Update pytorch_lightning/plugins/training_type/ddp.py

* Why do you not work :(

* Missing condition

* Fix deepspeed test

* GC collect in conftest

* Do not show warnings for special tests

* Needs to run on 1.8

To avoid: "RuntimeError: NCCL error in: /pytorch/torch/lib/c10d/ProcessGroupNCCL.cpp:32, unhandled cuda error, NCCL version 2.4.8"

* Run torch 1.8

* Skip test due to 'Python bus error'

* Debug NCCL

* shm size

* Disable warnings for special tests

* Remove NCCL_DEBUG statement

* Try smaller shm size

* Revert "Skip test due to 'Python bus error'"

This reverts commit e0a3e8785d.

* README and adjust versions

* Avoid self.on_gpu call

* empty cache cleanup

* More garbage collection

* Unroll parametrizations

* Do not reuse mock

* Undo changes

* Undo notebooks modification

* resolve test

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* delete file

* Undo

* Fix test

* Revert "WIP"

This reverts commit f5828a8c42.

* Rename

* Remove optimizers

* Fix bug with LightningOptimizer

* Add optimizers

* update

* update

* Update CHANGELOG

* On after backward refactor

* Do not call super

* Fixes

* Remove should_accumulate

* pre/post backward refactor

* Call the LM backward hook

* Update tests

* Remove dev debug patch

* Fix test

* Remove optimizer arguments and typing

* Docs fixes

* Fix comment

* Undo changes

* Split manual and auto

* Undo change

* Deepsource

* Remove optimizers

* Undo changes

* Call the hook

* Docs

* Docs

Co-authored-by: Carlos Mocholi <carlossmocholi@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-07-09 06:15:57 +00:00
thomas chaton e76ebd640e
[feat] Add BasePredictionWriter 3/3 (#7127) 
* wip

* update

* update

* update

* update

* update

* typo

* update on comments

* update

* update

* update

* update

* update changelog

* update

* Fix merge

* Fix merge

* move code

* resolve test

* add extra test

* add an extra test

* update on comments

* add typing

* resolve flake8

* Refactor and Docs

* Fix tests

* Fix tests

* Fix tests

* Duplicate

* Fix tests

* resolve bug

* update

* update on comments

* Update pytorch_lightning/utilities/imports.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Update pytorch_lightning/utilities/device_parser.py

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* update

* update

* update

* update on comments

* resolve flkae8

* update test

* Apply suggestions from code review

* update on comments

* Update pytorch_lightning/callbacks/prediction_writer.py

Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>

* Update pytorch_lightning/callbacks/prediction_writer.py

Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>

* Update pytorch_lightning/callbacks/prediction_writer.py

Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>

* update on comments

* update

* update on comment

* Apply suggestions from code review

* update

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Kaushik B <45285388+kaushikb11@users.noreply.github.com>
Co-authored-by: Ethan Harris <ewah1g13@soton.ac.uk>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2021-04-27 20:23:55 +00:00
Daniele Acquaviva fb02972dde
Fixed wrong on_fit_start callback reference in documentation (#7001) 
Co-authored-by: Daniele Acquaviva <danieleacquaviva@Danieles-MacBook-Pro.local>
 2021-04-14 01:19:27 +02:00
Akihiro Nitta 9876df16a2
[docs] Update Bolts link (#6743) 
* Update Bolts link

* Update Bolts link

* formt

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2021-03-30 22:52:59 +05:30
Rohit Gupta 9be092dbdb
Add on_epoch_start to run at the beginning of every loop irrespective of train/val/test (#6498) 
* update docs

* add hook and update docs

* update tests

* chlog

* Update CHANGELOG.md

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* chlog

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
 2021-03-25 14:20:49 +01:00
edenlightning 3449e2d79f
Docs for Pruning, Quantization, and SWA (#6041) 
Co-authored-by: chaton <thomas@grid.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Sean Naren <sean.narenthiran@gmail.com>
 2021-02-18 13:51:51 +00:00
chaton 7b00894130
[feat] Add StochasticWeightAveragingCallback (#5640) 
* add swa callback

* switch back to 1.6.0

* remove optimizer_step

* move super

* update

* forgot update_parameters

* update on comments

* works for ddp

* resolve flake8

* remove set_model

* resolve flake8

* resolve cpu

* resolve flake8

* resolve flake8

* update

* update on comments
 2021-02-11 00:05:59 +00:00
chaton e425bf3ba9
[BugOnFeat] Resolve bug with Finetuning (#5744) 
* resolve bug + add doc

* Update pytorch_lightning/callbacks/finetuning.py

* resolve bug

* start adding more test

* add more tests for finetuning callback functions

* rename to flatten_modules

* resolve doc

* Update pytorch_lightning/callbacks/finetuning.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* resolve comments

* remove update on BoringModel

* update on comments

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
 2021-02-04 18:36:54 +00:00
chaton d0aaf983b9
[Feat] Adding PruningCallback (#5618) 
* wip

* add pruning callback

* add condition for duplicated weights

* update on comments

* update on comments

* update on comments

* add more tests

* resolve flake8

* resolve on comments

* update changelog

* update on comments

* update on comments

* change order

* remove ddp_spawn skip

* update

* typo

* Update pytorch_lightning/callbacks/pruning.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* Update pytorch_lightning/callbacks/pruning.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* update on comments

* forgot platform

* update on comments

* remove     @rank_zero_only

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2021-01-27 01:00:42 -05:00
Jirka Borovec dee5553b2b
move to Pages dir (#4869) 
* folders

* common / advanced / extensions

* paths

* flake8

* isort

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2021-01-26 15:07:07 -05:00