spaCy/spacy
Adriane Boyd b57be94c78
Fix memory issues in Language.evaluate (#6386)
* Fix memory issues in Language.evaluate

Reset annotation in predicted docs before evaluating and store all data
in `examples`.

* Minor refactor to docs generator init

* Fix generator expression

* Fix final generator check

* Refactor pipeline loop

* Handle examples generator in Language.evaluate

* Add test with generator

* Use make_doc
2020-12-31 10:45:50 +11:00
..
cli Fix parser resizing when there is no upper layer (#6460) 2020-12-18 18:56:57 +08:00
displacy
lang Remove tag map 2020-12-09 11:13:49 +11:00
matcher Add SPACY as a Matcher attribute (#6463) 2020-11-30 09:34:50 +08:00
ml Fix parser resizing when there is no upper layer (#6460) 2020-12-18 18:56:57 +08:00
pipeline Use logger.warning instead of logger.warn (#6596) 2020-12-21 08:25:10 +08:00
tests Fix memory issues in Language.evaluate (#6386) 2020-12-31 10:45:50 +11:00
tokens Add logger warning when serializing user hooks (#6595) 2020-12-29 11:54:32 +01:00
training Fix memory issues in Language.evaluate (#6386) 2020-12-31 10:45:50 +11:00
__init__.pxd
__init__.py require_cpu functionality (#6336) 2020-12-08 14:42:40 +08:00
__main__.py
about.py Set version to v2.3.4 2020-11-26 08:48:52 +01:00
attrs.pxd
attrs.pyx
compat.py Use Literal type for nr_feature_tokens 2020-09-23 16:00:03 +02:00
default_config.cfg Add nlp.batch_size setting 2020-12-09 09:13:26 +01:00
default_config_pretraining.cfg pretrain architectures (#6451) 2020-12-08 14:41:03 +08:00
errors.py Add logger warning when serializing user hooks (#6595) 2020-12-29 11:54:32 +01:00
glossary.py
kb.pxd Revert added_strings change (#6236) 2020-10-10 18:55:07 +02:00
kb.pyx Revert added_strings change (#6236) 2020-10-10 18:55:07 +02:00
language.py Fix memory issues in Language.evaluate (#6386) 2020-12-31 10:45:50 +11:00
lexeme.pxd
lexeme.pyx
lookups.py Always serialize lookups and vectors to disk 2020-10-05 09:40:20 +02:00
morphology.pxd
morphology.pyx Fix memory leak when adding empty morph (#6581) 2020-12-18 18:51:01 +08:00
parts_of_speech.pxd
parts_of_speech.pyx
pipe_analysis.py Tidy up and auto-format 2020-09-29 21:39:28 +02:00
schemas.py Include custom code via spacy package command (#6531) 2020-12-10 20:36:46 +08:00
scorer.py Clean up 3rd party license info (#6478) 2020-12-02 10:15:23 +01:00
strings.pxd
strings.pyx
structs.pxd Clean up MorphAnalysisC struct (#6146) 2020-09-25 15:56:48 +02:00
symbols.pxd Add _ as a symbol (#6153) 2020-09-27 22:20:14 +02:00
symbols.pyx Add _ as a symbol (#6153) 2020-09-27 22:20:14 +02:00
tokenizer.pxd
tokenizer.pyx Merge branch 'develop' into pr/6444 2020-12-09 11:04:03 +11:00
typedefs.pxd Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master 2020-11-25 11:49:34 +01:00
typedefs.pyx
util.py prevent the root logger from inialising 2020-12-15 19:50:34 +00:00
vectors.pyx
vocab.pxd Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master 2020-11-25 11:49:34 +01:00
vocab.pyx Merge remote-tracking branch 'upstream/master' into chore/update-develop-from-master 2020-11-25 11:49:34 +01:00