Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/spacy
History
Matthew Honnibal c1bf3a5602
Fix significant performance bug in parser training (#6010) 
The parser training makes use of a trick for long documents, where we
use the oracle to cut up the document into sections, so that we can have
batch items in the middle of a document. For instance, if we have one
document of 600 words, we might make 6 states, starting at words 0, 100,
200, 300, 400 and 500.

The problem is for v3, I screwed this up and didn't stop parsing! So
instead of a batch of [100, 100, 100, 100, 100, 100], we'd have a batch
of [600, 500, 400, 300, 200, 100]. Oops.

The implementation here could probably be improved, it's annoying to
have this extra variable in the state. But this'll do.

This makes the v3 parser training 5-10 times faster, depending on document
lengths. This problem wasn't in v2.
 		2020-09-02 12:57:13 +02:00
..
cli Fix sparse checkout for 'spacy project' (#6008) 2020-09-01 19:49:01 +02:00
displacy Adjust label casing in displaCy NER visualizer (resolves #4866) 2020-08-21 11:51:31 +02:00
gold Tidy up and auto-format [ci skip] 2020-08-29 13:01:10 +02:00
lang Rename Polish lemmatizer method (#5960) 2020-08-25 00:22:27 +02:00
matcher Deprecate (Phrase)Matcher.pipe 2020-08-31 17:01:24 +02:00
ml Remove unused variable [ci skip] 2020-08-29 13:11:26 +02:00
pipeline Fix significant performance bug in parser training (#6010) 2020-09-02 12:57:13 +02:00
tests Prevent Tagger model init with 0 labels (#5984) 2020-08-31 21:24:33 +02:00
tokens Use frozen list with custom errors 2020-08-29 15:20:11 +02:00
__init__.pxd
…
__init__.py Use frozen list with custom errors 2020-08-29 15:20:11 +02:00
__main__.py Tidy up 2020-06-22 00:45:40 +02:00
about.py Set version to v3.0.0a13 2020-08-30 23:10:43 +02:00
attrs.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
attrs.pyx Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
compat.py Tidy up, autoformat, add types 2020-07-25 15:01:15 +02:00
default_config.cfg Allow loaded but disabled components 2020-08-28 15:20:14 +02:00
default_config_pretraining.cfg Fix handling of optional [pretraining] block (#5954) 2020-08-24 15:56:03 +02:00
errors.py Prevent Tagger model init with 0 labels (#5984) 2020-08-31 21:24:33 +02:00
glossary.py unicode -> str consistency 2020-05-24 17:20:58 +02:00
kb.pxd Define candidate generator in EL config (#5876) 2020-08-18 16:10:36 +02:00
kb.pyx Define candidate generator in EL config (#5876) 2020-08-18 16:10:36 +02:00
language.py Remove 'cleanup' of strings (#6007) 2020-09-01 16:12:15 +02:00
lexeme.pxd Fix Lexeme.from_ptr 2020-08-10 16:43:37 +02:00
lexeme.pyx WIP: move more language data to config 2020-07-22 15:59:37 +02:00
lookups.py Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
morphology.pxd Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
morphology.pyx Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00
parts_of_speech.pxd
…
parts_of_speech.pyx Drop Python 2.7 and 3.5 (#4828) 2019-12-22 01:53:56 +01:00
pipe_analysis.py Simplify pipe analysis 2020-08-01 13:40:06 +02:00
schemas.py Allow loaded but disabled components 2020-08-28 15:20:14 +02:00
scorer.py Use frozen list with custom errors 2020-08-29 15:20:11 +02:00
strings.pxd Remove 'cleanup' of strings (#6007) 2020-09-01 16:12:15 +02:00
strings.pyx Remove 'cleanup' of strings (#6007) 2020-09-01 16:12:15 +02:00
structs.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
symbols.pxd Merge branch 'develop' into master-tmp 2020-05-21 18:39:06 +02:00
symbols.pyx Remove PRON_LEMMA symbol (#5968) 2020-08-25 14:21:29 +02:00
tokenizer.pxd Remove dead and/or deprecated code (#5710) 2020-07-06 13:06:25 +02:00
tokenizer.pyx Restrict tokenizer exceptions to ORTH and NORM 2020-08-31 09:55:01 +02:00
typedefs.pxd Update spaCy for thinc 8.0.0 (#4920) 2020-01-29 17:06:46 +01:00
typedefs.pyx
…
util.py Merge pull request #5993 from explosion/feature/disabled-components 2020-08-29 15:58:41 +02:00
vectors.pyx Update docstrings, docs and types 2020-07-29 11:36:42 +02:00
vocab.pxd Tidy up and move noun_chunks, token_match, url_match 2020-07-22 22:18:46 +02:00
vocab.pyx Add Lemmatizer and simplify related components (#5848) 2020-08-07 15:27:13 +02:00