Matthew Honnibal bb911e5f4e Fix #3830: 'subtok' label being added even if learn_tokens=False (#4188) ... * Prevent subtok label if not learning tokens The parser introduces the subtok label to mark tokens that should be merged during post-processing. Previously this happened even if we did not have the --learn-tokens flag set. This patch passes the config through to the parser, to prevent the problem. * Make merge_subtokens a parser post-process if learn_subtokens * Fix train script * Add test for 3830: subtok problem * Fix handlign of non-subtok in parser training		2019-08-23 17:54:00 +02:00
..
cli	Fix #3830: 'subtok' label being added even if learn_tokens=False (#4188)	2019-08-23 17:54:00 +02:00
data	…
displacy	Improve token pattern checking without validation (#4105)	2019-08-21 14:00:37 +02:00
lang	💫 WIP: Basic lookup class scaffolding and JSON for all lemmati… (#4167)	2019-08-22 14:21:32 +02:00
matcher	Matcher ID fixes (#4179)	2019-08-22 17:17:07 +02:00
pipeline	Fix #3830: 'subtok' label being added even if learn_tokens=False (#4188)	2019-08-23 17:54:00 +02:00
syntax	Fix #3830: 'subtok' label being added even if learn_tokens=False (#4188)	2019-08-23 17:54:00 +02:00
tests	Fix #3830: 'subtok' label being added even if learn_tokens=False (#4188)	2019-08-23 17:54:00 +02:00
tokens	Small retokenizer fix (#4174)	2019-08-22 12:23:54 +02:00
__init__.pxd	…
__init__.py	Fix formatting (hopefully also restarts build properly)	2019-03-20 09:55:45 +01:00
__main__.py	Update __main__.py	2019-03-20 09:43:26 +01:00
_align.pyx	Improve alignment around quotes	2018-08-16 01:04:34 +02:00
_ml.py	Fix absolute imports and avoid importing from cli	2019-08-20 15:08:59 +02:00
about.py	Set version to v2.1.8	2019-08-07 13:53:58 +02:00
attrs.pxd	Fix attrs alignment	2019-07-12 17:59:47 +02:00
attrs.pyx	ensure Span.as_doc keeps the entity links + unit test	2019-06-25 15:28:51 +02:00
compat.py	Fix symlink creation to show error message on failure (#3589) (resolves #3307))	2019-04-16 11:58:31 +02:00
errors.py	Check for is_tagged/is_parsed for Matcher attrs (#4163)	2019-08-21 20:52:36 +02:00
glossary.py	Update glossary.py to match information found in documentation (#3704) (closes ##3679)	2019-05-10 14:23:20 +02:00
gold.pxd	fixes in kb and gold	2019-07-17 17:18:26 +02:00
gold.pyx	WIP: Extending debug-data (#4114)	2019-08-16 10:52:46 +02:00
kb.pxd	rename entity frequency	2019-07-19 17:40:28 +02:00
kb.pyx	CLI scripts for entity linking (wikipedia & generic) (#4091)	2019-08-13 15:38:59 +02:00
language.py	💫 WIP: Basic lookup class scaffolding and JSON for all lemmati… (#4167)	2019-08-22 14:21:32 +02:00
lemmatizer.py	Fix inconsistant lemmatizer issue #3484 (#3646)	2019-05-04 18:16:03 +02:00
lexeme.pxd	💫 Support lexical attributes in retokenizer attrs (closes #2390) (#3325)	2019-02-24 21:13:51 +01:00
lexeme.pyx	Tidy up property code style (#3391)	2019-03-11 15:59:09 +01:00
lookups.py	💫 WIP: Basic lookup class scaffolding and JSON for all lemmati… (#4167)	2019-08-22 14:21:32 +02:00
morphology.pxd	annotate kb_id through ents in doc	2019-03-22 11:36:44 +01:00
morphology.pyx	Fix issue #3551: Upper case lemmas	2019-04-16 12:27:15 +02:00
parts_of_speech.pxd	…
parts_of_speech.pyx	…
scorer.py	Tidy up and auto-format	2019-08-18 15:09:16 +02:00
strings.pxd	…
strings.pyx	💫 Make serialization methods consistent (#3385)	2019-03-10 19:16:45 +01:00
structs.pxd	rename entity frequency	2019-07-19 17:40:28 +02:00
symbols.pxd	Fix symbol alignment	2019-07-12 17:48:38 +02:00
symbols.pyx	ensure Span.as_doc keeps the entity links + unit test	2019-06-25 15:28:51 +02:00
tokenizer.pxd	…
tokenizer.pyx	tokenizer doc fix	2019-07-15 11:19:34 +02:00
typedefs.pxd	…
typedefs.pyx	…
util.py	💫 WIP: Basic lookup class scaffolding and JSON for all lemmati… (#4167)	2019-08-22 14:21:32 +02:00
vectors.pyx	Update Vectors.find docs [ci skip]	2019-03-16 17:10:57 +01:00
vocab.pxd	💫 WIP: Basic lookup class scaffolding and JSON for all lemmati… (#4167)	2019-08-22 14:21:32 +02:00
vocab.pyx	💫 WIP: Basic lookup class scaffolding and JSON for all lemmati… (#4167)	2019-08-22 14:21:32 +02:00