Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/spacy
History
Paul O'Leary McCann 61ef0739b8 Add Japanese stop words. (#2549) 
List created by taking the 2000 top words from a Wikipedia dump and
removing everything that wasn't hiragana.

Tried going through kanji words and deciding what to keep but there were
too many obvious non-stopwords (東京 was in the top 500) and many other
words where it wasn't clear if they should be included or not.
 		2018-07-17 10:12:48 +02:00
..
cli Better formatting for `spacy train` CLI (#2357) 2018-05-25 13:08:45 +02:00
data
…
displacy fix issue #2452 - displacy arrow direction is always forward (#2506) (closes #2452) 2018-07-04 14:12:08 +02:00
lang Add Japanese stop words. (#2549) 2018-07-17 10:12:48 +02:00
syntax Fix loading of models when custom vectors are added 2018-04-10 22:19:20 +02:00
tests Add Japanese lemmas (#2543) 2018-07-13 10:55:14 +02:00
tokens Add sent property to token (#2521) 2018-07-06 15:54:15 +02:00
__init__.pxd
…
__init__.py Silent keyword in info function in init (#2459) 2018-06-18 12:24:21 +02:00
__main__.py Don't pass CLI command name as dummy argument 2018-01-04 21:33:47 +01:00
_ml.py 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00
about.py Increment version to v2.0.12.dev0 2018-04-10 22:20:16 +02:00
attrs.pxd Fix LANG symbol 2018-02-17 18:10:50 +01:00
attrs.pyx missing PrepCase attribute 2018-02-18 14:46:12 +00:00
compat.py Simplify is_config() and normalize_string_keys() (#2305) 2018-05-21 01:54:35 +02:00
errors.py Accept Span to displacy render (#2478) (closes #2477) 2018-06-25 14:55:16 +02:00
glossary.py Fix typo in glossary (resolves #1964) 2018-02-10 11:58:41 +01:00
gold.pxd
…
gold.pyx Fix bug in CLI iob and ner converter (#2392) (fixes #2385) 2018-05-30 12:28:44 +02:00
language.py Fix vector-name loading fix 2018-04-04 01:31:25 +02:00
lemmatizer.py If no rules are set, lemmatize by lookup 2017-12-06 12:12:11 +01:00
lexeme.pxd
…
lexeme.pyx 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00
matcher.pyx 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00
morphology.pxd fix typo/missing here too 2018-02-18 14:38:27 +00:00
morphology.pyx 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00
parts_of_speech.pxd
…
parts_of_speech.pyx
…
pipeline.pxd
…
pipeline.pyx Fix loading of models when custom vectors are added 2018-04-10 22:19:20 +02:00
scorer.py 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00
strings.pxd
…
strings.pyx 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00
structs.pxd
…
symbols.pxd Fix inconsistencies in the symbols table 2018-02-18 13:51:31 +01:00
symbols.pyx Fix inconsistencies in the symbols table 2018-02-18 13:51:31 +01:00
tokenizer.pxd
…
tokenizer.pyx Fix loading tokenizer with custom prefix search (#2495) 2018-07-04 12:56:07 +02:00
typedefs.pxd
…
typedefs.pyx
…
util.py escape html in displacy.render (#2378) (closes #2361) 2018-05-28 18:36:41 +02:00
vectors.pyx 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00
vocab.pxd
…
vocab.pyx 💫 New system for error messages and warnings (#2163) 2018-04-03 15:50:31 +02:00