Commit Graph

6 Commits

Author SHA1 Message Date
Wolfgang Seeker eae35e9b27 add tokenizer files for German, add/change code to train German pos tagger
- add files to specify rules for German tokenization
- change generate_specials.py to generate from an external file (abbrev.de.tab)
- copy gazetteer.json from lang_data/en/

- init_model.py
	- change doc freq threshold to 0
- add train_german_tagger.py
	- expects conll09-formatted input
2016-02-18 13:24:20 +01:00
Matthew Honnibal 7cbff48ace * Set the German lemma rules to be an empty JSON object 2016-02-02 22:30:51 +01:00
Matthew Honnibal d0f06c5cc4 * Add missing tags to the German tag map 2016-02-02 22:30:22 +01:00
Henning Peters 9ecb98f30e basic german rules 2015-09-22 11:56:29 +02:00
Matthew Honnibal 238b2f533b * Add lemma rules 2015-09-06 17:55:53 +02:00
Matthew Honnibal 494da25872 * Refactor for more universal spacy 2015-08-26 19:13:50 +02:00