spaCy/spacy/__init__.py

# coding: utf8
from __future__ import unicode_literals

from pathlib import Path

from .util import set_lang_class, get_lang_class, parse_package_meta
from .deprecated import resolve_model_name
from .cli import info

from . import en, de, zh, es, it, hu, fr, pt, nl, sv, fi, bn, he


set_lang_class(en.English.lang, en.English)
set_lang_class(de.German.lang, de.German)
set_lang_class(es.Spanish.lang, es.Spanish)
set_lang_class(pt.Portuguese.lang, pt.Portuguese)
set_lang_class(fr.French.lang, fr.French)
set_lang_class(it.Italian.lang, it.Italian)
set_lang_class(hu.Hungarian.lang, hu.Hungarian)
set_lang_class(zh.Chinese.lang, zh.Chinese)
set_lang_class(nl.Dutch.lang, nl.Dutch)
set_lang_class(sv.Swedish.lang, sv.Swedish)
set_lang_class(fi.Finnish.lang, fi.Finnish)
set_lang_class(bn.Bengali.lang, bn.Bengali)
set_lang_class(he.Hebrew.lang, he.Hebrew)


def load(name, **overrides):
    data_path = overrides.get('path', util.get_data_path())
    model_name = resolve_model_name(name)
    meta = parse_package_meta(data_path, model_name, require=False)
    lang = meta['lang'] if meta and 'lang' in meta else name
    cls = get_lang_class(lang)
    overrides['meta'] = meta
    model_path = Path(data_path / model_name)
    if model_path.exists():
        overrides['path'] = model_path

    return cls(**overrides)
Update model loading to support links Remove match_best_version check, fetch model language from meta instead of directory name, and don't make too many assumptions – if model is downloaded via downloader, version should match anyway. (Otherwise, users should be free to add and load whichever models they want.) 2017-03-16 16:13:08 +00:00			`# coding: utf8`
Clean up imports, unused code, whitespace, docstrings 2017-04-15 10:05:47 +00:00			`from __future__ import unicode_literals`
Update model loading to support links Remove match_best_version check, fetch model language from meta instead of directory name, and don't make too many assumptions – if model is downloaded via downloader, version should match anyway. (Otherwise, users should be free to add and load whichever models they want.) 2017-03-16 16:13:08 +00:00
			`from pathlib import Path`
Clean up imports, unused code, whitespace, docstrings 2017-04-15 10:05:47 +00:00
Update model loading to support links Remove match_best_version check, fetch model language from meta instead of directory name, and don't make too many assumptions – if model is downloaded via downloader, version should match anyway. (Otherwise, users should be free to add and load whichever models they want.) 2017-03-16 16:13:08 +00:00			`from .util import set_lang_class, get_lang_class, parse_package_meta`
Add function to resolve model names and link them 2017-03-17 17:47:05 +00:00			`from .deprecated import resolve_model_name`
Fix imports 2017-03-22 09:02:14 +00:00			`from .cli import info`
refactored data_dir->via, add zip_safe, add spacy.load() 2016-01-15 17:01:02 +00:00
Clean up imports, unused code, whitespace, docstrings 2017-04-15 10:05:47 +00:00			`from . import en, de, zh, es, it, hu, fr, pt, nl, sv, fi, bn, he`
Import metadata into __init__ 2017-03-18 18:30:03 +00:00
Fix formatting and remove unused imports 2017-03-15 16:33:57 +00:00
avoid polluting spacy namespace with lang classes 2016-04-12 14:31:16 +00:00			`set_lang_class(en.English.lang, en.English)`
			`set_lang_class(de.German.lang, de.German)`
Link languages in __init__.py 2016-11-02 19:05:14 +00:00			`set_lang_class(es.Spanish.lang, es.Spanish)`
			`set_lang_class(pt.Portuguese.lang, pt.Portuguese)`
			`set_lang_class(fr.French.lang, fr.French)`
			`set_lang_class(it.Italian.lang, it.Italian)`
First steps towards the Hungarian tokenizer code. 2016-12-07 22:07:43 +00:00			`set_lang_class(hu.Hungarian.lang, hu.Hungarian)`
* Register Chinese language in spacy/__init__.py 2016-04-24 16:45:16 +00:00			`set_lang_class(zh.Chinese.lang, zh.Chinese)`
Added language Dutch to init file 2016-11-29 15:42:05 +00:00			`set_lang_class(nl.Dutch.lang, nl.Dutch)`
Initial commit for Swedish 2016-12-20 10:05:06 +00:00			`set_lang_class(sv.Swedish.lang, sv.Swedish)`
Add preliminary support for Finnish 2017-01-31 22:27:29 +00:00			`set_lang_class(fi.Finnish.lang, fi.Finnish)`
add basic Bengali support 2017-02-28 01:48:37 +00:00			`set_lang_class(bn.Bengali.lang, bn.Bengali)`
Add Hebrew to init and setup.py 2017-03-29 08:34:57 +00:00			`set_lang_class(he.Hebrew.lang, he.Hebrew)`
Add preliminary support for Finnish 2017-01-31 22:27:29 +00:00
add lang registration facility 2016-03-25 17:54:45 +00:00
Fix spacy.load 2016-10-18 17:23:31 +00:00			`def load(name, **overrides):`
Fix loading of GloVe vectors, to address Issue #541 2016-10-20 16:27:48 +00:00			`data_path = overrides.get('path', util.get_data_path())`
Add function to resolve model names and link them 2017-03-17 17:47:05 +00:00			`model_name = resolve_model_name(name)`
Merge changes to __init__.py 2017-03-17 18:51:45 +00:00			`meta = parse_package_meta(data_path, model_name, require=False)`
Fix loading when no package found 2017-03-16 23:30:02 +00:00			`lang = meta['lang'] if meta and 'lang' in meta else name`
Update model loading to support links Remove match_best_version check, fetch model language from meta instead of directory name, and don't make too many assumptions – if model is downloaded via downloader, version should match anyway. (Otherwise, users should be free to add and load whichever models they want.) 2017-03-16 16:13:08 +00:00			`cls = get_lang_class(lang)`
			`overrides['meta'] = meta`
Merge changes to __init__.py 2017-03-17 18:51:45 +00:00			`model_path = Path(data_path / model_name)`
Fix loading when no package found 2017-03-16 23:30:02 +00:00			`if model_path.exists():`
			`overrides['path'] = model_path`
Merge changes to __init__.py 2017-03-17 18:51:45 +00:00
Fix path-override bug in spacy.load 2016-12-18 21:15:29 +00:00			`return cls(**overrides)`