2017-11-01 22:04:28 +00:00
|
|
|
# encoding: utf8
|
|
|
|
|
from __future__ import unicode_literals
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
# Source: https://github.com/stopwords-iso/stopwords-hr
|
💫 Tidy up and auto-format .py files (#2983)
<!--- Provide a general summary of your changes in the title. -->
## Description
- [x] Use [`black`](https://github.com/ambv/black) to auto-format all `.py` files.
- [x] Update flake8 config to exclude very large files (lemmatization tables etc.)
- [x] Update code to be compatible with flake8 rules
- [x] Fix various small bugs, inconsistencies and messy stuff in the language data
- [x] Update docs to explain new code style (`black`, `flake8`, when to use `# fmt: off` and `# fmt: on` and what `# noqa` means)
Once #2932 is merged, which auto-formats and tidies up the CLI, we'll be able to run `flake8 spacy` actually get meaningful results.
At the moment, the code style and linting isn't applied automatically, but I'm hoping that the new [GitHub Actions](https://github.com/features/actions) will let us auto-format pull requests and post comments with relevant linting information.
### Types of change
enhancement, code style
## Checklist
<!--- Before you submit the PR, go over this checklist and make sure you can
tick off all the boxes. [] -> [x] -->
- [x] I have submitted the spaCy Contributor Agreement.
- [x] I ran the tests, and all new and existing tests passed.
- [x] My changes don't require a change to the documentation, or if they do, I've added all required information.
2018-11-30 16:03:03 +00:00
|
|
|
STOP_WORDS = set(
|
|
|
|
|
"""
|
2017-11-01 22:04:28 +00:00
|
|
|
a
|
2018-02-23 09:31:01 +00:00
|
|
|
ah
|
|
|
|
|
aha
|
|
|
|
|
aj
|
2017-11-01 22:04:28 +00:00
|
|
|
ako
|
2018-02-23 09:31:01 +00:00
|
|
|
al
|
2017-11-01 22:04:28 +00:00
|
|
|
ali
|
2018-02-23 09:31:01 +00:00
|
|
|
arh
|
|
|
|
|
au
|
|
|
|
|
avaj
|
|
|
|
|
bar
|
|
|
|
|
baš
|
|
|
|
|
bez
|
2017-11-01 22:04:28 +00:00
|
|
|
bi
|
|
|
|
|
bih
|
💫 Tidy up and auto-format .py files (#2983)
<!--- Provide a general summary of your changes in the title. -->
## Description
- [x] Use [`black`](https://github.com/ambv/black) to auto-format all `.py` files.
- [x] Update flake8 config to exclude very large files (lemmatization tables etc.)
- [x] Update code to be compatible with flake8 rules
- [x] Fix various small bugs, inconsistencies and messy stuff in the language data
- [x] Update docs to explain new code style (`black`, `flake8`, when to use `# fmt: off` and `# fmt: on` and what `# noqa` means)
Once #2932 is merged, which auto-formats and tidies up the CLI, we'll be able to run `flake8 spacy` actually get meaningful results.
At the moment, the code style and linting isn't applied automatically, but I'm hoping that the new [GitHub Actions](https://github.com/features/actions) will let us auto-format pull requests and post comments with relevant linting information.
### Types of change
enhancement, code style
## Checklist
<!--- Before you submit the PR, go over this checklist and make sure you can
tick off all the boxes. [] -> [x] -->
- [x] I have submitted the spaCy Contributor Agreement.
- [x] I ran the tests, and all new and existing tests passed.
- [x] My changes don't require a change to the documentation, or if they do, I've added all required information.
2018-11-30 16:03:03 +00:00
|
|
|
bijah
|
2018-02-23 09:31:01 +00:00
|
|
|
bijahu
|
|
|
|
|
bijaše
|
|
|
|
|
bijasmo
|
|
|
|
|
bijaste
|
2017-11-01 22:04:28 +00:00
|
|
|
bila
|
|
|
|
|
bili
|
|
|
|
|
bilo
|
|
|
|
|
bio
|
|
|
|
|
bismo
|
|
|
|
|
biste
|
|
|
|
|
biti
|
2018-02-23 09:31:01 +00:00
|
|
|
brr
|
|
|
|
|
buć
|
|
|
|
|
budavši
|
|
|
|
|
bude
|
|
|
|
|
budimo
|
|
|
|
|
budite
|
|
|
|
|
budu
|
|
|
|
|
budući
|
💫 Tidy up and auto-format .py files (#2983)
<!--- Provide a general summary of your changes in the title. -->
## Description
- [x] Use [`black`](https://github.com/ambv/black) to auto-format all `.py` files.
- [x] Update flake8 config to exclude very large files (lemmatization tables etc.)
- [x] Update code to be compatible with flake8 rules
- [x] Fix various small bugs, inconsistencies and messy stuff in the language data
- [x] Update docs to explain new code style (`black`, `flake8`, when to use `# fmt: off` and `# fmt: on` and what `# noqa` means)
Once #2932 is merged, which auto-formats and tidies up the CLI, we'll be able to run `flake8 spacy` actually get meaningful results.
At the moment, the code style and linting isn't applied automatically, but I'm hoping that the new [GitHub Actions](https://github.com/features/actions) will let us auto-format pull requests and post comments with relevant linting information.
### Types of change
enhancement, code style
## Checklist
<!--- Before you submit the PR, go over this checklist and make sure you can
tick off all the boxes. [] -> [x] -->
- [x] I have submitted the spaCy Contributor Agreement.
- [x] I ran the tests, and all new and existing tests passed.
- [x] My changes don't require a change to the documentation, or if they do, I've added all required information.
2018-11-30 16:03:03 +00:00
|
|
|
bum
|
2017-11-01 22:04:28 +00:00
|
|
|
bumo
|
2018-02-23 09:31:01 +00:00
|
|
|
će
|
|
|
|
|
ćemo
|
|
|
|
|
ćeš
|
|
|
|
|
ćete
|
|
|
|
|
čijem
|
|
|
|
|
čijim
|
|
|
|
|
čijima
|
|
|
|
|
ću
|
2017-11-01 22:04:28 +00:00
|
|
|
da
|
2018-02-23 09:31:01 +00:00
|
|
|
daj
|
|
|
|
|
dakle
|
|
|
|
|
de
|
|
|
|
|
deder
|
|
|
|
|
dem
|
|
|
|
|
djelomice
|
|
|
|
|
djelomično
|
2017-11-01 22:04:28 +00:00
|
|
|
do
|
2018-02-23 09:31:01 +00:00
|
|
|
doista
|
|
|
|
|
dok
|
|
|
|
|
dokle
|
|
|
|
|
donekle
|
|
|
|
|
dosad
|
|
|
|
|
doskoro
|
|
|
|
|
dotad
|
|
|
|
|
dotle
|
|
|
|
|
dovečer
|
|
|
|
|
drugamo
|
|
|
|
|
drugdje
|
2017-11-01 22:04:28 +00:00
|
|
|
duž
|
2018-02-23 09:31:01 +00:00
|
|
|
e
|
|
|
|
|
eh
|
|
|
|
|
ehe
|
|
|
|
|
ej
|
|
|
|
|
eno
|
|
|
|
|
eto
|
|
|
|
|
evo
|
2017-11-01 22:04:28 +00:00
|
|
|
ga
|
2018-02-23 09:31:01 +00:00
|
|
|
gdjekakav
|
|
|
|
|
gdjekoje
|
|
|
|
|
gic
|
|
|
|
|
god
|
|
|
|
|
halo
|
|
|
|
|
hej
|
|
|
|
|
hm
|
2017-11-01 22:04:28 +00:00
|
|
|
hoće
|
|
|
|
|
hoćemo
|
|
|
|
|
hoćeš
|
2018-02-23 09:31:01 +00:00
|
|
|
hoćete
|
2017-11-01 22:04:28 +00:00
|
|
|
hoću
|
2018-02-23 09:31:01 +00:00
|
|
|
hop
|
|
|
|
|
htijahu
|
|
|
|
|
htijasmo
|
|
|
|
|
htijaste
|
|
|
|
|
htio
|
|
|
|
|
htjedoh
|
|
|
|
|
htjedoše
|
|
|
|
|
htjedoste
|
|
|
|
|
htjela
|
|
|
|
|
htjele
|
|
|
|
|
htjeli
|
|
|
|
|
hura
|
2017-11-01 22:04:28 +00:00
|
|
|
i
|
|
|
|
|
iako
|
|
|
|
|
ih
|
2018-02-23 09:31:01 +00:00
|
|
|
iju
|
|
|
|
|
ijuju
|
|
|
|
|
ikada
|
|
|
|
|
ikakav
|
|
|
|
|
ikakva
|
|
|
|
|
ikakve
|
|
|
|
|
ikakvi
|
|
|
|
|
ikakvih
|
|
|
|
|
ikakvim
|
|
|
|
|
ikakvima
|
|
|
|
|
ikakvo
|
|
|
|
|
ikakvog
|
|
|
|
|
ikakvoga
|
|
|
|
|
ikakvoj
|
|
|
|
|
ikakvom
|
|
|
|
|
ikakvome
|
2017-11-01 22:04:28 +00:00
|
|
|
ili
|
2018-02-23 09:31:01 +00:00
|
|
|
im
|
2017-11-01 22:04:28 +00:00
|
|
|
iz
|
|
|
|
|
ja
|
|
|
|
|
je
|
|
|
|
|
jedna
|
|
|
|
|
jedne
|
2018-02-23 09:31:01 +00:00
|
|
|
jedni
|
2017-11-01 22:04:28 +00:00
|
|
|
jedno
|
|
|
|
|
jer
|
|
|
|
|
jesam
|
|
|
|
|
jesi
|
|
|
|
|
jesmo
|
|
|
|
|
jest
|
|
|
|
|
jeste
|
|
|
|
|
jesu
|
|
|
|
|
jim
|
|
|
|
|
joj
|
|
|
|
|
još
|
|
|
|
|
ju
|
|
|
|
|
kada
|
|
|
|
|
kako
|
|
|
|
|
kao
|
|
|
|
|
koja
|
|
|
|
|
koje
|
|
|
|
|
koji
|
|
|
|
|
kojima
|
|
|
|
|
koju
|
|
|
|
|
kroz
|
2018-02-23 09:31:01 +00:00
|
|
|
lani
|
2017-11-01 22:04:28 +00:00
|
|
|
li
|
|
|
|
|
me
|
|
|
|
|
mene
|
|
|
|
|
meni
|
|
|
|
|
mi
|
|
|
|
|
mimo
|
|
|
|
|
moj
|
|
|
|
|
moja
|
|
|
|
|
moje
|
2018-02-23 09:31:01 +00:00
|
|
|
moji
|
|
|
|
|
moju
|
2017-11-01 22:04:28 +00:00
|
|
|
mu
|
|
|
|
|
na
|
|
|
|
|
nad
|
|
|
|
|
nakon
|
|
|
|
|
nam
|
|
|
|
|
nama
|
|
|
|
|
nas
|
|
|
|
|
naš
|
|
|
|
|
naša
|
|
|
|
|
naše
|
|
|
|
|
našeg
|
2018-02-23 09:31:01 +00:00
|
|
|
naši
|
2017-11-01 22:04:28 +00:00
|
|
|
ne
|
2018-02-23 09:31:01 +00:00
|
|
|
neće
|
|
|
|
|
nećemo
|
|
|
|
|
nećeš
|
|
|
|
|
nećete
|
|
|
|
|
neću
|
2017-11-01 22:04:28 +00:00
|
|
|
nego
|
|
|
|
|
neka
|
2018-02-23 09:31:01 +00:00
|
|
|
neke
|
2017-11-01 22:04:28 +00:00
|
|
|
neki
|
|
|
|
|
nekog
|
|
|
|
|
neku
|
|
|
|
|
nema
|
|
|
|
|
nešto
|
2018-02-23 09:31:01 +00:00
|
|
|
netko
|
2017-11-01 22:04:28 +00:00
|
|
|
ni
|
|
|
|
|
nije
|
|
|
|
|
nikoga
|
|
|
|
|
nikoje
|
2018-02-23 09:31:01 +00:00
|
|
|
nikoji
|
2017-11-01 22:04:28 +00:00
|
|
|
nikoju
|
|
|
|
|
nisam
|
|
|
|
|
nisi
|
|
|
|
|
nismo
|
|
|
|
|
niste
|
|
|
|
|
nisu
|
|
|
|
|
njega
|
|
|
|
|
njegov
|
|
|
|
|
njegova
|
|
|
|
|
njegovo
|
|
|
|
|
njemu
|
|
|
|
|
njezin
|
|
|
|
|
njezina
|
|
|
|
|
njezino
|
|
|
|
|
njih
|
|
|
|
|
njihov
|
|
|
|
|
njihova
|
|
|
|
|
njihovo
|
|
|
|
|
njim
|
|
|
|
|
njima
|
|
|
|
|
njoj
|
|
|
|
|
nju
|
|
|
|
|
no
|
|
|
|
|
o
|
|
|
|
|
od
|
|
|
|
|
odmah
|
|
|
|
|
on
|
|
|
|
|
ona
|
2018-02-23 09:31:01 +00:00
|
|
|
one
|
2017-11-01 22:04:28 +00:00
|
|
|
oni
|
|
|
|
|
ono
|
2018-02-23 09:31:01 +00:00
|
|
|
onu
|
|
|
|
|
onoj
|
|
|
|
|
onom
|
|
|
|
|
onim
|
|
|
|
|
onima
|
2017-11-01 22:04:28 +00:00
|
|
|
ova
|
2018-02-23 09:31:01 +00:00
|
|
|
ovaj
|
|
|
|
|
ovim
|
|
|
|
|
ovima
|
|
|
|
|
ovoj
|
2017-11-01 22:04:28 +00:00
|
|
|
pa
|
|
|
|
|
pak
|
2018-02-23 09:31:01 +00:00
|
|
|
pljus
|
2017-11-01 22:04:28 +00:00
|
|
|
po
|
|
|
|
|
pod
|
2018-02-23 09:31:01 +00:00
|
|
|
podalje
|
|
|
|
|
poimence
|
|
|
|
|
poizdalje
|
|
|
|
|
ponekad
|
2017-11-01 22:04:28 +00:00
|
|
|
pored
|
2018-02-23 09:31:01 +00:00
|
|
|
postrance
|
|
|
|
|
potajice
|
|
|
|
|
potrbuške
|
|
|
|
|
pouzdano
|
2017-11-01 22:04:28 +00:00
|
|
|
prije
|
|
|
|
|
s
|
|
|
|
|
sa
|
|
|
|
|
sam
|
|
|
|
|
samo
|
2018-02-23 09:31:01 +00:00
|
|
|
sasvim
|
|
|
|
|
sav
|
2017-11-01 22:04:28 +00:00
|
|
|
se
|
|
|
|
|
sebe
|
|
|
|
|
sebi
|
|
|
|
|
si
|
2018-02-23 09:31:01 +00:00
|
|
|
šic
|
2017-11-01 22:04:28 +00:00
|
|
|
smo
|
|
|
|
|
ste
|
2018-02-23 09:31:01 +00:00
|
|
|
što
|
|
|
|
|
šta
|
|
|
|
|
štogod
|
|
|
|
|
štagod
|
2017-11-01 22:04:28 +00:00
|
|
|
su
|
2018-02-23 09:31:01 +00:00
|
|
|
sva
|
2017-11-01 22:04:28 +00:00
|
|
|
sve
|
|
|
|
|
svi
|
2018-02-23 09:31:01 +00:00
|
|
|
svi
|
2017-11-01 22:04:28 +00:00
|
|
|
svog
|
|
|
|
|
svoj
|
|
|
|
|
svoja
|
|
|
|
|
svoje
|
2018-02-23 09:31:01 +00:00
|
|
|
svoju
|
2017-11-01 22:04:28 +00:00
|
|
|
svom
|
2018-02-23 09:31:01 +00:00
|
|
|
svu
|
2017-11-01 22:04:28 +00:00
|
|
|
ta
|
|
|
|
|
tada
|
|
|
|
|
taj
|
|
|
|
|
tako
|
|
|
|
|
te
|
|
|
|
|
tebe
|
|
|
|
|
tebi
|
|
|
|
|
ti
|
2018-02-23 09:31:01 +00:00
|
|
|
tim
|
|
|
|
|
tima
|
2017-11-01 22:04:28 +00:00
|
|
|
to
|
|
|
|
|
toj
|
|
|
|
|
tome
|
|
|
|
|
tu
|
|
|
|
|
tvoj
|
|
|
|
|
tvoja
|
|
|
|
|
tvoje
|
2018-02-23 09:31:01 +00:00
|
|
|
tvoji
|
|
|
|
|
tvoju
|
2017-11-01 22:04:28 +00:00
|
|
|
u
|
2018-02-23 09:31:01 +00:00
|
|
|
usprkos
|
|
|
|
|
utaman
|
|
|
|
|
uvijek
|
2017-11-01 22:04:28 +00:00
|
|
|
uz
|
2018-02-23 09:31:01 +00:00
|
|
|
uza
|
|
|
|
|
uzagrapce
|
|
|
|
|
uzalud
|
|
|
|
|
uzduž
|
|
|
|
|
valjda
|
2017-11-01 22:04:28 +00:00
|
|
|
vam
|
|
|
|
|
vama
|
|
|
|
|
vas
|
|
|
|
|
vaš
|
|
|
|
|
vaša
|
|
|
|
|
vaše
|
2018-02-23 09:31:01 +00:00
|
|
|
vašim
|
|
|
|
|
vašima
|
2017-11-01 22:04:28 +00:00
|
|
|
već
|
|
|
|
|
vi
|
2018-02-23 09:31:01 +00:00
|
|
|
vjerojatno
|
|
|
|
|
vjerovatno
|
|
|
|
|
vrh
|
2017-11-01 22:04:28 +00:00
|
|
|
vrlo
|
|
|
|
|
za
|
2018-02-23 09:31:01 +00:00
|
|
|
zaista
|
2017-11-01 22:04:28 +00:00
|
|
|
zar
|
2018-02-23 09:31:01 +00:00
|
|
|
zatim
|
|
|
|
|
zato
|
|
|
|
|
zbija
|
|
|
|
|
zbog
|
|
|
|
|
želeći
|
|
|
|
|
željah
|
|
|
|
|
željela
|
|
|
|
|
željele
|
|
|
|
|
željeli
|
|
|
|
|
željelo
|
|
|
|
|
željen
|
|
|
|
|
željena
|
|
|
|
|
željene
|
|
|
|
|
željeni
|
|
|
|
|
željenu
|
|
|
|
|
željeo
|
|
|
|
|
zimus
|
|
|
|
|
zum
|
💫 Tidy up and auto-format .py files (#2983)
<!--- Provide a general summary of your changes in the title. -->
## Description
- [x] Use [`black`](https://github.com/ambv/black) to auto-format all `.py` files.
- [x] Update flake8 config to exclude very large files (lemmatization tables etc.)
- [x] Update code to be compatible with flake8 rules
- [x] Fix various small bugs, inconsistencies and messy stuff in the language data
- [x] Update docs to explain new code style (`black`, `flake8`, when to use `# fmt: off` and `# fmt: on` and what `# noqa` means)
Once #2932 is merged, which auto-formats and tidies up the CLI, we'll be able to run `flake8 spacy` actually get meaningful results.
At the moment, the code style and linting isn't applied automatically, but I'm hoping that the new [GitHub Actions](https://github.com/features/actions) will let us auto-format pull requests and post comments with relevant linting information.
### Types of change
enhancement, code style
## Checklist
<!--- Before you submit the PR, go over this checklist and make sure you can
tick off all the boxes. [] -> [x] -->
- [x] I have submitted the spaCy Contributor Agreement.
- [x] I ran the tests, and all new and existing tests passed.
- [x] My changes don't require a change to the documentation, or if they do, I've added all required information.
2018-11-30 16:03:03 +00:00
|
|
|
""".split()
|
|
|
|
|
)
|