spaCy

Commit Graph

Author	SHA1	Message	Date
Adriane Boyd	39540ed1ce	Replace dict trie with MapStruct trie	2019-09-24 14:39:50 +02:00
Adriane Boyd	0d9740e826	Replace PhraseMatcher with Aho-Corasick Replace PhraseMatcher with the Aho-Corasick algorithm over numpy arrays of the hash values for the relevant attribute. The implementation is based on FlashText. The speed should be similar to the previous PhraseMatcher. It is now possible to easily remove match IDs and matches don't go missing with large keyword lists / vocabularies. Fixes #4308.	2019-09-19 16:49:05 +02:00
Sofie Van Landeghem	c417c380e3	Matcher ID fixes (#4179 ) * allow phrasematcher to link one match to multiple original patterns * small fix for defining ent_id in the matcher (anti-ghost prevention) * cleanup * formatting	2019-08-22 17:17:07 +02:00

Author

SHA1

Message

Date

Adriane Boyd

39540ed1ce

Replace dict trie with MapStruct trie

2019-09-24 14:39:50 +02:00

Adriane Boyd

0d9740e826

Replace PhraseMatcher with Aho-Corasick

Replace PhraseMatcher with the Aho-Corasick algorithm over numpy arrays
of the hash values for the relevant attribute. The implementation is
based on FlashText.

The speed should be similar to the previous PhraseMatcher. It is now
possible to easily remove match IDs and matches don't go missing with
large keyword lists / vocabularies.

Fixes #4308.

2019-09-19 16:49:05 +02:00

Sofie Van Landeghem

c417c380e3

Matcher ID fixes (#4179 )

* allow phrasematcher to link one match to multiple original patterns

* small fix for defining ent_id in the matcher (anti-ghost prevention)

* cleanup

* formatting

2019-08-22 17:17:07 +02:00

3 Commits