Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/spacy/syntax/transition_system.pxd

54 lines
1.6 KiB
Cython
Raw Normal View History

* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
from cymem.cymem cimport Pool
from thinc.typedefs cimport weight_t
from ..structs cimport TokenC
* Move spacy.syntax.conll to spacy.gold
2015-05-24 19:35:02 +00:00
from ..gold cimport GoldParse
* Have oracle functions take a struct instead of a Python object
2015-06-02 18:01:06 +00:00
from ..gold cimport GoldParseC
* Use StringStore to encode label names, instead of label_ids
2015-03-14 15:06:35 +00:00
from ..strings cimport StringStore
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
* Move StateClass into the interface for is_valid
2015-06-09 21:23:28 +00:00
from .stateclass cimport StateClass
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 01:58:14 +00:00
from ._state cimport StateC
* Move StateClass into the interface for is_valid
2015-06-09 21:23:28 +00:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
cdef struct Transition:
int clas
int move
int label
weight_t score
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 01:58:14 +00:00
bint (*is_valid)(const StateC* state, int label) nogil
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser
2016-01-30 13:31:12 +00:00
weight_t (*get_cost)(StateClass state, const GoldParseC* gold, int label) nogil
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 01:58:14 +00:00
int (*do)(StateC* state, int label) nogil
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser
2016-01-30 13:31:12 +00:00
ctypedef weight_t (*get_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil
ctypedef weight_t (*move_cost_func_t)(StateClass state, const GoldParseC* gold) nogil
ctypedef weight_t (*label_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 01:58:14 +00:00
ctypedef int (*do_func_t)(StateC* state, int label) nogil
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
Allow beam parsing for NER
2017-03-11 17:12:01 +00:00
ctypedef void* (*init_state_t)(Pool mem, int length, void* tokens) except NULL
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
cdef class TransitionSystem:
cdef Pool mem
* Use StringStore to encode label names, instead of label_ids
2015-03-14 15:06:35 +00:00
cdef StringStore strings
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model
2016-01-19 18:09:33 +00:00
cdef Transition* c
* Tmp commit
2015-02-23 19:04:53 +00:00
cdef readonly int n_moves
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model
2016-01-19 18:09:33 +00:00
cdef int _size
* Remove gil from parser.call
2015-07-14 21:47:03 +00:00
cdef public int root_label
* Serialization round trip now working with decent API, but with rough spots in the organisation and requiring vocabulary to be fixed ahead of time.
2015-07-19 13:18:17 +00:00
cdef public freqs
Allow beam parsing for NER
2017-03-11 17:12:01 +00:00
cdef init_state_t init_beam_state
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
* Add a parse_batch method to Parser, that releases the GIL around a batch of documents.
2016-02-01 07:34:55 +00:00
cdef int initialize_state(self, StateC* state) nogil
cdef int finalize_state(self, StateC* state) nogil
* NER seems to be working, scoring 69 F. Need to add decision-history features --- currently only use current word, 2 words context. Need refactoring.
2015-03-10 17:00:23 +00:00
* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc.
2015-03-09 11:06:01 +00:00
cdef Transition lookup_transition(self, object name) except *
Remove trailing whitespace
2015-04-19 08:31:31 +00:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid
2015-02-21 15:38:18 +00:00
cdef Transition init_transition(self, int clas, int move, int label) except *
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents
2016-02-01 02:00:15 +00:00
cdef int set_valid(self, int* output, const StateC* st) nogil
* Whitespace
2015-08-08 21:35:59 +00:00
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser
2016-01-30 13:31:12 +00:00
cdef int set_costs(self, int* is_valid, weight_t* costs,
* Rejig parser interface to use new thinc.api.Example class, in prep of theano model. Comment out beam search
2015-06-26 04:25:36 +00:00
StateClass state, GoldParse gold) except -1