Commit Graph

35 Commits

Author SHA1 Message Date
Erez Shinan aede340449 Added earley__all_derivations due to performance concerns 2017-08-23 10:52:46 +03:00
Erez Shinan 950f8817ed Oops!! Important bugfix to last commit 2017-08-22 22:28:47 +03:00
Erez Shinan ac9ea26b58 Added token priority for standard lexers.
Big Thanks to Seth G of the mappyfile project for financing this feature!
2017-08-22 17:47:22 +03:00
Erez Shinan 5d41371fb3 Added resolve__antiscore_sum 2017-08-15 23:06:06 +03:00
Erez Shinan 9b8ae7aecb Bugfix: Fixed the %import TOKEN feature 2017-08-15 18:48:03 +03:00
Erez Shinan 0c5acaab8a Refactoring load_grammar 2017-08-04 22:46:20 +03:00
Erez Shinan dda0719375 Post-merge cleanup 2017-08-04 15:53:50 +03:00
Erez Shinan 2d0f2af0aa Merge branch 'master' into dyn_earley 2017-08-04 15:16:46 +03:00
Erez Shinan 4eec924403 Added prioritization to Earley. Use rule.1 etc. Highest priority will be selected in case of ambiguity. 2017-08-04 02:42:31 +03:00
Erez Shinan ee8dd8b3f3 Added a test suggested by James McLaughlin 2017-07-26 10:17:27 +03:00
Erez Shinan 1da851516c Added option: Keep all tokens 2017-05-29 00:05:54 +03:00
Erez Shinan 64d141e486 BUGFIX: Fixes a subtle bug in the LALR(1) parser. See the new test for details. 2017-05-22 12:26:24 +03:00
Erez Shinan 5946e78ed2 Bugfix for Scanless Earley. Thanks Ken! 2017-05-06 17:04:19 +03:00
Erez Shinan 8e2221b2fd Mid-work. A nice first try 2017-05-01 17:08:10 +03:00
Erez Shinan d43afcf74a Trying travis support 2017-04-18 11:43:19 +03:00
Erez Shinan f374e70b2c Feature: Added explicit ambiguity option for Earley 2017-04-18 02:17:17 +03:00
Erez Shinan 1685f94ea3 BUGFIX: Solved an elusive bug in Earley parser, when empty rules repeat in the same column 2017-04-05 17:32:56 +03:00
Erez Shinan 794a1c4965 More flags work 2017-03-09 21:33:34 +02:00
Erez Shinan 34acc4674e Added flag options to terminals (just 'i' for now) 2017-03-09 18:15:55 +02:00
Erez Shinan 24f86569da Fixed issue #3 (infinite recursion in grammar) 2017-03-09 09:45:56 +02:00
Erez Shinan a73cc9ad90 Re-wrote the Earley parser to use a parse-forest
It now knows how to resolve ambiguity! And in a memory-efficient way!
2017-03-08 23:47:05 +02:00
Erez Shinan 29718a9a3a Bugfix in scanless 2017-03-04 19:36:07 +02:00
Erez Shinan d8cbd239d7 Fixed a bug in string evaluation 2017-03-03 02:20:02 +02:00
Erez Shinan c1fbb3214c Earley.lexer = None as default now 2017-03-01 18:24:44 +02:00
Erez Shinan a60c339ff7 Scanless Earley now working for all tests! 2017-03-01 10:42:55 +02:00
Erez Shinan be6aa4f726 Fixed string escaping and unicode handling 2017-03-01 10:42:47 +02:00
Erez Shinan 2973167cf0 Added a test for empty rules 2017-03-01 10:42:47 +02:00
Erez Shinan c9b45823ed Better support for scanless parsing 2017-02-26 12:05:56 +02:00
Erez Shinan a5a20a423a Changed parser/lexer interface in lark. Bumped minor version 2017-02-25 18:35:31 +02:00
Erez Shinan fbba305a9e Fixed grammars 2017-02-24 00:45:34 +02:00
Erez Shinan 5236e4a32a Refactored TokenDef to store Pattern(Str/RE) 2017-02-23 23:50:52 +02:00
Erez Shinan c70355389f Initial support for EBNF in tokens (automatic compilation to regexps) 2017-02-23 13:01:21 +02:00
Erez Shinan 520ab88cd8 Added ContextualLexer for LALR. Working, but doesn't seem to improve speed.
Also some issues with python_parser
2017-02-15 00:45:00 +02:00
Erez Shinan 09a80ed222 Fixed bug in lexer where unidentical tokens got the same name 2017-02-12 00:36:34 +02:00
Erez Shinan 2f6f3f9a31 Changed to the MIT license 2017-02-11 10:41:40 +02:00