Many hyperlinks are disabled.
Use anonymous login
to enable hyperlinks.
50 most recent check-ins that include changes to files matching 'tests/grammars/lexemes/adverbs/*'
|
2018-09-20
| ||
| 01:54 | Merge staging into main stream. Basic parse events (io, lexer) done. Basic input extension done. Doctools example working (macros, includes) json blocked out (issues with partial utf, non-utf, non-standard codings - Tcl vs. C pre-handling, strings vs. file) Leaf check-in: 7337a35e08 user: aku tags: trunk | |
|
2018-09-08
| ||
| 22:16 | Integrate base event work. Stage before true merge. check-in: ecf881268e user: aku tags: trunk-stage | |
| 22:11 | Brought trunk and event work. Closed-Leaf check-in: d912ded2f3 user: aku tags: language-doctools | |
| 21:38 | Tkt [d9b47bbb78] completed check-in: f97a8147f6 user: aku tags: parse-events | |
|
2018-08-31
| ||
| 23:12 | Ticket [d9b47bbb78]. Fix event management in the generators. Extended to fix the event data structures in general. - Modified container, grammar base, grammar classes - Event information split into declaration with state (events), and usage information (triggers). Events are managed in the main container class. Triggers are managed in the grammar base class. Code is common to L0 and G1. API used by the semantics is unchanged. Serialization structure changes. Event section is global. Trigger sections under L0, G1. Used a purpose-written tool to rewrite the old serializations in tests results (gcstate, gcr_*) to the new form. Reworked the SLIF generator to use the new form of serialization. Tests pass, no results changed. Fixed testsuite oops (generatec_gc(c|tcl)) not seen in trunk because everything with gc also had gc_c, etc. GC generators are ok as well. Extended testsuite to cover grammars with events. check-in: 5b0bdf9591 user: andreask tags: tkt-d9b47bbb78-event-management | |
| 07:39 | Ticket [d9b47bbb78]. Fix event management in the generators. Tests fully updated. Started update of generators. - slif ok - tparse in the works check-in: d4619268cc user: aku | |
|
2018-08-30
| ||
| 23:32 | Ticket [d9b47bbb78]. Fix event management in the generators. Changed container data structures. Separated event definition from event usage by symbols (triggers). Attention: This changes the grammar serialization. Started update of tests. TODO: Update generators. check-in: 8c77fd896a user: andreask | |
|
2018-08-29
| ||
| 06:59 | Updated main line with continued event work. check-in: 36533140c7 user: aku tags: trunk | |
|
2018-08-21
| ||
| 17:50 | Brought information from mini-dt and the new features for IO and parse events into the main doctools example. check-in: 8a648972d9 user: andreask tags: language-doctools | |
| 17:37 | Integrated multi-stop support as new feature into parse-events. Mini doctools examples demonstrates usefulness (and worked out how to handle vset/include for doctools ;). check-in: 27f7f4624d user: andreask tags: parse-events | |
| 17:32 | Integrated mini-dt into the branch it came from, multi-stop handling. Closed-Leaf check-in: 4a80913963 user: andreask tags: multi-stop | |
| 07:54 | Fixed the higher layers, adapted to the changes in inbound. Updated tests. Still have to document the higher match location methods. check-in: 5f55575b22 user: aku tags: mini-dt | |
|
2018-08-08
| ||
| 21:21 | Brought the main enhanced with support for IO/L0 parse events into the language example which needs it (doctools: vset, include). check-in: 15eeacc70a user: aku tags: language-doctools | |
| 21:17 | Pulled current working state of parse events (IO and L0 events) into main. Keeping the branch for future work on the G1 level event support. check-in: 2b796f8c7a user: aku tags: trunk | |
| 21:10 | Pulled completed heredoc language example into the main parse-event work branch it was based on. check-in: 19009459df user: aku tags: parse-events | |
|
2018-08-03
| ||
| 19:22 | Pulled streamlined match API and updated to it. Filled in the helper/demo/example app. check-in: 9c438ff29f user: andreask tags: lang-heredoc | |
| 07:19 | Continued match API work, fixed dependent files (tests). Removed `rewind`, `values`, `start:`, `length:`, `value:`, `values`, `symbols:`, and `sv:` Renamed `relative` to `from+`. Closed-Leaf check-in: cf1bc408d8 user: aku tags: match-api-streamline | |
|
2018-08-01
| ||
| 05:58 | Merged the completed work on support for stop events, closed branch. check-in: 10238f62f5 user: aku tags: parse-events | |
|
2018-07-27
| ||
| 07:10 | Implemented facade access based on event type. Updated tests. Name churn for the match methods match moveby -> match relative match moveto -> match from match stop-at -> match to match stop? -> match stop New method `match dont-stop` to cancel a stop marker/event. Note: rt-Tcl and rtc divergent wrt `sv:`. check-in: 32e9e5d575 user: aku tags: stop-events | |
|
2018-07-26
| ||
| 23:46 | Fixed the parse issues. Draft snapshots for all match tests. Implement the per-event access control next. check-in: 460323c2ae user: andreask tags: stop-events | |
| 07:55 | Continued work on stop events and facade validation. New `stop?` query method. Still need a method to clear stop marker. Basic acess rejection for rtc (error when outside event handler). check-in: defc583e62 user: aku tags: stop-events | |
|
2018-07-25
| ||
| 04:02 | Tweaked the match API, specifically location reporting and manipulation. The user visible current location always points to the character where (with which) processing will resume when the event handler returns. Updated the tests. check-in: 11a3929e08 user: aku tags: parse-events | |
|
2018-07-24
| ||
| 03:54 | Merged the work on PE rtc support into the general PE branch. Nearly at the point where we can do heredocs. For that we still need a stack of input segments for more control over movement in the string. check-in: 8ff5c985cb user: aku tags: parse-events | |
|
2018-07-23
| ||
| 21:05 | Extended event testing to match method `alternate`. check-in: b2a6a0ad23 user: aku tags: parse-events-rtc | |
| 19:40 | Extended event testing to the sv/symbols match methods (set & get). check-in: bc770d489f user: aku tags: parse-events-rtc | |
|
2018-04-20
| ||
| 21:28 | inbound: Absolute movement, tweaked for consistency. Extended with optional delta arguments. gate: Extended with forwards to the input location accessor and modifiers. This provides parse event handlers with the ability to move in the input. lexer: Moved redo to before we handle parse events. This enables parse event handlers to modify the location without interference from the system itself. Modified pre-lexeme event generation to move input to the start of the lexeme. Fixed pe-fill method, forgot to set flag for the incremental rebuild of the symbol/sv tables. parse descriptor: See gate. Further fixed accessor setup. Extended view to report input location. testsuite: Report input location. Move input location to the end of the lexeme. Needed now that pre-lexeme events have the location at the start. Updated expected results. check-in: faebf8fba4 user: aku tags: parse-events | |
|
2018-04-04
| ||
| 16:58 | Added generation of pre- and post-lexeme events. Extended the testsuite to demonstrate them. Note, the pre-lexeme trigger location does not match Marpa::R2 yet. check-in: 7693f8601c user: aku tags: parse-events | |
|
2018-04-03
| ||
| 20:42 | Pull recent fixes into the language work check-in: da745b6e55 user: aku tags: parse-events | |
| 20:37 | Fixed bug in the semantics' handling of :lexeme. Do not exclude the symbol from LATM fixup if the :lexeme adverbs do _not specify_ latm information. Facepalm. Found playing with lexeme events, and GC missing the crucial latm information, breaking generated test parsers. Updated tests to correct results. check-in: e5e442db2a user: aku tags: trunk | |
|
2018-01-30
| ||
| 10:16 | Added formatter producing a SLIF grammar from a grammar container. Note, this is not fully round-trip at the moment (The special @LEX symbols can not be read back, violating identifier syntax). It is also sub-optimal with regard to LATM flags, g1 actions, etc. These are shown as attributes of each rule instead of making use of defaults to reduce duplication. It should be good enough however to serve as debugging aid. check-in: 3bfc0de63c user: aku tags: trunk | |
|
2017-06-26
| ||
| 22:21 | Removed support for the `bless` adverb from the boot-parser and following stages. Updated tests. Left the cases using bless in the suite, for the parse errors they now cause. check-in: c1b1d00b8e user: aku tags: trunk | |
|
2017-06-16
| ||
| 05:15 | Make the semantics work official, pulled into main line. check-in: 0bc6a8787c user: aku tags: trunk | |
|
2017-06-06
| ||
| 18:17 | Brought up to date with main working branch check-in: 81bbe98e8f user: aku tags: asbr-perf | |
|
2017-05-16
| ||
| 07:13 | Reduction choices for a C backend based on bytes and byte-ranges. Fixes for problems missed so far. Extended testsuite. Added the gcr_c result files Optimizations for character and ASBR reduction to prevent rule chains. check-in: 0e9dd3b6ed user: aku tags: new-slif-semantics | |
|
2017-05-12
| ||
| 20:45 | Fixes to normalizer: * Added bytes and byte ranges. Updated doc/atom.md. Fixes to reducer: * During a redo of the implementation of rstate the invokation of the normalizer on new pieces was inadvertently dropped. Added it back. * Added the missed handling of %namedclass'es to the Tcl specific reduction rules. Factored the common code into a separate proc (CC-TCL). Fixes to grammar container * Added missing method `remove`. Fixes to the container testsuite (reduce-tcl): * Skip over grammars without L0, or no literals. * With `grammar` unpacking done early not needed for getting the literals. * Varname typo * Added the gcr_tcl result files check-in: 5558558738 user: aku tags: new-slif-semantics | |
|
2017-04-26
| ||
| 19:27 | Updated container tests. Another API change (l0 atom -> l0 literal), with corresponding updates to tests. Everything passes again. Next, deconstruction of literals, i.e. normalization phase II. check-in: 69b1ee0e4d user: aku tags: new-slif-semantics | |
| 08:32 | Integrated new literal handling into semantics. Updated tests. Container API change, breaks container tests. To fix next. check-in: e596035c8a user: aku tags: new-slif-semantics | |
|
2017-04-20
| ||
| 23:07 | Reduced comments generated by literal handling. Tests updated to match. check-in: 5059e70410 user: aku tags: new-slif-semantics | |
| 19:18 | First simplification of literals. Single-element strings to characters, ditto for charclass whose element is a character. Updated tests to match. check-in: 85cd4f4c54 user: aku tags: new-slif-semantics | |
| 06:25 | Moved literal handling out of the semantics into its own helper class and file. Further restructured the code to allow for easier insertion of simplification rules. Tweaks to symbol names, updated the tests to match. check-in: f2fc6e54fd user: aku tags: new-slif-semantics | |
|
2017-04-18
| ||
| 23:19 | Moved l0 literals into their own class, 'literal'. Added character atoms as supported literal type. Updated the tests to match. check-in: 8f33a9c72c user: aku tags: new-slif-semantics | |
| 06:29 | Big set of related changes - Implemented grammar container. - Implemented state dump (serialization) for same - Pretty printer for state dump, for use in tests. - Created testsuite using SLIF ctrace's to drive a container and check the resulting state. - Tweaked various test cases (slif, derived ast, ctrace, container): Removed superfluous :start statements. - Changes to semantics, updated test cases to match. - Moved passing of start symbol to near the end (symbol existence ensured) - Create literal/lexeme definitions only once. check-in: 79414a2533 user: aku tags: new-slif-semantics | |
|
2017-04-11
| ||
| 05:52 | Dropped "symbol" from container interface. Not needed. Some text tweaks. Updated the tests to match. check-in: 150fa90af9 user: aku tags: new-slif-semantics | |
|
2017-04-08
| ||
| 04:51 | Reworked the grammar framework a bit to be more scalable, i.e. not requiring a change with every new key. Updated suites to match. Further added suite and placeholders for container testing. Currently the new suite is a full fail (container completely different from the API coming from the semantics). check-in: 281636de75 user: aku tags: new-slif-semantics | |
|
2017-04-07
| ||
| 20:41 | Changed the string/charclass rep conveyed from semantics to container, removed tagging, type can be infered unambiguously from the value. Updated tests to match. Further fixed ingestion of named (inverted) char classes. Added tests. check-in: 993a1e814c user: aku tags: new-slif-semantics | |
| 06:24 | Moved to decimal codepoints in literal specs. Added handling of nocase for chars, strings. Updated tests to match. check-in: 5b27a4891f user: aku tags: new-slif-semantics | |
| 05:05 | Grammar tweak to make handling of discard variants easier. Split the discard rule to inline the variants of <single symbol> Completely reworked the handling of symbols (g1, l0, lexeme, discard, literals, etc.) Now using a state-machine to keep track of the contexts symbols are found in, and the conclusions about which future contexts are thus still legal. Redone the handling of fixups for `lexeme default` and `discard default`. User-specified settings of "latm" and "discard events" now form an exclusion list of symbols, with the regular list to exclude them from pulled out of the new state tracking. Literal handling now performs normalization and derivation of symbols in the semantics. The container does not know anything about anymore. FIX BUG: Tcl escapes for strings and char classes are not handled yet, neither by semantics, nor syntax. FIX BUG: Normalization of specs for "nocase" still missing Updated tests to match. Added tests for all the cases missed by the old tracking scheme. check-in: 2d3c378396 user: aku tags: new-slif-semantics | |
|
2017-03-28
| ||
| 03:00 | Moved location management to AST processing, away from the container-to-be. Updated tests to match. check-in: dbe940e8b8 user: aku tags: new-slif-semantics | |
|
2017-03-25
| ||
| 00:21 | Tweaked a number of messages, updated tests to match. Split some supporting code into separate files. check-in: aab73ba179 user: aku tags: new-slif-semantics | |
|
2017-03-23
| ||
| 05:15 | Implemented the defaults for g1 actions/blessings. Extended and updated tests. check-in: a91d328909 user: aku tags: new-slif-semantics | |