Marpa

Timeline
Login

Timeline

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

50 most recent events

2019-02-03
23:23 Edit [44fee72091465a65|44fee72091]: Edit check-in comment. artifact: b4769c3a74 user: aku
2018-12-14
17:09 New ticket [f44dfffb30] . artifact: d6f3b4fa80 user: aku
2018-09-22
00:01
Added larger doctools examples from Tcllib. Modified dt helper to show new statistics. Untested. Leaf check-in: 3dbe995b99 user: andreask tags: io-statistics
2018-09-21
22:26
Completed IO statistics for rt-C. Fixed name clash in the new code (existing type vs new function, function renamed). Updated tests to match generator changes (cparse, clex). check-in: aa1749989d user: andreask tags: io-statistics
00:00
Added state and methods to collect and return IO statistics (#streams, #processed, #input). Implemented for rt-Tcl. Added tests. rt-C placeholders. check-in: 23a1ea88eb user: andreask tags: io-statistics
2018-09-20
22:24 Ticket [186c6e23bf] match state - expose more of events - listing, on/off status still Open with 3 other changes artifact: 0ebf6081e8 user: aku
22:22 Ticket [b10e687636] Create sample parser for SQL ISO standard status still Open with 3 other changes artifact: 463d606b6b user: aku
01:54
Merge staging into main stream. Basic parse events (io, lexer) done. Basic input extension done. Doctools example working (macros, includes) json blocked out (issues with partial utf, non-utf, non-standard codings - Tcl vs. C pre-handling, strings vs. file) Leaf check-in: 7337a35e08 user: aku tags: trunk
2018-09-18
17:18
Extended multi-byte char counting test to full unicode range. Closed-Leaf check-in: 15feed5264 user: aku tags: trunk-stage
05:01
Fix trailing whitespace check-in: d336725a4a user: aku tags: trunk-stage
05:00
Fixed miscounting of multi-byte characters in rtC. Reworked `inbound_step()`. Changed to test a character for correctness on the first byte, then arrange to (not) step the character location on the trailer bytes following, if any. Always steps the character location on the first byte. Updates the byte/char index the same time. Further reworked and fixed the interface from `gate` to `inbound` for rewinding after a rejection (straight end, or when the matched lexeme is actually shorter than the number of bytes consumed before stopping). The used API (`moveby`) was character based, which caused us to rewind to far, namely to the previous character. No trouble when it was a single-byte character. Bad for a multi-byte however. This could then trip the lexer if the first byte of the previous character is not acceptable at the given point. check-in: 44fee72091 user: aku tags: trunk-stage
2018-09-17
23:43
Added test demonstrating that rtC miscounts multi-byte character locations (because counting at end). Added tools to help with generation of test input check-in: 9337c00616 user: aku tags: trunk-stage
23:41
Tweaked test parser gen to leave a log file behind on grammar parse failure check-in: 1694246f20 user: aku tags: trunk-stage
2018-09-15
04:46
Trim trailing whitespace check-in: e64b244e12 user: aku tags: trunk-stage
2018-09-14
22:25 New ticket [2062bdb5d5] marpa::unicode - change confusing command names. artifact: 9620d80947 user: aku
2018-09-10
23:05
Added runtime tests. Note: These look to need some of the fixes on trunk-stage. Leaf check-in: 8b8a1cedf6 user: andreask tags: non-utf-bytes
22:23
Started implementation of non-utf byte support. check-in: 2d87d5c92b user: andreask tags: non-utf-bytes
2018-09-09
06:04 New ticket [dabc3ce88c] tests - add case with ltm-mode symbols => always-on, different from discards. artifact: b430384f95 user: aku
06:03 New ticket [2b73c9fe19] tests - add case without any discard/ltm symbols => no always-on symbols. artifact: fd620a60f3 user: aku
06:00
Fixed mindt|doctools crashes. Two for asserts. Problem with `mindt` was in the new `gather_events` function. It was not fully adapted to the changed data structures, with the split trigger and event arrays. It saved the loop index as event id, which was correct for the old structures. With the new structures OTOH the event id is a field in the array we iterate over instead. Problem with `doctools` was as above, plus also an unknown mismanagement of the `always` array by the shared rtC generator code for LTM-mode lexemes, i.e LATM=false. It triggered a similar assertion on lexer setup after the fix above was applied. `mindt` avoided that issue because it did not use LTM-mode lexemes for its special forms. Reactivated the disabled tests. Passing now. Note: json still disabled. check-in: cd54178989 user: aku tags: trunk-stage
00:02
Integrated doctools example - tests - remeta Regenerated doctools example parser to match runtime changes. Disabled tests with known problems - json (char mislocation) - mindt (crash! (rtc, mis-capacity for some symset)) - doctools (crash! (rtc, mis-capacity for some symset)) check-in: cba29d80fc user: aku tags: trunk-stage
2018-09-08
22:16
Integrate base event work. Stage before true merge. check-in: ecf881268e user: aku tags: trunk-stage
22:15
Integrate base doctools example. Closed-Leaf check-in: 77d4610d6a user: aku tags: parse-events
22:11
Brought trunk and event work. Closed-Leaf check-in: d912ded2f3 user: aku tags: language-doctools
22:07
Brought trunk work check-in: 6ceda1b56e user: aku tags: parse-events
21:50 Ticket [fca2fa991a] example doctools - testsuite - extend/fill status still Open with 4 other changes artifact: 3236e0ef97 user: aku ... 1 similar event omitted.
21:43 Closed ticket [d9b47bbb78]: grammar events - wrongly treating single event linked to multiple lexemes as separate/different plus 4 other changes artifact: 9e83543024 user: aku
21:38
Tkt [d9b47bbb78] completed check-in: f97a8147f6 user: aku tags: parse-events
09:04
Bring in the extended test suite which runs the example tests too. check-in: a48220cd05 user: aku tags: trunk
09:04 Edit [26a81da80592b041|26a81da805]: Edit check-in comment. artifact: 385baccc8e user: aku
04:23
More integration of the language examples into the main - Run example tests with the main - Regenerate example parsers with the main parsers Updated a few tests. Note: json tests have issues. Parse location differences. Investigate. Tracked the location differences to commit [dd2dfa9d07530d8d] where definition of lexeme start switched from byte-based LEX_START to character-based LEX_START_C. This commit is on branch [parse-events-rtc]. I suspect that the stepping of character locations is incorrect. Looking at the `step()` function I see the character increment done for the last byte of the character. This is ok for the singletons. For multi-byte characters OTOH it looks to be too late. We should step at the first byte of a character. Complicating things, partial characters, i.e. missing trailers, unexpected trailers. json is good to find these issues, its test suite contains many of these cases. Fix will be done on new branch. This commit is not responsible, can be merged. Closed-Leaf check-in: 26a81da805 user: aku tags: example-integration
02:44 Edit [7dbbfd79f5845a55|7dbbfd79f5]: Edit check-in comment. artifact: 28eaad60a4 user: aku
02:43 Edit [7dbbfd79f5845a55|7dbbfd79f5]: Move to branch mistake. Mark "Closed". artifact: d2cc5f7a84 user: aku
2018-09-07
23:12
Integrated the language example tests into the main. Added the language example parsers to the `remeta` tool to ensure that they are updated after runtime API changes too, not just the system parsers. Dropped the replicated support files, redirected test suites to the main support as the only support. Note: The json example has issues, major testsuite fail. Bisect where this started and fix. - Looks to be lexeme location information differences between rtC and rtTcl. - Might be fixed in the parse-event branch. Leaf check-in: 67d5a8317b user: andreask tags: mistake, example-test-integration
19:05
Fixed handling of `args` parameter in wrong#args error messages. The text is dependent on core version. -- There is more going on -- Critcl differences, Core differences -- Try later again -- Closed-Leaf check-in: 7dbbfd79f5 user: andreask tags: mistake
04:42
The code generating symbol names for literals was still subject on the exact content of the [:control:] charclass, causing differences in output depending on the version of Tcl used (seen between 8.5.18 and 8.5.19). Now ensured version-independent quoting in all the relevant places. Fixed order of conditions too. Cross-referenced these places. Regenerated the internal parsers (slif, literals). Updated tests. check-in: e71840b49a user: aku tags: trunk
2018-09-06
19:29
Fix missed bogus `static const` in test results. Closed-Leaf check-in: 3b692749d7 user: andreask tags: tkt-d9b47bbb78-event-management
16:32
Ticket [d9b47bbb78]. Fix event management in the generators. C runtime and generator updated for the new data structures. Tests updated. check-in: e2021e3ef5 user: aku tags: tkt-d9b47bbb78-event-management
2018-09-05
21:42 Ticket [b10e687636] Create sample parser for SQL ISO standard status still Open with 5 other changes artifact: 4e230548bb user: aku
19:58 Add attachment sql20nn.zip to ticket [b10e687636] artifact: 81d703eb38 user: aku
19:57 New ticket [b10e687636] Create sample parser for SQL ISO standard. artifact: f7f14297c7 user: aku
19:13 Ticket [7a49902291] implement g1 events (predicted, nulled, completed) status still Open with 4 other changes artifact: afed68dfa1 user: aku
19:13 Ticket [52e1f740dc] factor include processing to general base class status still Open with 4 other changes artifact: 0712befe2e user: aku
19:13 Ticket [c74311e30c] match - implement exhaustion events status still Open with 4 other changes artifact: e0fc8d2790 user: aku
19:12 Ticket [54d2d56c67] grammar check - nested quantified rules status still Open with 3 other changes artifact: bf44c8b51a user: aku
19:12 Ticket [416063bf4e] debugging - collect ambiguity statistics status still Open with 3 other changes artifact: 92158eba9f user: aku
2018-09-04
19:53
Ticket [d9b47bbb78]. Fix event management in the generators. Tcl runtime and generator updated for the new data structures. Tests updated. C runtime tests broken. Next: C runtime and generator. check-in: 69f8e6628c user: aku tags: tkt-d9b47bbb78-event-management
2018-08-31
23:12
Ticket [d9b47bbb78]. Fix event management in the generators. Extended to fix the event data structures in general. - Modified container, grammar base, grammar classes - Event information split into declaration with state (events), and usage information (triggers). Events are managed in the main container class. Triggers are managed in the grammar base class. Code is common to L0 and G1. API used by the semantics is unchanged. Serialization structure changes. Event section is global. Trigger sections under L0, G1. Used a purpose-written tool to rewrite the old serializations in tests results (gcstate, gcr_*) to the new form. Reworked the SLIF generator to use the new form of serialization. Tests pass, no results changed. Fixed testsuite oops (generatec_gc(c|tcl)) not seen in trunk because everything with gc also had gc_c, etc. GC generators are ok as well. Extended testsuite to cover grammars with events. check-in: 5b0bdf9591 user: andreask tags: tkt-d9b47bbb78-event-management
20:00 Edit [4cd32b9b44cf3809|4cd32b9b44]: Add propagating "closed". artifact: f2814b45a1 user: aku