krzysiekfonal/grammaregex

Regex like pattern tree matching but on sentence's tree instead of Strings

grammaregex's Issues

Describe what is a valid pattern

A detailed description of what forms a valid pattern will help the user.

Error on print statement : Is this library created using Python 3?

Traceback (most recent call last):
from textpipeliner import PipelineEngine, Context
File "/Library/Python/2.7/site-packages/textpipeliner/init.py", line 3, in
from .pipes import *
File "/Library/Python/2.7/site-packages/textpipeliner/pipes/init.py", line 1, in
from .pipe import Pipe,
File "/Library/Python/2.7/site-packages/textpipeliner/pipes/pipe.py", line 2, in
from grammaregex import find_tokens, match_tree
File "/Library/Python/2.7/site-packages/grammaregex/init.py", line 1, in
from .grammaregex import match_tree, find_tokens, print_tree, verify_pattern, PatternSyntaxException
File "/Library/Python/2.7/site-packages/grammaregex/grammaregex.py", line 70
print("{", end=" ")

Stars in sets of options are considered a valid pattern

Example:

grammaregex.verify_pattern("[VERB,**]/")
True
grammaregex.verify_pattern("[VERB,]/*")
True

This happens because the full verify_pattern function is called on each list element, meaning each list element gets matched against a regex for which "*" and "**" are acceptable strings.

Retrieve tokens on the path to a matching

It's often interesting to know not only the leaf token as selected by a pattern, but also some of the intermediate steps. Python's re package even provides functionality-- named groups-- to identify particular parts of a matching that may be interesting separately.

An example of how this might look like for grammaregex would be:

example sentence: "Mrs. Robinson graduated from the Wharton School of the University of Pennsylvania in 1980."
pattern: ?PVBD/prep/?PIN/pobj/?P*
matchings: [{"root": "graduated", "prep": "from", "where": "School"}, {"root": "graduated", "prep": "in", "where": "1980"}]

An example implementation of such behavior (with backwards compatibility: if no ?P<> appears in the pattern to match, just return tokens as before) can be found at this branch.