Comments (12)
We can also use the @rule attributes to identify possible discrepancies with the morphology.
from macula-hebrew.
Note that the categories used in the Westminster Hebrew Syntax are divided up differently than the Westminster Hebrew Morph. If you look at A Reference Guide to the Westminster Hebrew Morphology Database Document Release 4.20 (which is the version the Westminster Hebrew Syntax was built upon), there are only six categories: particle, pronoun, noun, adjective or numeral, verb, and suffixes. Definite article, object marker, conjunction, adverb, interjection, preposition, and relative particles belong within the category of particle. In the trees, these types have been separated out. Likewise, numerals have been separated out from adjectives. These differences account for the trees having 14 Cat vs. 6 categories in the Westminster morph originally.
Here's a list of the 14 Cat in the trees & how they correspond to the OSHB morph categories:
adj (maps directly to OSHB adj)
adv (maps directly to OSHB adv)
om (maps to OSHB ptcl & particle type direct object marker)
cj (maps directly to OSHB conj)
art (maps to OSHB ptcl & particle type definite article)
ij (maps to OSHB ptcl & particle type interjection)
rel (maps to OSHB ptcl & particle type relative)
noun (maps directly to OSHB noun)
ptcl (maps directly to OSHB ptcl)
prep (maps directly to OSHB prep)
pron (maps directly to OSHB pron)
verb (maps directly to OSHB verb)
num (maps to OSHB adj & 2 adjectives types of Cardinal & Ordinal numbers)
x (maps directly to OSHB sfx)
Be sure to look at my comments in https://github.com/Clear-Bible/macula-hebrew/tree/main/doc about the kind of systematic & frequent inconsistencies & mismatches I initially expect to see.
from macula-hebrew.
Just checking, these are the mismatches/inconsistencies you are looking for?
Or are we also looking at other attributes/features?
from macula-hebrew.
See here for a more insightful (but less readable) table. The index column consists of the OSHB "pos" and "type" attributed, joined by "_". It seems that there are a lot of exceptions and mismatches. Only "x" and "suffix" match perfectly.
Would it help if I:
- created a list of word ids for each combination of OSHB & Trees?
- find a way to categorize them further (using "rule", perhaps?)
from macula-hebrew.
from macula-hebrew.
from macula-hebrew.
Both of these are useful. Thank you, @klosoter. I agree with Jonathan's comments above. The volume of mismatches is higher than I'd like, but most of them don't surprise me at first glance. We'll want to curate these efficiently.
from macula-hebrew.
I categorized them further using the "Rule" attribute of the first parent node. Now, the differences are neatly categorized. Most combinations of "pos_rule_type" match exactly ONE "Cat". At first glance, the differences seem more logical now. See attached.
from macula-hebrew.
I've also put all mismatches in an XML file. They are structured like this:
Cat --> oshb pos --> oshb type --> Tree Node --> oshb m element (or c in case of compounds)
<mismatches>
<adj>
<pronoun>
<demonstrative>
<Node n="370010020072" Cat="adj" morphId="370010020072" Unicode="זֶּה֙" nodeId="3700100200720010" Rule="Adj2Adjp">
<m n="370010020072" morph="Pdxms" lang="H" lemma="2088" after=" " pos="pronoun" type="demonstrative" person="unknown: x" gender="masculine" number="singular">זֶּה֙</m>
</Node>
<Node>
<c>
<m/>
<m/>
</c>
</Node>
</demonstrative>
</pronoun>
</adj>
<adv>
<particle>
<negative/>
</particle>
</adv>
</mismatches>
Does something like this help drill down to instances? The XML file is too large to attach here, but you get the idea.
from macula-hebrew.
The other features, such as number, gender, and person, are not present in the current trees. They are in the trees-groves-full under /trees-oshb but I can't seem to figure out an easy way to map these two trees to each other. The morphId
's and the nodeId
's are different.
Is there an easy way to map the full attributes to the OSHB attributes that I overlooked?
from macula-hebrew.
The morphId's and the nodeId's are different.
Is there an easy way to map the full attributes to the OSHB attributes that I overlooked?
I think we need the mapping between Groves morphIds and our own added to the mapping file to do this comparison.
from macula-hebrew.
I've created new mappings, which can be found in trees-oshb/py/mappings
. Please see that same folder for documentation of the mismatches in part of speech between the trees and OSHB along with an explaining note. (this might need to be moved to a different directory/repo).
The new mappings can now be used to compare the grammatical categories between the Full Trees and OSHB.
from macula-hebrew.
Related Issues (20)
- Add lemmas to Hebrew nodes trees HOT 4
- There are missing `m/@xml:id`s in our current lowfat trees HOT 1
- Marble Domains (`Domain`, `ContextualDomain`, `CoreDomain`) HOT 6
- 5. Repopulate Hebrew lowfat with the latest updates:
- transcription and gloss attributes from SIL are still missing, at least from Genesis 1.
- Problems in `morpheme-mappings.xml` HOT 1
- Word Sense (from macula-greek) HOT 1
- Greek beta-to-unicode in Genesis 1:1 HOT 1
- Incorrect closing </w> tag
- Implicit article stealing attributes from following sibling
- Split node at GEN 50:10!4
- Replace `c` node with merged `m` in PSA 102:4
- After in Gen 1:12 HOT 2
- Incorrect mapping to lowfat HOT 1
- _ki_ missing in Lev 5:21. HOT 2
- Low-fat word parts missing HOT 5
- Lowfat 'c' fields have no glosses HOT 1
- include Ketiv into Macula-Hebrew ? HOT 2
- Misnumbered nodes in 1 Chronicles 20 HOT 1
- Macula Contextual Domains
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from macula-hebrew.