Comments (7)
proycon
commented on May 28, 2024
The problem is frogging note/t and head/t I assume? If there's a node//s/t or head//s/t it should already work I reckon? I don't see what would change in FoLiA itself in any case though. Examining anything other than sentences is indeed a bit strange considering the whole thing is trained on sentences, but I guess allowing users to explicitly mention tags that could be treated as sentences (e.g. note/head) is a good idea.
from frog.
kosloot
commented on May 28, 2024
Well: Annotations may not directly be added to <head> nor <note>, so that IS a problem for FoLiA at the moment.
from frog.
proycon
commented on May 28, 2024
Not? That would be strange indeed. But it should work already I think: https://github.com/proycon/folia/blob/master/schemas/folia.yml#L336 (and more inherited from AbstractStructureElement)
Edit: No token annotation under head/note makes sense, only makes sense for w.
from frog.
martinreynaert
commented on May 28, 2024
Not sure at all this is at all possible...
But should the user not be able to declare text in elements such as 'head' or 'note' as text, so that the tools recognize this as such and annotate accordingly?
This would allow the user to declare 'head' but not 'note' (or indeed vice versa should need be) as text and have it annotated.
My 2 cents, for now.
M.
from frog.
proycon
commented on May 28, 2024
I think the conclusion is that this is not a Frog issue, but an ucto issue; Frog is right just to look at s. It's the task of ucto to provide s (sentence detection) and w (tokenisation) on any FoLiA structure element that can hold them (e.g. has them as ACCEPTED_DATA) and that does not already have deeper structure elements with text layers (t).
from frog.
kosloot
commented on May 28, 2024
added as LanguageMachines/ucto#23
from frog.
kosloot
commented on May 28, 2024
Ok, and ucto does what needs to be done, but assumes that the text content is correct.
This is a.o. dependent on proycon/folia#24
to summarize:
The textcontent of a Structure Element is a composition of the textcontents of the underlying elements (if present)
It is not the task of Frog or Ucto to enforce this.
from frog.
Related Issues (20)
- Frog Chunker creates invalid FoLiA HOT 2
- released frog (0.29) depends on unreleased libfolia (2.15) HOT 2
- Building on Ubuntu 22.04 LTS Pop!_OS HOT 1
- Token annotation error for XML output with non-standard rules HOT 3
- segmentation fault when invoked with a missing [[tokenizer]] section in the configuration HOT 5
- Server mode creates only 1 paragraph HOT 2
- Add JSON output as an alternative to 'tabbed' format HOT 3
- Frog breaks while processing large amount of txt data HOT 11
- Keep the deep_morph structure intact when resolving MWU's HOT 1
- Simplify option and configuration handling
- MWU output when no Parser is selected HOT 7
- Update debian package for v0.20
- Python Frog HOT 2
- Frog (through python-frog) accumulates a huge number of temporary files HOT 11
- Praktische vragen rondom grote datasets HOT 7
- Bug: frog server; frog-:connection lost unexpected : write to client failed HOT 2
- Segfault on FoLiA in to FoLiA out (speech data with events and utterances) HOT 7
- New release? HOT 3
- frog lemmatizer with --deep-morph misses a morpheme in FoLiA output
- [Docker] Initialization fails for nld-vnn and dum HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from frog.