giellalt/lang-smn

Finite state and Constraint Grammar based analysers and proofing tools, and language resources for the Inari Sami language

The Inari Sami morphology and tools

Download nightly / CI/CD installation packages for testing (contains the core zhfst file(s)):

NB!! Note that the nightly / CI/CD installation packages are not tested for language quality, and might contain regressions and errors.

This repository contains finite state source files for the Inari Sami language, for building morphological analysers, proofing tools and dictionaries. The data and implementation are licenced under LICENSE licence, also detailed in the LICENSE. The authors named in the AUTHORS file are available to grant other licencing choices.

Install proofing tools and keyboards for the Inari Sami language by using the Divvun Installer (some languages are only available via the nightly channel).

Download and test speller files

The speller files downloadable at the top of this page (the *.bhfst files) can be used with divvunspell, to test their performance. These files are the exact same ones as installed on users' computers and mobile phones. Desktop and mobile speller files differ from each other in the error model and should be tested separately — thus also two different downloads.

Documentation

Documentation can be found at:

• Language specific documentation
• General documentation

Core dependencies

In order to compile and use Inari Sami language morphology and dictionaries, you need:

• an FST compiler: HFST, Foma or Xerox Xfst
• VislCG3 Constraint Grammar tools

To install VislCG3 and HFST, just copy/paste this into your Terminal on macOS:

curl https://apertium.projectjj.com/osx/install-nightly.sh | sudo bash

or terminal on Ubuntu, Debian or Windows Subsystem for Linux:

wget https://apertium.projectjj.com/apt/install-nightly.sh -O - | sudo bash
sudo apt-get install cg3 hfst

or terminal on RedHat, Fedora, CentOS or Windows Subsystem for Linux:

wget https://apertium.projectjj.com/rpm/install-nightly.sh -O - | sudo bash
sudo dnf install cg3 hfst

Alternatively, the Apertium wiki has good instructions on how to install the dependencies for Mac OS X and how to install the dependencies on linux

Further details and dependencies are described on the GiellaLT Getting Started pages.

Downloading

Using Git:

git clone https://github.com/giellalt/lang-smn

Using Subversion:

svn checkout https://github.com/giellalt/lang-smn.git/trunk lang-smn

Building and installation

INSTALL describes the GNU build system in detail, but for most users it is the usual:

./autogen.sh # This will automatically clone or check out other GiellaLT dependencies
./configure
make
(as root) make install

Citing

If you use language data from more than one GiellaLT language, consider citing our LREC 2022 article on whole infra:

Linda Wiechetek, Katri Hiovain-Asikainen, Inga Lill Sigga Mikkelsen, Sjur Moshagen, Flammie Pirinen, Trond Trosterud, and Børre Gaup. 2022. Unmasking the Myth of Effortless Big Data - Making an Open Source Multi-lingual Infrastructure and Building Language Resources from Scratch. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 1167–1177, Marseille, France. European Language Resources Association.

If you use bibtex, following is as it is on ACL anthology:

@inproceedings{wiechetek-etal-2022-unmasking,
    title = "Unmasking the Myth of Effortless Big Data - Making an Open Source
    Multi-lingual Infrastructure and Building Language Resources from Scratch",
    author = "Wiechetek, Linda  and
      Hiovain-Asikainen, Katri  and
      Mikkelsen, Inga Lill Sigga  and
      Moshagen, Sjur  and
      Pirinen, Flammie  and
      Trosterud, Trond  and
      Gaup, B{\o}rre",
    booktitle = "Proceedings of the Thirteenth Language Resources and Evaluation
    Conference",
    month = jun,
    year = "2022",
    address = "Marseille, France",
    publisher = "European Language Resources Association",
    url = "https://aclanthology.org/2022.lrec-1.125",
    pages = "1167--1177"
}

lang-smn's Issues

Dynamic compounds not generated in grammarchecker

Overview: The grc uses generator-gramcheck-gt-norm.hfstol, which does not generate compounds. The ordinary generator handles compounds, but is not used in the grammarchecker. (this bug moved from #68 in github.com/divvun/gramcheck-web

correct fst, wrong result:
uit-mac-443:grammarcheckers ttr000$ e muotâ+N+Cmp/SgNom+Cmp#sääni+v1+N+Pl+Nom|hfst-lookup -q ../../src/generator-gramcheck-gt-norm.hfstol 
muotâ+N+Cmp/SgNom+Cmp#sääni+v1+N+Pl+Nom	muotâ+N+Cmp/SgNom+Cmp#sääni+v1+N+Pl+Nom+?	inf

wrong fst, correct result:
uit-mac-443:grammarcheckers ttr000$ e muotâ+N+Cmp/SgNom+Cmp#sääni+v1+N+Pl+Nom|hfst-lookup -q ../../src/generator-gt-norm.hfstol 
muotâ+N+Cmp/SgNom+Cmp#sääni+v1+N+Pl+Nom	muotâsäänih	0,000000

Clean '7 and ' (KN) from smn (

This issue was created automatically with bugzilla2github

Bugzilla Bug 2523

Date: 2018-11-05T08:50:18+01:00
From: Sjur Nørstebø Moshagen <<sjur.n.moshagen>>
To: Trond Trosterud <<trond.trosterud>>
CC: lene.antonsen, marja-liisa.olthuis, trond.trosterud

Blocker for: #2475
Last updated: 2019-03-13T22:37:30+01:00

Different behaviour for fst and grc speller components

The third word of this sentence contains a typo (š pro s):

Mun lijkkum enâmuštáá čokkeraađeest, tot lii hirmâd kukke, tot mana ubâ suotâstâllâmsaje pirrâ, mun lam ton vyeijee.

The fst speller handles the case:

uit-mac-443:grammarcheckers ttr000$ e enâmuštáá|hfst-ospell -S -n 6 ../spellcheckers/smn.zhfst 
"enâmuštáá" is NOT in the lexicon:
Corrections for "enâmuštáá":
enâmustáá    13.787073
etâmušttáá    27.646885
enâmistáá    28.646885

But the grc speller does not. Instead of any of the 3 suggestions from the speller, it gives a fourth on:

Test 4/8: Mun lijkkum enâmuštáá čokkeraađeest, tot lii hirmâd kukke, tot mana ubâ suotâstâllâmsaje pirrâ, mun lam ton vyeijee.
----------
tests/msyn-v-prfprc-sg1.yaml
[4/8][PASS tp] lijkkum:lijkkuum (, ()) => lijkkum:[lijkkuum] (msyn-v-prfprc-sg1)
tests/msyn-v-prfprc-sg1.yaml
[4/8][FAIL fp1] enâmuštáá:enâmustáá (, ()) => enâmuštáá:[lenâmuštán] (typo)

The form it suggests instead is a compound "county + good.memory":

uit-mac-443:grammarcheckers ttr000$ husmn
lenâmuštán
lenâmuštán	leenâ+N+Cmp/SgNom+Cmp#muštee+N+Sg+Acc+PxDu1	0,000000

uit-mac-443:grammarcheckers ttr000$ smnfin
leenâ
leenâ	lääni

muštee
muštee	hyvämuistinen

So: Was passiert hier, eigentlich?

Use/-Spell er obligatorisk, og skal ikke være det (

This issue was created automatically with bugzilla2github

Bugzilla Bug 2079

Date: 2015-09-08T11:05:20+02:00
From: Lene Antonsen <<lene.antonsen>>
To: Sjur Nørstebø Moshagen <<sjur.n.moshagen>>
CC: erika.sarivaara, marja-liisa.olthuis, trond.trosterud

Last updated: 2015-11-09T12:37:29+01:00

Add support for compounds written apart in the grammar checker

Cf this push in SMJ.

@lynnda-hill @marjaliisa I will look at it in the beginning of January.

Dynamisk sammensetning av substantiver av deriverte verb (

This issue was created automatically with bugzilla2github

Bugzilla Bug 2430

Date: 2017-09-28T15:14:02+02:00
From: Lene Antonsen <<lene.antonsen>>
To: Sjur Nørstebø Moshagen <<sjur.n.moshagen>>
CC: lene.antonsen, marja-liisa.olthuis, trond.trosterud

Last updated: 2017-09-28T15:56:29+02:00

Inarinsaamen substantiivitiedostossa on pari sataa verbiä (

This issue was created automatically with bugzilla2github

Bugzilla Bug 2005

Date: 2015-03-05T09:09:38+01:00
From: Petter Morottaja <<petter.morottaja>>
To: Petter Morottaja <<petter.morottaja>>
CC: marja-liisa.olthuis, miinaseurujarvi, trond.trosterud

Last updated: 2018-05-25T20:51:05+02:00

gut template apply does nothing

Expected outcome: updates to .gitignore.

Cf also giellalt/template-lang-und#4.