Language Technology at UiT

The Divvun and Giellatekno teams build language technology aimed at minority and indigenous languages

View GiellaLT on GitHub divvungiellatekno/giellalt.uit.no

Meeting setup

Agenda

  1. Opening, agenda review
  2. Reviewing the task list from last week
  3. Documentation - divvun.no
  4. Corpus gathering
  5. Corpus infrastructure
  6. Infrastructure
  7. Linguistics
  8. name lexicon infrastructure
  9. Spellers
  10. Other issues
  11. Summary, task lists
  12. Closing

1. Opening, agenda review, participants

Opened at 09:39.

Present: Børre, Ilona, Per-Eric, Risten, Sjur, Thomas, Tomi, Trond

Absent: none

Agenda accepted as is.

2. Updated task status since last meeting

Børre

Ilona

Maaren

Per-Eric

Risten

Saara

Sjur

Thomas

Tomi

Trond

3. Documentation

Bugzilla 3.0.x has some nice features we would like to use, like shared, filtered queries.

TODO:

4. Corpus gathering

Trond had a look at the sma bible texts. We will postpone adding them till after Christmas, when we hopefully will have a dedicated sma project.

Børre has received lots of texts from Torkel Rasmussen, they will be added this week.

TODO:

5. Corpus infrastructure

Nothing.

6. Infrastructure

Speller testing is still fluctuating a bit.

7. Linguistics

North Sámi

Čorru > čorut
*Oslolaš with hyphen required, is printed now, but shouldn't
oslolaš - is done correctly now

This one is fixed by the latest changes in the PLX conversion.

TODO:

Lule Sámi

We have the same oslolaš derivation in smj too, but with another derivation.

Tjårro > tjårok
*Oslolaš with hyphen required, is printed now, but shouldn't
oslolaš - is done correctly now

Correct compounds are still not recognised:

Stuorafuoskok => input, should be accepted
(218) Stuorauvsuk
(217) Stuorraluohkák

fuoskok fuoskok Fuossko+N+Prop+Plc+Sg+Gen+Der1+Der/k+N+Sg+Nom

StuorFuoskok	Stuorafuoskok	2
(220) Stuorruskak
(220) Stuoruduskak
(219) SUFUR-Fuoskok

Fuoskok is in the PLX lexicon, but does not take part in this type of compounding. It should actually have been fuoskok.

Fuoskok Fuossko+N+Prop+Plc+Pl+Nom+Clt+ge Fuoskok Fuossko+N+Prop+Plc+Sg+Gen+Clt+ge

smj propernoun bug issue: procedure

  1. convert from common base (which means sme base)
    1. Words not convertable should be added to separate smj lexicon, and words that should not be converted from sme sme should be moved to non-convert lexicon in sme???
  2. send to smj morphology

The original todo was to correct the smj morphology. Current test shows weaknesses in both camps:

Testing procedures:

Suggestion: Let us first analyse the proper noun base forms for Lule Sámi, and thereafter look at the morphology.

TODO:

8. Name lexicon infrastructure

This sub-project needs to get up and running soon. Mainly Sjur’s task.

Decisions made in Tromsø can be found in [this meeting memo.|/admin/physical_meetings/tromso-2006-08-propnoun.html]

TODO:

  1. fix bugs in lexc2xml; add comments to the log element (Saara)
  2. finish first version of the editing (Sjur)
  3. test editing of the xml files. If ok, then: (Sjur, Thomas, Trond)
  4. make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (Sjur, Saara)
  5. convert propernoun-($lang)-lex.txt to a derived file from common xml files (Sjur, Tomi, Saara)
  6. implement data synchronisation between risten.no and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way)
  7. start to use the xml file as source file
  8. clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (Thomas, Maaren, linguists)
  9. merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (linguists)
  10. publish the name lexicon on risten.no (Sjur)
  11. add missing parallel names for placenames (linguists)
  12. add informative links between first names like Niillas and Nils (linguists)

9. Proofing tools

Hunspell

Sami languages are not supported in OpenOffice.org, until that is fixed we will have to do the same tricks we apply in Microsoft Office 2004 for Mac.

TODO:

Testing

Spelling Error Markup

TODO:

Automated testing

The infrastructure is about to settle.

TODO:

Lexicon conversion to the PLX format

TODO:

InDesign tools

We have received the first hyphenation beta for InDesign. It has been tested, and seems to work fine.

We should give the beta to Min Áigi and Davvi Girji.

TODO:

Hyphenators

There are some hyphenation errors we need to debug.

TODO:

New public beta

TODO:

Release version

The CD cover etc. will be worked on by John-Marcus Kuhmunen, and will follow the SD design rules. He is now waiting for the text to be put on the CD cover and other places.

TODO:

10. Other

Corpus contracts

Delayed till after final release.

TODO:

Bug fixing

When fixing bugs, record the version number containing the fix in the Bugzilla bug report, such that for each bug, we know exactly when it should have been fixed, in what file(s) and what version.

59 open Divvun/Disamb bugs (26 of these 56 are speller-related bugs, 33 are other bugs), and 23 risten.no bugs

11. Next meeting, closing

The next meeting is 15.10.2007, 09:30 Norwegian time.

Trond will be away.

The meeting was closed at 10:43.

Appendix - task lists for the next week

Boerre

Ilona

Maaren

Per-Eric

Risten

Saara

Sjur

Thomas

Tomi

Trond