Language Technology at UiT

The Divvun and Giellatekno teams build language technology aimed at minority and indigenous languages

View GiellaLT on GitHub divvungiellatekno/giellalt.uit.no

Meeting setup

Agenda

  1. Opening, agenda review
  2. Reviewing the task list from last week
  3. Documentation - divvun.no
  4. Corpus gathering
  5. Corpus infrastructure
  6. Infrastructure
  7. Linguistics
  8. name lexicon infrastructure
  9. Spellers
  10. Other issues
  11. Summary, task lists
  12. Closing

1. Opening, agenda review, participants

Opened at 09:47.

Present: Børre, Per-Eric,Sjur, Thomas, Tomi

Absent: Risten, Trond

Agenda accepted as is.

2. Updated task status since last meeting

Børre

Ilona

Maaren

Per-Eric

Risten

Saara

Sjur

Thomas

Tomi

Trond

3. Documentation

The new Bugzilla is good:)

TODO:

4. Corpus gathering

Sjur discussed error markup nesting with Saara, she will add nesting possiblities to the xml conversion tool.

TODO:

5. Corpus infrastructure

Nothing.

6. Infrastructure

Speller testing is now fixed, and won’t change.

7. Linguistics

North Sámi

No real issues at the moment.

Lule Sámi

Tomi has fixed the smj oslolaš isssue.

We still have some missing baseforms asides names. These should be checked.

TODO:

8. Name lexicon infrastructure

This sub-project needs to get up and running soon. Mainly Sjur’s task.

Decisions made in Tromsø can be found in [this meeting memo.|/admin/physical_meetings/tromso-2006-08-propnoun.html]

TODO:

  1. set up Tomcat and risten.no on the G5 again (Sjur, Børre)
  2. fix bugs in lexc2xml; add comments to the log element (Saara)
  3. finish first version of the editing (Sjur)
  4. test editing of the xml files. If ok, then: (Sjur, Thomas, Trond)
  5. make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (Sjur, Saara)
  6. convert propernoun-($lang)-lex.txt to a derived file from common xml files (Sjur, Tomi, Saara)
  7. implement data synchronisation between risten.no and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way)
  8. start to use the xml file as source file
  9. clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (Thomas, Maaren, linguists)
  10. merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (linguists)
  11. publish the name lexicon on risten.no (Sjur)
  12. add missing parallel names for placenames (linguists)
  13. add informative links between first names like Niillas and Nils (linguists)

9. Proofing tools

Hunspell

Sami languages are not supported in OpenOffice.org, until that is fixed we will have to do the same tricks we apply in Microsoft Office 2004 for Mac.

Børre has a UTF-8 issue with reading LexC files in the java code.

TODO:

  1. Begin adding support for the sami languages in OpenOffice.org (Børre)
  2. Hunspell lexicon conversion (Tomi, Børre)
    1. fix Unicode bug in Hunspell conversion java code (Tomi, Børre)
    2. add closed POSes by adding a new output format to the present PLX conversion code (Tomi, Børre)
    3. add build and compilation instructions (Børre)
    4. release an internal alpha for testing (Børre)
    5. add hunspell testing to the make file (Sjur)
    6. debug and fix remaining conversion issues (Børre, Tomi)

Testing

Spelling Error Markup

TODO:

Automated testing

The infrastructure is now fixed for speller testing, hyphenation testing still coming.

TODO:

Lexicon conversion to the PLX format

Open issues based on test results: smj - 489, 506, vissa, 536; sme - 380, 397, 408, 419, 425, 426, 431, 449, 452, 461, 489, 522, 524, 525, 529, 535, 536, 542.

TODO:

InDesign tools

The beta was sent to Min Áigi and Davvi Girji.

We now need to expand testing for InDesign. The first task is to install it on more computers.

TODO:

Hyphenators

There are some hyphenation errors we need to debug.

We should look into the possibility of generating pattern-based hyphenation for OOo. It shouldn’t be too hard, or require too much work, but needs investigation.

To check for bad hyphenation: open a document in word, set the correct language, turn automatic hyphenation on, and change the layout to 4 columns. Then read through the document to check for bad hyphenation.

TODO:

Beta release

TODO:

Release version

The CD cover etc. will be worked on by John-Marcus Kuhmunen, and will follow the SD design rules. He is now waiting for the text to be put on the CD cover and other places.

TODO:

10. Other

Corpus contracts

Delayed till after final release.

TODO:

Bug fixing

When fixing bugs, record the version number containing the fix in the Bugzilla bug report, such that for each bug, we know exactly when it should have been fixed, in what file(s) and what version.

56 open Divvun/Disamb bugs (23 of these 56 are speller-related bugs, 33 are other bugs), and 23 risten.no bugs

11. Next meeting, closing

The next meeting is 22.10.2007, 09:30 Norwegian time.

The meeting was closed at 10:47.

Appendix - task lists for the next week

Boerre

Ilona

Maaren

Per-Eric

Risten

Saara

Sjur

Thomas

Tomi

Trond