Language Technology at UiT

The Divvun and Giellatekno teams build language technology aimed at minority and indigenous languages

View GiellaLT on GitHub divvungiellatekno/giellalt.uit.no

Meeting setup

Agenda

  1. Opening, agenda review
  2. Reviewing the task list from last week
  3. Documentation - divvun.no
  4. Corpus gathering
  5. Corpus infrastructure
  6. Infrastructure
  7. Linguistics
  8. name lexicon infrastructure
  9. Spellers
  10. Other issues
  11. Summary, task lists
  12. Closing

1. Opening, agenda review, participants

Opened at 09:44.

Present: Børre, Ilona, Risten, Sjur, Thomas, Tomi, Trond

Absent: Per-Eric

Agenda accepted as is.

2. Updated task status since last meeting

Børre

Ilona

Maaren

Per-Eric

Risten

Saara

Sjur

Thomas

Tomi

Trond

3. Documentation

Nothing new.

TODO:

4. Corpus infrastructure

Nothing.

5. Infrastructure

[http://giellatekno.uit.no] and [http://www.divvun.no] are now hosted on the G5. Bugzilla is not yet up and running again.

ssh www.divvun.no = G5
ssh giellatekno.uit.no = G5
ssh 129.242.220.111 = xserve

Jabber support = iChat server:

Addresses of the format:

sjur@divvun.no
trond@giellatekno.uit.no

TODO:

6. Linguistics

North Sámi

We solved(?) the hypheantion problem, but got instead a circularity problem. Meeting 12:30 Norw. time Tuesday to fix the circularity problem after the hyphenation fix.

TODO:

Lule Sámi

Name conversion improvements last week.

TODO:

7. Name lexicon infrastructure

This sub-project needs to get up and running soon. Mainly Sjur’s task.

Decisions made in Tromsø can be found in [this meeting memo.|/admin/physical_meetings/tromso-2006-08-propnoun.html]

TODO:

  1. set up Tomcat and risten.no on the G5 again (Sjur, Børre)
    1. install risten.no
  2. fix bugs in lexc2xml; add comments to the log element (Saara)
  3. finish first version of the editing (Sjur)
  4. test editing of the xml files. If ok, then: (Sjur, Thomas, Trond)
  5. make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (Sjur, Saara)
  6. convert propernoun-($lang)-lex.txt to a derived file from common xml files (Sjur, Tomi, Saara)
  7. implement data synchronisation between risten.no and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way)
  8. start to use the xml file as source file
  9. clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (Thomas, Maaren, linguists)
  10. merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (linguists)
  11. publish the name lexicon on risten.no (Sjur)
  12. add missing parallel names for placenames (linguists)
  13. add informative links between first names like Niillas and Nils (linguists)

8. Proofing tools

Hunspell

TODO:

  1. Follow-up support for the sami languages in OpenOffice.org (Børre, Sjur)
    1. there is still hope to get them included in OOo 2.4
  2. Hunspell lexicon conversion (Tomi, Børre)
    1. nothing major happened last week, working on getting the basic conversion correctly (ie complete and correct inflection), then adding derivation
  3. add hunspell testing to the make file (Sjur)
    1. done

Testing

Spelling Error Markup

TODO:

Automated testing

Paradigm testing implemented, but the reporting needs improvements. Testing manually:

cd gt/sme/testing
gen-paradigms.sh

Output in paradigm-sme.txt.

Test words should go in the file parawlist.txt. The format is like this:

WORD<TAB>POS
áigi	n
ráhkistit	v

We need to separate proper nouns from regular nouns properly, by checking the files prop-codes.txt and n-codes.txt, as well as making sure the Makefile has support for proper noun paradigm generation.

TODO:

MS Office

We need to check that the proofing tools are working in all Office applications, not only Word. This is especially important on Windows, which includes quite a few applications in the bundle.

TODO:

Lexicon conversion to the PLX format

Open issues based on test results:

smj

482 - still problematic, 552 - still open, Svierigadárogielan - still rejected

sme

397 - not as good as it should be, 408 - fixed, 419, 425 - roman number, 431, 452 - miel is a prefix, 461 - ovda accepted, almost 50 % (17) gets correct suggestion, 489, 508 - fixed, 522, 524.

TODO:

InDesign tools

TODO:

Hyphenators

We should look into the possibility of generating pattern-based hyphenation for OOo. It shouldn’t be too hard, or require too much work, but needs investigation.

TODO:

Release version

We need to print the CD cover pretty soon, and for that we need to finish the CD cover, especially the back side text. The cover proof print should be ready in 14 days, ie Nov. 26.

TODO:

Actual release

December 11-13, one of these days.

9. Other

Corpus contracts

Delayed till after final release.

TODO:

Faroese

Speller for fao using our infrastructure and the knowledge we have.

TODO:

Bug fixing

When fixing bugs, record the version number containing the fix in the Bugzilla bug report, such that for each bug, we know exactly when it should have been fixed, in what file(s) and what version.

69 open Divvun/Disamb bugs (35 of these 56 are speller-related bugs, 34 are other bugs), and 23 risten.no bugs

Dictionaries

We have now 7 dictionaries in xml format that could be published in a risten.no-like framework. Trond would like to have them online, both for the feedback and usefulness to the public.

It requires that eXist/XQuery + homepage, and conversion to a proper presentation format is in place.

TODO:

Parallel corpora

There will be a parallel corpus seminar this weekend. It would have been nice to have parallel text for that:

TODO:

SD yearly personell seminar

6.-7. December. Sjur will discuss it with Julia, but our view is that we don’t have time to go this year. The release are just a few days later.

Software updates

10. Next meeting, closing

The next meeting is 19.11.2007, 09:30 Norwegian time.

Trond will be away in the next meeting.

The meeting was closed at 11:13.

Appendix - task lists for the next week

Boerre

Ilona

Maaren

Per-Eric

Risten

Saara

Sjur

Thomas

Tomi

Trond