Meeting setup

• Date: 20.10.2008
• Time: 09.30 Norw. time
• Place: Internet
• Tools: SubEthaEdit, iChat

Agenda

Cf. one of the following, depending on context:

• the upper bar of the SEE window (provided you use the JSPWiki syntax mode)
• the TOC in Forrest-rendered output, like HTML and PDF

Opening, agenda review, participants

Opened at 10:34.

Present: Børre, Ciprian, Jovsset, Sjur, Thomas, Tomi

Absent: David, Trond

Agenda accepted, with one addition under “Other”.

Updated task status since last meeting

Børre

• fix the Upload more link on the corpus upload page
  • done
• Make a divvun-tools download log
  • not done
• Finish the OOo extension package of the hunspell dictionaries
  • working
• check the hunspell test bench and tokenization errors
  • not done
• further investigate installation of dictionaries in NeoOffice
  • not done
• setup iCal server on the XServe
  • not done
• make a 1-page, light version of the corpus contract, also in Swedish
  • not done
• work around crashing Hunspell bug in OOo 2.x/3.0 on Win/Mac
  • working
• e-mail about G5 repair status
  • not done
• infrastructure remake - news discussion
  • not done
• implement an easter egg (almost) identical to the Polderland one
  • not done
• fix bugs!

Ciprian

• close the open SVN repository at requested paths
  • not done
• make a test-all target that runs all tests we have (with Sjur and Trond)
  • on the way
• define and document testing routines (with Sjur and Trond)
  • not done
• continue the dictionary infrastructure discussion (with Sjur, Trond)
  • on the way
• improve processing of new corpus documents
  • on the way
• make the pipeline of StarDict dictionary generation running on the Mac
  • not done
• have a closer look at the formatting for StarDict
  • not done
• update the Makefile for generating dictionaries (related to the dictionary infrastructure task)
  • on the way
• look at the xml conversion script
  • not done
• take care of the error logging during conversion process
  • not done
• look at the xml conversion quality
  • not done
• check the bug with the text uploading via web interface (with Børre)
  • Børre did it… but yesterday an uplading bug reported by Trond and Per
• make a list of (general and special) problems related with converting docs into xml-forat and adding them to the corpora
  • not done
• continue the search and testing of an appropriate tool for lexicon working (no xml-file editing via text editors!)
  • not done
• generate new sme:nob/nob:sme dictionaries in all formats, marking them as “Beta”-versions (Sjur’s proposal to use an image background for that purpose)
  • on the way
• infrastructure remake - news discussion
  • not done
• short meeting to go through missing points before a dictionary release (with Sjur, Trond)
  • not done

David

• continue gathering sma corpus texts
• stay in contact withSáminuorat about writing about the project and advertising.
• gather orthographic decisions (with Jovsset)
• translate corpus contract to swedish (with Jovsset)
• make a 1-page, light version of the corpus contract, also in Swedish
• prepare a workshop on South Sámi orthography and grammar (David)
  • suggest dates
    • try to coordinate with the SGL so we meet together
  • set up a preliminary agenda (with Sjur)
  • prepare data for each topic (with Sjur and Trond)
• Assist Jovsset in the work with the leaflet.
• make an add for our tools to go into Sámi newspapers (with Jovsset)

Jovsset

• get the list of verbs from the auhtors ofVerbh.
  • Not done.
• Write and translate leaflet text, add pictures.
  • In progress.
• Find a suitable infrastructure for the distribution of the CD version. Possible through the library bus, the language centres and common sami centres in all of Sápmi.
• Talk to person who can talk to translator of Gåessie dah jeatjebh åerieminie
  • Not done
• make an add for our tools to go into Sámi newspapers (with David)
  • Not done.

Lene

• Work on test routine with Trond and Sjur

Linda

• add remaining verbs of type VI
  • did some

Per-Eric

• transfer the smj texts by Kurt Tore to our corpus repository
• follow-up contracts from Nord-Salten avis and Lena Davidsson
• Work with missing list same_dutkama_pgr.txt
• Plan a smj pr tour for our tools
• contact Ulf Stefan Winka for smj texts
• fix bugs!

Saara

• add new XSL/XML headers for proofing test docs
• Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
• implement the ped UI and functionality
• infrastructure remake - news discussion

Sjur

• name db/risten.no
  • todo
• update the Changes document
  • todo
• follow-up on some Polderland-related bugs: 621, 630, 652
  • todo
• InDesign documentation
  • todo
• make a test-all target that runs all tests we have (with Trond, Ciprian)
  • todo
• define and document testing routines (with Trond, Ciprian)
  • todo
• finish leaflet text
  • todo
• continue the dictionary infrastructure discussion (with Ciprian, Trond)
  • todo
• make make target for MS Office 2008 spellers
  • todo
• reformulate the noun grammar like the verbs (with Trond)
  • todo
• Contact Davvi Girji about cooperation on electronic dictionaries
  • todo
• subcontractor work for sma proofing tools, MS and Adobe versions
  • todo
• support and maintenance contract for sme and smj, MS+Adobe tools
  • mail sent, and contract suggestion received
• finish paper about our test bench to be presented at the [NLP for reading and writing|http://spraakbanken.gu.se/personal/sofie/SLTC_2008/SLTC_2008.html] workshop at SLTC2008 in Stockholm, Nov. 20-21
  • done
• Sámi languages as part of Norsk språkbank
  • worked on it, not finished
• make a 1-page, light version of the corpus contract, also in Swedish
  • todo
• contact MS Nordic, and ask them to include the Divvun tools in the next Office releases (both Windows and Mac). The integration can/should be done by Polderland, which is an official MS subcontractor/integrator. It could be used by MS as part of their advertising for the next releases, and it will make it much easier for people to get access to the tools.
  • waiting for feedback from A Lona
• integrate sma adjectives into the analyser (without morphology)
  • todo
• create a new test case using the new speller test data
  • done and used
• make proper folder for the SK parallell names
  • todo
• infrastructure remake - news discussion
  • todo
• set up a preliminary agenda for sma workshop (with David)
  • todo
• prepare data for each topic at sma workshop (with David and Trond)
  • todo
• short meeting to go through missing points before a dictionary release (with Ciprian, Trond)
  • todo
• fix bugs!
• other things:
  • autumn leave parts of the week, thus less done

Thomas

• add SK parallel place name data files to proper folder
  • not yet
• contact Nordsalten avis for a project interview aimed at getting more knowledge about the tools out to the users = more users
  • written a mail, have not received answer
• type the verbs in manually (missing: the odd-syllabic only, now at dïjmedidh on p. 113). The verbs to be added are the ones with p. 78-84 s. 146-160
  • done
• fine tune suggestions for Hunspell
  • not yet
• look at test cases still not behaving properly
  • worked some
• translate leaflet text
  • not yet
• test leaflet installation instructions on Mac, Windows XP, Windows Vista
  • tested on Mac and Windows XP, have not got Windows Vista
• work with presentation at Guovdageaidnu-symposia
  • made a draft
• sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage
  • not yet
• fix bugs!
  • worked some

Tomi

• document how compounding is controlled in the PLX conversion
  • not done
• fix double hyphen bugs
  • done
• fix PL hyphenator errors
  • not done
• fix PL and Hunspell conversion bugs
  • done
• work with presentation at Guovdageaidnu-symposia
  • not done
• test hyphenator with new speller lexicons
  • done
• infrastructure remake - news discussion
  • not done
• fix bugs!

Trond

• Hunspell QA README and installation docs
  • Still not.
• Look at dictionaries pipeline
  • Not done.
• Plan recording for text-to-speech
  • Recording done (Biret Ánne the local hero), the first alpha, or rather the quality is so good let us call it a beta has been made (Antti the Helsinki hero). Next step is to take one more round on improbements and do one rerun before the Sámediggi october meeting.
• South Sámi verbs
  • Coordinated odd-syllabic verbs, and even group VI. Next step should probably be to alphabetise our list and go through it.
• South Sámi adjectives
  • Meeting not held. Done some preparations.
• reformulate the noun grammar like the verbs (with Sjur)
  • Will be next step.
• make a 1-page, light version of the corpus contract, also in Swedish
  • Not done.
• infrastructure remake - news discussion
  • ??
• prepare data for each topic at sma workshop (with David and Sjur)
  • Not done
• short meeting to go through missing points before a dictionary release (with Ciprian, Sjur)
  • Not done, will be next steps.
• fix bugs!.
  • No bugs this week.

Pedagogical software online

Working on CG implementation for the ped software. There is now a robust version online (next-steps have been temporarily removed, so that the present games are the state of the art as functioning games go.

Meeting memos can be found at [http://giellatekno.uit.no/ped/index.html#Meeting+memos]

Corpus gathering

The problem with the present setup is that the corpus administrators are not informed about changes in the corpus repository, as well as a lack of a proper change history - we don’t know who did what when. This has lead to a number of unidentifiable files, or files without known history or origin.

Discussion to be held in the news group

No news on smj and sma corpus gathering.

TODO:

• continue gathering sma corpus texts (David, Jovsset)
  • Jovsset is working on the Gun Utsi book, as well as the problematic book
  • David has spoken to a lot of sma students at UmeåU last week, and urged them to send us their texts; also spoke to the teachers; spoke to Maidi Steinfjell, wanted to write about our need for texts
• gather the smj texts from Kurt Tore (Per-Eric)
• other contacts: Nord-Salten avis (Børge Strandskog), Lena Davidsson daughter to Lars-Matto Tuolja
• Ulf Stefan Winka has a lot of smj texts (Per-Eric)
• plan a smj pr tour for our tools (Per-Eric, Thomas)
• meet with the Sámi publishers (meeting delayed) (Jovsset)
• add incoming sma texts to the corpus rep (Børre, Ciprian)
  • Ciprian would like to add some more automatisation to the corpus processing
• make a 1-page, light version of the contract, also in Swedish (Børre, David, Sjur, Trond)
• fix the Upload more link (Børre)
• incorporate SK place name data when we have the proper name infrastructure
• store SK data in svn:
  • make proper folder (Sjur)
  • add data files (Thomas)

Promoting Divvun

Received valuable feedback on the leaflet from Thomas.

TODO:

• Make a download log (Børre)
• use a newspaper or something to write about the tools from an end-user point of view (a review in Š, Ávvir, Nordsalten avis?)
  • contact Astrid Helander at Ávvir for a project interview (Thomas)
    • written her a mail, she has not answered
  • contact Nordsalten avis (Thomas)
    • written mail, have not got answer
  • contact Š (Børre?)
• consider the best way to inform potential users in Sweden about the Divvun tools (David)
  • David has suggested to announce in Sáminuorat and Samefolket
  • preferably get an article in the papers at the same time, about the project and the tools
  • make an add for our tools to go into newspapers (David, Jovsset)
• Prepare for a coordinated info campaign when Ped is ready (inform teachers about Divvun as well as Ped when we inform about Ped) - next year
• Tour de Divvun (smj info tour) (Thomas, Per-Eric)
  • fix the date
  • make sure the leaflet is ready (see below)
  • bring some CD’s
• make leaflet to inform about the project (Jovsset, David)
  • first draft available at xtdoc/sd/src/documentation/content/xdocs/leaflet/leaflet.sv.jspwiki as well as [http://www.divvun.no/leaflet/leaflet.sv.html]
  • translate text when it is finished (Thomas, Jovsset)
• distribute CD version through the library bus, the language centres and common sami centres in all of Sápmi. Gaaltije in Östersund for example. (Leif Åge, Jovsset)
• contact MS Nordic, and ask them to include the Divvun tools in the next Office releases (both Windows and Mac). The integration can/should be done by Polderland, which is an official MS subcontractor/integrator. It could be used by MS as part of their advertising for the next releases, and it will make it much easier for people to get access to the tools. (Sjur)
  • discussed with A. Lona. He said it would be difficult, even if we use Polderland. Another solution could be to enforce it through a political decision.

Future plans, directions and ideas

See a separate document in plan/strat/5year.jspwiki.

Infrastructure

To accomodate future enhancements in different directions (in rough order of importance):

1. test bench for all parts of our language technology efforts
   1. test bench enhanced, but not yet complet
2. set up the Leopard Server features for collaborative support:
   1. permanent chat rooms
   2. stored (and indexed) chat transcripts of the chat rooms
   3. iCal server / group calendars
   4. wiki
3. wiki? on G5 (is part of Leopard Server) or other web-based documentation
4. improve Forrest stability and i18n support ( the divvun crashes)
   1. Sjur has been working on better i18n and pdf rendering
   2. Børre has some ideas for getting back to serving static html files
5. reorganise the documentation:
   1. differ between target groups
   2. get better grouping
   3. decide what to write in forrest and what in wiki (cf. Apertium and [http://xixona.dlsi.ua.es/apertium/]) for a similar split)
   4. update/add missing parts
6. migrate lexc lexicons to XML, splitting the task
   1. Name lexica (the Name project)
   2. Dictionaries (already in XML, task is to integrate them)
   3. At least migrate the lexc open POSes (Komi as a pilot case)
7. change the look of the documentation web
8. sfst?
   1. replacement for xfst -> see [omorf | http://www.ling.helsinki.fi/kieliteknologia/tutkimus/omor/index.shtml], omorf wiki and omorfi
   2. replacement for hunspell/open-source proofing tools
9. investigate the NSIS installer, potentially replacing the InstallShield package from Polderland
10. corpus content moved to Max Planck repositories? Norsk språkbank?
11. update infrastructure to allow content-restricted spellers for special target groups

SVN issues:

• http access not yet available (https only at the moment, but it works as anonymous checkout if the user is not specified)
• read access to the whole repo is working, BUT:
  • gt/*/polderland should be protected
  • plan should be protected
• certain users need to be on the UiT VPN to be able to commit (bug #705)
• UTF-8 problem in svn commit mails: the commit log text is garbled

TODO:

• infrastructure remake: (Børre, Ciprian, Saara, Sjur, Tomi, Trond)
  • to be discussed in news first
  • more modularised make / build infra (prepare for smn, sms, sjd, others)
  • merge gt, kt and st into one
  • modularised preprocess and spellrelax
• make a test-all target that runs all tests we have (Ciprian, Sjur, Trond)
• define and document testing routines (Ciprian, Sjur, Trond)
• follow-up migration to svn:
  • close the open SVN repository at requested paths (Ciprian)
    • completely closed at the moment, until we have solved the path-based control
  • prepare and discuss with external users: Jack Ruether (Trond)
• setup iCal Server (on XServe) (Børre)
• repair the G5 (Børre)
  • e-mail and remind

Linguistics

North Sámi

(nothing new, see proofing bugs below)

http://giellatekno.uit.no/bugzilla/show_bug.cgi?id=711

Lule Sámi

(nothing new, see proofing bugs below)

TODO:

• sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage (Trond).
• Add the words when all words are ready.

South Sámi

TODO:

• ask for the list of sma verbs in baseform from the Verbh authors; NOTE: this is not the same as the manuscript, only the list of baseforms. It should be unproblematic to get this without asking the publisher, since this is not the book. (Jovsset)
• type odd-syllable verbs in manually. The verbs to be added are the ones with reference to pages 78-84
  • 146-190 (Thomas)
    • all done!
• add remaining verbs of type VI, from page 138 or 139 (Thomas)
• get an overview over all problematic areas of the orthography (David)
  • done as far as has been possible - a call to Lajla Mattsson-Magga confirmed the findings so far (ie mostly word lists have been handled, the only orthographic decision has been a partial decision on how to spell foreign words)
• integrate adjectives into the analyser, without morphology as a starting point (Trond, Sjur)
• reformulate the noun grammar like the verbs (Sjur, Trond)
• prepare a workshop on South Sámi orthography and grammar (David)
  • suggest dates
    • try to coordinate with the SGL so we meet together
  • we’ll cover travel and hotel expenses
  • we’ll invite both SGL and as many of the other key persons in the sma writing/normativity community as possible
  • set up a preliminary agenda (David, Sjur)
  • prepare data for each topic (David, Sjur, Trond)

Name lexicon/risten.no infrastructure

TODO:

1. fix i18n bug in risten.no/G5 (so they will work without the proper locale request) (Sjur)
2. fix bugs in lexc2xml; add comments to the log element (Saara)
3. finish first version of the editing (Sjur)
4. test editing of the xml files. If ok, then: (Sjur, Thomas, Trond)
5. make terms-smX.xml <=== automatically from propernoun-sme-lex.xml (add nob as well) (the morphological section should be kept intact, in e.g. propernoun-sme-morph.txt) (Sjur, Saara)
6. convert propernoun-($lang)-lex.txt to a derived file from common xml files (Sjur, Tomi, Saara)
7. implement data synchronisation between risten.no and the cvs repo, and possibly other servers (ie the G5 as an alternative server to the public risten.no - it might be faster and better suited than the official one; also local installations could be treated the same way)
8. start to use the xml file as source file
9. clean terms-sme.xml such that all names have the correct tag for their use (e.g. @type=secondary) (Thomas, linguists)
10. merge placenames which are errouneously in different entries: e.g. Helsinki, Helsingfors, Helsset (linguists)
11. publish the name lexicon on risten.no (Sjur)
12. add missing parallel names for placenames (linguists)
13. add informative links between first names like Niillas and Nils (linguists)

Dictionaries

Presentable version by end of October.

TODO:

• Continue the dictionary infrastructure discussion (Ciprian, Sjur, Trond)
• make simple installer applications
• make a public release
  • Make a homepage with instructions for dictionary use: xtdoc/gtuit/src/documentation/content/xdocs/dict.eng.xml
  • Clarify the difference between local and online dictionaries:
    • Plugin for Firefox and Internet Explorer (online dictionaries)
• Contact Davvi Girji about cooperation on electronic dictionaries (Sjur)
• short meeting to go through missing points before a release (Ciprian, Sjur, Trond)

Proofing tools

Hunspell

The crashing bug has been reported to the Hunspell author, which confirmed the bug to a limitation in the 1.1 branch of Hunspell (OOo is using 1.1.2). He is working to update the Hunspell version in OOo for the next release (3.0.1).

TODO:

• QA README and installation docs - report (Trond)
• check the hunspell test bench and tokenization errors (Børre, Sjur)
• create a make target for OOo extension packages of the spellers (Børre)
• implement an easter egg (almost) identical to the Polderland one (Børre)
• work around crashing bug in Hunspell 1.1.x series (found in OOo 2.x and 3.0 on Mac & Win, perhaps other places) (Børre)
• fine tune suggestions (Børre, Thomas)

OpenXSpell

Working everywhere (almost) in MacOS X applications, provides Sámi spell checking system-wide through a hunspell back-end. OpenXSPell

Update: The UTF-8 problem seems to have been a false alarm, but need to check it again for the letter ŋ. In other cases it seems to work ok as far as the characters are concerned. But the speller does crash after a while, for unknown reasons. It can be related to the Hunspell problem reported above by Børre, and it can be a problem in OpenXSpell. We don’t know yet.

TODO:

• track down the crashing bug

Testing

Spelling Error Markup

TODO:

• Set up ways of adding meta-information (source info, used in testing or not, added to lexicon or not) (Saara)
• test new and nested error markup (Sjur)

Speller testing

TODO:

• create a new test case using the new data (Sjur)
  • done
• include this test in the standard test suite (Sjur)
• improve error markup in smj gold standard document (Sjur, Thomas)

Speller updates

TODO:

• test the spellers (Divvun team)
• new make target for Office 2008 (Sjur)
• waiting for hyphenation updates for 2008 (Polderland)

Speller bugs

List of bugs returned from Polderland: 621, 630, 652, 656, 676.

Open issues based on test results:

sme

Version: Davvisámi, version 1.0.1, 2008-10-16

• 380 - REGRESSION - citation compounds FIXED
• 397 - REGRESSION - name compounds, their derivations, other compounds - one word left (suopmasápmelaš), OPEN
• 426 - comp words from Divvun.no - guoktedássásaš accepted, some compounds not accepted - FIXED
• 431 - REGRESSION - name compounds / lowering in front of hyphen - FIXED
• 435 - roman numbers - inflection of single letter numbers rejected, as well as some complex numbers (but is ok in smj) - still OPEN
  • we should pregenerate all numbers once and for all, and store them in a separate lexicon file
• 449 - REGRESSION - suopmasápmelaš comps wrongly accepted - OPEN
• 489 - REGRESSION - stem vowel shortening / compound tags - FIXED
• 581 - REGRESSION - consonant doubling - OPEN
• 525 - REGRESSION - citation compounds not accepted (the bug relates to suggs) - FIXED
• 536 - REGRESSION - speller accepts “impossible” compound forms - FIXED
• 539 - REGRESSION - speller does not follow compound tagging - FIXED
• 542 - REGRESSION - speller does not pronouns + clitic - FIXED
• 575 - REGRESSION - name+name suggestions with double hyphens (legal compounds not accepted) - FIXED
• 582 - REGRESSION - noun+Prop without hyphen - FIXED
• 593 - REGRESSION - Missing words in beta 2 - one word left (Nuppelohkái), OPEN
• 595 - prefix+name without hyphen (ovdaLot instead of ovda-Lot) - still OPEN
• 597 - REGRESSION - does not recognize nubbelohki - still OPEN
• 599 - REGRESSION - numeral attr:s on lot - oktalot not recognized, OPEN
• 600 - gen+hyph compound sámi-dáru - still OPEN
• 603 - suomabealdi accepted - still OPEN
• 609 - REGRESSION - Anár-julggaštusa not recognized - FIXED
• 610 - REGRESSION - duhát words missing - oktanuppelotduhát remaining, OPEN
• 611 - double hyphen sugg still accepted - still OPEN
• 612 - REGRESSION - case-forms of makkár - FIXED
• 613 - REGRESSION - short gen. as second compound part
• 619 - numerals and pronouns to NAMÁK and SASJ fails - vihttasoarttat remaining, still OPEN
• 629 - a taking part in compounding without hyphen - still OPEN
• 631 - REGRESSION: number compound, numbers starting with 0 - OPEN
• 633 - double hyphens accepted
• 634 - PropGen+hyph+PropGen - FIXED
• 642 - REGRESSION - noun/adj/proper + hyphen + ain
• 644 - cased numeral+numeral compund - still OPEN
• 646 - adverb + hyphen + noun - still OPEN
• 647 - numerals+NOUN - still OPEN
• 649 - name + adj compound without hyphen - still OPEN
• 655 - pron + nai - still OPEN
• 666 - REGRESSION: guovtte- and njealje- - FIXED
• 696 - numerals + NAMAT-adjs + vuohta - OPEN
• 697 - +N+Der1+Der/laš+A+Der3+Der/vuohta - OPEN
• 709 - sámedikkeválga accepted, or with bad suggestion - FIXED
• 717 - noun-acro compounds (juovla-CD) - OPEN
• 728 - vowel shortening GenCmp+Left-tagged - OPEN
• 739 - Rmiddle-words accepted as first part of compound as well
• other REGRESSION:
  • eaktudáhtolaččat now accepted - FIXED

smj

Version: Julevsáme, version 1.0.1, 2008-10-16

• 435 - roman number - single letter numbers now recognised
  • we should pregenerate all numbers once and for all, and store them in a separate lexicon file
  • please note that inflection of single letter numerals is fine in smj, as opposed to sme
• 482 - REGRESSION: double hyphen, polar>-dutkamin suggested - OPEN
• 496 - REGRESSION: unrecognised clitics - FIXED
• 599 - numeral attr:s on lot - still OPEN
• 600 - gen+hyph compound sáme-dáro - still OPEN
• 616 - Bispadime-me-ráden - still OPEN, try to find an acro or abbr me
• 619 - numerals and pronouns to NAMÁK and SASJ fails - FIXED
• 627 - REGRESSION: prefix + hyhpen does not get accepted - OPEN
• 629 - a taking part in compound - still OPEN
• 631 - REGRESSION: number compound, numbers starting with 0 - OPEN
• 634 - rop gen + hyphen + Prop gen - FIXED
• 641 - numeral+noun compounds - FIXED
• 644 - cased numeral+numeral compund - still OPEN
• 647 - numerals+NOUN - still OPEN
• 648 - unmotivated suggestions with numeral+noun - still OPEN
• 649 - name + adj compound without hyphen - still OPEN
• 650 - noun prefix+name compound without hyphen - still OPEN
• 652 - REGRESSION: UPPERCASE-typos only get acronym-suggestions - OPEN
• 692 - numeral-variants - OPEN
• 717 - NEW: - noun-acro compounds - OPEN
• 721 - NEW: - Nom- and gen-numerals make compounds with nouns - FIXED
• other REGRESSIONS:
  • gus NOT accepted anymore - FIXED
  • Svierigadárogielan NOT accepted anymore - OPEN

TODO:

• document how compounding is controlled in the PLX conversion (Tomi)

Hyphenator bugs

Open issues based on test results :

sme

Lexicon version: Davvisámi, version 1.0.1, 2008-04-01

• 468 - REGRESSION:Márkomeanu - OPEN
• 547 - REGRESSION: hyphen in front of vowel: Lotnolasealáhusas - OPEN
• 548 - REGRESSION: mid syllable hyphenation: Háliidivččen - OPEN
• 549 - REGRESSION: division without hyph: Váccedettiin
• 673 - adj-derivations: guovttenuppelotčoarvvagiin (the word is not rec.)
• 677 - NEW: Wrongly hyphenated ending -danidja - invalid - FIXED

smj

Lexicon version: Julevsáme, version 1.0.1, 2008-04-01

• 545 - REGRESSION: bad hyphenation in compounds: åhpadusorganisásjåvnån (not recognised) - FIXED
• 546 - REGRESSION: obligatory hyph rules seem to work in facultative manner: organisásjåvnån (not recognised) - FIXED
• 547 - REGRESSION: hyphen in front of vowel: Jienastimnjuolgadusá and Orgánajs

TODO:

• fix PL hyphenator errors (Tomi)

InDesign tools

Nothing new.

Releases

TODO:

• update the Changes document (Sjur)
• InDesign documentation (Sjur)
  • Norwegian translation received from Davvi Girji
• prepare 1.1 release soon

Other

Sámi week in Tromsø

Sigbjørn Skåden has asked the UiT gang to demonstrate etc at the Tromsø city Library as a part of that week and the happenings at the Library.

• ped tools
• Sámi dictionaries
• Sámi proofing tools
• other things?

Sounds like a good idea, we will be there.

Gathering

Best week for Thomas is week 47, but week 45 is ok during regular working hours. Week 47 might be even better, at least for some of us.

Forthcoming Sámi allaskuvla conference

Info on the conference site.

Title submitted is: Goallosteapmi ja suorggideapmi Divvun-reaidduin

TODO:

• write presentation (Thomas, Tomi)
• read and comment presentation (Sjur)

Text to speech

Update: We have received some first samples, and they sound quite good:)

We are planning a North Sámi text to speech. Work on the text-to-transcription (ttt) component has begun, and for the transcription-to-sound we cooperate with U Hki.

From Trond’s report:

• Plan recording for text-to-speech
  • Recording done (Biret Ánne the local hero), the first alpha, or rather the quality is so good let us call it a beta has been made (Antti the Helsinki hero). Next step is to take one more round on improvements and do one rerun before the Sámediggi october meeting.

TODO:

• Technical issues on the ttt automata (Trond, …)
• Moving input to required xml format (Helsinki)
• Read in the 200 sentences (Biret Ánne)
• Make sounds out of them (Helsinki)

Corpus contracts + open source

Postponed until the svn repository is fully functional (it is too open now).

Next meeting, closing

The next meeting is 27.10.2008, 9.30 Norwegian time.

The meeting was closed at 11:33.

Appendix - task lists for the next five days

Boerre

• Make a divvun-tools download log
• Automatize the making of the OOo extension package of the hunspell dicts
• check the hunspell test bench and tokenization errors
• further investigate installation of dictionaries in NeoOffice
• setup iCal server on the XServe
• make a 1-page, light version of the corpus contract, also in Swedish
• work around crashing Hunspell bug in OOo 2.x/3.0 on Win/Mac
• e-mail about G5 repair status
• infrastructure remake - news discussion
• implement an easter egg (almost) identical to the Polderland one
• fix bugs!

Ciprian

• close the open SVN repository at requested paths
• make a test-all target that runs all tests we have (with Sjur and Trond)
• define and document testing routines (with Sjur and Trond)
• continue the dictionary infrastructure discussion (with Sjur, Trond)
• improve processing of new corpus documents
• make the pipeline of StarDict dictionary generation running on the Mac
• have a closer look at the formatting for StarDict
• update the Makefile for generating dictionaries (related to the dictionary infrastructure task)
• look at the xml conversion script
• take care of the error logging during conversion process
• look at the xml conversion quality
• make a list of (general and special) problems related with converting docs into xml-forat and adding them to the corpora
• continue the search and testing of an appropriate tool for lexicon working (no xml-file editing via text editors!)
• generate new sme:nob/nob:sme dictionaries in all formats, marking them as “Beta”-versions (Sjur’s proposal to use an image background for that purpose)
• infrastructure remake - news discussion
• short meeting to go through missing points before a dictionary release (with Sjur, Trond)
• restructure the paradigme-generating scripts (keep the generalization in mind)
• fix bugs!

David

• continue gathering sma corpus texts
• stay in contact withSáminuorat about writing about the project and advertising.
• gather orthographic decisions (with Jovsset)
• translate corpus contract to swedish (with Jovsset)
• make a 1-page, light version of the corpus contract, also in Swedish
• prepare a workshop on South Sámi orthography and grammar (David)
  • suggest dates
    • try to coordinate with the SGL so we meet together
  • set up a preliminary agenda (with Sjur)
  • prepare data for each topic (with Sjur and Trond)
• Assist Jovsset in the work with the leaflet.
• make an add for our tools to go into Sámi newspapers (with Jovsset)

Jovsset

• get the list of verbs from the auhtors ofVerbh.
• Write and translate leaflet text, add pictures.
• Find a suitable infrastructure for the distribution of the CD version. Possible through the library bus, the language centres and common sami centres in all of Sápmi.
• Talk to person who can talk to translator of Gåessie dah jeatjebh åerieminie
• make an add for our tools to go into Sámi newspapers (with David)

Per-Eric

• transfer the smj texts by Kurt Tore to our corpus repository
• follow-up contracts from Nord-Salten avis and Lena Davidsson
• Work with missing list same_dutkama_pgr.txt
• Plan a smj pr tour for our tools
• contact Ulf Stefan Winka for smj texts
• fix bugs!

Saara

• add new XSL/XML headers for proofing test docs
• Set up ways of adding meta-information for proofing correct corpus docs (source info, used in testing or not, added to lexicon or not)
• implement the ped UI and functionality
• infrastructure remake - news discussion

Sjur

• name db/risten.no
• update the Changes document
• follow-up on some Polderland-related bugs: 621, 630, 652
• InDesign documentation
• make a test-all target that runs all tests we have (with Trond, Ciprian)
• define and document testing routines (with Trond, Ciprian)
• write leaflet text
• continue the dictionary infrastructure discussion (with Ciprian, Trond)
• make make target for MS Office 2008 spellers
• reformulate the noun grammar like the verbs (with Trond)
• Contact Davvi Girji about cooperation on electronic dictionaries
• subcontractor work for sma proofing tools, MS and Adobe versions
• support and maintenance contract for sme and smj, MS+Adobe tools
• Sámi languages as part of Norsk språkbank
• make a 1-page, light version of the corpus contract, also in Swedish
• contact MS Nordic, and ask them to include the Divvun tools in the next Office releases (both Windows and Mac). The integration can/should be done by Polderland, which is an official MS subcontractor/integrator. It could be used by MS as part of their advertising for the next releases, and it will make it much easier for people to get access to the tools.
• integrate sma adjectives into the analyser (without morphology)
• make proper folder for the SK parallell names
• infrastructure remake - news discussion
• set up a preliminary agenda for sma workshop (with David)
• prepare data for each topic at sma workshop (with David and Trond)
• short meeting to go through missing points before a dictionary release (with Ciprian, Trond)
• include the new speller test in the standard test suite
• read and comment allaskuvla presentation
• improve error markup in smj gold standard document (with Thomas)
• fix bugs!

Thomas

• add remaining verbs of type VI from page 138 or 139
• add SK parallel place name data files to proper folder
• fine tune suggestions for Hunspell
• look at test cases still not behaving properly
• translate leaflet text
• test leaflet installation instructions on Mac, Windows XP, Windows Vista
• work with presentation at Guovdageaidnu-symposia
• sme->smj lexicon conversion to build bilingual lexicon resources, and increase smj coverage
• improve error markup in smj gold standard document (with Sjur)
• fix bugs!

Tomi

• document how compounding is controlled in the PLX conversion
• fix double hyphen bugs
• fix PL hyphenator bugs
• fix PL and Hunspell conversion bugs
• work with presentation at Guovdageaidnu-symposia
• infrastructure remake - news discussion
• fix bugs!

Trond

• Hunspell QA README and installation docs
• Look at dictionaries pipeline
• Plan recording for text-to-speech
• South Sámi verbs
• South Sámi adjectives
• reformulate the noun grammar like the verbs (with Sjur)
• make a 1-page, light version of the corpus contract, also in Swedish
• integrate sma adjectives into the analyser (without morphology)
• infrastructure remake - news discussion
• prepare data for each topic at sma workshop (with David and Sjur)
• short meeting to go through missing points before a dictionary release (with Ciprian, Sjur)
• fix bugs!.