Skip to content

Commit

Permalink
Added rule for adding back the prefix boundary markers.
Browse files Browse the repository at this point in the history
  • Loading branch information
aarppe committed Mar 5, 2024
1 parent e7fde5b commit 7d65067
Showing 1 changed file with 15 additions and 0 deletions.
15 changes: 15 additions & 0 deletions src/fst/verb_lexicon.xfscript.in
Original file line number Diff line number Diff line change
Expand Up @@ -101,6 +101,13 @@ read regex [Stems PostverbalAffixes] .o.
"=" -> "=" OuterAffixes;
define WordForms;

# Rewrite rule for resurrecting the prefix boundary markers

define ShowBoundaries [ "@P.PREFIX.INNER@" -> "." ,
"@P.PREFIX.MIDDLE@" -> "_" ,
"@P.PREFIX.OUTER@" -> "="
];

# Concatenate ObliqueAffixes and the other inflectional FSTs.
read regex WordForms .o. [..] -> ObliqueAffixes || .#. _;

Expand All @@ -125,6 +132,14 @@ set flag-is-epsilon ON
# the the morphological component one-by-one for faster compilation.

regex [Grammar Tags] .o. MorphoPhonology ;
define VerbModel

# Make flags visible, so that they can be converted to explicit boundary markers
set flag-is-epsilon ON

# Output boundary markers based on flags

regex VerbModel .o. ShowBoundaries ;

# regex [Grammar Tags] .o. deletePrefixI .o. hToneSpreading .o. hToneSpreadingCleanup .o. deleteBoundarySymbol .o. uBeforeA .o. aBeforeI .o. lowABeforeI .o. iBeforeA .o. iBeforeO .o. uBeforeO .o. lInitialStemsSbjPl2 .o. lInitialStemsSbjPl2Cleanup .o. slDissimilation .o. zhDevoicing .o. zDevoicing;

Expand Down

0 comments on commit 7d65067

Please sign in to comment.