Skip to content

README.md

Latest commit

 

History

History
36 lines (20 loc) · 1.31 KB

README.md

File metadata and controls

36 lines (20 loc) · 1.31 KB
Raw

Pāli Analysis

What is this repository

This repository is some work related to pāliwiki, which is a Tipiṭaka reading, learning and translating platform.

Explanation of the folders

material

includes the materials for cook, they are basicly convert from others.

From pāliwiki:

  • pali_text.tgz is the full text of Tipiṭaka.

  • dict_parent.db is convert from sys_regular.db and sys_irregular.db.

    • The sys_regular.db is a regular inflection dictionary infered by all possible grammer rules. The parent of a word is not the stem nor the root. For example, "gam->gaccha(ti)->gacchanta->gacchato", each word's previous is called the parent of the word.
    • The sys_irregular.db is the dictionary of irregular word entered manually.

  • dict_compound.db is convert from pm.db and comp.db, it contains the split of each compound word.

    • pm.db is the pāli-myanmar dictionary.
    • comp.db is the results of splits using algorithm.

cook

includes preprocessing scripts:

  • parenting.py convert each word of pali_text.txt to its parent using dict_parent.db and dict_compound.db.

sentence

includes codes used for analysis the sentences in Tipiṭaka:

  • Get similar sentences using jaccard similarity.