[Bug]: Variable Name with Japanese is truncated opening a ods file

[momoldo]

JASP Version

0.18.3

Commit ID

No response

JASP Module

Unrelated

What analysis are you seeing the problem on?

No response

What OS are you seeing the problem on?

macOS Silicon

Bug Description

I attempted this ods file to JASP.

This is a result opend in JASP

The name of the fifth variable consists five Kanji characters, but after opening in JASP, this consists three Kanji characters.
This situation don't happen when I open csv file. It's not a serious problem, but kanji characters in a csv file sometimes happen another problem when it opened.

Expected Behaviour

It is not serious. If it is easy to repair, I need to repair the problem.

Steps to Reproduce

I can't recognize what kanji character happens this problem.

Log (if any)

No response

Final Checklist

• I have included a screenshot showcasing the issue, if possible.
• I have included a JASP file (zipped) or data file that causes the crash/bug, if applicable.
• I have accurately described the bug, and steps to reproduce it.

[boutinb]

@shun2wang did you ever have this problem?

[shun2wang]

I didn't saw this problem,.@momoldo could you please share your .ods file and we will have a look?

[momoldo]

Thank you for your reply.

This file causes this problem...
小売価格2020年6月.ods

I'm checking if another ods file causes same problem.
This file "testfile.ods" is no problem.
testfile.ods

Do this file "testfile2.ods" causes problem?
testfile2.ods

[momoldo]

"珈琲" is something wrong.

Testfile3.ods hos three variables "追手門学院大学", "コメダ珈琲" and "珈琲Shop".
testfile3.ods

The name of the second variable changes "コメダ" and the third changes "珈琲".
Is "珈琲" a naughty word?

[shun2wang]

yeah, confirmed this is a importing ods problems, if rows names in text:p then we read them as names. because we read xml depth at text:p, seems libreOffice/MS-Office will merge them and ignore ruby-xxx?

see:

<table:table-cell office:value-type="string" table:style-name="ce2">
    <text:p>
        <text:ruby text:style-name="ru1">
            <text:ruby-base>喫茶店</text:ruby-base>
              <text:ruby-text text:style-name="T5">キッサテン </text:ruby-text>
              </text:ruby>
        <text:ruby text:style-name="ru1">
            <text:ruby-base>珈琲</text:ruby-base>
            <text:ruby-text text:style-name="T5">コーヒー </text:ruby-text>
        </text:ruby>
    </text:p>
</table:table-cell>

and

<table:table-cell office:value-type="string" table:style-name="ce2">
    <text:p>
        <text:ruby text:style-name="ru1">
            <text:ruby-base>都市名</text:ruby-base>
            <text:ruby-text text:style-name="T5">トシメイ </text:ruby-text>
       </text:ruby>
    </text:p>
</table:table-cell>

[momoldo]

Thank you for your job!
I understood it.

[JorisGoosen]

Is what I see when I open it in libre office on my system, where it doesnt even show anything in the headers?
(This is after opening the file linked above)

[shun2wang]

It's OK for me on Linux/Window in LibreOffice:

Even MS-Excel on Windows is OK, maybe a bug from LibreOffice on MacOS.

[JorisGoosen]

This is weird, also if I load it in google-docs:

(But I dont have access to a windows or linux machine for a few days)

[JorisGoosen]

都市名 | マグロ | ジャガイモ | 喫茶店珈琲 | 民営家賃 | 水道料金

is what it gets loaded as on linux, looking like boxes...
Does ods have some weird encoding settings that we dont know about?

[JorisGoosen]

This issue might be solved by the PR jasp-stats/jasp-desktop#5703 but there might be some strange issues with such characters in ods. Not sure whats up, but if it works on Shun and momoldo's systems I guess it works where it needs to.