Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Encoding issues in Nix install unless LC_ALL is set #125

Closed
haoyun opened this issue Sep 13, 2021 · 5 comments
Closed

Encoding issues in Nix install unless LC_ALL is set #125

haoyun opened this issue Sep 13, 2021 · 5 comments
Labels
documentation Improvements or additions to documentation question Further information is requested unicode
Milestone

Comments

@haoyun
Copy link

haoyun commented Sep 13, 2021

Describe the bug
I have a markdown file with file name in CJK characters.
The generated html has name ������.html. Also in terminal,

[Debug#WS.Client.01]  ~~> Identity (Identity (Identity R[LMLType Md]:������))

To Reproduce
Steps to reproduce the behavior:

  1. newly created project folder with only one file: 测试.md
  2. run emanote

Expected behavior
In terminal and browser, Chinese characters should be properly displayed.

Desktop (please complete the following information):

  • Browser Chrome
  • Version latest
@haoyun haoyun added the bug Something isn't working label Sep 13, 2021
@srid
Copy link
Owner

srid commented Sep 13, 2021

It works for me:

image

image

image


But I wonder what we can do here to make it behave consistently regardless of the user environment. What happens when you run emanote with LANG=C.UTF-8 and/or LC_ALL=C.UTF-8? See #120 (comment)

@haoyun
Copy link
Author

haoyun commented Sep 13, 2021

Thanks for the information. With LC_ALL=C.UTF-8, it works.

Then it seems to be a nix problem. It reminds me of a similar problem with hledger simonmichael/hledger#1033 (comment).

@srid
Copy link
Owner

srid commented Sep 13, 2021

Could you paste the output of env | grep LC and env | grep LANG? Just curious what your user environment already defines.

@haoyun
Copy link
Author

haoyun commented Sep 13, 2021

~/Documents/emanote ❯ env | grep LC 

~/Documents/emanote ❯ env | grep LANG
GDM_LANG=en_US.utf8
LANG=en_US.utf8

@srid
Copy link
Owner

srid commented Sep 13, 2021

Probably related: srid/neuron#381

The only pending question I guess is whether Emanote should set LOCALE_ARCHIVE as part of its nix derivation.

@srid srid added question Further information is requested and removed bug Something isn't working labels Sep 16, 2021
@srid srid added this to the Initial Public release milestone Sep 24, 2021
@srid srid added unicode documentation Improvements or additions to documentation labels Nov 26, 2021
@srid srid changed the title encoding problem for CJK characters. Encoding issues in Nix install unless LC_ALL is set Feb 10, 2022
@srid srid closed this as completed in c6774be Aug 30, 2022
shivaraj-bh pushed a commit to shivaraj-bh/emanote that referenced this issue Dec 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation question Further information is requested unicode
Projects
None yet
Development

No branches or pull requests

2 participants