Skip to content

Parse full content failed to handle French characters (e.g. developpez.com) #1094

Closed

Description

@heberjeur

Checklist

  • I've already searched in existing issues and haven't found a similar problem reported.
  • This error caused the app to crash
  • This error is reproducible

Which category best fits this error?

User Interface

App version

0.14.2 and olders

Reproduction steps

1.Describe the bug :

When parsing and displaying articles https://www.developpez.com/rss.php—French special characters (e.g., é, è, ç, à, etc.) are not rendered correctly. Instead, they appear as encoding artifacts like:

Perplexity a lanc� son nouvel abonnement Max, factur� 200 dollars par mois, et d�sormais disponible sur iOS et sur le Web...

This issue negatively affects readability and the user experience for French content.

2.To Reproduce :

Steps to reproduce the issue:

  1. Add the feed: https://www.developpez.com/rss.php

  2. Sync and open a few articles.

  3. Observe that French characters (accents and special letters) appear as corrupted or misencoded symbols (e.g., �).

3.Expected behavior :

French characters should be displayed correctly as UTF-8 or as defined by the feed encoding, for example:

Perplexity a lancé son nouvel abonnement Max, facturé 200 dollars par mois, et désormais disponible sur iOS et sur le Web...

4. Possible cause :

The issue may be due to incorrect or missing handling of character encoding (e.g., assuming UTF-8 without checking the feed's declared encoding). The feed may declare ISO-8859-1 or Windows-1252, which needs to be properly respected when parsing content.

Activity

  1. added
    bugSomething isn't working
    untriagedThis issue hasn't been triaged yet
    on Jul 6, 2025
  2. heberjeur commented on Jul 6, 2025

    @heberjeur
    Author

    Image

  3. changed the title [-]Incorrect display of French special characters in some RSS feeds (e.g. developpez.com)[/-] [+]Parse full content failed to handle French characters (e.g. developpez.com)[/+] on Jul 6, 2025
  4. Lampotrias commented on Jul 7, 2025

    @Lampotrias

    I also can't reproduce it with this specific news item from the RSS feed.

  5. JunkFood02 commented on Jul 7, 2025

    @JunkFood02
    Collaborator

    it seems that developpez.com is using iso-8859-1 charset instead of utf-8 while their rss feed being utf-8

  6. JunkFood02 commented on Jul 7, 2025

    @JunkFood02
    Collaborator

    @heberjeur if you know the admin in developpez.com, please contact them or point them to this issue. they return a wrong content-type for certain pages

    curl -I https://intelligence-artificielle.developpez.com/actu/373456/Philipp-Schmid-La-nouvelle-competence-de-l-IA-n-est-pas-le-prompting-mais-l-ingenierie-contextuelle-Structurer-dynamiquement-le-contexte-permettrait-de-booster-la-pertinence-des-modeles-d-IA-selon-lui/
    HTTP/1.1 200 Connection established
    
    ......
    
    Content-Type: text/html, charset=iso-8859-1
    

    should be text/html; charset=iso-8859-1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions