Restore Netsurf port

[klange]

ToaruOS once had a port of Netsurf, circa 2016. We should bring that back.

Netsurf has some dependencies which don't exist in the current port catalog:

• Curl, which builds with some minor patches, including support for mbedtls.
• zlib, which shouldn't have any issues, it was just largely obviated by toaru_inflate.
• libpng, again, was obviated by toaru_png; I'd rather not rewrite things to use our libraries, so just porting these is worthwhile.
• Freetype, which was working in Toaru 1.14.
• libjpeg, which is optional but desirable; our JPEG parser is insufficient for most images on the Internet anyway.

During the last port of Netsurf, we did not have a BSD sockets layer and the Curl port was largely stubbed, so I'm not sure we were ever even able to load web pages, just local files on disk. I expect things will go a bit better this time around.

The framebuffer backend for Netsurf supports SDL, and the first pass at porting Netsurf should use it. A future improvement might be to write a native Yutani frontend - possibly one that makes use of our menu and button libraries.

[klange]

Curl builds with minor patches. Some changes to our libc were implemented to support it, but it also needs a couple of kludges to disable calls to select that were not guarded behind HAVE_SELECT, as well as disabling some uses of getaddrinfo that were not allowing failure.

Additionally, some changes to the configure script were necessary to support shared library builds, which are now functioning.

I will formulate patches for these changes and prepare Curl for packaging. My next focus will be on zlib, libpng, and freetype.

[klange]

[klange]

I have had a separate checkout of the main OS repo for going on three years now with the build environment for Netsurf. I double checked that the built binaries still work in a current build of the OS, which it does:

I am trying to work out what I actually patched in Netsurf. The Netsurf source tree is not from a revision control repository, so I need to directly diff it against a fresh download of the same version.

Additionally, I believe I did this previous work before the last (ever?) release of Netsurf, so upgrading might also be worthwhile. There's also been some development in Netsurf since that release...

[klange]

When I was first working on porting Netsurf, I opted not to invest effort in using native libraries to make porting more straightforward and get to a working browser faster, but I think now it may be worthwhile to consider some places where we can get Netsurf to feel more "at home" in ToaruOS:

• A Toaru frontend, instead of SDL: Using UI widgets from the File Browser, including a proper menu, URL bar, context menus, and status bar.
• Integration with our text rendering library instead of using Freetype, if possible - for a consistent look-and-feel and to reduce dependencies.
• Possibly integration with our PNG and JPEG libraries, but that will reduce overall usability.

Of course, doing any of this requires getting the build environment functioning again and understanding what patches we already have.

[klange]

I compared my development environment with a fresh unpack of the 3.10 sources and the changes are surprisingly minimal:

• Various things related to preventing fd "multisets" (select) from being used, particularly with Curl.
• Lots of work to make the SDL framebuffer frontend not render its own cursors, instead setting appropriate system cursors.
• SDL polling hacks because we don't (didn't?) have SDL timers. Should be largely obviated by having our own native frontend.
• iconv-related hacks, to make sure Netsurf uses the real GNU iconv and not our stubbed libc versions.
• Normal config.h changes to support __toaru__.

I also know that in curl itself we have an additional patch, again for the multiset stuff. This Curl is also three years old.

I seem to have some additional unpublished SDL patches as well, but I don't know how much any of that matters.

[klange]

This is all still very preliminary (and I'm honestly surprised it works this well with the limited set of things I have implemented), but I have started work on a native Toaru frontend for Netsurf. No SDL, no NSFB, no FreeType - this is using our own graphics routines and text rendering, so it looks right at home. It still depends on libcurl, libturbojpeg, etc., as those are slightly more tightly coupled to Netsurf, but it also means it's more likely to work.

The overall UI will be based on File Browser, with the same sort of toolbars, as well, so it really will look just like a ToaruOS application.

[klange]

Still need to add more plotters, fixup a bunch of stuff with clipping, actually implement half of the text layout table, add scrolling, add the URL bar and toolbar buttons... but it's getting there.

[klange]

I also still need to update the base for this for Netsurf 3.11, which would support the column layout on Wikipedia's monobook skin, but we'll get to that in a bit...

[klange]

Toolbar is ported from File Browser, though only sort of functional.

[klange]

Also, all of this is on an aarch64 toolchain (hence screenshots from a macOS host - I do my aarch64 dev on an M1 Air) and I haven't yet gotten around to ensuring I have the external ports working for x86-64 targets, but we'll see if I can make some progress on that this week...

[klange]

Upgraded the base source to 3.11.

[klange]

I guess the next step here might be to try to get duktape working...

[klange]

Dependency list for reference:

• libcurl: our curl port repo is here: https://github.com/toaruos/curl - modifications are mostly build support and disabling select; might be possible to upgrade to a newer release?
• libexpat: based on upstream 3cc10ece0999894c90367a22fb5a782c7356c425 and only seems to have some generated cmake files added
• libiconv: seems to be from a release tarball of 1.17, not sure on changes (probably config.sub); we have a stub iconv in our libc, so this gets weird.
• libjpeg-turbo: based on upstream 3a53627306233013dcec61a90f0e9ed302ea5156, has a minor change to a test source, also has cmake files? Also, Netsurf does not use the "turbo" API, so we only need to ship libjpeg.
• zlib: actually using Sortie's libz, from upstream 752c1630421502d6c837506d810f7918ac8cdd27; no modifications
• libpng: seems to be from a release tarball of 1.6.39 (I have debated using our PNG loader, but it is too incomplete and it's a more invasive change to Netsurf); definitely try upgrading this to a newer release
• mbedtls: is based on upstream e483a77c85e1f9c1dd2eb1c5a8f552d2617fe400 and disables MBEDTLS_NET_C (which uses select, so despite having a sockets layer these days we should keep this disabled): we have packed this on x86-64 already.

Modifications to Netsurf itself, beyond the additional frontend, are mostly limited to ensuring curl doesn't do silly things, disabling the iconv filter (which doesn't want to play well with external iconv build), and forcing the one place that does use the external iconv to use the external symbol names.

With 3.11, the process for adding a new frontend has been greatly simplified, so it might even be possible to upstream something.

I should try to upgrade everything to a newer release, but our mbedtls in particular is very old.