-
Notifications
You must be signed in to change notification settings - Fork 377
Added Emscripten documentation #4115
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 6 commits
b799c74
f08ce92
759f18b
ffa0dc3
21360e1
6d021ba
e9724ef
7ae9a5c
8b4e963
12f6972
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,349 @@ | ||
| .. _examples_cross_build_emscripten: | ||
|
|
||
| Cross-building with Emscripten - WebAssembly and asm.js | ||
| ======================================================= | ||
|
|
||
| This example demonstrates how to cross-build a simple C++ project using Emscripten and Conan. | ||
|
|
||
| Conan supports building for both `asm.js <http://asmjs.org>`_ and `WASM | ||
| <https://webassembly.org>`_, giving you the flexibility to target different | ||
| JavaScript/WebAssembly runtimes in the browser. | ||
|
|
||
| We recommend creating separate Conan profiles for each target. Below are | ||
| recommended profiles and instructions on how to build with them. | ||
|
|
||
| What’s the difference between asm.js and WASM? | ||
| ---------------------------------------------- | ||
|
|
||
| - **asm.js** is a subset of JavaScript optimized for speed. It is fully supported by all browsers (even older ones) and compiles to a large ``.js`` file. | ||
| - **WebAssembly (WASM)** is a binary format that is smaller and faster to load and execute. Most modern browsers support it, and it is generally recommended for new projects. **WASM** is also easier to integrate with native browser APIs compared to **asm.js**. | ||
|
|
||
| Setting up Conan profiles | ||
| ------------------------- | ||
|
|
||
| **For asm.js (JavaScript-based output):** | ||
|
|
||
| .. code-block:: text | ||
|
|
||
| [settings] | ||
| arch=asm.js | ||
| build_type=Release | ||
| compiler=emcc | ||
| compiler.cppstd=<cppstd> | ||
| compiler.libcxx=<libcxx> | ||
| compiler.threads=<threads> | ||
| compiler.version=<version> | ||
perseoGI marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| os=Emscripten | ||
|
|
||
| [tool_requires] | ||
perseoGI marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
| emsdk/[*] | ||
|
|
||
| [conf] | ||
| # Optional settings to enable memory allocation | ||
| tools.build:exelinkflags=['-sALLOW_MEMORY_GROWTH=1', '-sMAXIMUM_MEMORY=2GB', '-sINITIAL_MEMORY=64MB'] | ||
| tools.build:sharedlinkflags=['-sALLOW_MEMORY_GROWTH=1', '-sMAXIMUM_MEMORY=2GB', '-sINITIAL_MEMORY=64MB'] | ||
|
|
||
| **For WebAssembly (WASM):** | ||
|
|
||
| .. code-block:: text | ||
|
|
||
| [settings] | ||
| arch=wasm | ||
| build_type=Release | ||
| compiler=emcc | ||
| compiler.cppstd=<cppstd> | ||
| compiler.libcxx=<libcxx> | ||
| compiler.threads=<threads> | ||
| compiler.version=<version> | ||
| os=Emscripten | ||
|
|
||
| [tool_requires] | ||
| emsdk/[*] | ||
|
|
||
| [conf] | ||
| # Optional settings to enable memory allocation | ||
| tools.build:exelinkflags=['-sALLOW_MEMORY_GROWTH=1', '-sMAXIMUM_MEMORY=4GB', '-sINITIAL_MEMORY=64MB'] | ||
| tools.build:sharedlinkflags=['-sALLOW_MEMORY_GROWTH=1', '-sMAXIMUM_MEMORY=4GB', '-sINITIAL_MEMORY=64MB'] | ||
|
|
||
|
|
||
| Even though Emscripten is not a true runtime environment (like Linux or | ||
| Windows), it is part of a toolchain ecosystem that compiles C/C++ to | ||
| WebAssembly (WASM) and asm.js. | ||
|
|
||
| Conan uses Emscripten to: | ||
perseoGI marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| - Align with the toolchain: Emscripten integrates the compiler, runtime glue, and JavaScript environment, making it practical to treat as an "OS-like" target. | ||
|
|
||
| - Support backward compatibility: Many recipes in Conan Center Index use ``os=Emscripten`` to enable or disable features and dependencies that specifically target Emscripten. | ||
|
|
||
| - Maintain stability: Changing this setting would break recipes that rely on it, and would complicate compatibility with alternative WASM toolchains. | ||
|
|
||
|
|
||
| .. note:: | ||
|
|
||
| ``wasm`` arch refers to ``WASM 32-bit`` target architecture, which is the | ||
| default. If you wish to target ``WASM64``, set ``arch=wasm64`` in your profile. | ||
| **Note that WASM64 is still experimental** and requires Node.js v20+ and a browser that supports it. | ||
|
|
||
| .. important:: | ||
|
|
||
| According to `emscripten documentation <https://emscripten.org/docs/api_reference/wasm_workers.html>`_ Emscripten supports two multithreading APIs: | ||
|
|
||
| - POSIX Threads API (``posix`` in conan profile) | ||
| - Wasm Workers API (``wasm_workers`` in conan profile) | ||
|
|
||
| These two APIs are incompatible with each other and incompatibles with binaries compiled without threading support. | ||
| This incompatibility necessitates the modeling of threading usage within | ||
| the compiler's binary model, allowing conan to distinguish between binaries | ||
| compiled with threading and those compiled without it. | ||
|
|
||
| Conan will automatically set compiler and linker flags to enable threading if configured in the profile. | ||
|
|
||
| .. note:: | ||
|
|
||
| The profiles above use the ``emsdk`` package from `Conan Toolchains repository <https://github.com/conan-io/conan-toolchains>`_, which provides the Emscripten SDK, including ``emcc``, ``em++``, and tools like ``emrun`` and ``node``. | ||
|
|
||
| If you prefer to use your system-installed Emscripten instead of the Conan-provided one, ``tool_requires`` could be replaced by custom ``compiler_executables`` and ``buildenv``: | ||
|
|
||
| .. code-block:: text | ||
|
|
||
| [conf] | ||
| tools.build:compiler_executables={'c':'/path/to/emcc', 'cpp':'/path/to/em++'} | ||
| # Add native Emscripten toolchain | ||
| # tools.cmake.cmaketoolchain:user_toolchain=["/path/to/emsdk/upstream/emscripten/cmake/Modules/Platform/Emscripten.cmake"] | ||
|
||
|
|
||
| [buildenv] | ||
| CC=emcc | ||
| CXX=em++ | ||
| AR=emar | ||
| NM=emnm | ||
| RANLIB=emranlib | ||
| STRIP=emstrip | ||
|
|
||
|
|
||
| This way conan could configure `emsdk` local installation to be used from `CMake`, `Meson`, `Autotools` or other build systems. | ||
|
|
||
|
|
||
| .. note:: | ||
|
|
||
| The ``tools.build:exelinkflags`` and ``tools.build:sharedlinkflags`` in | ||
| previous profiles are recomendations but users can modify them or define | ||
| their values in the CMakeLists.txt file using the | ||
| ``set_target_properties()`` command. | ||
|
|
||
| - By enabling ``ALLOW_MEMORY_GROWTH`` we allow the runtime to grow its | ||
| memory dynamically at runtime by calling ``emscripten_resize_heap()``. Without | ||
| this flag, memory is allocated at startup and cannot grow. | ||
|
|
||
| - The ``MAXIMUM_MEMORY`` and ``INITIAL_MEMORY`` values specifies the maximum | ||
| and initial memory size for the Emscripten runtime. These values can be | ||
| adjusted based on your application's needs. | ||
|
|
||
| Take into account that ``arch=wasm64`` has a theorical exabytes maximum | ||
| memory size, but runtime currently limits it to 16GB, while ``arch=wasm32`` | ||
| has a maximum memory size of 4GB and ``arch=asm.js`` has a maximum memory size of 2GB. | ||
|
|
||
|
|
||
| .. important:: | ||
|
|
||
| ``emcc`` compiler does not guarantee any ABI compatibility between different versions (patches included) | ||
| To ensure a new ``package_id`` is generated when the Emscripten version | ||
| changes, it is recommended to update the ``compiler.version`` setting in your profile accordingly. | ||
|
|
||
| Also, when requiring ``emsdk`` package as a tool, it is recommended to use it this way: | ||
|
|
||
| .. code-block:: python | ||
|
|
||
| self.tool_requires("emsdk/[*]", package_id_mode="patch_mode") | ||
|
||
|
|
||
|
|
||
| This will ensure that the package ID is generated based on the Emscripten | ||
| version, allowing Conan to detect changes in the Emscripten toolchain and | ||
| rebuild the project accordingly. | ||
|
|
||
|
|
||
| Example Usage | ||
| ------------- | ||
|
|
||
| Please, first clone the sources to recreate this project. You can find them in the | ||
| `examples2 repository <https://github.com/conan-io/examples2>`_ in GitHub: | ||
|
|
||
| .. code-block:: bash | ||
|
|
||
| $ git clone https://github.com/conan-io/examples2.git | ||
| $ cd examples2/examples/cross_build/emscripten/bindings | ||
|
|
||
|
|
||
| You can check the contents of the project: | ||
|
|
||
| .. code-block:: text | ||
|
|
||
| . | ||
| ├── CMakeLists.txt | ||
| ├── conanfile.py | ||
| ├── main.cpp | ||
| ├── shell.html | ||
| └── ... | ||
|
|
||
|
|
||
| As we can see in the conanfile and CMakeLists.txt, this project depends on | ||
| external libraries such as `eigen <https://conan.io/center/recipes/eigen>`_, | ||
| `zlib <https://conan.io/center/recipes/zlib>`_ and `fmt <https://conan.io/center/recipes/fmt>`_. | ||
| This library is used to perform a simple floating point operation and to | ||
| demonstrate how easy it is to cross-build a project with emscripten using Conan even if it depends on external libraries. | ||
|
|
||
| To simplify the CMakeLists.txt, all the Emscripten specific configuration | ||
| have been moved to the conanfile.py, only one line is needed in the | ||
| CMakeLists.txt to enable the generation of the ``html`` output (testing | ||
| purposes). | ||
|
|
||
| The main.cpp file contains some basic functions which will be called from | ||
| JavaScript. Notice the usage of ``EMSCRIPTEN_KEEPALIVE`` specifier to ensure that | ||
| the functions are not removed by the Emscripten optimizer, allowing them to be | ||
| called from JavaScript. This could be avoided by using the ``-s EXPORTED_FUNCTIONS`` flag. | ||
|
|
||
| In the conanfile.py we may focus on the ``generate()`` method, more specifically in the following lines: | ||
|
|
||
| .. code-block:: python | ||
|
|
||
| def generate(self): | ||
| ... | ||
| tc.extra_exelinkflags.append( | ||
| "-sEXPORTED_FUNCTIONS=['_malloc','_free'] \ | ||
| -sEXPORTED_RUNTIME_METHODS=['ccall','cwrap','getValue','setValue','HEAPF32'] \ | ||
| -sENVIRONMENT=web \ | ||
| -sALLOW_MEMORY_GROWTH=1 \ | ||
| -sNO_EXIT_RUNTIME=1 \ | ||
| --shell-file ${CMAKE_SOURCE_DIR}/shell.html" | ||
| ) | ||
|
|
||
| This line is crucial as it specifies the Emscripten flags that will be used | ||
| during the linking phase. It exports the necessary functions to be callable | ||
| from JavaScript, sets the environment to web, allows memory growth, and | ||
| prevents the runtime from exiting immediately after execution. | ||
| Also, defines the ``shell.html`` file. This file will act as a ``html`` template to produce the final output. | ||
|
|
||
|
|
||
| These linker options could also be passed from CMakeLists.txt using the | ||
| ``set_target_properties()`` command. | ||
|
|
||
| And finally, the ``shell.html`` file is a slightly modified version of the default shell packaged in ``emsdk`` with the following changes: | ||
|
|
||
| - Simplified to only include the necessary scripts and styles. | ||
| - Added buttons and input fields to act as a user interface for the exported functions. | ||
| - Added in the ``<script>`` section, the JavaScript code to call the exported functions | ||
| from the C++ code, demonstrating how to interact with the compiled code. | ||
|
|
||
|
|
||
| Build the project for `asm.js` | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
|
|
||
| Let's build the project for both targets, first for ``asm.js``: | ||
|
|
||
|
|
||
| .. code-block:: bash | ||
|
|
||
| $ conan build . -profile:host ../profiles/wasm32 --build=missing | ||
perseoGI marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
|
|
||
| .. note:: | ||
|
|
||
| The ``-profile:host`` option specifies the profile to use for the host system | ||
| (in this case ``Emscripten``). Notice that we are using the profiles from | ||
| the ``examples2`` repository, but feel free to use your own profiles or | ||
| create new ones based on the examples provided above. | ||
|
|
||
| This should generate the following files in the ``build/release-asmjs/`` directory: | ||
|
|
||
| .. code-block:: text | ||
|
|
||
| . | ||
| ├── wasm_example.html | ||
| ├── wasm_example.js | ||
| └── ... | ||
|
|
||
| Notice that there is no ``.wasm`` file generated, as the output is in `asm.js` format. (TODO explain the differences) | ||
|
|
||
| This page can be opened in a browser to test the functionality of the "transpiled" code. | ||
|
|
||
| |bindings_webpage| | ||
|
|
||
| If we take a look at the `Browser Developer Tools`, on the `Sources` tab we could find the following files: | ||
|
|
||
| |bindings_devtools| | ||
|
|
||
| Notice that the `wasm_example.js` file is the JavaScript code generated by | ||
| Emscripten, which contains a javascript optimized code (improve) | ||
|
|
||
|
|
||
| Build the project for `WebAssembly (WASM)` | ||
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | ||
|
|
||
| .. code-block:: bash | ||
|
|
||
| $ conan build . -profile:host ../profiles/wasm32 --build=missing | ||
|
|
||
| This generates: | ||
|
|
||
| .. code-block:: text | ||
|
|
||
| build/release-wasm/ | ||
| ├── wasm_example.html | ||
| ├── wasm_example.js | ||
| ├── wasm_example.wasm | ||
| └── ... | ||
|
|
||
| Here, the ``.wasm`` file is the main compiled output, and the `.js` file is a small loader script that initializes and runs the ``WASM`` module in the browser. | ||
|
|
||
| Running the WebAssembly Page | ||
| ---------------------------- | ||
|
|
||
| Most browsers enforce strict security rules and will refuse to load WebAssembly | ||
| modules directly from the file system. The easiest way to run the generated | ||
| page locally is to serve it using a local server. | ||
|
|
||
| **Using emrun (recommended with emsdk):** | ||
|
|
||
| ``emrun`` is provided by the ``emsdk`` Conan package and is available once the Conan build environment is activated. | ||
|
|
||
| Activate the environment: | ||
|
|
||
| **POSIX:** | ||
|
|
||
| .. code-block:: bash | ||
|
|
||
| $ source build/release-wasm/generators/conanbuild.sh | ||
|
|
||
| **Windows:** | ||
|
|
||
| .. code-block:: bash | ||
|
|
||
| $ build\release-wasm\generators\conanbuild.bat | ||
|
|
||
| Then: | ||
|
|
||
| .. code-block:: bash | ||
|
|
||
| $ emrun --browser <browser_name> build/release-wasm/wasm_example.html | ||
|
|
||
| Replace ``<browser_name>`` with `chrome`, `firefox`, or another browser you have | ||
| installed. If you omit the ``--browser`` option, it will open the default | ||
| browser. | ||
|
|
||
| **Alternatively, using Python’s built-in HTTP server:** | ||
|
|
||
| .. code-block:: bash | ||
|
|
||
| $ cd build/release-wasm | ||
| $ python -m http.server 8080 | ||
|
|
||
| Then open your browser and navigate to `http://localhost:8080/wasm_example.html`. | ||
|
|
||
| This should display the page with buttons and input fields that interact with the compiled C++ functions via JavaScript. | ||
|
|
||
|
|
||
| .. |bindings_webpage| image:: ../../images/examples/cross_build/emscripten/bindings-webpage.png | ||
| :alt: Webpage showing some buttons and input fields to interact with the compiled code. | ||
|
|
||
| .. |bindings_devtools| image:: ../../images/examples/cross_build/emscripten/bindings-devtools.png | ||
| :alt: Webpage Developer Tools showing the sources tab with the generated JavaScript code. | ||
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,14 @@ | ||
| .. _integrations_emscripten: | ||
|
|
||
| |emscripten_logo| Emscripten | ||
| ============================ | ||
|
|
||
| Conan provides support for cross-building for both `asm.js <http://asmjs.org>`_ and `WASM <https://webassembly.org>`_ (Web Assembly) targets | ||
| using `Emscripten <https://emscripten.org>`__. This enables developers to compile C/C++ code for the browser | ||
| and other JavaScript environments. | ||
|
|
||
| For detailed examples and step-by-step instructions, refer to: | ||
|
|
||
| - :ref:`Cross-building with Emscripten <examples_cross_build_emscripten>` | ||
|
|
||
| .. |emscripten_logo| image:: ../images/integrations/conan-emscripten-logo.png |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is asm.js kind of deprecated, superseded by Wasm already?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, but it is still used so seems reasonable to add the docs for it. But I'll move it to a secondary position to make WASM more relevant