First off, thanks for taking the time to contribute! ❤️
All types of contributions are encouraged and valued. Please make sure to read the relevant section before making your contribution. It will make it a lot easier for us maintainers and smooth out the experience for all involved. The community looks forward to your contributions. 🎉
And if you like the project, but just don't have time to contribute, that's fine. There are other easy ways to support the project and show your appreciation, which we would also be very happy about:
- Star the project
- Tweet about it
- Refer this project in your project's readme
- Mention the project at local meetups and tell your friends/colleagues
If you want to ask a question or report a bug, we assume that you have read the available Documentation.
Before you ask a question, it is best to search for existing Issues that might help you. In case you have found a suitable issue and still need clarification, you can write your question in this issue. It is also advisable to search the internet for answers first.
If you then still feel the need to ask a question and need clarification, we recommend the following:
- Open an Issue.
- Provide as much context as you can about what you're running into.
- Provide project and platform versions (nodejs, npm, etc), depending on what seems relevant.
We will then take care of the issue as soon as possible.
This is a Monorepo project including the following technologies:
- Cross-platform framework: Electron
- Interface:
- State management and communication:
- Automation framework/toolkit:
- Test framework
.
├── README.md
├── package.json # Electron application dependencies
├── forge.config.ts # Electron pack and publish configuration
├── electron.vite.config.ts # Electron bundle configuration
│
├── src # Electron application source code
│ ├── main # Main process source code(Like backend)
│ ├── preload # Preload script source code
│ └── renderer # Renderer process source code(Like frontend)
│
├── packages # Packages or Modules or SDK for UI-TARS Desktop
│ ├── action-parser # Action parser for parsing UI-TARS model output into actions
│ ├── core # Core SDK package for UI-TARS Agent
│ ├── electron-ipc # Electron IPC for communication between main and renderer processes
│ ├── shared # Shared code of the project(including types, utils, constants, etc.)
│ ├── utio # UTIO (UI-TARS Insights and Observation)
│ ├── visualizer # Sharing HTML Visualization Reporter
│ └── operators # Automation operators
│ ├── browserbase # Browserbase integration
│ └── nut-js # Nut.js integration
│
├── docs # Documentation of the project
├── rfcs # RFCs (Request for Comments) for the project
├── e2e # E2E test cases for the project
├── playwright.config.ts # E2E test configuration
└── vitest.*.mts # Unit test configuration
Note: The
src
directory is located in the top-level directory instead of theapps/{main,preload,renderer}
directories because Electron Forge previously did not support Pnpm's hoisting mechanism(electron/forge#2633), requiring thesrc
directory to be placed in the top-level directory.
$ git clone https://github.com/bytedance/ui-tars-desktop.git
$ cd ui-tars-desktop
$ pnpm install
$ pnpm run dev
After the application starts, you can see the UI-TARS interface within the application.
Note: On MacOS, you need to grant permissions to the app (e.g., iTerm2, Terminal) you are using to run commands.
By default, pnpm run dev
only has frontend Hot Module Replacement (HMR) hot updates. If you need to simultaneously reload the main process during debugging, you can execute pnpm run dev:w
.
$ pnpm run dev:w
The CI pipeline to execute is .github/workflows/release.yml, only manual triggered by maintainers. If you're a maintainer, you can follow the steps below to release the application:
- Edit the
version
inpackage.json
- Git commit and push to the
release/${version}
branch, create a PR targetingmain
branch, titledrelease(app): ${version}
- Trigger the release workflow manually after the PR is merged
Currently, the release workflow supports the following platforms:
- MacOS x64
- MacOS arm64
- Windows x64
If you want to publish the latest
version packages to the npm registry, you can run the following command:
pnpm changeset
to specify the changelogs for the packages you want to publish- Git commit and push to the
release-pkgs/${version}
branch, create a PR targetingmain
branch, titledrelease(pkgs): ${version}
pnpm run publish:packages
to publish the packages in latestorigin/main
branch after the PR is merged
If you want to publish the beta
version packages to the npm registry, you can run the following command:
pnpm changeset
to specify the changelogs for the packages you want to publish- Git commit and push to the branch
pnpm run publish-beta:packages
to publish the packages in current branch
The documents are placed in the docs/*.md
directory, formatted in markdown. There is currently no documentation site, but the docs/*.md
directory will be converted into a documentation site in the future.
We use Husky and lint-staged to enforce the pre-commit hooks. The hooks include:
prettier --write
to format the codenpm run typecheck
to strictly check the type
We use Conventional Commits to standardize the commit messages.
Each PR or main branch push will trigger the CI pipeline to run the unit test and E2E test.
pnpm run test
pnpm run test:e2e
- Push your changes to a feature branch in your fork of the repository.
- Submit a pull request to this repository
- Accept the CLA in your PR.