Skip to content

Feat/browser gui agent#1

Open
nithinm93 wants to merge 62 commits into11from
feat/browser-gui-agent
Open

Feat/browser gui agent#1
nithinm93 wants to merge 62 commits into11from
feat/browser-gui-agent

Conversation

@nithinm93
Copy link
Owner

No description provided.

ycjcl868 and others added 30 commits February 12, 2025 17:10
* chore: version 0.0.5

* feat: setting preset (close: #57) (#61)

* feat: implement preset setting (close: #57)

* fix(renderer): setting page cannot scroll

* refactor(renderer): setting layout and scroll behavior

* refactor(renderer): remote preset management ui

* refactor(renderer): setting input should be disabled when remote preset management take effect

* fix(renderer): reset to manual does not work

* chore(renderer): dispatch get setting after import preset

* feat(renderer): clear setting

* refactor(renderer): naming

* chore: tweaks

* chore: add setting store change log

* refactor: enhance impl of `setting:resetPreset`

* refactor: enhance impl of `setting:clear`

* chore: tweaks

* refactor: using self-implemented setting state management

* chore: tweaks

* fix(renderer): only fallback to download if upload was not configured or failed (#95)

* refactor(ipc-bridge): replace zutron to trpc-like ipc bridge (#94)

* refactor(ipc-bridge): replace zutron to trpc-like ipc bridge

* chore: replace window

* chore: ipc get permissions

* refactor: remove all dispatch

* docs: init setting docs (#96)

* docs: init setting docs

* Update docs/setting.md

Co-authored-by: Charles <jinxin001@bytedance.com>

---------

Co-authored-by: Charles <jinxin001@bytedance.com>

* chore: make language setting optional (#99)

* fix(windows): windows fails to handle events when the dock bar is opened after being closed (#100)

* chore: tool

* chore: canvas capture frame 30 to 60

* chore: upgrade electron 3.1.1

---------

Co-authored-by: ULIVZ <chenhaoli@bytedance.com>
* fix: not use system picker

* chore: version

* chore: version reset
…ded (#105)

* feat(renderer): add a strong prompt when the report needs to be uploaded

* chore: should only display notice model when `reportStorageBaseUrl` is configured
* docs: contributing.md

* chore: pnpm and node

* docs: monorepo

* docs: contributing
* fix(main): resolve focus missing for typing window on Windows

* fix(main): resolve key event missing on Windows

* fix(main): reformat code
* fix: ensure screen capture uses primary display source

* test: add device.test.ts

* test: update device.test.ts
* feat(visualizer): reduce html report size

* feat(visualizer): remove midscene_report_tpl element and minify css & js code

* feat(visualizer): externals common lib
* fix(bug): ensure screen capture uses primary display source (#117)

* fix: ensure screen capture uses primary display source

* test: add device.test.ts

* test: update device.test.ts

* tweak(ux): close Settings Window after saving (#115)

* feat(visualizer): reduce html report size (close: #118) (#119)

* feat(visualizer): reduce html report size

* feat(visualizer): remove midscene_report_tpl element and minify css & js code

* feat(visualizer): externals common lib

* feat: init sdk

* chore: operators

* feat: sdk agent

* feat: sdk ready

* chore: add publish beta shell

* feat: packages changelog

* release: publish beta packages

* chore: remove pre pack

* refactor(agent): use @ui-tars/sdk refactor

* chore: type

* chore: beta shell

* chore: add utio

* chore: remove app agent code

* release: publish beta packages

* chore: version

* fix: async_hooks

* chore: unsafe

* chore: forge

* fix(build): front end bundle server code

* release: publish beta packages

* chore: status

* fix(operator): scaleFactor

* fix: scaleFactor

* chore: unused

* fix: model retry bug

* fix: som bug

* fix: windows screenshot size

* fix: resize screenshot

* fix: scale factor

* release: publish beta packages

* fix: sdk add parsedPrediction

* chore: utio version

* release: publish beta packages

* fix: useConfig bug

* chore: peer deps

* fix: model custom

* chore: typo

* fix(sdk): async_hooks store get undefined multiple sdk versions in the project

* fix: screen sources primary

* chore: ci test

* chore: replace inquirer to clack

* chore: date.now

* feat: support pass InstanceType model

* release: publish beta packages

* fix: operator bug

* release: publish beta packages

* chore: add instruction

* chore: sdk add maxLoopCount

* chore: simplify sdk

* refactor: useConfig to useContext

* release: publish beta packages

* chore: useContext

* fix: global this

* chore: browser

* chore: add test cases

* feat: init sdk

* chore: unused

---------

Co-authored-by: Dugyu <duguangyu.d@bytedance.com>
Co-authored-by: skychx <skychx@hotmail.com>
Co-authored-by: heh <38528320+ZhaoHeh@users.noreply.github.com>
* chore: edit 0.0.6

* chore: remove changeset

* docs: graph

* chore: same version

* chore: fix

* release: publish beta packages
* fix: cli

* release: publish beta packages

* chore: esm

* release: publish beta packages

* chore: sdk
* fix(operator): macos cannot type

* chore: log
* feat: support operator-browserbase

* chore: md

* chore: test

* chore: types

* release: publish beta packages

* chore: docs

* chore: typo

* refactor: pnpm

* chore: reset gui agent

* chore: types predictionParsed Close bytedance/UI-TARS-desktop#136

* chore: types

* fix: onData end trigger twice

* chore: typo

* chore: mouse speed

* chore: copyright

* chore: type

* chore: publish
* docs: browserbase fork from

* feat: support factors for different model coordinate systems

* chore: factors

* refactor: support UITarsModel custom

* chore: type

* chore: invokeModelProvider
Signed-off-by: StepSecurity Bot <bot@stepsecurity.io>
Co-authored-by: Willem Jiang <143703838+willem-bd@users.noreply.github.com>
* feat(sdk): export `UITarsModelConfig` type

* fix(sdk): should respect model's factors config

* Update packages/sdk/src/core.ts

Co-authored-by: Charles <jinxin001@bytedance.com>

---------

Co-authored-by: Charles <jinxin001@bytedance.com>
WillemJiang and others added 30 commits February 28, 2025 14:10
* test: add unit tests for screen and permission ipcRoutes

* test: fixed the unit test errors of permission

---------

Co-authored-by: Willem Jiang <143703838+willem-bd@users.noreply.github.com>
Co-authored-by: Charles <jinxin001@bytedance.com>
* fix: screenshot thumbnail undefined

* chore: version
* feat: add new action for secret scanning

* fix the format of security-scan

---------

Co-authored-by: Willem Jiang <143703838+willem-bd@users.noreply.github.com>
Co-authored-by: Charles <jinxin001@bytedance.com>
* refactor(sdk): screenshot only return base64 and scaleFactor

* chore: screenshot width height

* fix: windows screenshot mark bug

* chore: reset

* chore: beta pkgs

* fix: test

* release: publish beta packages

* chore: reset

* feat(sdk): action parser add start_coords, end_coords

* release: publish beta packages

* fix: test

* release: publish beta packages
* fix: deps build

* fix: deps

* fix: build bug

* fix: native module
Co-authored-by: chenhaoli <chenhaoli@bytedance.com>
Co-authored-by: Charles <jinxin001@bytedance.com>
Co-authored-by: Charles <jinxin001@bytedance.com>
Co-authored-by: Charles <jinxin001@bytedance.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.