Copilot Workspace Feedback

[ThisIsKirsch]

Looking for Product Feedback

The wait is over! 🎉 We’re thrilled to share that the technical preview of GitHub Copilot Workspace is now available to all paying Copilot customers. 🚀

We've loved all the feedback given to use during the technical preview and pubic preview, and we're thrilled to be getting such amazing feedback from you. Previously we were collecting feedback on Discord. Moving forward we'll be using this discussions post as the one-stop shop for all user feedback!

If you have any feedback, bugs to report, or comments in general regarding Copilot Workspace please leave it here!

[ykundesu]

I am using VisualStudio.
Currently only supported in VSCode and browser, will it be supported in VisualStudio in the future?

[skylar-anderson]

We don't have exact plans yet, but adding more IDE extensions is something we are considering in the future :)

[diachromemis]

Is there a specific feature or tool you’re curious about being supported in Visual Studio in the future?

[detty-down]

Have you tried using VSCode or a browser to access the current features? If yes, how was your experience?

[dpewaal-iba]

Is there any tool or extension in Visual Studio that you think needs improvement or additional support?

[beingminimal]

@ThisIsKirsch When we are going to have a model selection in CW? any ETA?

[beingminimal]

@beingminimal Making CW multi-model is a top priority for us. Stay tuned 👀

ok thanks.

[PierrunoYT]

Would love to get Higher Rate Limits

[hetsaraiya]

What are the rate limits can you please mention the numbs if you can?

i am new on technical preview.

[derKosi]

+1

replacing Random with RandomNumberGenerator.Create() (in C#, yeah i know) and putting it in its own service and changing 35 files was to much for the rate limit. So Sad.

I even would throw my own ressources (azure) against it or setup a local env (ollama + api key) to properly test this.
It seems to be able to generate solutions for Issues generated by sonarqube and such, and I would like to compare this against Devin for example.

[wmeints]

I find that reordering files in the plan is difficult when you have a large list of files. I would love to be able to have some form of dedicated function to reorder files in the plan.

[dylanatsmith]

@wmeints Can you tell us more about why you reorder files and what order you put them in?

For example, are you grouping files and their tests, grouping all files together and all tests together, etc?

[wmeints]

I noticed that sometimes copilot workspace has the order reversed and produces the wrong result. For example, when the test file is generated before the implementation, the implementation generated is a lot worse. Now when I reorder the files, the results are better.

In most cases the order of the files is correct, however, when you start to iterate in the session using brainstorming or by typing revisions, new files are added at the end of the list that need to be at the top or somewhere in the middle. By then the list is getting pretty long so it becomes harder to reorder the files.

[dylanatsmith]

That’s helpful context, thanks @wmeints. We’ll look into this.

[jagerman777hx]

When you encounter difficulties in reordering files in your plan, have you ever tried using any tools or methods to address this issue?

[beingminimal]

@ThisIsKirsch Does CW going to support custom Ai agents? like in case if we want to run ai agents we have built with langgraph in CW then is it going to be supported?

[beingminimal]

@ThisIsKirsch CW will have canvas like GPT4o-canvas to iterate?

[MarzLars]

Hi,
I've been playing around for some hours and I noticed that doing multiple revisions of one ''task-session''--not sure how to name it--will essentially make co-pilot behave a bit weirdly and not complete some of the instructed tasks. My fix for this has so far been to start new task sessions and make brainstorms etc. for the current features I want to improve--and begin new separate task sessions if I want some new features for my application.

From my understanding it seems to be intended to start a new "Task" in your workspace when copilot has completed what was initially prompted. Hence, I think it would be nice with some UI that promotes this workflow. See example images below

Current UI:

My suggestion would be to include a button at the bottom of the side bar, which makes it possible to start new Tasks, straight from the sidebar, when copilot has implemented the initial task prompt:

Suggested UI-draft:

***When button is clicked, you get prompted to go to a new task page and start the process again, or something along those lines. ***

But I really love it so far! Kudos!

[six7]

@MarzLars would you say you always want to be in control of when to start a new task like depicted? How would you feel if CW automatically started new tasks (as follow-ups to the original with proper UI affordances) if it thinks your request doesnt fit into the current?

[MarzLars]

@six7 I will mostly want to always be in control, but it would be nice if CW comes with a pop-up or notifaction if it notices the request diverges too much--you get the option to put that request into a new task or keep going with your current session. 😛

[lehotskysamuel]

Any plans to integrate CW with pycharm / jetbrains IDEs?

[skylar-anderson]

No specific plans as of yet, but additional IDE support is something we are considering.

[Mistic92]

Should be higher priority

[grandell1234]

I would appreciate if the Command part, has knowledge of the actual scripts, so you can have it install the necessary dependencies without having to specify them one-by-one.

[SkywardSyntax]

Hey, I was wondering if CW will still be receiving weekly updates while in public preview?

[skylar-anderson]

We will continue shipping updates to CW as we build towards public preview :) Expect changelogs to land every 2 weeks.

[bripkens]

Something we frequently do is to have tasks like "Implement a new thing X that is similar to Y. To figure out what to do, search for usages of Y.". So far it seems like CoPilot workspace cannot understand this. Especially not within a monorepo. Example of where one would do this:

• plugin systems: Spinning up a new plugin (requiring new files/directories/constant files/registrations etc. – lots of boilerplate)
• adding additional telemetry: Define a new metric that is similar to an already existing one.

[skylar-anderson]

Have you tried using Brainstorming to extract a description of current system behaviors e.g. "similar to Y"? Brainstorming lets you query the current codebase to understand existing behaviors which can then be injected back into the task description in order to inform the plan.

[pethers]

Hi,

Really enjoyed using the workspace, had some success cleaning up javadoc on my open source project https://github.com/Hack23/cia .

Javadoc improvements Pull request.
Hack23/cia#6751
Hack23/cia#6744
Hack23/cia#6742
Hack23/cia#6740

Works pretty well, result https://hack23.github.io/cia/apidocs/com.hack23.cia.web/module-summary.html better module descriptions was empty before.

Some issues I had.

• Don't find all relevant files to update, seems to only scan small subset of project.
• Regulary hit "You have exceeded your usage quota per hour. " even with first brainstorm off the day.
• The base branch requires all commits to be signed, can the pull request generated be signed ? Issue already exist at Add possibility to generate signed commits githubnext/copilot-workspace-user-manual#65

Would be great if could scan the whole project and detect and modify large set of files better.

Example want to fix "Desc." descriptions in UI since I was lazy when I wrote ot https://copilot-workspace.githubnext.com/Hack23/cia?shareId=f93d776f-206d-4445-bf64-8fae04951c51 . Would be great to fix it everywhere :) Now limited to one package Hack23/cia#6753 or do it for multiple areas.

Like the workflow, easy to learn and great support for generating pull request.

Best regards

[skylar-anderson]

Thanks for sharing @pethers. It's awesome to see your success with CW.

Context selection is a critical piece of CW. We're actively working on some new ideas to improve the way CW selects files for your task.

We're also working to increase capacity as we scale CW towards a public preview so hopefully you aren't hitting quota limits as frequently going forward.

Keep an eye out on our changelog for continued improvements! :)

[gaieges]

Generally a huge fan of the copilot workspace, cant wait to see where it will go. Also can't wait til I'm not rate limited and can use it more extensively!

Some feedback I had while creating:

• The "ideas" concept seems powerful but a bit confusing in how it works - could be a little more intuitive
  • I'd like for IT to ask me clarifying questions to aid the plan and code steps (rather than selecting questions to ask itself)
  • I'd then like to override certain plan steps with an idea in text form and not have to deal with the ui aspects (ie via the input field at the bottom - "make sure that we implement it via X approach")
• I would want some more granularity over "steps" to add to "tasks" from a question. For example in the answer to the question of "how should the ui look", I may want to pull out just "color X" and "rounded edges" from the list of 10 items returned.
• It would be great to be able to do parts of this in the PR, if you detect something wrong after PR generation. Ie make some suggestions as you normally would via comments and have the PR updated automatically from the same contextual LLM (some tools already that do this, but you could do it better)

[skylar-anderson]

Love this feedback. Your points about improving ideas are fantastic. I'll raise these points with the team as we shape the next iterations.

[gaieges]

Glad to hear it!

Another note regarding this feedback approach- it's a bit noisy to get emails about everyone else's input. I'll be muting this thread, so ping me directly if you have any additional questions.

[davidecelano]

I've been lookin' around in the project repo and site and I wasn't able to find terms regarding what happens with source code in private/internal repos when granting access to Copilot Workspace: I think it's really relevant for businesses to be sure that their private source code is not shared to train models or provide code snippets/suggestions to the whole Github community

[xbito]

I have a bit of feedback / thoughts regarding the UI. For a bit of context, I am a software engineer that haven't used Github that much before, my previous company was using other products for code and project management. So I'm a bit familiar with Github UIs but I am not entirely comfortable yet.

I might not be offering solutions/alternatives, this is more an expression of my thoughts / first impressions while using the tool. This is my fourth session, and I have done relatively small tasks so far. I started the session from my repo using the Code -> Copilot -> Start task flow.

In this first Interaction I have some mixed indications of what I need to do next:

• On the sidebar under "Write" is what I initially entered as Start task which seems to be editable.
• On the main part of the UI I have the Brainstorm section, which has Add item callouts, and a chat with a set of Suggested questions for the Chat.
• And then we have the Generate plan button.

At that point, as a new user that has not read the documentation because I am really confident about my ability to understand a UI, I am a bit confused what I'm supposed to do next.

This is what I feel the UI is telling me: If I click "Generate plan" it is going to use the input I made in Write to re-generate the Brainstorm. But actually what happens if I change the Task is that a new button/section appears at the top of the Brainstorm content to regenerate it, and I still can hit Generate plan without updating the Brainstorm:

It seems like the intention is for Brainstorms to be updated when the Task changes. There's even this "Outdated" indicator in the "Ideas from brainstorm" thing under the Task textbox once I change the Task. But if I click Generate plan thinking that it would update the Brainstorm it seems to proceed with the original Brainstorm instead. I have to click on Brainstorm or on the Outdated label and then click on that other Update button to update the Brainstorm and then update the Plan. But, also, if I update the Brainstorm there is no indication that the Plan is now Outdated, and that I should click on Update plan rather than on Implement selected files.

Now, if click on one of the "Suggested questions", it seems to replace the content from the original Brainstorm. Turns out that the original one still exists under that hamburger button, but there is no indication that that is what is happening. Why not add another tab beside Brainstorm? Or indicate that will open another "page"? But also, what the Chat-like interface is suggesting to me is that this section is more like a chat-gpt experience, where there is a conversation, not an individual document per question/answer. First thing I thought was: It's not clear why aren't the questions I'm asking added to the "Ideas from brainstorming section" which contains the original, automatically added, "How do I solve this task?" (By the way, maybe it should say we, it is copilot and the user brainstorming together right?)

Once I used the questions I saw the answers give you options, like "Where should the avatar be displayed", it gave me a few options, which I can then "+ Add to task" if I agree. Which then adds something to the list of ideas from brainstorming, but also changes the original "How do I solve this task?" page/answer right?. In particular in the Proposed solution section. Why both places?

There also seem to be questions, like the above one, that is not really giving me the option to specifically select which one I want to add to task, it seems to be an all or nothing rather than options like in others. These seem to be 3 ways to attend to the issue expressed by the question that do not need to be all done. And in this case I can't edit instantly, I have to click on the pencil button to enter edit mode, which is not the case with the original "How do I solve this task?" page.

This whole concept of Suggested questions seem to dance between 2 different purposes, there are some that seem to be questions that may help us further refine the request, like the one about where to display the avatar. But then there are others that seem to be more about the user wanting to learn about something, for example I have a suggestion about Learning about PySide6 for UI development. Should there be a distinction about Questions for refining where we will be given a selection to further refine the task, versus those that are about other related topics?

I have more thoughts but my son just came back from school! Hope you find these reflections (sort of ramble) useful!

[cruftyoldsysadmin]

User management for copilot workspace is completely and hopelessly broken. After everything broke last night, I thought maybe I had hit a hidden limit, so I purchased an organization seat for copilot pro. This seemingly deleted the personal copilot access (which I prepaid for a year) and also failed to give me access with the new seat I purchased.

On top of this, my access to code spaces broke a few days ago despite only having used 0.5% of my allotted access

Help @github-staff

[arthurwolf]

I'm hitting the rate limit daily now, it's getting very frustrating.

(Also, frequently the entire thing just crashes, either the tab or behind the scenes, and I'm sort of worrying maybe the many times I have to click again and again on "regenerate" as a consequence, count as extra uses, and are in part responsible for me hitting the limit too early)

I'd gladly pay to have them lifted, or pay for whatever compute this uses.

Amazing tool otherwise...

(though I'd really like some way to give it instructions in a general manner, it keeps removing comments in existing code / generating code with no comments, and it's annoying having to separately fix that...)

[tomMoulard]

I'd love to have a fast feedback loop of actions directly in gw.

Running commands is nice but often not enough to cover most use cases that the ci offers (like linting, tests, and builds)

[ehalsey]

Looking for Product Feedback

I keep hitting the quota limits and I'm not really doing much. Makes the product feel undependable and is pretty frustrating.

[ehalsey]

Looking for Product Feedback

Open in Workspace from an issue should automatically select the branch associated with the issue. Currently have to cancel it b/c it always defaults to using the main branch.

[Derpenstein69]

it has been absolutely awesome, im blown away and impressed, its great when im allowed to use it... but the low quota's are pretty frustrating. the hourly quota's/rate limits are understandable and only a mild inconvenience, if those stayed the same i wouldnt mind at all. But the daily quota seems very low and can be a huge pain to wait for, if the daily limit was doubled it would be much much more useful for me personally. ( i could use 4x the quota some days, but i realize thats probably too much, 2x the quota would make it infinitely more usable though )

[brantburnett]

I've been trying to use Copilot Workspaces to convert a project from VB to C#. I've gotten the conversion plan and implementation to be pretty good. However, it involves a lot of Git file moves from .vb extensions to .cs extensions. When I attempt to sync the changes in VSCode, it only creates the deletions for the .vb files and doesn't create any of the .cs files.

[lilmnm-kamikaze-]

It will not generate a plan. It will after i type "do work" in the revise text box. When it then does generate the plan all of the tasks it says it did do (with the green check mark) it did not add. Having to regen the plan or file still doesnt have it implement the plan correctly. This then leads to hitting the hourly and daily limit in about 15 minutes (I timed it). It only works about 5% of the time.

[hemanth]

Sometimes it just ignores the plan.

[hemanth]

It some times misses to implement the functionality form the plan.

[hemanth]

Feature request:

• It would be good to have a preview tab for UI-related repositories and pull requests.
• Provide options to build and test.
• Integrate VSCode with the brainstorming sessions.
• Provide a playground; it is neither a new nor an existing repository.

[Akash1134]

Expanding Access to the GitHub Copilot Workspace Technical Preview ⏩

We are excited to announce that all paying Copilot customers can now use the technical preview of GitHub Copilot Workspace. 🎉

Getting Started

Sign up for the technical preview by logging into Copilot Workspace. Please note that Enterprise Managed Users are not eligible for the technical preview.

Once you have access, check out the user manual, or these 5 helpful tips and tricks for getting the most out of Copilot Workspace.

Organization administrators can enable members to use Copilot Workspace with repositories owned by their organization by approving the Copilot Workspace OAuth app for the organization. OAuth app restrictions are enabled by default when new organizations are created, so unless you’ve changed this setting, members of your organization will not have access to Copilot Workspace on organization-owned repositories by default. To enable Copilot Workspace for your organization’s repositories:

• Enable Copilot Extensions
• Opt-in to Copilot feature previews
• Approve the GitHub Copilot Workspace OAuth application for any organizations where you want developer access

⭐ We shipped some amazing features and improvements this December. Read more in the Copilot Workspace Changelog

To dive deeper into the Copilot Workspace world, explore the blog that introduced GitHub Copilot Workspace to the world. We’d love to hear your feedback as we continue to enhance your workspace in the coming year. 🚀

[ekerner-com]

Im loving GitHub Copilot Workspaces !! It's a complete game-changer and my new ❤️
I want to do all of my work this way.

Only 2 issues:

1. Please allocate more resources tho, it keeps hanging and crashing.
2. I can use it in web, but when I click open in vscode and try to use it via the vscode plugin it keeps asking me to add targets, which I cant figure out how to. The error "No targets have been selected to implement. Aborting.".

Your avid supporter.

[Mistic92]

I'm constantly getting out of memory errors in chrome tab where I try to work with Copilot Workspaces.

[hungquang291]

Thank you and have a good day