Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Error parsing LLM response in a laravel simple project! #1003

Open
hooman-mirghasemi opened this issue Jun 6, 2024 · 6 comments
Open
Labels
bug Something isn't working

Comments

@hooman-mirghasemi
Copy link

hooman-mirghasemi commented Jun 6, 2024

Version

VisualStudio Code extension

Operating System

Linux (other)

What happened?

I just start a laravel project
when I define a simple task to "create a category with crud in admin panel"

{
"summary": "The 'User.php' file defines the User model class within the 'App\Models' namespace. This class extends 'Authenticatable' class provided by Laravel framework for user authentication. It includes attributes like 'name', 'email', and 'password' that are mass assignable and hidden attributes like 'password' and 'remember_token'. Additionally, it defines a method 'casts' to specify the data types for certain attributes like 'email_verified_at' and 'password'.",
"references": [
"Illuminate/Contracts/Auth/MustVerifyEmail.php",
"Illuminate/Database/Eloquent/Factories/HasFactory.php",
"Illuminate/Foundation/Auth/User.php",
"Illuminate/Notifications/Notifiable.php"
]
}

{
"summary": "The 'User.php' file defines the User model class within the 'App\Models' namespace. This class extends 'Authenticatable' class provided by Laravel framework for user authentication. It includes attributes like 'name', 'email', and 'password' that are mass assignable and hidden attributes like 'password' and 'remember_token'. Additionally, it defines a method 'casts' to specify the data types for certain attributes like 'email_verified_at' and 'password'.",
"references": [
"Illuminate/Contracts/Auth/MustVerifyEmail.php",
"Illuminate/Database/Eloquent/Factories/HasFactory.php",
"Illuminate/Foundation/Auth/User.php",
"Illuminate/Notifications/Notifiable.php"
]
}

{
"summary": "The 'User.php' file defines the User model class within the 'App\Models' namespace. This class extends 'Authenticatable' class provided by Laravel framework for user authentication. It includes attributes like 'name', 'email', and 'password' that are mass assignable and hidden attributes like 'password' and 'remember_token'. Additionally, it defines a method 'casts' to specify the data types for certain attributes like 'email_verified_at' and 'password'.",
"references": [
"Illuminate/Contracts/Auth/MustVerifyEmail.php",
"Illuminate/Database/Eloquent/Factories/HasFactory.php",
"Illuminate/Foundation/Auth/User.php",
"Illuminate/Notifications/Notifiable.php"
]
}

Error parsing LLM response

it seems every time with every task Pythagora try to read all project files and send to API!!?

I set it much simpler: "only create category model"

and again faced up with:

Hooman mir

Yes

Code Monkey Agent

{
"summary": "The 'Category.php' file defines the Category model class within the 'App\Models' namespace. This model extends the Eloquent Model class provided by Laravel and uses the HasFactory trait. It represents a category entity with properties such as id, name, and description. The 'fillable' property specifies which attributes can be mass assigned when creating instances of this model. Additionally, the file mentions that future relationships might be defined within this class.",
"references": [
"Illuminate/Database/Eloquent/Model.php",
"Illuminate/Database/Eloquent/Factories/HasFactory.php"
]
}

{
"summary": "The 'Category.php' file defines the Category model class within the 'App\Models' namespace. This model extends the Eloquent Model class provided by Laravel and uses the HasFactory trait. It represents a category entity with properties such as id, name, and description. The 'fillable' property specifies which attributes can be mass assigned when creating instances of this model. Additionally, the file mentions that future relationships might be defined within this class.",
"references": [
"Illuminate/Database/Eloquent/Model.php",
"Illuminate/Database/Eloquent/Factories/HasFactory.php"
]
}

{
"summary": "The 'Category.php' file defines the Category model class within the 'App\Models' namespace. This model extends the Eloquent Model class provided by Laravel and uses the HasFactory trait. It represents a category entity with properties such as id, name, and description. The 'fillable' property specifies which attributes can be mass assigned when creating instances of this model. Additionally, the file mentions that future relationships might be defined within this class.",
"references": [
"Illuminate/Database/Eloquent/Model.php",
"Illuminate/Database/Eloquent/Factories/HasFactory.php"
]
}

Error parsing LLM response

@hooman-mirghasemi hooman-mirghasemi added the bug Something isn't working label Jun 6, 2024
@hooman-mirghasemi hooman-mirghasemi changed the title [Bug]: Error parsing LLM response [Bug]: Error parsing LLM response in a laravel simple project! Jun 6, 2024
@senko
Copy link
Collaborator

senko commented Jun 6, 2024

@hooman-mirghasemi which LLM was that? The default or you configured a specific one?

The file summary is done just once after the file is changed, but this looks like the response couldn't be parsed so Pythagora retried several times before giving up.

@DaddyWozBucks
Copy link

DaddyWozBucks commented Jun 8, 2024

I got the same error on gpt-4o. It is now stuck in a loop trying to update the plan. Even restarting the process ends up back here

    {
      "description": "Create a Docker setup for the application. Create a `Dockerfile` for the backend and a `docker-compose.yml` file in the project root. Configure the Docker setup to build and run the entire application, including the backend, frontend, and MongoDB database."
    }
  ]
}

[Tech Lead] 
Error parsing LLM response[Pythagora] Would you like to retry the failed request?

@hooman-mirghasemi
Copy link
Author

"agent": {
"default": {
"provider": "openai",
"model": "gpt-4-0125-preview",
"temperature": 0.5
},
"CodeMonkey.describe_files": {
"provider": "openai",
"model": "gpt-3.5-turbo",
"temperature": 0.0
}
},

@banchaa
Copy link

banchaa commented Jun 10, 2024

I'm having a similar issue. After some generation, suddenly the generation stops, resulting in:
Error parsing LLM response[Pythagora] Would you like to retry the failed request?

This happens with the standalone CLI in Debian and gpt-4o.

I could choose [yes], which generates the whole code again usually without success.
Sometimes choosing [yes] and then [no] and then reloading the project from the last step works suddenly. But this process is draining lots of money..

@ChiefGorilla
Copy link

Same issue. Both gpt 4 and local llms

@Global-ti
Copy link

Same error, I got this since the v2 update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

6 participants