“First AI Software Engineer” Creators Are Accused of Lying
Later, the creator of this task, Felipe “Computer Vision Engineer,” also went to YouTube to point out what the AI did wrong, and there are some crucial details to examine.
First of all, Devin failed the most important part of the job – understanding the problem. You see, the original post said: “I am looking to make inferences with the models in this repository. Your deliverable will be detailed instructions on how to do it in an EC2 instance in AWS. Please provide your estimate to complete this job.”
Felipe couldn’t meet the requirements and match different versions of software, so the AI needed to do it for him. However, Cognition fed only the first sentence to Devin and told it to “figure it out.” Considering the request was in the second part, it’s a significant error on the company’s part, so the AI couldn’t deliver the expected result, naturally.
Source: 80.lv