Sounds about right, I had a positive experience when I told my local LLM to refactor a function and add a single argument.
I would not dare letting it loose on a whole source file, because it changes random things giving you more code to review.
In my view current LLM’s do a acceptable job with:
- Adding comments
- Writing docstrings
- Writing git commit messages
- Simple tasks on small pieces of code
Browsing the internet will be like playing AI Quake II, you’ll think you are in this alternate universe.