Is it just me or are LLM chat bots still useless in many cases?
This recent encounter illustrates that well. It's a simple coding task, where I couldn't by reading the manual figure out in 1 minute whether or not I could get something done with a given project. Hence I asked the following question at phind.com, MS Co-pilot, MS M365 Chat, Llama 3.1 70B (via the Huggingface web interface), chatgpt-o1 preview:
---
I have a recent BMW electric vehicle. I want to programmatically list all charging sessions: I need the charging session's start and end time, with the amount of kWh charged.
I found the bimmer_connected Python module, which may be able to do what I want. Can you check whether that indeed allows to obtain such a list, and if so, suggest some sample Python code.
Be brief, I'll read the code and don't need much explanation.
---
Observations:
- all of them except from chatgtp-o1 preview told me the functionality existed (which, from reading the manual, is not the case; I guess BMW doesn't store extended history and hence doesn't offer an API to obtain such info)
- they all returned code examples with functions that in reality don't exist in the said module
- chatgpt-o1 told me the functionality didn't exist in bimmer_connected, but suggested another Python module named 'MyBMW'. As I couldn't find that easily, I asked the follow-up question where I should find it: the response was that no such Python module existed.
What are your thoughts and experiences?