@NefariousCelt @dragonfrog @cstross @ViennaMike
95% agree. I'm currently working an LLM project that is interfacing with something a touch more than home automation. Aside from fine tuning the model and putting constraints on the output (think https://github.com/dottxt-ai/outlines), you can use existing approved software as validation of llm output.
All of this requires in-depth knowlege, patience and exaustive testing.