Per a user request, I put together a PHAL plugin that saves JSON output from conversation messages to a JSONL file in ~/.cache/transcriptions. Right now it logs recognizer_loop:wakeword, recognizer_loop:utterance, and speak, so you can start to detect trends, false activations, and possible areas of skill improvement/gaps.
PRs are always welcome and so are issues. Hope you enjoy!