I compiled what I've learned, implemented, and created over the last few days re: Substrate + Prometheus + Grafana into a short guide. Hopefully, it's helpful to someone(s) as a way to better monitor your node.
https://medium.com/@matthew.marcus/a-better-way-to-monitor-your-parity-substrate-node-e20e129b9f