@nazokiyoubinbou @Viss Exactly
-
Like, depending on what you want to do, it might be as simple as throwing your data into DuckDB and generating some time series graphs with Plotly with a tiny bit of Python in a Jupyter NB, or a dashboard built using Dash. It's been a while since I've done any of that personally, though.
@DaveMWilburn @hrbrmstr im building out orbital and i want graphs for it. i have a fairly robust queuing system and workers and api nodes that are passing jobs around back and forth and i need to see shit like how many jobs are in the queue, what the workers are doing, cpu/ram on the workers and api, etc.. in case i hit scaling issues early (which would be fucking epic), but i refuse to deal with the docker flavored grafana stack. its way way way topheavy
-
@Viss For reference also, it was all supremely trivial to configure. I put up a nuc-style PC with a N95 and 8gb of ram to hold the `graphs and shit` role in my homelab of like ~30 hosts, and it turns out that was WILDLY overspecced for the task. I don't know what kind of black magic VictoriaMetrics does in terms of storage and memory usage, but it's shockingly low.
@mr_daemon youre the second person to mention victoriametrics, and i went and looked at their site and their youtube page but i cant find, like, a simple quickstart guide, or screenshots of it, or a video of someone installing it or anything. does that even exist?
-
@Viss what does librenms use for vis? I always liked theirs
-
@Viss As long as you can push whatever metrics you have into a database/store of your choice, pretty sure you can use Grafana to visualize it.
I just push my metrics to postgres and query from Grafana.
@larsmb i wonder if theres a simple snmp connector for grafana that skips all that other crap
-
@Viss what does librenms use for vis? I always liked theirs
@h2onolan thats a good question - i have no idea. I need to build out some kinda monitoring/alerting system for orbital after this hetzner nonsense. i need to know the instant a scanning node goes away if some cloud host decides they dont ilke me anymore and doesnt say anything first.
-
@Viss Since InfluxDB added some graphing ability to their system in V2, I've not used Grafana.
I find I'm able to run the InfluxDB container, and then telegraf on the sources, and have a much smaller footprint.
-
@larsmb i wonder if theres a simple snmp connector for grafana that skips all that other crap
-
@DaveMWilburn @hrbrmstr im building out orbital and i want graphs for it. i have a fairly robust queuing system and workers and api nodes that are passing jobs around back and forth and i need to see shit like how many jobs are in the queue, what the workers are doing, cpu/ram on the workers and api, etc.. in case i hit scaling issues early (which would be fucking epic), but i refuse to deal with the docker flavored grafana stack. its way way way topheavy
@DaveMWilburn @hrbrmstr chiefly, basic system info. disk, ram, cpu, network usage at a minimum, if its got hooks to showme postres stats, that would be rad, bonus points for it can show me rabbitmq stats.
thats basically it.
i just need dashboard lights for my asm scanning platform so that when i do the big linkedin (urk) post announcing the promo and new pricing, and if i get a swell of new customers, i want to see that shit scale livebyobu is great for that, but no history
-
@mr_daemon youre the second person to mention victoriametrics, and i went and looked at their site and their youtube page but i cant find, like, a simple quickstart guide, or screenshots of it, or a video of someone installing it or anything. does that even exist?
@Viss
I believe they just assume everyone will just use grafana.
As far as working with vicoriametrics, the query syntax is very much like Prometheus, and concepts are similar.
@mr_daemon -
@mr_daemon sweet! thanks man!
-
@Viss
I believe they just assume everyone will just use grafana.
As far as working with vicoriametrics, the query syntax is very much like Prometheus, and concepts are similar.
@mr_daemon -
@mr_daemon @viq the more middleware i can skip the better. so i can light up victoriametrics, and that will squirt data directly into grafana?
-
@mr_daemon
But also similarly you can set up Prometheus directly on a system, without any containers anywhere.
@Viss -
@mr_daemon @viq the more middleware i can skip the better. so i can light up victoriametrics, and that will squirt data directly into grafana?
@Viss @viq Yeah, or rather, you add the VictoriaMetrics server as a data source in grafana and it will read the timeseries from it. You can setup the data source __twice__ as prometheus AND victoriametrics (via the plug in) if you want, which lets you both do graphql and also just straight up use generic prometheus dashboards.
-
@mr_daemon @viq the more middleware i can skip the better. so i can light up victoriametrics, and that will squirt data directly into grafana?
-
@Viss @viq Yeah, or rather, you add the VictoriaMetrics server as a data source in grafana and it will read the timeseries from it. You can setup the data source __twice__ as prometheus AND victoriametrics (via the plug in) if you want, which lets you both do graphql and also just straight up use generic prometheus dashboards.
@mr_daemon @viq oh handy! yeah that sounds like a better layout. Ideally, I'd like to have as streamlined a setup as possible, with the fewest 'things i have to run that expose ports and require systemd' as possible
-
@mr_daemon @viq in my circumstance im looking at like.. maybe five actual servers, all of which are going to be incus container hosts - and since each host is setup to just let any of the containers use all the resources of the box, i dont think i need to go beyond just monitoring the entire server as a whole. i noticed there are rabbitmq plugins which is great, i havent found a postgres one yet (but im sure i just havent looked hard enough)
-
@mr_daemon @viq in my circumstance im looking at like.. maybe five actual servers, all of which are going to be incus container hosts - and since each host is setup to just let any of the containers use all the resources of the box, i dont think i need to go beyond just monitoring the entire server as a whole. i noticed there are rabbitmq plugins which is great, i havent found a postgres one yet (but im sure i just havent looked hard enough)
@mr_daemon @viq oh it looks like incus has a writeup on how to do it: https://linuxcontainers.org/incus/docs/main/metrics/
-
@Viss @viq Yeah, or rather, you add the VictoriaMetrics server as a data source in grafana and it will read the timeseries from it. You can setup the data source __twice__ as prometheus AND victoriametrics (via the plug in) if you want, which lets you both do graphql and also just straight up use generic prometheus dashboards.
@mr_daemon
I've seen people say that VictoriaMetrics is more pleasant to work with. But, for sake of completeness: with Prometheus you have equivalent components in exact same number, places, with same data flow.
@Viss -
@Viss You might have a look at Telegraf to collect metrics, and then shove them into InfluxDB. You can query InfluxDB with Grafana or use Chronograf that comes with the Influx stuff.