Prometheus monitoring
Use Prometheus with W&B Server. Prometheus installs are exposed as a kubernetes ClusterIP service.
info
Prometheus monitoring is only available with Self-managed instances.
Follow the procedure below to access your Prometheus metrics endpoint (/metrics
):
- Connect to the cluster with Kubernetes CLI toolkit, kubectl. See kubernetes' Accessing Clusters documentation for more information.
- Find the internal address of the cluster with:
kubectl describe svc prometheus
Start a shell session inside your container running in your Kubernetes cluster with
kubectl exec
. Hit the endpoint at<internal address>/metrics
.Copy the command below and execute it in your terminal and replace
<internal address>
with your internal address:kubectl exec <internal address>/metrics
The previous command will start a dummy pod that you can exec into just to access anything in the network with:
kubectl run -it testpod --image=alpine bin/ash --restart=Never --rm
From there you can choose to keep access internal to the network or expose it yourself with a kubernetes nodeport service.