Grafana dashboard disappeared
Problem: all dashboard disappeared from https://git.nomics.world/-/grafana/
Analysis:
- https://gitlab.com/gitlab-org/omnibus-gitlab/issues/4646
- in short,
gitlab-ce
Debian package backed-up the/var/opt/gitlab/grafana/data/
directory to/var/opt/gitlab/grafana/data.bak.2019-11-04
, resetting thegrafana.db
file (a SQLite database)
Tasks:
-
restore backup -
export all dashboards to data files (JSON or YAML?) -
commit all dashboards to a new Git repository (dbnomics-grafana-dashboards) -
setup grafana to use those dashboards in provisioned mode
Notes:
- we don't add a new datasource to Grafana because the only existing one "GitLab Omnibus" is actually the Prometheus server, which knows about our metrics, because we declared them in
/etc/gitlab/gitlab.rb
Questions:
- will the provisioned mode keep the existing dashboards when upgrading GitLab?
- if not, we could deploy a dedicated instance of Grafana, but that would be a new application to maintain
Actions
Created https://git.nomics.world/dbnomics/dbnomics-grafana-dashboards (cf README.md)