docker-compose 搭建 Prometheus+Grafana監控系統

有關監控選型之前有寫過一篇文章: 監控系統選型，一文輕鬆搞定！

監控物件

Linux伺服器
Docker
Redis
MySQL

資料採集

1)、prometheus: 採集資料

2)、node-exporter: 收集作業系統和硬體資訊的metrics

3)、cadvisor : 收集Docker的metrics

4)、redis-exporter: 收集Redis的metrics

5)、 mysql-exporter: 收集MySQL的metrics

報表

grafana: 圖表展示

一、環境搭建

1、MySQL使用者授權

之前想用root賬號嘗試收集MySQL的metrics,但在啟動docker的時候一直報錯：

「Error pinging mysqld" err="Error 1049: Unknown database

後來去官方地址在發現，需要對使用者進行授權才能收集監控資料資訊。

gitHub開源專案有說明: https://github.com/prometheus/mysqld_exporter

所以這裡重新建立使用者並授權。

CREATE USER 'exporter'@'%' IDENTIFIED BY '123456';
GRANT PROCESS, REPLICATION CLIENT ON *.* TO 'exporter'@'%';
GRANT SELECT ON performance_schema.* TO 'exporter'@'%';

注意：建議為使用者設定最大連線限制，以避免在重負載下監控抓取使伺服器過載。

2、設定docker-compose.yml

我在/etc/prometheus建立一個docker-compose.yml檔案,檔案內容如下

version: '2'

networks:
    monitor:
        driver: bridge

services:
    prometheus:
        image: prom/prometheus
        container_name: prometheus
        hostname: prometheus
        restart: always
        volumes:
            - ./prometheus.yml:/etc/prometheus/prometheus.yml
        ports:
            - "9090:9090"
        networks:
            - monitor

    alertmanager:  #預警模組
        image: prom/alertmanager
        container_name: alertmanager
        hostname: alertmanager
        restart: always
        ports:
            - "9093:9093"
        networks:
            - monitor

    grafana:
        image: grafana/grafana
        container_name: grafana
        hostname: grafana
        restart: always
        ports:
            - "3000:3000"
        networks:
            - monitor

    node-exporter:
        image: quay.io/prometheus/node-exporter
        container_name: node-exporter
        hostname: node-exporter
        restart: always
        ports:
            - "9100:9100"
        networks:
            - monitor

    cadvisor:
        image: google/cadvisor:latest
        container_name: cadvisor
        hostname: cadvisor
        restart: always
        volumes:
            - /:/rootfs:ro
            - /var/run:/var/run:rw
            - /sys:/sys:ro
            - /var/lib/docker/:/var/lib/docker:ro
        ports:
            - "8899:8080"
        networks:
            - monitor

    redis-exporter:
        image: oliver006/redis_exporter
        container_name: redis-exporter
        hostname: redis-exporter
        restart: always
        ports:
            - "9121:9121"
        command:
            - "--redis.addr=redis://127.0.0.1:6379"
        networks:
            - monitor

    mysql_xporter:
        image: prom/mysqld-exporter
        container_name: mysql-exporter
        hostname: mysql-exporter
        restart: always
        ports:
            - "9104:9104"
        environment:
            DATA_SOURCE_NAME: 'exporter:123456@(127.0.0.1:3306)'
        networks:
            - monitor

因為這裡prometheus容器的組態檔重新掛載了，掛載到/etc/prometheus/目錄下，所以在該目錄建立好prometheus.yml檔案。

3、設定prometheus.yml

global:
  scrape_interval:     15s
  evaluation_interval: 15s
scrape_configs:
  - job_name: 'prometheus'
    static_configs:
    - targets: ['ip:9090'] //ip為自己伺服器IP
  - job_name: 'cadvisor'
    static_configs:
    - targets: ['ip:8899']
  - job_name: 'node'
    static_configs:
    - targets: ['ip:9100']
  - job_name: 'redis_exporter'
    static_configs:
    - targets: ['ip:9121']
  - job_name: 'mysql_exporter'
    static_configs:
    - targets: ['ip:9104']