Docker & MonitoringPersonal Project• AWS EC2 Docker Host

CloudOps Sentinel: Docker Fleet & Infrastructure Cockpit

Full-stack operational monitoring dashboard providing real-time server cluster metrics, Docker container lifecycle controls, and automated database retention routines.

Stack:
DockerDocker
ReactReact
Node.jsNode.js
Express.jsExpress
SQLiteSQLite
Node.jsPM2
Section 01

Executive Overview & Context

CloudOps Sentinel is a full-stack infrastructure cockpit engineered to monitor fleet metrics, supervise Docker containers, and automate backup cycles. Features real-time CPU/memory meters, Docker container start/stop/restart management, automated SQLite database retention with pre-cleanup SQL dumps, and Trivy CVE report ingestion.

Deployment Target
AWS EC2 Docker Host
Production Status
Personal Project Verified
Primary Objective
Automated & Hardened

Project Objectives

1. Build authenticated telemetry endpoints interfacing with the Linux kernel and Docker socket. 2. Render live CPU, RAM, disk, and container lifecycle telemetry in a React dashboard. 3. Automate SQLite database retention routines with pre-cleanup SQL dumps. 4. Ingest and display Trivy vulnerability trends.

The Problem

Challenges & Pain Points

Replaced disjointed command-line utilities (docker ps, htop, df, systemctl) with a consolidated, secure web cockpit for swift diagnosis during incident responses.

The Solution

Engineered Implementation

Built a Node.js/Express backend communicating directly with /proc system statistics and the Docker UNIX domain socket (/var/run/docker.sock). Connected to a React single-page frontend with responsive metric cards, chart visualizations, and process controls.

Capabilities

Key Engineering Features

Real-time server cluster metric telemetry and storage volume consumption graphs
Docker container fleet health monitoring and restart management
Automated scheduled SQLite database retention and pre-cleanup SQL dumps
Role-based authenticated administrative login protecting monitoring endpoints
Trivy CVE scan report ingestion and vulnerability trend charts
Architecture

System Topology & Traffic Flow

React dashboard client → Role-gated Node.js REST API → Linux /proc telemetry & Docker Engine socket (/var/run/docker.sock) → Local SQLite persistent store.

Inspect Detailed Cloud & Security Architecture

Explore full multi-layer topology, live active ports, security controls, and verified repository evidence in the Architecture Explorer.

Engineering Notes

Implementation Details & Workflow

Implemented Node.js child-process supervisors and stream readers to process /proc/stat, /proc/meminfo, and Docker socket events without CPU-intensive polling.

CI/CD & Automation Pipeline

Continuous integration runs automated Dockerfile linting (Hadolint), vulnerability scans with Trivy, and unit tests validating API endpoint authentication.

Security & Hardening Controls

Secured access to /var/run/docker.sock by running the service within a dedicated group with least-privilege POSIX permissions. Implemented JWT token expiration and rate limiting.

Tech Stack

Technologies & Cloud Services

Docker
DockerDocker
React
ReactReact
Node.js
Node.jsNode.js
Express.js
ExpressExpress.js
SQLite
SQLiteSQLite
Node.js
PM2Node.js
Nginx
NginxNginx
Trivy
TrivyTrivy
GitHub Actions
GitHub ActionsGitHub Actions
Impact & Outcomes

Measurable Results

Sub-second container state discovery and metric refresh without noticeable CPU overhead on host infrastructure.

Lessons & Challenges Solved

Preventing SQLite database bloat over long monitoring runs was achieved by implementing an automated 30-day retention pruning job with automatic vacuuming.