OBSERVABILITY WITH GRAFANA monitor, control, and visualize your Kubernetes and cloud platforms using the LGTM stack / Rob Chapman, Peter Holmes.
Implement the LGTM stack for cost-effective, faster, and secure delivery and management of applications to provide effective infrastructure solutions Key Features Use personas to better understand the needs and challenges of observability tools users Get hands-on practice with Grafana and the LGTM s...
Saved in:
| Online Access: |
Full Text (via O'Reilly/Safari) |
|---|---|
| Main Authors: | , |
| Format: | eBook |
| Language: | English |
| Published: |
Birmingham, UK :
Packt Publishing Ltd.,
2023.
|
| Edition: | 1st edition. |
| Subjects: |
Table of Contents:
- Cover
- Title Page
- Copyright and Credits
- Contributors
- Table of Contents
- Preface
- Part 1: Get Started with Grafana and Observability
- Chapter 1: Introducing Observability and the Grafana Stack
- Observability in a nutshell
- Case study
- A ship passing through the Panama Canal
- Telemetry types and technologies
- Metrics
- Logs
- Distributed traces
- Other telemetry types
- Introducing the user personas of observers
- Diego Developer
- Ophelia Operator
- Steven Service
- Pelé Product
- Masha Manager
- Introducing the Grafana stack
- The core Grafana stack
- Grafana Enterprise plugins
- Grafana incident response and management
- Other Grafana tools
- Alternatives to the Grafana stack
- Data collection
- Data storage, processing, and visualization
- Deploying the Grafana stack
- Summary
- Chapter 2: Instrumenting Applications and Infrastructure
- Common log formats
- Structured, semi-structured, and unstructured logging
- Sample log formats
- Exploring metric types and best practices
- Metric types
- Comparing metric types
- Metric protocols
- Best practices for implementing metrics
- Tracing protocols and best practices
- Spans and traces
- Tracing protocols
- Best practices for setting up distributed tracing
- Using libraries to instrument efficiently
- Popular libraries for different programming languages
- Infrastructure data technologies
- Common infrastructure components
- Common standards for infrastructure components
- Summary
- Chapter 3: Setting Up a Learning Environment with Demo Applications
- Technical requirements
- Introducing Grafana Cloud
- Setting up an account
- Exploring the Grafana Cloud Portal
- Exploring the Grafana instance
- Installing the prerequisite tools
- Installing WSL2
- Installing Homebrew
- Installing container orchestration tools.
- Installing a single-node Kubernetes cluster
- Installing Helm
- Installing the OpenTelemetry Demo application
- Setting up access credentials
- Downloading the repository and adding credentials and endpoints
- Installing the OpenTelemetry Collector
- Installing the OpenTelemetry demo application
- Exploring telemetry from the demo application
- Logs in Loki
- Metrics in Prometheus/Mimir
- Traces in Tempo
- Adding your own applications
- Troubleshooting your OpenTelemetry Demo installation
- Checking Grafana credentials
- Reading logs from the OpenTelemetry Collector
- Debugging logs from the OpenTelemetry Collector
- Summary
- Part 2: Implement Telemetry in Grafana
- Chapter 4: Looking at Logs with Grafana Loki
- Technical requirements
- Updating the OpenTelemetry demo application
- Introducing Loki
- Understanding LogQL
- LogQL query builder
- An overview of LogQL features
- Log stream selector
- Log pipeline
- Exploring LogQL metric queries
- Exploring Loki's architecture
- Tips, tricks, and best practices
- Summary
- Chapter 5: Monitoring with Metrics Using Grafana Mimir and Prometheus
- Technical requirements
- Updating the OpenTelemetry demo application
- Introducing PromQL
- An overview of PromQL features
- Writing PromQL
- Exploring data collection and metric protocols
- StatsD and DogStatsD
- OTLP
- Prometheus
- SNMP
- Understanding data storage architectures
- Graphite architecture
- Prometheus architecture
- Mimir architecture
- Using exemplars in Grafana
- Summary
- Chapter 6: Tracing Technicalities with Grafana Tempo
- Technical requirements
- Updating the OpenTelemetry Demo application
- Introducing Tempo and the TraceQL query language
- Exploring the Tempo features
- Exploring the Tempo Query language
- Pivoting between data types
- Exploring tracing protocols.
- What are the main tracing protocols?
- Context propagation
- Understanding the Tempo architecture
- Summary
- Chapter 7: Interrogating Infrastructure with Kubernetes, AWS, GCP, and Azure
- Technical requirements
- Monitoring Kubernetes using Grafana
- Kubernetes Attributes Processor
- Kubeletstats Receiver
- Filelog Receiver
- Kubernetes Cluster Receiver
- Kubernetes Object Receiver
- Prometheus Receiver
- Host Metrics Receiver
- Visualizing AWS telemetry with Grafana Cloud
- Amazon CloudWatch data source
- Exploring AWS integration
- Monitoring GCP using Grafana
- Configuring the data source
- Google Cloud Monitoring query editor
- Google Cloud Monitoring dashboards
- Monitoring Azure using Grafana
- Configuring the data source
- Using the Azure Monitor query editor
- Using Azure Monitor dashboards
- Best practices and approaches
- Summary
- Part 3: Grafana in Practice
- Chapter 8: Displaying Data with Dashboards
- Technical requirements
- Creating your first dashboard
- Developing your dashboard further
- Using visualizations in Grafana
- Developing a dashboard purpose
- Advanced dashboard techniques
- Managing and organizing dashboards
- Case study
- an overall system view
- Summary
- Chapter 9: Managing Incidents Using Alerts
- Technical requirements
- Being alerted versus being alarmed
- Before an incident
- During an incident
- After an incident
- Writing great alerts using SLIs and SLOs
- Grafana Alerting
- Alert rules
- Contact points, notification policies, and silences
- Groups and admin
- Grafana OnCall
- Alert groups
- Inbound integrations
- Templating
- Escalation chains
- Outbound integrations
- Schedules
- Grafana Incident
- Summary
- Chapter 10: Automation with Infrastructure as Code
- Technical requirements
- Benefits of automating Grafana.
- Introducing the components of observability systems
- Automating collection infrastructure with Helm or Ansible
- Automating the installation of the OpenTelemetry Collector
- Automating the installation of Grafana Agent
- Getting to grips with the Grafana API
- Exploring the Grafana Cloud API
- Using Terraform and Ansible for Grafana Cloud
- Exploring the Grafana API
- Managing dashboards and alerts with Terraform or Ansible
- Summary
- Chapter 11: Architecting an Observability Platform
- Architecting your observability platform
- Defining a data architecture
- Establishing system architecture
- Management and automation
- Developing a proof of concept
- Containerization and virtualization
- Data production tools
- Setting the right access levels
- Sending telemetry to other consumers
- Summary
- Part 4: Advanced Applications and Best Practices of Grafana
- Chapter 12: Real User Monitoring with Grafana
- Introducing RUM
- Setting up Grafana Frontend Observability
- Exploring Web Vitals
- Pivoting from frontend to backend data
- Enhancements and custom configurations
- Summary
- Chapter 13: Application Performance with Grafana Pyroscope and k6
- Using Pyroscope for continuous profiling
- A brief overview of Pyroscope
- Searching Pyroscope data
- Continuous profiling client configuration
- Understanding the Pyroscope architecture
- Using k6 for load testing
- A brief overview of k6
- Writing a test using checks
- Writing a test using thresholds
- Adding scenarios to a test to run at scale
- Test life cycle
- Installing and running k6
- Summary
- Chapter 14: Supporting DevOps Processes with Observability
- Introducing the DevOps life cycle
- Using Grafana for fast feedback during the development life cycle
- Code
- Test
- Release
- Deploy
- Operate
- Monitor
- Plan.
- Using Grafana to monitor infrastructure and platforms
- Observability platforms
- CI platforms
- CD platforms
- Resource platforms
- Security platforms
- Summary
- Chapter 15: Troubleshooting, Implementing Best Practices, and More with Grafana
- Best practices and troubleshooting for data collection
- Preparing for data collection
- Data collection decisions
- Debugging collector
- Best practices and troubleshooting for the Grafana stack
- Preparing the Grafana stack
- Grafana stack decisions
- Debugging Grafana
- Avoiding pitfalls of observability
- Future trends in application monitoring
- Summary
- Index
- Other Books You May Enjoy.