Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Log groups are used to group log streams that share the same retention, monitoring, and access control settings. For instance, you can create a log group for all logs from a particular application or system component.

How to Choose a Log Group?

Mostly we have this log group naming convention by default:

  • fluent-bit-cloudwatch-{cluster_name} → containers' logs

  • fluent-bit-cloudwatch-{cluster_name}-kube → containers' logs from kube-system namespace

  • adot_log_group_name → adot’s logs (turned off be default)

  • /aws/eks/{cluster_name}/cluster → AWS EKS logs (api, scheduler, etc.)

  • /aws/rds/instance/{rds_name}/… → RDS instance logs

AWS CloudWatch Logs Insightshttps://eu-central-1.console.aws.amazon.com/cloudwatch/home?region=eu-central-1#logsV2:logs-insights

...

  1. Querying Logs: You can write queries to extract fields from log data, calculate statistics, sort and filter results, and more.

  2. Visualizing Data: Logs Insights can visualize query results, making it easier to analyze and interpret the data.

  3. Interactive Analysis: You can interactively run queries on your log data, fine-tune them, and see results quickly.

AWS CloudWatch Live Tailhttps://us-west-1.console.aws.amazon.com/cloudwatch/home?region=us-west-1#logsV2:live-tail

Live Tail in CloudWatch Logs allows you to view streaming log data in real-time as it is sent to CloudWatch. This feature is particularly useful for real-time application and system monitoring, troubleshooting, and quickly identifying issues as they occur.

...

Live Tail has these important features:

  1. Real-Time Streaming: Live Tail streams log data as it's sent to CloudWatch Logs without any delay, providing immediate insights into your application or system's behavior.

  2. Search and Filter: You can run queries to filter and search the log data in real-time, which helps in pinpointing specific issues or monitoring certain aspects of your system.

You need to select a log group and can set a filter:

...

Alarms

AWS CloudWatch Alarmshttps://eu-central-1.console.aws.amazon.com/cloudwatch/home?region=eu-central-1#alarmsV2:

...