블로그 구독

Opening the Pandora Box with Observability - Blog Series

The Five Pillars of OpenShift Observability

Red Hat OpenShift Observability aims at turning your data into answers. Not only are we working toward facilitating metrics, traces, and logs collection/storage, but also to aggregate them, normalize them, transport them in a flexible way - as well as to assess the health of your cluster(s) with intuitive and efficient user interfaces. A summary of our current offering is provided in the diagram below. 

With the OpenShift Monitoring 4.12 and Logging 5.6 releases, we continuously work toward delivering a unified, consistent, and simplified Observability experience across any footprint: cloud, on-prem, and edge - putting equal emphasis on all the five pillars of Red Hat OpenShift Observability: (i) Data Collection, (ii) Data Storage, (iii) Data Delivery, (iv) Data Visualization, and (v) Data Analytics. In the next section, let’s take a closer look at the features included in the upcoming releases and what, as users, you can expect next.

image1-Jan-09-2023-03-40-28-5353-PM

What are the problems you can now solve with Observability?

From a Data Collection point of view, with Logging 5.6, Vector - as an alternate collector to Fluentd - is now GA. For an overview of the benefits coming from adopting Vector, take a look at our Logging 5.5 release blog. Vector further consolidates our OpenShift Logging Architecture, providing users with great flexibility (see flowchart below). Given its scalability, vendor-neutrality, flexible configuration options, and less memory consumption, Vector makes collecting, transforming, and sending logs, metrics, and events very easy.

From a Monitoring standpoint, to improve data consistency in the collection phase, Thanos Querier is now being employed as backend to get metrics for the prometheus-adapter (e.g., prometheus-adapter CPU and RAM time series). Prior to this, Platform Prometheus was used. Because of this specific design, users would receive metrics from two different Prometheus instances, which, not having replicated data, might have provided different results. 

 

In regard to Data Storage, with Logging 5.6 we have exposed stream-based retention capabilities in the Loki Stack. For stream-based retention, retention in Loki has always been global for a cluster and deferred to the underlying object store. With Loki v2.3.0, Loki can do retention through the Loki Compactor, and can enable retention configuration per tenant and per stream.

With OpenShift Monitoring 4.12, users have now the option to specify topology spread constraints for Prometheus, Alertmanager, and Thanos Ruler - improving the overall Data Storage experience. By having better control on how pods are spread across users’ clusters, the protection against node or zonal failures is strengthened. Pod topology spread constraints are suitable for controlling pod scheduling within hierarchical topologies where nodes are spread across different infrastructure levels, such as regions and zones within those regions. Additionally, by being able to schedule pods in different zones, you can improve network latency in certain scenarios. 

Along with this feature, admins can now also create new alerting rules based on platform metrics, improving the management of alert rules. With OpenShift Monitoring 4.12, this feature is available in Tech Preview.

What about data aggregation, normalization, and transportation? With the Logging 5.6 release, you can now benefit from the support provided for forwarding logs to Splunk. In 2022, not only have we provided support for forwarding logs to Google Cloud Logging, but also included CloudWatch log forwarding add-on, supporting STS installations. These features make the overall Logging Data Delivery experience more customizable, thus more versatile for users and their use cases. 

From a Data Visualization perspective, with OpenShift 4.12, logs can now also be explored via the Developer Perspective of the OpenShift Web Console. Under the Observe > Aggregated Logs tab, you can easily search, filter, and visualize logs by severity and quickly identify issues related to your cluster(s). Predefined filters, such as pod and container, have also been added to facilitate the search of logs. Take a look at the demo for a snapshot of these new features.

 

Along with these new logging capabilities, in the OpenShift Web Console we now also support Alertmanager’s negative matchers for silencing alerts. This new feature provides greater flexibility to Web Console users when it comes to managing silences. The demo below provides an overview of this functionality in the OpenShift Web Console.

 

With every release, we also keep working toward improving user navigation. With OpenShift 4.12, Web Console users can now easily make use of runbooks URLs for alerts via the Alerting UI. This means that if an alert includes a runbook_url label, users will be able to access the runbook information by clicking on the alert and rapidly address issues. Briefly, this new feature helps reduce the time spent on debugging activities - facilitating interactive Data Analytics. Moreover, from a logging perspective, you can now also add the OpenShift cluster ID to log records to uniquely identify clusters in aggregated logs, increasing the control that you have on the data.

What are we planning next for Observability?

We are working on emphasizing all five pillars of Red Hat Observability and gradually moving away from siloed observability pillars. As we acknowledge the importance of providing a customizable Observability experience, our magic formula continues to be flexibility. That is why we are expanding third party integration opportunities. 

Along with establishing partnerships, we aim at extracting value from all observability signals. To achieve this, we are working on a series of initiatives, including providing log-based alerts and enhancing the Dashboards UI in the OpenShift Web Console. Briefly, we are planning to deliver a 360-degree OpenShift Observability experience, where all observability pillars are complementary to one another.

Are you curious to learn more about our roadmap? Do you need more information on how to open the Pandora Box with Observability? Interested in learning more about Data Visualization and Analytics opportunities? Do not hesitate to get in touch with Red Hat’s Field Organization for more information and support or drop us an email for any questions you may have on the upcoming features. Stay tuned for more blogs and welcome aboard to our new OpenShift Observability journey!


저자 소개

Roger Florén, a dynamic and forward-thinking leader, currently serves as the Principal Product Manager at Red Hat, specializing in Observability. His journey in the tech industry is marked by high performance and ambition, transitioning from a senior developer role to a principal product manager. With a strong foundation in technical skills, Roger is constantly driven by curiosity and innovation. At Red Hat, Roger leads the Observability platform team, working closely with in-cluster monitoring teams and contributing to the development of products like Prometheus, AlertManager, Thanos and Observatorium. His expertise extends to coaching, product strategy, interpersonal skills, technical design, IT strategy and agile project management.

Read full bio

Jamie Parker is a compliance and privacy expert within Red Hat's products and technologies organization. She is passionate about data protection and privacy. Before joining Red Hat, Parker spent 12 years at Cisco Systems transforming business processes. Her focus was policy governance, regulatory compliance, internal audit, customer data protection, and privacy.

 
Read full bio

Vanessa is a Senior Product Manager in the Observability group at Red Hat, focusing on both OpenShift Analytics and Observability UI. She is particularly interested in turning observability signals into answers. She loves to combine her passions: data and languages.

Read full bio

채널별 검색

automation icon

오토메이션

기술, 팀, 인프라를 위한 IT 자동화 최신 동향

AI icon

인공지능

고객이 어디서나 AI 워크로드를 실행할 수 있도록 지원하는 플랫폼 업데이트

open hybrid cloud icon

오픈 하이브리드 클라우드

하이브리드 클라우드로 더욱 유연한 미래를 구축하는 방법을 알아보세요

security icon

보안

환경과 기술 전반에 걸쳐 리스크를 감소하는 방법에 대한 최신 정보

edge icon

엣지 컴퓨팅

엣지에서의 운영을 단순화하는 플랫폼 업데이트

Infrastructure icon

인프라

세계적으로 인정받은 기업용 Linux 플랫폼에 대한 최신 정보

application development icon

애플리케이션

복잡한 애플리케이션에 대한 솔루션 더 보기

Original series icon

오리지널 쇼

엔터프라이즈 기술 분야의 제작자와 리더가 전하는 흥미로운 스토리