• Release Notes

v6.2 CE Release Notes

This document was translated by GPT-4

# 1. v6.2.6.5 [May 17, 2023]

# 1.1 New Features (GA)

  • AutoTracing
    • Provides a trace completion API tracing-completion-by-external-app-spans: the caller inputs a group of APP Spans (no need to be stored in DeepFlow), obtains their upstream and downstream SYS/NET Spans, thereby enhancing the tracing capacity of traditional APM for infrastructure and untracked services. Detailed Documentation
  • WASM Plugin
    • Adds a new WebAssembly Plugin mechanism, enhancing the capability to parse private protocols and standard protocol field. Detailed Documentation

# 1.2 Optimization

N/A

# 2. v6.2.6.4 [May 10, 2023]

# 2.1 New Features (GA)

N/A

# 2.2 Optimization

  • Refactors application protocol parsing (metric generation) process, making it easier to add new protocols.

# 3. v6.2.6.3 [April 27, 2023]

# 3.1 New Features (GA)

  • AutoTagging
    • Supports adding cloud.tag labels for attached K8s Namespace of the container cluster.
  • PromQL

# 3.2 Optimization

# 4. v6.2.6.2 [April 20, 2023]

# 4.1 New Features (GA)

  • AutoTracing
    • Adds file IO event data and associates it with the tracing logs.

# 4.2 Optimization

  • Management
    • Automatically deletes an Agent when its disconnection time exceeds vtap_auto_delete_interval. The deletion happens by default once the disconnection exceeds 1 hour.

# 5. v6.2.6.1 [April 13, 2023]

# 5.1 New Features (GA)

  • AutoTagging
    • Adds support for K8s Service for the Custom Tag field k8s.label.
  • PromQL
    • Supports querying Prometheus RemoteWrite metrics via PromQL.
    • Supports using DeepFlow Universal Tag when querying Prometheus metrics.
  • Grafana
    • Prometheus Dashboard can now be used as data source for DeepFlow without modification.
    • In Query Editor, supports referencing the $__interval variable for Math operator.

# 5.2 Optimization

  • AutoTagging
    • Only associates the smallest lexical service when a K8s Pod works as a backend for multiple K8s Services.
  • Compatibility
    • Adds two configurations for Huawei's public cloud: domain name and IAM authorization address to adapt to HCSO scenarios.
  • Debug
    • deepflow-server supports monitoring itself through continuous profiling.

# 6. v6.2.6 [April 6, 2023]

# 6.1 New Features (GA)

  • Universal Service Map
    • Supports displaying application topology as groups by Custom Tag (e.g. k8s.label.xxx).
    • Helps filter monitored process list using parent process name (static_config.os-proc-regex.match-type = parent_process_name), simplifying configuration complexity. FR-028-Xiaomi (opens new window)
    • Synchronizes only processes with tags, reducing the number of processes synchronized. FR-034-Xiaomi (opens new window) Thanks to @eddietanshuo for the contribution. PR-2974 (opens new window)
  • AutoTagging
    • Adds three Universal Tags: tap_port_host, tap_port_chost, tap_port_pod_node, representing host, cloud server, and container node where the network interface belongs, respectively.
  • Grafana
    • When defining Variable, supports referring to another Variable.
  • OTLP

# 6.2 Optimization

  • Compatibility
    • eBPF program supports auto-adapting kernel offsets using BTF files.
  • Management
    • Supports the unified setting of additional network interfaces for the cloud platform's attached container clusters to be synchronized.
  • Debug
    • All DeepFlow's self-monitoring metrics collect intervals reduced to 10 seconds.
    • Embed eBPF data source information (syscall, go-tls, go-http2, openssl, io-event) in the tap_port field, enhancing debug capability.

# 7. v6.2.5 [March 21, 2023]

# 7.1 New Features (Alpha)

  • Universal Service Map
    • Added Direction Score metrics. The higher the score, the more accurate the client and server direction. When the score is 255, the direction is definitely correct.
  • Querier API
    • Supports using the labels automatically injected by DeepFlow AutoTagging when querying Prometheus native metrics with PromQL.

# 7.2 New Features (GA)

  • Universal Service Map
  • Integration
    • Aggregates OpenTelemetry Span data into service and path metrics.
  • AutoTagging
    • Prioritizes grouping by processes when unable to group by Pod for auto_service and auto_instance (resource_glX).

# 7.3 Optimization

  • Management
    • Supports configuring data storage duration at an hourly granularity.
    • Supports unified setting for additional docking network interface for all hosted K8s clusters under a public cloud account.
    • Provides two types of deepflow-agent binary package: dynamically linked and statically linked. The former depends on the glibc dynamic library, while the latter shows noticeable lock contention during malloc/free in a multi-threaded environment.
  • Querier API
    • The Category of custom type Tags (k8s.label/cloud.tag/os.app) is uniformly labeled map_item.

# 8. v6.2.4 [March 7, 2023]

# 8.1 New Features (Alpha)

  • Integration
    • Aggregates OpenTelemetry Span data into service and path metrics in advance.
  • AutoTagging
    • Supports batch entry of information for load balancers and their listeners. FR-022-Xiaomi (opens new window)
    • Prioritizes grouping by processes when unable to group by Pod for auto_service and auto_instance (resource_glX).

# 8.2 New Features (GA)

  • AutoTagging
  • SQL API
    • Supports SLIMIT parameter to limit the series amount returned in the result.

# 8.3 Optimization

  • AutoTagging
    • Process level application topology adapted to port reuse scenarios. ISSUE-#2394 (opens new window)
    • Field Renaming: Renaming resource_gl0 to auto_instance, and resource_gl2 to auto_serivce.
  • Management
    • Supports configuration deepflow-agent list k8s-apiserver time interval.
    • Supports specifying the Hostname for the deepflow-agent's environment.

# 9. v6.2.3 [February 21, 2023]

# 9.1 New Features (Alpha)

  • SQL API
    • Introduced new SLIMIT parameter to limit the series amount returned in the result.

# 9.2 New Features (GA)

  • Universal Service Map
  • AutoTagging
    • Process automatically inherits metadata (os_app label) of its parent process. FR-024-Xiaomi (opens new window)
    • Supports synchronizing resource information of Baidu Cloud Intelligent Network (CSN).
  • Grafana
    • Adds Grafana backend plugin module, supporting standard Grafana alert strategy configuration.

# 9.3 Optimization

  • Management
    • Remote upgrade deepflow-agent on cloud server can be completely carried out through deepflow-ctl without manually mounting hostPath for deepflow-server.
  • AutoTagging
    • Adapts to resource information synchronization of K8s 1.18 and 1.20.
  • SQL API
    • When getting optional values of enum type Tag field, it returns corresponding description information.

# 10. v6.2.2 [February 7, 2023]

# 10.1 New Features (GA)

  • AutoTracing
    • Supports zero-code-injection distributed tracing for Golang applications
  • AutoTagging
    • Supports adding custom metadata for processes, cloud servers, and K8s Namespaces FR-001-Xiaomi (opens new window)
    • Supports automated synchronization of K8s cluster information under AWS and AliCloud accounts.
  • Management

# 10.2 Optimization

  • deepflow-agent
    • The process scanning regular expression list (os-proc-regex) supports configuring action=drop for ignore semantics. FR-010-Xiaomi (opens new window)
    • Supports running in Linux Kernel environment lower than version 3.0. FR-012-Xiaomi (opens new window)
    • Using operating system's socket information to correct the direction of flow log. FR-011-Xiaomi (opens new window)
    • Supports automatic update of agent's corresponding information when the ctrl_ip or ctrl_mac of the agent running environment changes.
  • deepflow-server
    • Sets the status field of l4_flow_log to normal when the UDP stream timeouts.

# 11. v6.2.1 [January 17, 2023]

# 11.1 New Features (Alpha)

  • Universal Service Map
  • AutoTagging
    • Supports adding custom metadata for processes, cloud servers, and K8s Namespaces FR-001-Xiaomi (opens new window)
    • Supports automated synchronization of K8s cluster information under AWS and AliCloud accounts.
    • Supports synchronization of resource information of Baidu Cloud Intelligent Network (CSN).
  • Querier API
    • Supports PromQL
  • Management

# 11.2 Optimization

  • Querier API
    • Supports returning original column names before AS.
  • Grafana
    • Optimizes the Variable of Enum type to prevent it from expanding all candidate values when selecting All.

# 12. v6.2.0 [December 29, 2022]

# 12.1 New Features (Alpha)

  • AutoTracing
    • Supports zero-code-injection distributed tracing for Golang applications
  • Universal Service Map