Application Request Log
This document was translated by GPT-4
Without the need to insert any code into the application, DeepFlow automatically generates request logs for all services.
Database table name: flow_log.l7_flow_log.
# 1. Tags
List of automatically injected tags includes: IP, protocol, port, request/response fields, collection location, process information, cloud resources, K8s resources, and custom K8s labels. Detailed field descriptions are below.
| Name | DisplayName | Description |
|---|---|---|
| _id | UID | |
| time | Time | Round end_time to seconds. |
| region | Region | |
| az | Availability Zone | |
| host | VM Hypervisor | Host running virtual machine. |
| chost | Cloud Host | Including virtual machines |
| vpc | VPC | |
| l2_vpc | Forwarding VPC | VPC where the MAC address is located. |
| subnet | Subnet | |
| router | Router | |
| dhcpgw | DHCP Gateway | |
| lb | Load Balancer | |
| lb_listener | Load Balancer Listener | |
| natgw | NAT Gateway | |
| redis | Redis | |
| rds | RDS | |
| pod_cluster | K8s Cluster | |
| pod_ns | K8s Namespace | |
| pod_node | K8s Node | |
| pod_ingress | K8s Ingress | |
| pod_service | K8s Service | |
| pod_group_type | K8s Workload Type | |
| pod_group | K8s Workload | Such as Deployment |
| pod | K8s POD | |
| service | Service | |
| resource_gl0_type | Type - K8s POD First | Deprecated，please use auto_instance_type. |
| resource_gl0 | Instance - K8s POD First | Deprecated，please use auto_instance. |
| resource_gl1_type | Type - K8s Workload First | Deprecated，please use auto_service_type. |
| resource_gl1 | Instance - K8s Workload First | Deprecated，please use auto_service. |
| resource_gl2_type | Type - K8s Service First | Deprecated，please use auto_service_type. |
| resource_gl2 | Instance - K8s Service First | Deprecated，please use auto_service. |
| auto_instance_type | Type - K8s POD First | The type of 'auto_instance'. |
| auto_instance | Instance - K8s POD First | The instance of IP |
| auto_service_type | Type - K8s Service First | The type of 'auto_service'. |
| auto_service | Instance - K8s Service First | On the basis of 'auto_instance' |
| gprocess | Process | |
| tap_port_host | Tap Port Host | Deprecated，please use capture_nic_host. |
| tap_port_chost | Tap Port Cloud Host | Deprecated，please use capture_nic_chost. |
| tap_port_pod_node | Tap Port K8s Node | Deprecated，please use capture_nic_pod_node. |
| capture_nic_host | Host of Capture NIC | |
| capture_nic_chost | Cloud Host of Capture NIC | |
| capture_nic_pod_node | K8s Node of Capture NIC | |
| host_ip | VM Hypervisor | The management IP address of VM Hypervisor. |
| host_hostname | VM Hypervisor | The hostname of VM Hypervisor. |
| chost_ip | Cloud Host | The primary IP address of Cloud Host. |
| chost_hostname | Cloud Host | The hostname of Cloud Host. |
| pod_node_ip | K8s Node | The primary IP address of K8s Node. |
| pod_node_hostname | K8s Node | The hostname of K8s Node. |
| k8s.label | K8s Label | |
| k8s.annotation | K8s Annotation | |
| k8s.env | K8s Env | |
| attribute | Attribute | |
| cloud.tag | Cloud Tag | |
| os.app | OS APP | |
| ip | IP Address | |
| is_ipv4 | IPv4 Flag | |
| is_internet | Internet IP Flag | Whether the IP address is an external Internet address. |
| protocol | Network Protocol | |
| tunnel_type | Tunnel Type | |
| client_port | Client Port | |
| server_port | Server Port | |
| tcp_seq | TCP Seq | |
| req_tcp_seq | TCP Seq of Request | |
| resp_tcp_seq | TCP Seq of Response | |
| l7_protocol | Application Protocol | |
| l7_protocol_str | Application Protocol | In string. |
| is_tls | TLS | |
| version | Protocol Version | |
| type | Log Type | |
| request_type | Request Type | |
| request_domain | Request Domain | |
| request_resource | Request Resource | |
| request_id | Request ID | |
| response_status | Response Status | |
| response_code | Response Code | |
| response_exception | Response Exception | |
| response_result | Response Result | |
| events | Events | |
| app_service | Application Service | |
| app_instance | Application Instance | |
| endpoint | API Endpoint | |
| process_id | Process ID | |
| process_kname | Kernel Thread Name | |
| trace_id | TraceID | |
| span_id | SpanID | |
| parent_span_id | ParentSpanID | |
| span_kind | Span Kind | From OpenTelemetry. |
| x_request_id | X-Request-ID | |
| x_request_id_0 | Request X-Request-ID | |
| x_request_id_1 | Response X-Request-ID | |
| http_proxy_client | HTTP Client IP | Real client IP before proxy translate. |
| syscall_trace_id | Syscall TraceID | |
| syscall_trace_id_request | Req Syscall TraceID | |
| syscall_trace_id_response | Resp Syscall TraceID | |
| syscall_thread | Syscall Thread | |
| syscall_thread_0 | Req Syscall Thread | |
| syscall_thread_1 | Resp Syscall Thread | |
| syscall_coroutine | Syscall Coroutine | |
| syscall_coroutine_0 | Req Syscall Coroutine | |
| syscall_coroutine_1 | Resp Syscall Coroutine | |
| syscall_cap_seq | Syscall CapSeq | |
| syscall_cap_seq_0 | Req Syscall CapSeq | |
| syscall_cap_seq_1 | Resp Syscall CapSeq | |
| flow_id | Flow ID | |
| start_time | Start Time | Unit: microseconds. Start time of request. |
| end_time | End Time | Unit: microseconds. Start time of response |
| signal_source | Signal Source | |
| tap | Traffic Access Point | Deprecated，please use capture_network_type. |
| capture_network_type | Network Location | The network location for capturing traffic uses a fixed value (Cloud Network) to represent intra-cloud traffic |
| vtap | DeepFlow Agent | Deprecated |
| agent | DeepFlow Agent | |
| nat_source | NAT Source | |
| tap_port | TAP Port Identifier | Deprecated |
| tap_port_name | TAP Port Name | Deprecated |
| tap_port_type | TAP Port Type | Deprecated |
| capture_nic | Capture NIC ID | When the value of tap_port_type is 'Local NIC' |
| capture_nic_name | Capture NIC Name | When the value of tap_port_type is 'Local NIC' |
| capture_nic_type | Capture NIC Type | Indicates the type of traffic collection location |
| tap_side | TAP Side | Deprecated |
| observation_point | Observation Point | The logical location of the collection location in the traffic path |
| biz_type | Business Type |
generate from csv file: l7_flow_log.en
# 2. Metrics
Metrics list: throughput, latency, exceptions. Detailed field descriptions are as follows.
| Field | DisplayName | Unit | Description |
|---|---|---|---|
| request | Request | ||
| response | Response | ||
| session_length | Session Total Bytes | Byte | request_length + response_length. |
| request_length | Request Total Bytes | Byte | |
| response_length | Response Total Bytes | Byte | |
| sql_affected_rows | SQL Affected Rows | Row | |
| direction_score | Direction Score | The higher the score | |
| log_count | Log Count | ||
| error | Error | Client Error + Server Error. | |
| client_error | Client Error | ||
| server_error | Server Error | ||
| error_ratio | Error % | % | Error / Response. |
| client_error_ratio | Client Error % | % | Client Error / Response. |
| server_error_ratio | Server Error % | % | Server Error / Response. |
| response_duration | Response Delay | us | If the log type is Session |
| row | Row Count |
generate from csv file: l7_flow_log.en
# 3. Grafana Dashboard
Based on the aforementioned data, a comprehensive Dashboard can be constructed through Grafana. We have preset an 'Application - Request Log' Dashboard in Grafana, and the effect is as follows:
Application Request Log
You can also visit DeepFlow Online Demo (opens new window) to see the effect.