目錄
8.1.1 SpringCloud Sleuth 是什么
- SpringCloud Sleuth 必知必會
- SpringCloud Sleuth 實作的功能是:它會自動為當前應用構建起各通信通道的跟蹤機制
- 通過諸如 RabbitMQ、Kafka(或者其他任何 SpringCloud Sleuth 系結器實作的訊息中間件)傳遞的請求
- 通過 Zuul、Gateway 代理傳遞的請求
- 通過 RestTemplate 發起的請求
- SpringCloud Sleuth 實作的功能是:它會自動為當前應用構建起各通信通道的跟蹤機制
- SpringCloud Sleuth 跟蹤實作原理
- 為了實作請求跟蹤:當請求發送到分布式系統的入口端點時,只需要服務跟蹤框架為該請求創建一個唯一的跟蹤標識 Trace ID
- 為了統計各處理單元的時間延遲,當請求到達各個服務組件時,或是處理邏輯到達某個狀態時,也通過一個唯一標識來標記它的開始、具體程序以及結束,Span ID
Span ID 如果要計算時間延遲,可以通過 spanIdA11 - spanIdA1
8.1.2 Zipkin 是什么
- Zipkin 的基礎概念
- Zipkin 解決微服務架構中的延遲問題,包括資料的收集、存盤、查找和展現
- Zipkin 有四大核心組件構成
- Collector:收集器組件
- Storge:存盤組件
- API:RESTFul API,提供外部訪問介面
- UI:Web UI,提供可視化查詢頁面
8.2.1 集成 SpringCloud Sleuth 實作微服務通信跟蹤
8.2.1.1 集成步驟
- 保證服務與服務之間存在跨行程通信
- Maven 依賴
8.2.1.2 撰寫測驗代碼
sca-commerce-gateway 與 sca-commerce-alibaba-nacos-client 添加 Maven 依賴
<!-- 通過 Sleuth 實作鏈路跟蹤 -->
<dependency>
<groupId>org.springframework.cloud</groupId>
<artifactId>spring-cloud-starter-sleuth</artifactId>
</dependency>
sca-commerce-alibaba-nacos-client 撰寫測驗業務代碼與控制層代碼
SleuthTraceInfoService
package com.edcode.commerce.service;
import brave.Tracer;
import lombok.RequiredArgsConstructor;
import lombok.extern.slf4j.Slf4j;
import org.springframework.stereotype.Service;
/**
* @author eddie.lee
* @blog blog.eddilee.cn
* @description 使用代碼更直觀的看到 Sleuth 生成的相關跟蹤資訊
*/
@Slf4j
@Service
@RequiredArgsConstructor
public class SleuthTraceInfoService {
/** brave.Tracer 跟蹤物件 */
private final Tracer tracer;
/**
* 列印當前的跟蹤資訊到日志中
*/
public void logCurrentTraceInfo() {
log.info("Sleuth trace id: [{}]", tracer.currentSpan().context().traceId());
log.info("Sleuth span id: [{}]", tracer.currentSpan().context().spanId());
}
}
SleuthTraceInfoController
package com.edcode.commerce.controller;
import com.edcode.commerce.service.SleuthTraceInfoService;
import lombok.RequiredArgsConstructor;
import lombok.extern.slf4j.Slf4j;
import org.springframework.web.bind.annotation.GetMapping;
import org.springframework.web.bind.annotation.RequestMapping;
import org.springframework.web.bind.annotation.RestController;
/**
* @author eddie.lee
* @blog blog.eddilee.cn
* @description 列印跟蹤資訊
*/
@Slf4j
@RestController
@RequestMapping("/sleuth")
@RequiredArgsConstructor
public class SleuthTraceInfoController {
private final SleuthTraceInfoService traceInfoService;
/**
* 列印日志跟蹤資訊
*/
@GetMapping("/trace-info")
public void logCurrentTraceInfo() {
traceInfoService.logCurrentTraceInfo();
}
}
8.2.1.2 測驗請求與查看控制臺日志
發起請求
### 查看 Sleuth 跟蹤資訊
GET http://127.0.0.1:9001/edcode/scacommerce-nacos-client/sleuth/trace-info
Accept: application/json
sca-commerce-user: eyJhbGciOiJSUzI1NiJ9.eyJzY2EtY29tbWVyY2UtdXNlciI6IntcImlkXCI6MTEsXCJ1c2VybmFtZVwiOlwiZWRkaWVAcXEuY29tXCJ9IiwianRpIjoiZjQ3M2NhZjctY2RjMi00ZmE4LWExNzQtZjZhYmQ5ZDFjMzAzIiwiZXhwIjoxNjM1ODY4ODAwfQ.iTtQE2gHzjPxVP5SEFHrDBkvrzI-yt6oy-w1x--Q3ahhTvYLTiYnvndtIx7IIyYipr_ayZnAQyluPt3oiLaS80r9qByaN3zQF-6gBW_wu_fd0yd89hIjPnQeP1mY2NcchV2FaMUW7Jlq8CUDPurEhW4GUDXOqBXgmxai5UTu4yoXBUfyXUXznKTx697cGo5aoVKTAKvMReJg-77n5sQuafZNDu6pz2D1KMvEucNyZtbXw0JRIl1CsK777Jt3IG1bnOnwRBt8o1tkodZ3zJbfgTGVCHJmfEuUnXwdf4DLAq568pNVvylPLh4_r-UUGGxE6Az9XwOtl1w4vzK1M2ATzw
token: edcode
回應資訊
GET http://127.0.0.1:9001/edcode/scacommerce-nacos-client/sleuth/trace-info
HTTP/1.1 200 OK
transfer-encoding: chunked
Content-Type: application/json
Date: Tue, 02 Nov 2021 13:04:55 GMT
{
"code": 0,
"message": "",
"data": null
}
Response code: 200 (OK); Time: 1160ms; Content length: 35 bytes
查看日志
sca-commerce-gateway
2021-11-02 21:04:55.332 INFO [sca-commerce-gateway,353ea734cc43d6ee,353ea734cc43d6ee,true] 1060 --- [ctor-http-nio-2] c.netflix.config.ChainedDynamicProperty : Flipping property: sca-commerce-nacos-client.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647
2021-11-02 21:04:55.347 INFO [sca-commerce-gateway,353ea734cc43d6ee,353ea734cc43d6ee,true] 1060 --- [ctor-http-nio-2] c.netflix.loadbalancer.BaseLoadBalancer : Client: sca-commerce-nacos-client instantiated a LoadBalancer: DynamicServerListLoadBalancer:{NFLoadBalancer:name=sca-commerce-nacos-client,current list of Servers=[],Load balancer stats=Zone stats: {},Server stats: []}ServerList:null
2021-11-02 21:04:55.353 INFO [sca-commerce-gateway,353ea734cc43d6ee,353ea734cc43d6ee,true] 1060 --- [ctor-http-nio-2] c.n.l.DynamicServerListLoadBalancer : Using serverListUpdater PollingServerListUpdater
2021-11-02 21:04:55.372 INFO [sca-commerce-gateway,353ea734cc43d6ee,353ea734cc43d6ee,true] 1060 --- [ctor-http-nio-2] c.netflix.config.ChainedDynamicProperty : Flipping property: sca-commerce-nacos-client.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647
2021-11-02 21:04:55.374 INFO [sca-commerce-gateway,353ea734cc43d6ee,353ea734cc43d6ee,true] 1060 --- [ctor-http-nio-2] c.n.l.DynamicServerListLoadBalancer : DynamicServerListLoadBalancer for client sca-commerce-nacos-client initialized: DynamicServerListLoadBalancer:{NFLoadBalancer:name=sca-commerce-nacos-client,current list of Servers=[192.168.3.192:8000],Load balancer stats=Zone stats: {unknown=[Zone:unknown; Instance count:1; Active connections count: 0; Circuit breaker tripped count: 0; Active connections per server: 0.0;]
},Server stats: [[Server:192.168.3.192:8000; Zone:UNKNOWN; Total Requests:0; Successive connection failure:0; Total blackout seconds:0; Last connection made:Thu Jan 01 08:00:00 CST 1970; First connection made: Thu Jan 01 08:00:00 CST 1970; Active Connections:0; total failure count in last (1000) msecs:0; average resp time:0.0; 90 percentile resp time:0.0; 95 percentile resp time:0.0; min resp time:0.0; max resp time:0.0; stddev resp time:0.0]
]}ServerList:com.alibaba.cloud.nacos.ribbon.NacosServerList@72186c8f
2021-11-02 21:04:55.592 INFO [sca-commerce-gateway,353ea734cc43d6ee,353ea734cc43d6ee,true] 1060 --- [ctor-http-nio-2] c.e.c.filter.GlobalElapsedLogFilter : [/edcode/scacommerce-nacos-client/sleuth/trace-info] elapsed: [1034ms]
2021-11-02 21:04:56.358 INFO [sca-commerce-gateway,,,] 1060 --- [erListUpdater-0] c.netflix.config.ChainedDynamicProperty : Flipping property: sca-commerce-nacos-client.ribbon.ActiveConnectionsLimit to use NEXT property: niws.loadbalancer.availabilityFilteringRule.activeConnectionsLimit = 2147483647
sca-commerce-alibaba-nacos-client
2021-11-02 21:04:55.543 INFO [sca-commerce-nacos-client,353ea734cc43d6ee,c85be2c1bb127558,true] 33740 --- [nio-8000-exec-1] c.e.c.service.SleuthTraceInfoService : Sleuth trace id: [3836687777773377262]
2021-11-02 21:04:55.543 INFO [sca-commerce-nacos-client,353ea734cc43d6ee,c85be2c1bb127558,true] 33740 --- [nio-8000-exec-1] c.e.c.service.SleuthTraceInfoService : Sleuth span id: [-4009361721548180136]
決議:[sca-commerce-nacos-client,353ea734cc43d6ee,c85be2c1bb127558,true]
第一行:service name
第二行:trace id
第三行:span id
8.3.1 搭建 Zipkin Server 實作對跟蹤資訊的收集
8.3.1.1 ZS搭建步驟
- Tips:SpringCloud Finchley 版本(包含)之后,官方不建議自己搭建 Zipkin-Server,提供了已經打包好的jar檔案(SpringBoot工程),直接下載啟動即可
- 下載地址
- curl -sSL https://zipkin.io/quickstart.sh | bash -s
- 選擇自己需要的版本即可
- 選擇 *.exec.jar 結尾的 jar
8.3.1.2 Linux 終端
[root@localhost opt]# curl -sSL https://zipkin.io/quickstart.sh | bash -s
Thank you for trying Zipkin!
This installer is provided as a quick-start helper, so you can try Zipkin out
without a lengthy installation process.
Fetching version number of latest io.zipkin:zipkin-server release...
Latest release of io.zipkin:zipkin-server seems to be 2.23.4
Downloading io.zipkin:zipkin-server:2.23.4:exec to zipkin.jar...
> curl -fL -o 'zipkin.jar' 'https://repo1.maven.org/maven2/io/zipkin/zipkin-server/2.23.4/zipkin-server-2.23.4-exec.jar'
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 59.0M 100 59.0M 0 0 34146 0 0:30:14 0:30:14 --:--:-- 33309
Verifying checksum...
> curl -fL -o 'zipkin.jar.md5' 'https://repo1.maven.org/maven2/io/zipkin/zipkin-server/2.23.4/zipkin-server-2.23.4-exec.jar.md5'
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 32 100 32 0 0 17 0 0:00:01 0:00:01 --:--:-- 17
> md5sum -c <<< "$(cat zipkin.jar.md5) zipkin.jar"
zipkin.jar: OK
Checksum for zipkin.jar passes verification
Verifying GPG signature of zipkin.jar...
> curl -fL -o 'zipkin.jar.asc' 'https://repo1.maven.org/maven2/io/zipkin/zipkin-server/2.23.4/zipkin-server-2.23.4-exec.jar.asc'
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 833 100 833 0 0 91 0 0:00:09 0:00:09 --:--:-- 180
GPG signing key is not known, skipping signature verification.
Use the following commands to manually verify the signature of zipkin.jar:
gpg --keyserver keyserver.ubuntu.com --recv FF31B515
# Optionally trust the key via 'gpg --edit-key FF31B515', then typing 'trust',
# choosing a trust level, and exiting the interactive GPG session by 'quit'
gpg --verify zipkin.jar.asc zipkin.jar
You can now run the downloaded executable jar:
java -jar zipkin.jar
[root@localhost opt]# nohup java -jar zipkin.jar &
[1] 30238
[root@localhost opt]# nohup: ignoring input and appending output to ‘nohup.out’
8.3.1.3 Zipkin Web UI
訪問:IP:9411

8.3.2 配置 Zipkin Server 實作對跟蹤資訊的收集
- 配置 ZS
- 為什么需要對 ZS 做自定義配置?
- 默認情況下, ZS 將 跟蹤資訊存盤在記憶體中(JVM),重啟會丟失
- ZS 默認使用 HTTP 方式上報跟蹤資料,性能較差
- ZS 配置 MySQL 跟蹤資料持久化 (同時它也支持 ES)
- MySQL 中添加資料表:https://github.com/openzipkin/zipkin/blob/master/zipkin-storage/mysql-v1/src/main/resources/mysql.sql
- ZS 啟動指定 MySQL 路徑
- 為什么需要對 ZS 做自定義配置?

8.4.1 SpringCloud Sleuth 整合 Zipkin 實作分布式鏈路跟蹤、收集
-
SpringCloud Sleuth 整合 Zipkin 步驟
- 簡單的兩個步驟(Zipkin Server 使用 MySQL 實作跟蹤資料持久化)
- Maven 依賴
- bootstrap.yml 中增加 Zipkin 的配置
- 簡單的兩個步驟(Zipkin Server 使用 MySQL 實作跟蹤資料持久化)
-
下載、安裝 Kafka
- 下載 Kafka:https://kafka.apache.org/quickstart
- 解壓、啟動 ZK 和 Kafka Server 即可 (使用默認配置)
8.4.1.1 下載與解壓 Kafka
Downloads
https://kafka.apache.org/downloads

Linux 步驟
[root@localhost opt]# wget https://dlcdn.apache.org/kafka/3.0.0/kafka_2.13-3.0.0.tgz
[root@localhost opt]# tar -zxf kafka_2.13-3.0.0.tgz
[root@localhost opt]# ls -la | grep kafka
drwxr-xr-x. 8 root root 134 Nov 3 01:48 kafka_2.13-3.0.0
-rw-r--r--. 1 root root 86396520 Sep 20 04:46 kafka_2.13-3.0.0.tgz
8.4.1.2 啟動 zookeeper 與 Kafka
對外訪問需要修改 Kafka 的 server.properties
找到 advertised.listeners 或者 自行添加 advertised.listeners 指定 IP 地址
[root@localhost kafka_2.13-3.0.0]# vim /opt/kafka_2.13-3.0.0/config/server.properties
advertised.listeners=PLAINTEXT://192.168.3.250:9092
后臺啟動 zookeeper
[root@localhost kafka_2.13-3.0.0]# nohup /opt/kafka_2.13-3.0.0/bin/zookeeper-server-start.sh config/zookeeper.properties &
[1] 31998
[root@localhost kafka_2.13-3.0.0]# nohup: ignoring input and appending output to ‘nohup.out’
后臺啟動 kafka
[root@localhost kafka_2.13-3.0.0]# nohup /opt/kafka_2.13-3.0.0/bin/kafka-server-start.sh config/server.properties &
[1] 32574
[root@localhost kafka_2.13-3.0.0]# nohup: ignoring input and appending output to ‘nohup.out’
8.4.1.3 運行 ZipKin 關聯 Kafka 與 MySQL
[root@localhost opt]# nohup java -DKAFKA_BOOTSTRAP_SERVERS=127.0.0.1:9092 -jar zipkin.jar --STORAGE_TYPE=mysql --MYSQL_USER=root --MYSQL_PASS=123456 --MYSQL_HOST=127.0.0.1 --MYSQL_TCP_PORT=3306 --MYSQL_DB=zipkin &
[1] 601
[root@localhost opt]# nohup: ignoring input and appending output to ‘nohup.out’
連接kafka:-DKAFKA_BOOTSTRAP_SERVERS=127.0.0.1:9092
連接MySQL:–STORAGE_TYPE=mysql --MYSQL_USER=root --MYSQL_PASS=123456 --MYSQL_HOST=127.0.0.1 --MYSQL_TCP_PORT=3306 --MYSQL_DB=zipkin
8.4.1.4 檢查 Linux 服務是否啟動
[root@localhost opt]# ps -aux | grep -E 'nacos|zipkin|kafka|zookeeper'
[root@localhost opt]# netstat -ltnp | grep -E '8848|9092|9411|2181'
tcp6 0 0 :::8848 :::* LISTEN 1932/java
tcp6 0 0 :::9411 :::* LISTEN 601/java
tcp6 0 0 :::9092 :::* LISTEN 32574/java
tcp6 0 0 :::2181 :::* LISTEN 31998/java
8.4.1.4 IDEA 啟動服務與測驗發起請求
Maven 依賴 (zipkin 與 kafka)
<!-- 通過 Sleuth 實作鏈路跟蹤 -->
<!-- <dependency>-->
<!-- <groupId>org.springframework.cloud</groupId>-->
<!-- <artifactId>spring-cloud-starter-sleuth</artifactId>-->
<!-- </dependency>-->
<!-- zipkin = spring-cloud-starter-sleuth + spring-cloud-sleuth-zipkin-->
<dependency>
<groupId>org.springframework.cloud</groupId>
<artifactId>spring-cloud-starter-zipkin</artifactId>
</dependency>
<dependency>
<groupId>org.springframework.kafka</groupId>
<artifactId>spring-kafka</artifactId>
<version>2.5.0.RELEASE</version>
</dependency>
修改 Gateway 與 Nacos-Client 服務的組態檔
spring:
kafka:
bootstrap-servers: ${KAFKA_SERVER:127.0.0.1}:${KAFKA_PORT:9092}
producer:
retries: 3
consumer:
auto-offset-reset: latest
zipkin:
sender:
type: ${ZIPKIN_KAFKA_SENDER:web} # 默認是 web
base-url: http://${ZIPKIN_URL:localhost}:${ZIPKIN_PORT:9411}/
兩個服務都需要添加 kafka 與 zipkin 的連接資訊
啟動服務
- 啟動以下服務
- AuthorityCenterApplication :7000/ # 如果 token 過期,需要重新簽發
- NacosClientApplication :8000/
- GatewayApplication :9001/
請求測驗
sca-commerce-gateway/src/main/resources/http/nacos-client.http
### 查詢服務
GET http://127.0.0.1:9001/edcode/scacommerce-nacos-client/nacos-client/service-instance?serviceId=sca-commerce-gateway
Accept: application/json
sca-commerce-user: eyJhbGciOiJSUzI1NiJ9.eyJzY2EtY29tbWVyY2UtdXNlciI6IntcImlkXCI6MTEsXCJ1c2VybmFtZVwiOlwiZWRkaWVAcXEuY29tXCJ9IiwianRpIjoiMWU1MGI2ZWYtNmUzOS00YmY2LWJlMjktZDc4NWU3NWQyNmY1IiwiZXhwIjoxNjM1OTU1MjAwfQ.P7GxZuMUrgiMUbD4dNYzQiV3A6YkaFpvlzg8cpBdu_hvxqDsVEuuiYODQSzZPQeN3xTQPbJ70zkSY084HV7Vsk929en1lqNiX_dpQEuGSbz2JSPqyJuLZ6v7hRX9GI32sPrZAnaKVXMdeHUXCMMmaS1L3osimSvAlaoDE0n2UukDLgu83xRlL3bddHIJbmFD5BrV6Y-u9d-blqXPOpxFEYkdwS_XrljYiULTH7Olr71TAwODUPdttnmVhHPXB0_dnOG5DZMOC0OxqokHGZJ7CC86paE4TvdNPwqotB6u6zh_d_YCCBWM3t1LmKYB6E_bnz2taL5Q4AYHlRaZZotaAA
token: edcode ## HeaderTokenGatewayFilter
###
8.4.1.5 Zipkin Web UI
如何簡單的使用
打開 http://192.168.3.250:9411

默認 all,然后直接查找,會顯示所有的請求資訊,點擊其中一條
就會看到該請求的所有經過哪些服務,耗時多少
同樣,也可以在終端拿 trace Id:669b59f38adf2c38 去跟蹤鏈路
trace Id 搜索框:669b59f38adf2c38

如何查看服務之間的依賴關系
點擊上方的【依賴】

8.5.1 Spring Cloud Sleuth 設定采樣率、抽樣收集策略
8.5.1.1 Spring Cloud Sleuth 采樣收集
- 收集跟蹤資訊是一把雙刃劍,需要做好權衡
- 收集的跟蹤資訊越多,越能反映出系統的實際運行情況
- 高并發場景下,大量的請求呼叫會產生海量的跟蹤日志資訊,性能開銷太大
開發與測驗環境可以使用高的采樣率,但是生產環境建議不要這么做,
- 可以自由選擇 Zipkin brave 自帶的兩個抽樣策略
- ProbabilityBasedSampler 采樣率策略
- 默認使用的策略,以請求百分比 的方式配置和手機跟蹤資訊:它的默認值為 0.1,代表手機 10% 的請求跟蹤資訊
- spring.sleuth.sampler.probability=0.5
- RateLimitingSampler 抽樣策略
- 限速采集,也就是說它可以用來限制每秒追蹤請求的最大數量,優先級更高
- spring.sleuth.sampler.rate=10 ## 一秒最大只有10個跟蹤策略給采集
- ProbabilityBasedSampler 采樣率策略
8.5.1.2 bootstrap.yml 配置 Sleuth
sca-commerce-alibaba-nacos-client
spring:
sleuth:
sampler:
# RateLimitingSampler 抽樣策略,設定了限速采樣,spring.sleuth.sampler.probability 屬性值無效
rate: 100 # 每秒間隔接受的 trace 量
# Probability 抽樣策略
probability: 1.0 # 采樣比例,1.0 表示 100%, 默認:0.1
8.5.1.3 代碼配置 Sleuth
package com.edcode.commerce.sampler;
import brave.sampler.RateLimitingSampler;
import brave.sampler.Sampler;
import org.springframework.context.annotation.Bean;
import org.springframework.context.annotation.Configuration;
/**
* @author eddie.lee
* @blog blog.eddilee.cn
* @description 使用配置的方式設定抽樣率 (二選一)
*/
@Configuration
public class SamplerConfig {
/**
* 限速采集(推薦)
*/
@Bean
public Sampler sampler() {
return RateLimitingSampler.create(100);
}
// /**
// * 概率采集, 默認的采樣策略, 默認值是 0.1
// */
// @Bean
// public Sampler defaultSampler() {
// return ProbabilityBasedSampler.create(0.5f);
// }
}
代碼與Yaml檔案配置是二選一,方便簡潔肯定是 Yaml配置
限速采集與概率采集無論是代碼還是 Yaml檔案 都是二選一
8.6.1 SpringCloud Sleuth+Zipkin 分布式日志追蹤總結
8.6.1.1 SpringCloud Sleuth+Zipkin 邏輯架構圖
- 跟蹤、收集所涉及的三個組件(模塊)Sleuth、Zipkin、Brave
- 三個組件之間的關系
- Brave 是一個 tracer 庫,提供的是 tracer 介面
- Sleuth 采用了 Brave 作為 tracer 庫
- Sleuth 可以不使用 Zipkin

8.6.1.2 Brave 解讀
-
Brave 的兩個最基本、也是最核心的概念
- trace:以看作是一個邏輯執行程序中的整個鏈條 (可以看作一棵樹)
- span:是 trace 跟蹤的基本單位
-
Brave 中常用的資料結構以及說明
- Tracing:工具類,用于生成 Tracer 類實體
- Tracer:也是工具類,用于生成 Span
- Span:實際記錄每個功能塊執行資訊的類
- TraceContext:記錄 trace 的執行程序中的元資料資訊類
- Propagation:用于在分布式環境或者跨行程條件下的 trace 跟蹤時實作 TraceContext 傳遞的工具類
8.6.1.2 SpringCloud Sleuth 如何實作跨服務Trace 追蹤
- SpringCloud Sleuth 實作跨服務 Trace 追蹤
- SpringCloud Sleuth 和 Brave 提供了很多不同的分布式框架的支持,例如 gRPC、Kafka、HTTP等
轉載請註明出處,本文鏈接:https://www.uj5u.com/qita/348308.html
標籤:其他
