ZMX - IT技术交流论坛 - 无限Perfect，追求梦想 - itzmx.com

标题: 测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率，边缘节点磁盘满了的情况，是否能正常不回源站服务器，cdnbest系统 [打印本页]

---

作者: 小樱    时间: 2021/2/21 03:39
标题: 测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率，边缘节点磁盘满了的情况，是否能正常不回源站服务器，cdnbest系统
测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率，边缘节点磁盘满了的情况，是否能正常不回源站服务器，cdnbest系统


问题：
哔哩哔哩网DASH视频CDN分发在线播放所需，采用10台中间节点采用120TB磁盘缓存进行取源分发到边缘节点，800百台边缘节点采用2TB SSD固态硬盘进行分发到腾讯云CDN或阿里云CDN省内节点，最终到用户浏览器页面上进行视频播放，测试边缘节点因磁盘满载是否需要回源的命中率情况

晒一波中间节点服务器120TB配置
(, 下载次数: 3)

上传

点击文件名下载附件


以下配置均采用VPS进行简化模拟测试环境，边缘节点通过DD命令，塞满硬盘，然后进行缓存观察
中间节点
(, 下载次数: 3)

上传

点击文件名下载附件

边缘节点
(, 下载次数: 3)

上传

点击文件名下载附件

结果：
中间节点成功命中，不进行回源到视频存储服务器，没有产生下行数据
测试数据截图
(, 下载次数: 3)

上传

点击文件名下载附件

未产生回源的中间节点收到日志请求为

1. 111.58.168.22 - - [20/Feb/2021:19:12:34 +0000] "GET https://www.itzmx.com/post/archives/00/00/test1.zip?v=abcd5 HTTP/1.1" 200 49667056 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[CLT0] 177c0db5dd5-7f3903ad45c0
   
2. 111.58.168.22 - - [20/Feb/2021:19:21:28 +0000] "GET https://www.itzmx.com/post/archives/00/05/test1.zip?v=abcd5 HTTP/1.1" 200 50947246 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[CLT0] 177c0e39d82-7f3903ad5380
   
3. 111.58.168.22 - - [20/Feb/2021:19:29:25 +0000] "GET https://www.itzmx.com/post/archives/00/21/test1.zip?v=abcd5 HTTP/1.1" 200 54472749 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[CLT0] 177c0eaf9c2-7f3903ad4ac0

复制代码

产生回源的中间节点收到日志请求为

1. 111.58.168.22 - - [20/Feb/2021:19:17:37 +0000] "GET https://www.itzmx.com/post/archives/00/04/test1.zip?v=abcd5 HTTP/1.1" 200 8335064 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT396] 177c0e03347-7f3903ad4980
   
2. 111.58.168.22 - - [20/Feb/2021:19:19:40 +0000] "GET https://www.itzmx.com/post/archives/00/02/test1.zip?v=abcd5 HTTP/1.1" 200 52349458 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT487] 177c0e1ef6f-7f3903ad5b00
   
3. 111.58.168.22 - - [20/Feb/2021:19:20:42 +0000] "GET https://www.itzmx.com/post/archives/00/12/test1.zip?v=abcd5 HTTP/1.1" 200 60939918 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT533] 177c0e2d94c-7f3903ad5d80
   
4. 111.58.168.22 - - [20/Feb/2021:19:26:55 +0000] "GET https://www.itzmx.com/post/archives/00/13/test1.zip?v=abcd5 HTTP/1.1" 200 54231200 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT2882] 177c0e8a488-7f3903ad59c0
   
5. 111.58.168.22 - - [20/Feb/2021:19:27:35 +0000] "GET https://www.itzmx.com/post/archives/00/07/test1.zip?v=abcd5 HTTP/1.1" 200 57214345 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT398] 177c0e9478c-7f3903ad5d80
   
6. 111.58.168.22 - - [20/Feb/2021:19:28:54 +0000] "GET https://www.itzmx.com/post/archives/00/48/test1.zip?v=abcd5 HTTP/1.1" 200 50995649 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT2037] 177c0ea7711-7f3903ad5d80

复制代码

可以观察到未产生回源的日志[CLT0]标识
和产生回源的日志标识[SULT396]、[SULT487]、[SULT533]、[SULT2882]、[SULT398]、[SULT2037]的区别，猜测后几位数为文件校验码？不过我测了MD5，SHA1，CRC32均不对，可能是随机数，搭建的测试服务器观察到有3到4位


关于kangle日志标识代号的一些疑问
https://bbs.itzmx.com/thread-94114-1-1.html

---

作者: 不可名    时间: 2021/2/21 20:22

---

欢迎光临 ZMX - IT技术交流论坛 - 无限Perfect，追求梦想 - itzmx.com (https://bbs.itzmx.com/)

Powered by Discuz! X3.4