设为首页收藏本站

ZMX - IT技术交流论坛 - 无限Perfect,追求梦想 - itzmx.com

 找回密码
 注册论坛

QQ登录

只需一步,快速开始

新浪微博账号登陆

只需一步,快速开始

用百度帐号登录

只需两步,快速登录

搜索
查看: 472|回复: 1

测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率,边缘节点磁盘满了的情况,是否能正常不回源站服务器,cdnbest系统

[复制链接]
 成长值: 27500

签到天数: 3547 天

[LV.Master]伴坛终老

发表于 2021/2/21 03:39 | 显示全部楼层 |阅读模式 |Google Chrome 88.0.4324.182|Windows 10
天涯海角搜一下: 百度 谷歌 360 搜狗 有道 雅虎 必应 即刻
测试kangle中间源分发哔哩哔哩网DASH视频缓存命中率,边缘节点磁盘满了的情况,是否能正常不回源站服务器,cdnbest系统


问题:
哔哩哔哩网DASH视频CDN分发在线播放所需,采用10台中间节点采用120TB磁盘缓存进行取源分发到边缘节点,800百台边缘节点采用2TB SSD固态硬盘进行分发到腾讯云CDN阿里云CDN省内节点,最终到用户浏览器页面上进行视频播放,测试边缘节点因磁盘满载是否需要回源的命中率情况

晒一波中间节点服务器120TB配置
185858fnn5hulthuafr0xn.jpg


以下配置均采用VPS进行简化模拟测试环境,边缘节点通过DD命令,塞满硬盘,然后进行缓存观察
中间节点
1.png

边缘节点
2.png

结果:
中间节点成功命中,不进行回源到视频存储服务器,没有产生下行数据
测试数据截图
3.png

未产生回源的中间节点收到日志请求为
  1. 111.58.168.22 - - [20/Feb/2021:19:12:34 +0000] "GET https://www.itzmx.com/post/archives/00/00/test1.zip?v=abcd5 HTTP/1.1" 200 49667056 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[CLT0] 177c0db5dd5-7f3903ad45c0
  2. 111.58.168.22 - - [20/Feb/2021:19:21:28 +0000] "GET https://www.itzmx.com/post/archives/00/05/test1.zip?v=abcd5 HTTP/1.1" 200 50947246 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[CLT0] 177c0e39d82-7f3903ad5380
  3. 111.58.168.22 - - [20/Feb/2021:19:29:25 +0000] "GET https://www.itzmx.com/post/archives/00/21/test1.zip?v=abcd5 HTTP/1.1" 200 54472749 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[CLT0] 177c0eaf9c2-7f3903ad4ac0
复制代码



产生回源的中间节点收到日志请求为
  1. 111.58.168.22 - - [20/Feb/2021:19:17:37 +0000] "GET https://www.itzmx.com/post/archives/00/04/test1.zip?v=abcd5 HTTP/1.1" 200 8335064 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT396] 177c0e03347-7f3903ad4980
  2. 111.58.168.22 - - [20/Feb/2021:19:19:40 +0000] "GET https://www.itzmx.com/post/archives/00/02/test1.zip?v=abcd5 HTTP/1.1" 200 52349458 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT487] 177c0e1ef6f-7f3903ad5b00
  3. 111.58.168.22 - - [20/Feb/2021:19:20:42 +0000] "GET https://www.itzmx.com/post/archives/00/12/test1.zip?v=abcd5 HTTP/1.1" 200 60939918 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT533] 177c0e2d94c-7f3903ad5d80
  4. 111.58.168.22 - - [20/Feb/2021:19:26:55 +0000] "GET https://www.itzmx.com/post/archives/00/13/test1.zip?v=abcd5 HTTP/1.1" 200 54231200 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT2882] 177c0e8a488-7f3903ad59c0
  5. 111.58.168.22 - - [20/Feb/2021:19:27:35 +0000] "GET https://www.itzmx.com/post/archives/00/07/test1.zip?v=abcd5 HTTP/1.1" 200 57214345 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT398] 177c0e9478c-7f3903ad5d80
  6. 111.58.168.22 - - [20/Feb/2021:19:28:54 +0000] "GET https://www.itzmx.com/post/archives/00/48/test1.zip?v=abcd5 HTTP/1.1" 200 50995649 "https://www.itzmx.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36"[SULT2037] 177c0ea7711-7f3903ad5d80
复制代码



可以观察到未产生回源的日志[CLT0]标识
和产生回源的日志标识[SULT396]、[SULT487]、[SULT533]、[SULT2882]、[SULT398]、[SULT2037]的区别,猜测后几位数为文件校验码?不过我测了MD5,SHA1,CRC32均不对,可能是随机数,搭建的测试服务器观察到有3到4位


关于kangle日志标识代号的一些疑问
https://bbs.itzmx.com/thread-94114-1-1.html

欢迎光临IT技术交流论坛:http://bbs.itzmx.com/
回复

使用道具 举报

签到天数: 1063 天

[LV.10]以坛为家III

发表于 2021/2/21 20:22 | 显示全部楼层 |Google Chrome 88.0.4324.182|Windows 10
欢迎光临IT技术交流论坛:http://bbs.itzmx.com/
回复 支持 反对

使用道具 举报

您需要登录后才可以回帖 登录 | 注册论坛 新浪微博账号登陆用百度帐号登录

本版积分规则

手机版|Archiver|Mail me|网站地图|IT技术交流论坛 ( 闽ICP备13013206号-7 )

GMT+8, 2021/9/19 13:43 , Processed in 0.144818 second(s), 22 queries , MemCache On.

Powered by itzmx! X3.4

© 2011- sakura

快速回复 返回顶部 返回列表