讀書筆記:Fuxi: a Fault-Tolerant Resource Management and Job Scheduling System at Internet Scale
此文是關於阿裏雲伏羲平台的論文,一些感興趣的點:
Fuxi:a resouce management and job scheduling system. (我感覺是基於YARN做的,很像YARN)
1, An incremental resource management protocol
2, A user-transparent failure recovery
3, A effective (faulty-node) detection mechanism and a mlti-level blacklisting schema
Fuxi (FuxiMaster, AppMaster, Tubo) <>YARN(ResourceManager, AppMaster, NodeManager)
Fuxi 與 YARN區別:
1,Fuxi seperates the notion of task(the application process that performs the actual work) and container(the unit of resource grant). Once an application master receives an grant , it explicitly controls its life-cycle and may reuse the container to run multiple tasks.
2,Lcality tree based scheduling.
最後更新:2017-08-19 01:33:16