Energy-efficient Hadoop green scheduler

The problems of energy consumption controlling of data center is the hot spot on big data, cloud computing and green computing. In this paper we construct an energy consumption controlling frame of Xen virtual machines on Hadoop from the perspective of Hadoop scheduler: first, we propose an energy calculation model to calculate the energy consumption of tasks running in a virtual environment via which we can implement the real-time energy consumption measurement of physical machine and virtual machine then based on the above model we design Green Scheduler which can allocate resources to jobs rationally and efficiently by perceiving the status of each resource in real time. In addition, this paper compares 3 different schedulers including Green Scheduler, FIFO Scheduler and Capacity Scheduler on Hadoop and the result shows that on the premise of similar total runtime, Green Scheduler has more advantages in energy consumption controlling.