CODEWITHSUNDEEP
amazon-web-servicesgoogle-cloud-platformcloudenergy
TharinduRanathunga
TharinduRanathunga

Reputation: 221

How to measure the power consumption in a virtual machine on a cloud environment?

I'm running a few Blockchain related containers in a cloud environment (Google Compute Engine). I want to measure the power/energy consumption of the containers or the instance that I'm running.

There are tools like powerapi which is possible to do this in real infrastructure where it has access to real CPU counters. This should be possible by doing an estimation based on the CPU, Memory, and Network usage. There's one such model proposed in the literature.

Is it theoretically possible to do this? If so is there already existing tools for this task.

Upvotes: 4

Views: 3880

Answers (4)

Forhad Hossain
Forhad Hossain

Reputation: 438

If you would like to develop a proof of concept, or for your research purpose, you can use CodeCarbon, a python based tool. https://codecarbon.io/#howitwork

But, I am not sure if it measures energy consumption and carbon emission perfectly on Cloud Virtual Machines.

Upvotes: 0

nulse
nulse

Reputation: 873

Measuring in cloud instances is more complicated yes. If you do have access to the underlying hardware, then it would be possible. There is a pretty recent project that allows to get power consumption metrics for a qemu/kvm hypervisor and share the metrics releveant to each virtual machine through another agent in the VM: github.com/hubblo-org/scaphandre/

They are also working (very early) on a "degraded mode" to estimate* the power consumption of the instance/vm if such communication between the hypervisor and the vm is not possible, like when working on a public cloud instance.

*: Based on the resources (cpu/ram/gpu...) consumption in the VM and characteristics of the instance and the underlying hardware power consumption "profile".

Upvotes: 3

Balamurugan.Santhanaraj
Balamurugan.Santhanaraj

Reputation: 162

Can we conclude that , it is impossible to measure power/energy consumption of process running on virtual machines?

Upvotes: 0

mebius99
mebius99

Reputation: 2605

A generalized answer is "No, it is impossible". A program running in a virtual machine deals with virtual hardware. The goal of virtualization is to abstract running programs from physical hardware, while access to physical equipment is required to measure energy consumption. For instance, without processor affinity enabled, it's unlikely that PowerAPI will be able to collect useful statistics due to virtual CPU migrations. Time-slicing that allows to run multiple vCPUs on one physical CPU is another factor to keep in mind. Needless to say about energy consumed by RAM, I/O controllers, storage devices, etc.

A substantive answer is "No, it is impossible". Authors of the manuscript use PowerAPI libraries to collect CPU statistics, and a monitoring agent to count bytes transmitted through network. HWPC-sensor the PowerAPI relies on has distinct requirement:

"monitored node(s) run a Linux distribution that is not hosted in a virtual environment"

Also, authors emphasize that they couldn't measure absolute values of power consumption but rather used percentage to compare certain Java classes and methods in order to suppose the origin of energy leaks in CPU-intensive workloads.

As for the network I/O, the number of bytes used to estimate power consumption in their model differs significantly between the network interface exposed into the virtual guest and the host hardware port on the network with the SDN stack in between.

Upvotes: 1

Related Questions