CODEWITHSUNDEEP
amazon-sagemaker
Warlax56
Warlax56

Reputation: 1202

Sage Maker Studio CPU Usage

I'm working in sage maker studio, and I have a single instance running one computationally intensive task:

enter image description here

It appears that the kernel running my task is maxed out, but the actual instance is only using a small amount of its resources. Is there some sort of throttling occurring? Can I configure this so that more of the instance is utilized?

Upvotes: 5

Views: 4510

Answers (2)

Stitch W
Stitch W

Reputation: 86

Your ml.c5.xlarge instance comes with 4 vCPU. However, Python only uses a single CPU by default. (Source: Can I apply multithreading for computationally intensive task in python?)

As a result, the overall CPU utilization of your ml.c5.xlarge instance is low. To utilize all the vCPUs, you can try multiprocessing.

The examples below are performed using a 2 vCPU + 4 GiB instance.

In the first picture, multiprocessing is not set up. The instance CPU utilization peaks at around 50%.

single processing:
single processing

In the second picture, I created 50 processes to be run simultaneously. The instance CPU utilization rises to 100% immediately.

multiprocessing:
multiprocessing

Upvotes: 7

Gili Nachum
Gili Nachum

Reputation: 5568

It might be something off with these stats your seeing, or they are showing different time spans, or the kernel has a certain resources assignment out of the total instance.

I suggest opening a terminal and running top to see what's actually going on and which UI stat it matches (note your opening the instance's terminal, and not the Jupyter UI instance terminal).

Upvotes: 1

Related Questions