CODEWITHSUNDEEP
amazon-s3amazon-sagemaker
loretoparisi
loretoparisi

Reputation: 16301

Amazon SageMaker: ClientError: Data download failed:NoSuchKey (404): The specified key does not exist

I'm running a SageMaker Training Job with a custom algorithm and the input data from s3. The SagaMaker AIM role ARN has a Read/Put policy on the specified S3 bucket folder, but while creating the job I get a client error:

ClientError: Data download failed:NoSuchKey (404): The specified key does not exist.

Unfortunately no more error info is provided in the SageMaker dashboard to investigate further.

Upvotes: 2

Views: 1998

Answers (1)

ishaaq
ishaaq

Reputation: 6779

SageMaker team member here.

The problem here is that the training job in question was setup with S3DataType=ManifestFile. In this case SageMaker expects to be able to download a single manifest file from the location specified by the S3Uri, if the file does not exist in S3 we get a 404 which is what we're sending back as the error here.

See here for documentation on S3DataType/S3Uri and manifests: https://docs.aws.amazon.com/sagemaker/latest/dg/API_S3DataSource.html#SageMaker-Type-S3DataSource-S3DataType

We will work to make this error message a bit more user-friendly, thanks for calling this out!

Upvotes: 2

Related Questions