CODEWITHSUNDEEP
amazon-sagemaker
ozil
ozil

Reputation: 669

How to invoke a serverless endpoint in aws sagemaker?

based on aws documetation (https://docs.aws.amazon.com/sagemaker/latest/dg/serverless-endpoints-create.html) ,

response = client.create_endpoint_config(
   EndpointConfigName="<your-endpoint-configuration>",
   ProductionVariants=[
        {
            "ModelName": "<your-model-name>",
            "VariantName": "AllTraffic",
            "ServerlessConfig": {
                "MemorySizeInMB": 2048,
                "MaxConcurrency": 20
            }
        } 
    ]
)

i created an serverless endpoint (sample code above) , but I keep getting error when the endpoint is invoked , has anyone run into this issue - 'Error - / .sagemaker/ts/models/model.mar already exists. Please specify --force/-f option to overwrite the model archive output file' . FYI - this worked when the endpoint was configured provisioned instead of serverless.

Upvotes: 1

Views: 994

Answers (1)

Raghu Ramesha
Raghu Ramesha

Reputation: 484

You can checkout a few examples we created here

Upvotes: 1

Related Questions