sachin yadav
Reputation: 1
multi-model endpoints on sagemaker
I know, one can have multiple models on a single endpoint(Multi-Model endpoints). But, can I have these multiple models of different use cases and different datasets from the s3 bucket? because we mention model artifacts while invoking for prediction. can I have?
Upvotes: 0
Views: 1349
Answers (1)
Julien Simon
Reputation: 2729
Yes. You can use unrelated models. The S3 path you pass in the prediction request is the location the model artefact. Check the doc for details:) https://docs.aws.amazon.com/sagemaker/latest/dg/multi-model-endpoints.html for details.
Upvotes: 2
Related Questions
- Error when deploying pre trained Tensorflow models to one endpoint (multimodel for one endpoint) in sagemaker?
- How to integrate two models in sequential order in one endpoint?
- Shared input in Sagemaker inference pipeline models
- AWS Sagemaker Multi-Model Endpoint with Scikit Learn: UnexpectedStatusException whilst using a training script
- AWS SageMaker hosting multiple models on the same machine (ML compute instance)
- SageMaker endpoint for pretrained model
- SageMaker multimodel and RandomCutForest
- Training multiple model in AWS Sagemaker
- Hosting multiple models for multiple datasets in aws sagemaker
- AWS Sagemaker init 1K+ models "endpoints"?