CODEWITHSUNDEEP
dockertensorflowtensorflow-serving
onuryartasi
onuryartasi

Reputation: 597

How can I use tensorflow serving for multiple models

How can I use multiple tensorflow models? I use docker container.

model_config_list: {

  config: {
    name: "model1",
    base_path: "/tmp/model",
    model_platform: "tensorflow"
  },
  config: {
     name: "model2",
     base_path: "/tmp/model2",
     model_platform: "tensorflow"
  }
}

Upvotes: 26

Views: 11028

Answers (1)

Sumsuddin Shojib
Sumsuddin Shojib

Reputation: 3743

Built a docker image from official tensorflow serving docker file

Then inside docker image.

/usr/local/bin/tensorflow_model_server --port=9000 --model_config_file=/serving/models.conf

here /serving/models.conf is a similar file as yours.

Upvotes: 24

Related Questions