Skip to main content
Version: 1.0

3. Seldon-Core

Seldon-Core

Seldon-Core is one of the open source frameworks that can deploy and manage numerous machine learning models in Kubernetes environments.
For more details, please refer to the official product description page and GitHub of Seldon-Core and API Deployment part.

Installing Seldon-Core

In order to use Seldon-Core, modules such as Ambassador, which is responsible for Ingress of Kubernetes, and Istio are required here.
Seldon-Core officially supports only Ambassador and Istio, and MLOps for everyone will use Ambassador to use Seldon-core, so we will install Ambassador.

Adding Ambassador to the Helm Repository

helm repo add datawire https://www.getambassador.io

If the following message is displayed, it means it has been added normally.

"datawire" has been added to your repositories

Update Ambassador - Helm Repository

helm repo update

If the following message is output, it means that the update has been completed normally.

Hang tight while we grab the latest from your chart repositories...
...Successfully got an update from the "datawire" chart repository
Update Complete. ⎈Happy Helming!

Ambassador - Helm Install

Install version 6.9.3 of the Ambassador Chart.

helm install ambassador datawire/ambassador \
--namespace seldon-system \
--create-namespace \
--set image.repository=quay.io/datawire/ambassador \
--set enableAES=false \
--set crds.keep=false \
--version 6.9.3

The following message should be displayed.

생략...

W1206 17:01:36.026326 26635 warnings.go:70] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1206 17:01:36.029764 26635 warnings.go:70] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
NAME: ambassador
LAST DEPLOYED: Mon Dec 6 17:01:34 2021
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
NOTES:
-------------------------------------------------------------------------------
Congratulations! You've successfully installed Ambassador!

-------------------------------------------------------------------------------
To get the IP address of Ambassador, run the following commands:
NOTE: It may take a few minutes for the LoadBalancer IP to be available.
You can watch the status of by running 'kubectl get svc -w --namespace seldon-system ambassador'

On GKE/Azure:
export SERVICE_IP=$(kubectl get svc --namespace seldon-system ambassador -o jsonpath='{.status.loadBalancer.ingress[0].ip}')

On AWS:
export SERVICE_IP=$(kubectl get svc --namespace seldon-system ambassador -o jsonpath='{.status.loadBalancer.ingress[0].hostname}')

echo http://$SERVICE_IP:

For help, visit our Slack at http://a8r.io/Slack or view the documentation online at https://www.getambassador.io.

Wait until four pods become running in the seldon-system.

kubectl get pod -n seldon-system
ambassador-7f596c8b57-4s9xh                  1/1     Running   0          7m15s
ambassador-7f596c8b57-dt6lr 1/1 Running 0 7m15s
ambassador-7f596c8b57-h5l6f 1/1 Running 0 7m15s
ambassador-agent-77bccdfcd5-d5jxj 1/1 Running 0 7m15s

Seldon-Core - Helm Install

Install version 1.11.2 of the seldon-core-operator Chart.

helm install seldon-core seldon-core-operator \
--repo https://storage.googleapis.com/seldon-charts \
--namespace seldon-system \
--set usageMetrics.enabled=true \
--set ambassador.enabled=true \
--version 1.11.2

The following message should be displayed.

Skip...

W1206 17:05:38.336391 28181 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
NAME: seldon-core
LAST DEPLOYED: Mon Dec 6 17:05:34 2021
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
TEST SUITE: None

Wait until one seldon-controller-manager pod is Running in the seldon-system namespace.

kubectl get pod -n seldon-system | grep seldon-controller
seldon-controller-manager-8457b8b5c7-r2frm   1/1     Running   0          2m22s

References