3. Seldon-Core
Seldon-Core
Seldon-Core is one of the open source frameworks that can deploy and manage numerous machine learning models in Kubernetes environments.
For more details, please refer to the official product description page and GitHub of Seldon-Core and API Deployment part.
Installing Seldon-Core
In order to use Seldon-Core, modules such as Ambassador, which is responsible for Ingress of Kubernetes, and Istio are required here.
Seldon-Core officially supports only Ambassador and Istio, and MLOps for everyone will use Ambassador to use Seldon-core, so we will install Ambassador.
Adding Ambassador to the Helm Repository
helm repo add datawire https://www.getambassador.io
If the following message is displayed, it means it has been added normally.
"datawire" has been added to your repositories
Update Ambassador - Helm Repository
helm repo update
If the following message is output, it means that the update has been completed normally.
Hang tight while we grab the latest from your chart repositories...
...Successfully got an update from the "datawire" chart repository
Update Complete. ⎈Happy Helming!⎈
Ambassador - Helm Install
Install version 6.9.3 of the Ambassador Chart.
helm install ambassador datawire/ambassador \
--namespace seldon-system \
--create-namespace \
--set image.repository=quay.io/datawire/ambassador \
--set enableAES=false \
--set crds.keep=false \
--version 6.9.3
The following message should be displayed.
생략...
W1206 17:01:36.026326 26635 warnings.go:70] rbac.authorization.k8s.io/v1beta1 Role is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 Role
W1206 17:01:36.029764 26635 warnings.go:70] rbac.authorization.k8s.io/v1beta1 RoleBinding is deprecated in v1.17+, unavailable in v1.22+; use rbac.authorization.k8s.io/v1 RoleBinding
NAME: ambassador
LAST DEPLOYED: Mon Dec 6 17:01:34 2021
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
NOTES:
-------------------------------------------------------------------------------
Congratulations! You've successfully installed Ambassador!
-------------------------------------------------------------------------------
To get the IP address of Ambassador, run the following commands:
NOTE: It may take a few minutes for the LoadBalancer IP to be available.
You can watch the status of by running 'kubectl get svc -w --namespace seldon-system ambassador'
On GKE/Azure:
export SERVICE_IP=$(kubectl get svc --namespace seldon-system ambassador -o jsonpath='{.status.loadBalancer.ingress[0].ip}')
On AWS:
export SERVICE_IP=$(kubectl get svc --namespace seldon-system ambassador -o jsonpath='{.status.loadBalancer.ingress[0].hostname}')
echo http://$SERVICE_IP:
For help, visit our Slack at http://a8r.io/Slack or view the documentation online at https://www.getambassador.io.
Wait until four pods become running in the seldon-system.
kubectl get pod -n seldon-system
ambassador-7f596c8b57-4s9xh 1/1 Running 0 7m15s
ambassador-7f596c8b57-dt6lr 1/1 Running 0 7m15s
ambassador-7f596c8b57-h5l6f 1/1 Running 0 7m15s
ambassador-agent-77bccdfcd5-d5jxj 1/1 Running 0 7m15s
Seldon-Core - Helm Install
Install version 1.11.2 of the seldon-core-operator Chart.
helm install seldon-core seldon-core-operator \
--repo https://storage.googleapis.com/seldon-charts \
--namespace seldon-system \
--set usageMetrics.enabled=true \
--set ambassador.enabled=true \
--version 1.11.2
The following message should be displayed.
Skip...
W1206 17:05:38.336391 28181 warnings.go:70] admissionregistration.k8s.io/v1beta1 ValidatingWebhookConfiguration is deprecated in v1.16+, unavailable in v1.22+; use admissionregistration.k8s.io/v1 ValidatingWebhookConfiguration
NAME: seldon-core
LAST DEPLOYED: Mon Dec 6 17:05:34 2021
NAMESPACE: seldon-system
STATUS: deployed
REVISION: 1
TEST SUITE: None
Wait until one seldon-controller-manager pod is Running in the seldon-system namespace.
kubectl get pod -n seldon-system | grep seldon-controller
seldon-controller-manager-8457b8b5c7-r2frm 1/1 Running 0 2m22s