You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
70 lines
1.5 KiB
70 lines
1.5 KiB
2 years ago
|
# k8sgpt example
|
||
|
|
|
||
|
|
This example show how to use LocalAI with k8sgpt
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
## Create the cluster locally with Kind (optional)
|
||
|
|
|
||
|
|
If you want to test this locally without a remote Kubernetes cluster, you can use kind.
|
||
|
|
|
||
|
|
Install [kind](https://kind.sigs.k8s.io/) and create a cluster:
|
||
|
|
|
||
|
|
```
|
||
|
|
kind create cluster
|
||
|
|
```
|
||
|
|
|
||
|
|
## Setup LocalAI
|
||
|
|
|
||
|
|
We will use [helm](https://helm.sh/docs/intro/install/):
|
||
|
|
|
||
|
|
```
|
||
|
|
helm repo add go-skynet https://go-skynet.github.io/helm-charts/
|
||
|
|
helm repo update
|
||
|
|
|
||
|
|
# Clone LocalAI
|
||
|
|
git clone https://github.com/go-skynet/LocalAI
|
||
|
|
|
||
|
|
cd LocalAI/examples/k8sgpt
|
||
|
|
|
||
|
|
# modify values.yaml preload_models with the models you want to install.
|
||
|
|
# CHANGE the URL to a model in huggingface.
|
||
|
|
helm install local-ai go-skynet/local-ai --create-namespace --namespace local-ai --values values.yaml
|
||
|
|
```
|
||
|
|
|
||
|
|
## Setup K8sGPT
|
||
|
|
|
||
|
|
```
|
||
|
|
# Install k8sgpt
|
||
|
|
helm repo add k8sgpt https://charts.k8sgpt.ai/
|
||
|
|
helm repo update
|
||
|
|
helm install release k8sgpt/k8sgpt-operator -n k8sgpt-operator-system --create-namespace
|
||
|
|
```
|
||
|
|
|
||
|
|
Apply the k8sgpt-operator configuration:
|
||
|
|
|
||
|
|
```
|
||
|
|
kubectl apply -f - << EOF
|
||
|
|
apiVersion: core.k8sgpt.ai/v1alpha1
|
||
|
|
kind: K8sGPT
|
||
|
|
metadata:
|
||
|
|
name: k8sgpt-local-ai
|
||
|
|
namespace: default
|
||
|
|
spec:
|
||
|
|
backend: localai
|
||
|
|
baseUrl: http://local-ai.local-ai.svc.cluster.local:8080/v1
|
||
|
|
noCache: false
|
||
|
|
model: gpt-3.5-turbo
|
||
|
|
noCache: false
|
||
|
|
version: v0.3.0
|
||
|
|
enableAI: true
|
||
|
|
EOF
|
||
|
|
```
|
||
|
|
|
||
|
|
## Test
|
||
|
|
|
||
|
|
Apply a broken pod:
|
||
|
|
|
||
|
|
```
|
||
|
|
kubectl apply -f broken-pod.yaml
|
||
|
|
```
|