247 lines
6.8 KiB
ReStructuredText
247 lines
6.8 KiB
ReStructuredText
Deployment Documentation
|
|
=====================================
|
|
|
|
This page describes how to setup a working development environment that can be used in developing stackube on Ubuntu or
|
|
CentOS. These instructions assume you're already installed git, golang and python on your host.
|
|
|
|
=========
|
|
Build
|
|
=========
|
|
|
|
Build binary:
|
|
|
|
::
|
|
|
|
make
|
|
|
|
The binary will be placed at:
|
|
|
|
::
|
|
|
|
_output/kubestack
|
|
_output/stackube-controller
|
|
_output/stackube-proxy
|
|
|
|
Build docker images:
|
|
|
|
::
|
|
|
|
make docker
|
|
|
|
Three docker images will be built:
|
|
|
|
::
|
|
|
|
stackube/stackube-proxy:v0.1
|
|
stackube/stackube-controller:v0.1
|
|
stackube/kubestack:v0.1
|
|
|
|
=========
|
|
Start
|
|
=========
|
|
|
|
The following parts suppose you have already deployed an environment of OpenStack and Kubernetes on same baremetal host.
|
|
If the cluster is not deployed via devstack, don't forget to setup `--experimental-keystone-url` for kube-apiserver, e.g.
|
|
|
|
::
|
|
|
|
kube-apiserver --experimental-keystone-url=https://192.168.128.66:5000/v2.0 ...
|
|
|
|
Remove kube-dns deployment and kube-proxy daemonset if you have already running them.
|
|
|
|
::
|
|
|
|
kubectl -n kube-system delete deployment kube-dns
|
|
kubectl -n kube-system delete daemonset kube-proxy
|
|
|
|
If you have also configured a CNI network plugin, you should also remove it togather with CNI network config.
|
|
|
|
::
|
|
|
|
# Remove CNI network components, e.g. deployments or daemonsets first.
|
|
# Then remove CNI network config.
|
|
rm -f /etc/cni/net.d/*
|
|
|
|
Then create external network in Neutron if there is no one.
|
|
|
|
::
|
|
|
|
# Create an external network if there is no one.
|
|
# Please replace 10.123.0.x with your own external network
|
|
# and remember the id of your created external network
|
|
neutron net-create br-ex --router:external=True --shared
|
|
neutron subnet-create --ip_version 4 --gateway 10.123.0.1 br-ex 10.123.0.0/16 --allocation-pool start=10.123.0.2,end=10.123.0.200 --name public-subnet
|
|
|
|
|
|
Now, we are ready to deploy stackube components.
|
|
|
|
First create configure file for Stackube.
|
|
|
|
::
|
|
|
|
# Remember to replace them with your own ones.
|
|
cat >stackube-configmap.yaml <<EOF
|
|
kind: ConfigMap
|
|
apiVersion: v1
|
|
metadata:
|
|
name: stackube-config
|
|
namespace: kube-system
|
|
data:
|
|
auth-url: "https://192.168.128.66/identity_admin/v2.0"
|
|
username: "admin"
|
|
password: "admin"
|
|
tenant-name: "admin"
|
|
region: "RegionOne"
|
|
ext-net-id: "550370a3-4fc2-4494-919d-cae33f5b3de8"
|
|
plugin-name: "ovs"
|
|
integration-bridge: "br-int"
|
|
user-cidr: "10.244.0.0/16"
|
|
user-gateway: "10.244.0.1"
|
|
kubernetes-host: "192.168.0.33"
|
|
kubernetes-port: "6443"
|
|
EOF
|
|
|
|
Then deploy stackube components:
|
|
|
|
::
|
|
|
|
kubectl create -f stackube-configmap.yaml
|
|
kubectl create -f deployment/stackube-proxy.yaml
|
|
kubectl create -f deployment/stackube.yaml
|
|
|
|
|
|
=========
|
|
Test
|
|
=========
|
|
|
|
1. Create a new tenant
|
|
|
|
::
|
|
|
|
$ cat test-tenant.yaml
|
|
|
|
apiVersion: "stackube.kubernetes.io/v1"
|
|
kind: Tenant
|
|
metadata:
|
|
name: test
|
|
spec:
|
|
username: "test"
|
|
password: "password"
|
|
|
|
$ kubectl create -f test-tenant.yaml
|
|
|
|
2. Check the auto-created namespace and network. Wait a while, the namespace and network for this tenant should be created automatically:
|
|
|
|
::
|
|
|
|
$ kubectl get namespace test
|
|
NAME STATUS AGE
|
|
test Active 58m
|
|
|
|
$ kubectl -n test get network test -o yaml
|
|
apiVersion: stackube.kubernetes.io/v1
|
|
kind: Network
|
|
metadata:
|
|
clusterName: ""
|
|
creationTimestamp: 2017-08-03T11:58:31Z
|
|
generation: 0
|
|
name: test
|
|
namespace: test
|
|
resourceVersion: "3992023"
|
|
selfLink: /apis/stackube.kubernetes.io/v1/namespaces/test/networks/test
|
|
uid: 11d452eb-7843-11e7-8319-68b599b7918c
|
|
spec:
|
|
cidr: 10.244.0.0/16
|
|
gateway: 10.244.0.1
|
|
networkID: ""
|
|
status:
|
|
state: Active
|
|
|
|
3. Check the Network and Tenant created in Neutron by Stackube controller.
|
|
|
|
::
|
|
|
|
$ source ~/keystonerc_admin
|
|
$ neutron net-list
|
|
+--------------------------------------+----------------------+----------------------------------+----------------------------------------------------------+
|
|
| id | name | tenant_id | subnets |
|
|
+--------------------------------------+----------------------+----------------------------------+----------------------------------------------------------+
|
|
| 421d913a-a269-408a-9765-2360e202ad5b | kube-test-test | 915b36add7e34018b7241ab63a193530 | bb446a53-de4d-4546-81fc-8736a9a88e3a 10.244.0.0/16 |
|
|
|
|
4. Check the kube-dns pods created in the new namespace.
|
|
|
|
::
|
|
|
|
# kubectl -n test get pods
|
|
NAME READY STATUS RESTARTS AGE
|
|
kube-dns-1476438210-37jv7 3/3 Running 0 1h
|
|
|
|
5. Create pods and services in the new namespace.
|
|
|
|
::
|
|
|
|
# kubectl -n test run nginx --image=nginx
|
|
deployment "nginx" created
|
|
# kubectl -n test expose deployment nginx --port=80
|
|
service "nginx" exposed
|
|
|
|
# kubectl -n test get pods -o wide
|
|
NAME READY STATUS RESTARTS AGE IP NODE
|
|
kube-dns-1476438210-37jv7 3/3 Running 0 1h 10.244.0.4 stackube
|
|
nginx-4217019353-6gjxq 1/1 Running 0 27s 10.244.0.10 stackube
|
|
|
|
# kubectl -n test run -i -t busybox --image=busybox sh
|
|
If you don't see a command prompt, try pressing enter.
|
|
/ # nslookup nginx
|
|
Server: 10.96.0.10
|
|
Address 1: 10.96.0.10
|
|
|
|
Name: nginx
|
|
Address 1: 10.108.57.129 nginx.test.svc.cluster.local
|
|
|
|
/ # wget -O- nginx
|
|
Connecting to nginx (10.108.57.129:80)
|
|
<!DOCTYPE html>
|
|
<html>
|
|
<head>
|
|
<title>Welcome to nginx!</title>
|
|
<style>
|
|
body {
|
|
width: 35em;
|
|
margin: 0 auto;
|
|
font-family: Tahoma, Verdana, Arial, sans-serif;
|
|
}
|
|
</style>
|
|
</head>
|
|
<body>
|
|
<h1>Welcome to nginx!</h1>
|
|
<p>If you see this page, the nginx web server is successfully installed and
|
|
working. Further configuration is required.</p>
|
|
|
|
<p>For online documentation and support please refer to
|
|
<a href="http://nginx.org/">nginx.org</a>.<br/>
|
|
Commercial support is available at
|
|
<a href="http://nginx.com/">nginx.com</a>.</p>
|
|
|
|
<p><em>Thank you for using nginx.</em></p>
|
|
</body>
|
|
</html>
|
|
- 100% |*********************************************************************| 612 0:00:00 ETA
|
|
/ #
|
|
|
|
6. Finally, remove the tenant.
|
|
|
|
::
|
|
|
|
$ kubectl delete tenant test
|
|
tenant "test" deleted
|
|
|
|
7. Check Network in Neutron is also deleted by Stackube controller
|
|
|
|
::
|
|
|
|
$ neutron net-list
|
|
+--------------------------------------+---------+----------------------------------+----------------------------------------------------------+
|
|
| id | name | tenant_id | subnets |
|
|
+--------------------------------------+---------+----------------------------------+----------------------------------------------------------+
|