|
| 1 | +--- |
| 2 | +layout: post |
| 3 | +title: "Plone and Docker" |
| 4 | +date: 2015-01-27 18:32:57 +0200 |
| 5 | +tags: Docker Python Plone |
| 6 | +--- |
| 7 | + |
| 8 | +*In this post, I will try to explain how we put Plone sites into production in our organization ([iMio](https://www.imio.be), Belgium).* |
| 9 | + |
| 10 | +## Introduction |
| 11 | +For this process, we used some software as Puppet, Jenkins, but the process we use should be agnostic from these softwares. |
| 12 | + |
| 13 | +Short story: when a push is made on Github, Jenkins builds a new image for Docker, pushes this image into a private Docker registry and updates the Docker image on server. |
| 14 | + |
| 15 | + |
| 16 | + |
| 17 | + |
| 18 | +## Docker images |
| 19 | +We create Docker images with [packer](https://www.packer.io/). We build .deb files with buildout, mr.bob and Jenkins. We create “debian” folder used to .deb files creation with a mr.bob template. We create 3 deb files: |
| 20 | +- plone-core-${version}.deb: contains eggs |
| 21 | +- plone-zeoserver-${version}.deb: contains zeoserver config files |
| 22 | +- plone-instance-${version}.deb: contains instance config files |
| 23 | + |
| 24 | +After creation of deb files, packer uses (and installs) those deb files to create 2 Docker images: |
| 25 | +- docker.private-registry.be/plone.zeoserver.be:latest |
| 26 | +- docker.private-registry.be/plone.instance.be:latest |
| 27 | +We think this is a good way to have good isolation. |
| 28 | + |
| 29 | +Both images are based on a "base IMIO image". Our base image is based on ubuntu image from docker hub. Each image has a size of +/- 530 MB because we have a lot of plone eggs in our buildout/plone site. |
| 30 | + |
| 31 | +You could also create a simple Dockerfile which pulls a github repo and runs buildout to create your Docker image. |
| 32 | + |
| 33 | +Once Packer has built the Docker images, Jenkins pushes them into a private Docker registry. |
| 34 | + |
| 35 | +## Private registry |
| 36 | +For this post, I imagine we have a private docker registry in this url: docker.private-registry.be. |
| 37 | + |
| 38 | +We use private registry to store our images. |
| 39 | + |
| 40 | +Our images are created with tag latest and YYYYMMDD-JENKINS_JOB_NUMBER (20150127-97) |
| 41 | +We use a private registry for each environment, (staging, production, …) and we copy images between environments. Actually, we automatically update dev and staging environments and when we see there are no problem, we copy images on production. |
| 42 | + |
| 43 | +## Update production |
| 44 | +We use fig to orchestrate our docker containers (zeo server must be started before zeo clients). We use a script to update our docker images. This script checks if the currently running docker containers use the latest image. If not, the script downloads the latest image, stops the docker containers which are running, remove them and restart containers from new images (we use upstart scripts to starting docker daemon). |
| 45 | + |
| 46 | +``` |
| 47 | +cd /fig/directory;fig pull > /dev/null 2>&1 |
| 48 | +NAME='plone' |
| 49 | +REGISTRY_URL='docker.private-registry.be' |
| 50 | +INSTANCE="instance" |
| 51 | +ZEO="zeo" |
| 52 | +INSTANCE_NAME="instance_1" |
| 53 | +INSTANCE_IMAGE="$REGISTRY_URL/$INSTANCE" |
| 54 | +ZEO_IMAGE="$REGISTRY_URL/$ZEO" |
| 55 | +
|
| 56 | +LATEST_INSTANCE_IMAGE_ID=$(docker images | grep $INSTANCE_IMAGE | grep latest | awk '{print $3}') |
| 57 | +LATEST_ZEO_IMAGE_ID=$(docker images | grep $ZEO_IMAGE | grep latest | awk '{print $3}') |
| 58 | +
|
| 59 | +TAG_INSTANCE_IMAGE_ID=$(docker images | grep $LATEST_INSTANCE_IMAGE_ID | grep -v latest | awk '{print $2}') |
| 60 | +TAG_ZEO_IMAGE_ID=$(docker images | grep $LATEST_ZEO_IMAGE_ID | grep -v latest | awk '{print $2}') |
| 61 | +
|
| 62 | +if [ "$TAG_INSTANCE_IMAGE_ID" != "$TAG_ZEO_IMAGE_ID" ];then |
| 63 | + echo "Error: instance and zeo images are no the same tag !" 1>&2 |
| 64 | + exit 1 |
| 65 | +fi |
| 66 | +RUNNING=$(docker ps | grep $INSTANCE_NAME | awk '{print $2}') |
| 67 | +LATEST="$INSTANCE_IMAGE:$TAG_INSTANCE_IMAGE_ID" |
| 68 | +if [ "$RUNNING" != "$LATEST" ];then |
| 69 | + echo "restarting $NAME" |
| 70 | + stop $NAME |
| 71 | + start $NAME |
| 72 | +else |
| 73 | + echo "$NAME up to date" |
| 74 | +fi |
| 75 | +``` |
| 76 | + |
| 77 | +## Storage and backup |
| 78 | +We use [Docker data containers](https://docs.docker.com/userguide/dockervolumes/#creating-and-mounting-a-data-volume-container) (called storage in our case) for filestorage, blobstorage and backup folders. We start docker container with --volumes-from option. We have to be carefull to NEVER delete a storage container (maybe we have to improve docker for that). |
| 79 | + |
| 80 | +We configure our buildouts to backup all data into var/backups folder and so, we launch docker with --volumes-from and -v options for backup and restore. Thanks to -v options, backups are stored on server and not in Docker. Later, backups are synced to our backup server. |
| 81 | + |
| 82 | +With this zeo docker image, it’s easy to backup, pack and restore zodb. In the futur, we envision using relstorage instead of zeoserver. But currently, there is no DB admin in the company (hint to our boss ?). |
| 83 | + |
| 84 | +## Conclusion |
| 85 | +Docker runs great in production ! |
| 86 | + |
| 87 | +I intend to follow [docker machine](https://github.com/docker/machine), [docker swarm](https://github.com/docker/swarm/) and docker compose. |
| 88 | + |
| 89 | +Thank you to my colleagues Cédric de Wilde and Jean-François Roche for having worked with me to setup our production Plone into Docker. |
0 commit comments