Docker Training

Abdullah Fathi

Download Presentation Slide

Have you ever heard the famous phrase
"It works on my machine"?

By using Docker it is not an excuse anymore. Docker allows you to locally run the same (or almost the same) environment which will be used in production

  • Docker is a tool that allows developers, sys-admins etc. to automate deployment of an application as a lightweight container so that the application can work efficiently in different environments.
  • The key benefit of Docker is that it allows users to package an application with all of its dependencies (code, framework, libraries, etc.) into a standardized unit for software development
  • By taking advantage of Docker’s methodologies for shipping, testing, and deploying code quickly, you can significantly reduce the delay between writing code and running it in production.

What is Docker?

Why Docker ?

  • Fast, consistent delivery of your applications: Great for continuous integration and continuous delivery (CI/CD) workflows
  • Responsive deployment and scaling: Easy to dynamically manage workloads, scaling up or tearing down applications and services as business needs dictate, in near real time
  • Running more workloads on the same hardware: Docker is lightweight and fast. It provides a viable, cost-effective alternative to hypervisor-based virtual machines, so you can use more of your server capacity to achieve your business goals

Docker Architecture

What is Docker Daemon?

The Docker daemon (dockerd) listens for Docker API requests and manages Docker objects such as images, containers, networks, and volumes

What is Docker Client?

The Docker client (docker) is the primary way that many Docker users interact with Docker

What is Docker Registry?

A Docker registry stores Docker images. Docker Hub is a public registry that anyone can use, and Docker is configured to look for images on Docker Hub by default

What is Docker Image?

  • An image is a read-only template with instructions for creating a Docker container. Often, an image is based on another image, with some additional customization.

  • You might create your own images or you might only use those created by others and published in a registry. To build your own image, you create a Dockerfile with a simple syntax for defining the steps needed to create the image and run it. Each instruction in a Dockerfile creates a layer in the image. When you change the Dockerfile and rebuild the image, only those layers which have changed are rebuilt. This is part of what makes images so lightweight, small, and fast, when compared to other virtualization technologies.

What is Docker Container?

  • A container is a runnable instance of an image. You can create, start, stop, move, or delete a container using the Docker API or CLI. You can connect a container to one or more networks, attach storage to it, or even create a new image based on its current state.
  • By default, a container is relatively well isolated from other containers and its host machine. You can control how isolated a container’s network, storage, or other underlying subsystems are from other containers or from the host machine.
  • When a container is removed, any changes to its state that are not stored in persistent storage disappear.

Docker Image

  • It is a file, comprised of multiple layers, used to execute code in a Docker container.
  • They are a set of instructions used to create docker containers.

Docker Container

  • It is a runtime instance of an image.
  • Allows developers to package applications with all parts needed such as libraries and other dependencies.
  • CONTAINER is a running environment for IMAGE

  • virtual file system

Docker Container
vs
Virtual Machine

Docker

Virtual Machine

Applications

OS Kernel

Hardware

Applications

OS Kernel

Hardware

Docker Container

VM

  • Docker Containers contain binaries, libraries, and configuration files along with the application itself
  • Containers share resources with other containers in the same host OS and provide OS-level process isolation
  • Virtual Machines (VMs) run on Hypervisors, which allow multiple Virtual Machines to run on a single machine along with its own operating system
  • Provide Hardware-level process isolation and are slow to boot

Size: Docker image much smaller

Speed: Docker containers start and run much fast

Compatibility: VM of any OS can run on any OS host

Docker CI/CD

Docker Container Lifecycle

Basic Commands

# Pull Image from Docker Hub
docker pull nginx

# Check Existing Images
docker images

# Tags
docker pull nginx:1.24-alpine

# Run Image
# Start image in a container
docker run nginx

# Status running container
docker ps

# Run container in detached mode
docker run -d nginx

# Restart container
docker stop <container id>
docker start <container id>

# Show all container lists (running/not running)
docker ps -a

HOST Port vs CONTAINER Port

  • Multiple containers can run on your host machine
  • Your laptop has only certain ports available
  • Conflict when same port on host machine

Container

Port 5000

Container

Port 5000

Container

Port 5000

Container

Port 3000

Container

Port 5000

Container

Port 3000

Port 5000

Port 3000

Port 3001

Host

# Docker Port Binding Between Host and Container
docker run -d -p<host port>:<container port> <image>
#docker run -d -p6000:6379 redis
docker run -d -p80:80 nginx

Debugging Container

# Debugging Container
docker logs <container id/container name>
# Display last part of Log
docker logs <container id/container name> | tail
# Stream the logs
docker logs <container id/container name> -f

# Assign container name
docker run -d -p6001:6379 --name redis-older redis:4.0

# Get to Terminal of Running Container (Interactive Terminal)
docker exec -it <container id/container name> /bin/bash 

Docker Network
(Bridge)

# View auto generated docker network
docker network ls

# Create docker network
docker network create <network name>
docker network create mongo-network

It allows containers to communicate with each other on the same host through IP addresses/container name (custom bridge)

Docker Network
(Host)

# HOST network is already created by default
# We can directly use it as below
docker run -dit --rm --network host --name test nginx

Containers share the network namespace with the host and use the host's networking directly.

Docker Compose

  • Compose is a tool for defining and running multi-container Docker applications.
  • With Compose, you use a YAML file to configure your application’s services. Then, with a single command, you create and start all the services from your configuration
docker run -d \

-p 27017:27017 \

-e MONGO_INITDB_ROOT_USERNAME=admin \

-e MONGO_INITDB_ROOT_PASSWORD=password \

--name mongodb \

--net mongo-network \

mongo
version: '3' #version of docker-compose

services:
	
    mongodb:
    	
        image: mongo
        
        ports:
        	-27017:27017 #HOST:CONTAINER
        
        environtment:
		- MONGO_INITDB_ROOT_USERNAME=admin
		- MONGO_INITDB_ROOT_PASSWORD=password

Docker Compose takes care of creating a common Network

Docker Run Command

docker-compose.yaml

#Start container using docker-compose file
docker-compose -f mongo.yaml up -d
#Stop the containers and network using docker compose
docker-compose -f mongo.yaml down

Dockerfile

Build your own Docker Image

Dockerfile: Blueprint for creating docker images

#First line of every 
# Start by basing it on another image
# Generates a layer based on Nodejs + Alpine.
FROM node:13-alpine

# Optionally define environment variables
# Previously we define it in docker compose which is recommended,
# So we didnt have to rebuild the image if the environment variables changes
ENV MONGO_DB_USERNAME=admin \
	MONGO_DB_PWD=password

# RUN: execute any LINUX command / Constructs your container
# The directory is created INSIDE the container
RUN mkdir -p /home/app 

# COPY: executes on the HOST machine
COPY . /home/app

# Executes an entrypoint LINUX command
# Specifies which command should be executed within the container
CMD ["node", "server.js"]

# Differences between RUN and CMD:
# CMD=entrypoint command
# you can have multiple RUN commands
# Mark dockerfile that this is the command we want to execute as entrypoint
#
#
install node 13

#
#
#
set MONGO_DB_USERNAME=admin
set MONGO_DB_PWD=password

#
#
create /home/app folder

#
copy current folder files to /home/app

#
Start the app with: "node server.js"
Image Environment Blueprint
Dockerfile

Docker Build Image

docker build -t my-app:1.0 .

# Rebuild Image
1) Delete container
docker rm <container id>
2) Delete Docker Image
docker rmi <image id>
3) Build New Image
docker build -t my-app:1.1 .

Push Image to Private Registry

# The server needs to login to pull from PRIVATE repository

# Push image to private container registry
docker push hub.osdec.gov.my/<project-name>:<image tag>

# Pull image from private container registry
docker pull hub.osdec.gov.my/<project-name>:1.0

Image Naming in Docker registries

registryDomain/imageName:tag

In DockerHub:

  • docker pull mongo:4.2
  • equivalent to: docker pull docker.io/library/mongo:4.2

In Harbor (Private Registry):

  • docker pull hub.osdec.gov.my/<project-name>:1.0

Docker Volumes

Data Persistence

What is Docker Volume?

  • Folder in physical host file system is mounted into the virtual file system of Docker
  • Data gets automatically replicated

3 Type of Docker Volumes

  1. Host Volumes
    • docker run -v /home/mount/data:/var/lib/mysql/data
  2. Anonymous Volumes
    • docker run -v /var/lib/mysql/data
    • Directory automatically created by Docker
  3. Named Volumes
    • docker run -v name:/var/lib/mysql/data
    • Recommended
version: '3'
services:
	mongodb:
    	image:mongo
        ports:
        	- 27017:27017
        environment:
        	- MONGO_INITDB_ROOT_USERNAME=admin
            - MONGO_INITDB_ROOT__PASSWORD=password
         #Volumes
         volumes:
         	 - mongo-data:/data/db
	mongo-express
    	image:mongo-express
        ports:
        	- 8080:8081
        environment:
        	- ME_CONFIG_MONGODB_ADMINUSERNAME=admin
            - ME_CONFIG_MONGODB_ADMINPASSWORD=password
            - ME_CONFIG_MONGODB_SERVER=mongodb
volumes:
	mongo-data:
    	driver: local

Example in docker-compose

Docker Volume Locations

Windows - \\wsl$\docker-desktop-data\data\docker\volumes

Linux - /var/lib/docker/volumes

MacOS - /var/lib/docker/volumes

Your feedback matters

Thank You

Docker Training

By Abdullah Fathi

Docker Training

  • 232