Skip to content

README.md

Latest commit

 

History

History
164 lines (127 loc) · 10.7 KB

README.md

File metadata and controls

164 lines (127 loc) · 10.7 KB

Automated Installer for 3PAR Docker Volume plugin (Ansible)

These are Ansible playbooks to automate the install of the HPE 3PAR Docker Volume Plug-in for Docker for use within standalone docker environment or Kubernetes/OpenShift environments.

NOTE: The Ansible installer only supports Ubuntu/RHEL/CentOS. If you are using another distribution of Linux, you will need to modify the playbooks to support your application manager (apt, etc.) and the pre-requisite packages.

Getting Started

These playbooks perform the following tasks on the Master/Worker nodes as defined in the Ansible hosts file.

  • Configure the Docker Services for the HPE 3PAR Docker Volume Plug-in
  • Deploys the config files (iSCSI or FC) to support your environment
  • Installs the HPE 3PAR Docker Volume Plug-in (Containerized version)
  • For standalone docker environment,
    • Deploys an etcd cluster
  • For Kubernetes/OpenShift,
    • Deploys a Highly Available etcd cluster used by the HPE 3PAR Docker Volume plugin
      • Supports single node (Use only for testing purposes) or multi-node deployment (HA) as defined in the Ansible hosts file
    • Deploys the HPE FlexVolume Driver

Prerequisites:

  • Install Ansible 2.5 or above as per Installation Guide

  • Login to 3PAR via SSH to create entry in /<user>/.ssh/known_hosts file

Note: Entries for the Master and Worker nodes should already exist within the /<user>/.ssh/known_hosts file from the OpenShift installation. If not, you will need to log into each of the Master and Worker nodes as well to prevent connection errors from Ansible.

  • Clone the python-hpedockerplugin repository

    git clone https://github.com/hpe-storage/python-hpedockerplugin
cd python-hpedockerplugin/ansible_3par_docker_plugin

  • Add plugin configuration properties - sample at properties/plugin_configuration_properties.yml based on your HPE 3PAR Storage array configuration. Some of the properties are mandatory and must be specified in the properties file while others are optional.

    Property Mandatory Default Value Description
    hpedockerplugin_driver Yes No default value ISCSI/FC driver (hpedockerplugin.hpe.hpe_3par_iscsi.HPE3PARISCSIDriver/hpedockerplugin.hpe.hpe_3par_fc.HPE3PARFCDriver)
    hpe3par_ip Yes No default value IP address of 3PAR array
    hpe3par_username Yes No default value 3PAR username
    hpe3par_password Yes No default value 3PAR password
    hpe3par_cpg Yes No default value Primary user CPG
    volume_plugin Yes No default value Name of the docker volume image (only required with DEFAULT backend)
    encryptor_key No No default value Encryption key string for 3PAR password
    logging No INFO Log level
    hpe3par_debug No No default value 3PAR log level
    suppress_requests_ssl_warning No True Suppress request SSL warnings
    hpe3par_snapcpg No hpe3par_cpg Snapshot CPG
    hpe3par_iscsi_chap_enabled No False ISCSI chap toggle
    hpe3par_iscsi_ips No No default value Comma separated iscsi port IPs (only required if driver is ISCSI based)
    use_multipath No False Mutltipath toggle
    enforce_multipath No False Forcefully enforce multipath
    ssh_hosts_key_file No /root/.ssh/known_hosts Path to hosts key file
    quorum_witness_ip No No default value Quorum witness IP
    mount_prefix No No default value Alternate mount path prefix
    hpe3par_iscsi_ips No No default value Comma separated iscsi IPs. If not provided, all iscsi IPs will be read from the array and populated in hpe.conf
    vlan_tag No False Populates the iscsi_ips which are vlan tagged, only applicable if hpe3par_iscsi_ips is not specified
    replication_device No No default value Replication backend properties

  • The Etcd ports can be modified in etcd cluster properties as follows:

    Property Mandatory Default Value
    etcd_peer_port Yes 23800
    etcd_client_port_1 Yes 23790
    etcd_client_port_2 Yes 40010

    Note: Please ensure that the ports specified above are unoccupied before installation. If the ports are not available on a particular node, etcd installation will fail.

    Limitation: The installer, in the current state does not have the capability to add or remove nodes in the etcd cluster. In case an etcd node is not responding or goes down, it is beyond the current scope to admit it back into the cluster. Please follow the etcd documentation to do so manually.

  • It is recommended that the properties file is encrypted using Ansible Vault.

  • Modify hosts file to define your Master/Worker nodes as well as where you want to deploy your etcd cluster

Working with proxies:

Set http_proxy and https_proxy in the inventory hosts file while installing plugin on Kubernetes/Openshift setup. For setting proxies in the standalone plugin installation, see inventory hosts file for standalone plugin installation

Usage

Once the prerequisites are complete, run the following command:

  • Fresh installation on standalone docker environment:
$ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts_standalone_nodes install_standalone_hpe_3par_volume_driver.yml --ask-vault-pass
  • Fresh installation on Openshift/Kubernetes environment:
$ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts install_hpe_3par_volume_driver.yml --ask-vault-pass

Note: --ask-vault-pass is required only when the properties file is encrypted

Once complete you will be ready to start using the HPE 3PAR Docker Volume Plug-in.

  • Update the array backends in Standalone/Openshift/Kubernetes environment:

    • Modify the plugin configuration properties - sample at properties/plugin_configuration_properties.yml based on the updated HPE 3PAR Storage array configuration. Additional backends may be added or removed from the existing configuration. Individual attributes of the existing array configuration may also be modified.

      • Update array backend on standalone docker environment:
      $ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts_standalone_nodes install_standalone_hpe_3par_volume_driver.yml --ask-vault-pass
      • Update array backend on Openshift/Kubernetes environment:
      $ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts install_hpe_3par_volume_driver.yml --ask-vault-pass

    Note: It is not recommended to change the Etcd information and array encryption password during the backend update process

  • Upgrade the docker volume plugin

    • Modify the volume_plugin in plugin configuration properties - sample and point it to the latest image from docker hub
      • Update plugin on standalone docker environment:
      $ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts_standalone_nodes install_standalone_hpe_3par_volume_driver.yml --ask-vault-pass
      • Update plugin on Openshift/Kubernetes environment:
      $ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts install_hpe_3par_volume_driver.yml --ask-vault-pass

    Note:

    • Ensure that all the nodes in the cluster are present in the inventory hosts file
    • The docker volume plugin will be restarted and the user will not be able to create the volume during the process
    • Successful upgrade will remove the old plugin container and replace it with the new plugin container which is specified in the plugin properties file

  • Install docker volume plugin to additional nodes in the cluster

    • Add the new nodes in the respective sections in the inventory hosts file

    • Only new nodes IP or hostnames must be present in the hosts file

    • Do not change the etcd hosts from the existing setup. Do not add or remove nodes in the etcd section

      • Install plugin on new nodes on Openshift/Kubernetes environment:
      $ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts install_hpe_3par_volume_driver.yml --ask-vault-pass
      • Uninstall plugin on nodes on Openshift/Kubernetes environment:
      $ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts uninstall/uninstall_hpe_3par_volume_driver.yml --ask-vault-pass
      • Uninstall plugin along with etcd on nodes on Openshift/Kubernetes environment:
      $ cd python-hpedockerplugin/ansible_3par_docker_plugin
$ ansible-playbook -i hosts uninstall/uninstall_hpe_3par_volume_driver_etcd.yml --ask-vault-pass

      Note: This process only adds or removes docker volume plugin and/or etcd in nodes in an existing cluster. It does not add or remove nodes in Kubernetes/Openshift cluster

    • On success after adding plugin on new nodes, the additional nodes will have a running docker volume plugin container

    • On success after removing plugin from specified nodes, docker volume plugin container will be removed

Please refer to Usage Guide on how to perform volume related actions on the standalone docker environment.

Please refer to the Kubernetes/OpenShift section in the Usage Guide on how to create and deploy some sample SCs, PVCs, and Pods with persistent volumes using the HPE 3PAR Docker Volume Plug-in.