PROD Server Python Package install Deployment error

Error: home/ubuntu/proto-2/requirements.txt (line 2))\n Using cached https://files.pythonhosted.org/packages/d7/14/2a0004d487464d120c9fb85313a75cd3d71a7506955be458eebfe19a6b1d/s3transfer-0.1.13-py2.py3-none-any.whl\nCollecting rsa<=3.5.0,>=3.1.2 (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\n Using cached https://files.pythonhosted.org/packages/e1/ae/baedc9cb175552e95f3395c43055a6a5e125ae4d48a1d7a924baca83e92e/rsa-3.4.2-py2.py3-none-any.whl\nCollecting colorama<=0.3.9,>=0.2.5 (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\n Using cached https://files.pythonhosted.org/packages/db/c8/7dcf9dbcb22429512708fe3a547f8b6101c0d02137acbd892505aee57adf/colorama-0.3.9-py2.py3-none-any.whl\nCollecting boto3>=1.1.1 (from credstash==1.15.0->-r /home/ubuntu/proto-2/requirements.txt (line 3))\n Using cached https://files.pythonhosted.org/packages/11/5d/55fd56e43f672073d13f7e7630856108614274026bc053c5fd4a70195767/boto3-1.17.11-py2.py3-none-any.whl\nCollecting cryptography>=2.1 (from credstash==1.15.0->-r /home/ubuntu/proto-2/requirements.txt (line 3))\n Using cached https://files.pythonhosted.org/packages/fa/2d/2154d8cb773064570f48ec0b60258a4522490fcb115a6c7c9423482ca993/cryptography-3.4.6.tar.gz\n Complete output from command python setup.py egg_info:\n \n =============================DEBUG ASSISTANCE==========================\n If you are seeing an error here please try the following to\n successfully install cryptography:\n \n Upgrade to the latest pip and try again. This will fix errors for most\n users. See: https://pip.pypa.io/en/stable/installing/#upgrading-pip\n =============================DEBUG ASSISTANCE==========================\n \n Traceback (most recent call last):\n File "", line 1, in \n File "/tmp/pip-build-vj_vGT/cryptography/setup.py", line 14, in \n from setuptools_rust import RustExtension\n ImportError: No module named setuptools_rust\n \n ----------------------------------------\n\n:stderr: Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-vj_vGT/cryptography/\nYou are using pip version 8.1.1, however version 21.0.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n"}

Resolution: We added in requirements.txt cryptography-3.3.1 ( an older version of cryptography) and this solved the issue

Links visited: https://pypi.org/project/bcrypt/#history https://stackoverflow.com/questions/42515296/pip-install-fails-with-invalid-requirement-xml-version-1-0-encoding-utf

Faced another issue on staging:

Error: fatal: [18.207.213.235]: FAILED! => {"changed": false, "cmd": "/usr/local/bin/pip install -r /home/ubuntu/proto-2/requirements.txt", "msg": "stdout: Requirement already satisfied: setuptools==41.2.0 in /home/ubuntu/.local/lib/python2.7/site-packages (from -r /home/ubuntu/proto-2/requirements.txt (line 1))\nRequirement already satisfied: awscli==1.15.68 in /home/ubuntu/.local/lib/python2.7/site-packages (from -r /home/ubuntu/proto-2/requirements.txt (line 2))\nCollecting cryptography==3.3.1 (from -r /home/ubuntu/proto-2/requirements.txt (line 3))\n Using cached https://files.pythonhosted.org/packages/03/7b/b208dfa8ac77108af4a14960d1a9e0bb86fd87f084dd75f614f9b27adc85/cryptography-3.3.1-cp27-cp27mu-manylinux1_x86_64.whl\nRequirement already satisfied: credstash==1.15.0 in /home/ubuntu/.local/lib/python2.7/site-packages (from -r /home/ubuntu/proto-2/requirements.txt (line 4))\nRequirement already satisfied: ansible==2.6.14 in /home/ubuntu/.local/lib/python2.7/site-packages (from -r /home/ubuntu/proto-2/requirements.txt (line 5))\nRequirement already satisfied: boto==2.49.0 in /home/ubuntu/.local/lib/python2.7/site-packages (from -r /home/ubuntu/proto-2/requirements.txt (line 6))\nRequirement already satisfied: bcrypt==3.1.7 in /home/ubuntu/.local/lib/python2.7/site-packages (from -r /home/ubuntu/proto-2/requirements.txt (line 7))\nRequirement already satisfied: docutils>=0.10 in /home/ubuntu/.local/lib/python2.7/site-packages (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: botocore==1.10.67 in /home/ubuntu/.local/lib/python2.7/site-packages (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: PyYAML<=3.13,>=3.10 in /home/ubuntu/.local/lib/python2.7/site-packages (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: s3transfer<0.2.0,>=0.1.12 in /home/ubuntu/.local/lib/python2.7/site-packages (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: rsa<=3.5.0,>=3.1.2 in /home/ubuntu/.local/lib/python2.7/site-packages (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: colorama<=0.3.9,>=0.2.5 in /home/ubuntu/.local/lib/python2.7/site-packages (from awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: enum34; python_version < "3" in /home/ubuntu/.local/lib/python2.7/site-packages (from cryptography==3.3.1->-r /home/ubuntu/proto-2/requirements.txt (line 3))\nRequirement already satisfied: six>=1.4.1 in /home/ubuntu/.local/lib/python2.7/site-packages (from cryptography==3.3.1->-r /home/ubuntu/proto-2/requirements.txt (line 3))\nRequirement already satisfied: cffi>=1.12 in /home/ubuntu/.local/lib/python2.7/site-packages (from cryptography==3.3.1->-r /home/ubuntu/proto-2/requirements.txt (line 3))\nRequirement already satisfied: ipaddress; python_version < "3" in /home/ubuntu/.local/lib/python2.7/site-packages (from cryptography==3.3.1->-r /home/ubuntu/proto-2/requirements.txt (line 3))\nRequirement already satisfied: boto3>=1.1.1 in /home/ubuntu/.local/lib/python2.7/site-packages (from credstash==1.15.0->-r /home/ubuntu/proto-2/requirements.txt (line 4))\nRequirement already satisfied: paramiko in /home/ubuntu/.local/lib/python2.7/site-packages (from ansible==2.6.14->-r /home/ubuntu/proto-2/requirements.txt (line 5))\nRequirement already satisfied: jinja2 in /home/ubuntu/.local/lib/python2.7/site-packages (from ansible==2.6.14->-r /home/ubuntu/proto-2/requirements.txt (line 5))\nRequirement already satisfied: jmespath<1.0.0,>=0.7.1 in /home/ubuntu/.local/lib/python2.7/site-packages (from botocore==1.10.67->awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: python-dateutil<3.0.0,>=2.1; python_version >= "2.7" in /home/ubuntu/.local/lib/python2.7/site-packages (from botocore==1.10.67->awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" in /home/ubuntu/.local/lib/python2.7/site-packages (from s3transfer<0.2.0,>=0.1.12->awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: pyasn1>=0.1.3 in /home/ubuntu/.local/lib/python2.7/site-packages (from rsa<=3.5.0,>=3.1.2->awscli==1.15.68->-r /home/ubuntu/proto-2/requirements.txt (line 2))\nRequirement already satisfied: pycparser in /home/ubuntu/.local/lib/python2.7/site-packages (from cffi>=1.12->cryptography==3.3.1->-r /home/ubuntu/proto-2/requirements.txt (line 3))\nRequirement already satisfied: pynacl>=1.0.1 in /home/ubuntu/.local/lib/python2.7/site-packages (from paramiko->ansible==2.6.14->-r /home/ubuntu/proto-2/requirements.txt (line 5))\nRequirement already satisfied: MarkupSafe>=0.23 in /home/ubuntu/.local/lib/python2.7/site-packages (from jinja2->ansible==2.6.14->-r /home/ubuntu/proto-2/requirements.txt (line 5))\nInstalling collected packages: cryptography\n Found existing installation: cryptography 2.6.1\n Uninstalling cryptography-2.6.1:\n Successfully uninstalled cryptography-2.6.1\n Rolling back uninstall of cryptography\n\n:stderr: Exception:\nTraceback (most recent call last):\n File "/usr/local/lib/python2.7/dist-packages/pip/basecommand.py", line 215, in main\n status = self.run(options, args)\n File "/usr/local/lib/python2.7/dist-packages/pip/commands/install.py", line 342, in run\n prefix=options.prefix_path,\n File "/usr/local/lib/python2.7/dist-packages/pip/req/req_set.py", line 784, in install\n **kwargs\n File "/usr/local/lib/python2.7/dist-packages/pip/req/req_install.py", line 851, in install\n self.move_wheel_files(self.source_dir, root=root, prefix=prefix)\n File "/usr/local/lib/python2.7/dist-packages/pip/req/req_install.py", line 1064, in move_wheel_files\n isolated=self.isolated,\n File "/usr/local/lib/python2.7/dist-packages/pip/wheel.py", line 345, in move_wheel_files\n clobber(source, lib_dir, True)\n File "/usr/local/lib/python2.7/dist-packages/pip/wheel.py", line 316, in clobber\n ensure_dir(destdir)\n File "/usr/local/lib/python2.7/dist-packages/pip/utils/init.py", line 83, in ensure_dir\n os.makedirs(path)\n File "/usr/lib/python2.7/os.py", line 157, in makedirs\n mkdir(name, mode)\nOSError: [Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/cryptography-3.3.1.dist-info'\nYou are using pip version 9.0.1, however version 21.0.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n"}

Resolution: Logged into AWS staging box, manually installed cryptography-3.3.1 using command pip install --user cryptography==3.3.1. This resolved the error and we could do a staging deploy using ansible scripts