If you would like to use pyspark in client mode with Spark 2.3.0-cloudera4, you will probably install the open-source version from pypi…