=> ERROR [compose_notebook 4/6] RUN pip install --user notebook findspark pyspark-kernel spylon-kernel                                                                                                                                     46.8s

#11 25.51 Installing collected packages: zipp, traitlets, pyrsistent, importlib-resources, attrs, wcwidth, typing-extensions, tornado, tomli, pyzmq, python-dateutil, pyparsing, pycparser, pure-eval, ptyprocess, pathspec, parso, nest-asyncio, mypy-extensions, jupyter-core, jsonschema, ipython-genutils, executing, entrypoints, click, asttokens, webencodings, stack-data, pygments, prompt-toolkit, pickleshare, pexpect, packaging, nbformat, matplotlib-inline, MarkupSafe, jupyter-client, jedi, decorator, cffi, black, backcall, testpath, pandocfilters, nbclient, mistune, jupyterlab-pygments, jinja2, IPython, defusedxml, debugpy, bleach, argon2-cffi-bindings, terminado, Send2Trash, prometheus-client, nbconvert, ipykernel, argon2-cffi, notebook, widgetsnbextension, jupyterlab-widgets, spylon, pyyaml, pytz, numpy, ipywidgets, findspark, pandas, metakernel, ipydatatable, spylon-kernel, pyspark-kernel
#11 32.11     Running setup.py install for spylon: started
#11 32.69     Running setup.py install for spylon: finished with status 'done'
#11 40.38     Running setup.py install for spylon-kernel: started
#11 40.97     Running setup.py install for spylon-kernel: finished with status 'done'
#11 40.98     Running setup.py install for pyspark-kernel: started
#11 41.94     Running setup.py install for pyspark-kernel: finished with status 'error'
#11 41.94     ERROR: Command errored out with exit status 1:
#11 41.94      command: /opt/bitnami/python/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-6s83qwr7/pyspark-kernel_92ad01ead7a341e2b57109b9973cad88/setup.py'"'"'; __file__='"'"'/tmp/pip-install-6s83qwr7/pyspark-kernel_92ad01ead7a341e2b57109b9973cad88/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-dvuvon8d/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /home/notebook/.local/include/python3.8/pyspark-kernel
#11 41.94          cwd: /tmp/pip-install-6s83qwr7/pyspark-kernel_92ad01ead7a341e2b57109b9973cad88/
#11 41.94     Complete output (44 lines):
#11 41.94     running install
#11 41.94     running build
#11 41.94     running build_py
#11 41.94     creating build
#11 41.94     creating build/lib
#11 41.94     creating build/lib/pyspark_kernel
#11 41.94     copying pyspark_kernel/pyspark_kernel.py -> build/lib/pyspark_kernel
#11 41.94     copying pyspark_kernel/__init__.py -> build/lib/pyspark_kernel
#11 41.94     copying pyspark_kernel/__main__.py -> build/lib/pyspark_kernel
#11 41.94     copying pyspark_kernel/pyspark_magic.py -> build/lib/pyspark_kernel
#11 41.94     running install_lib
#11 41.94     creating /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel
#11 41.94     copying build/lib/pyspark_kernel/pyspark_kernel.py -> /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel
#11 41.94     copying build/lib/pyspark_kernel/__init__.py -> /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel
#11 41.94     copying build/lib/pyspark_kernel/__main__.py -> /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel
#11 41.94     copying build/lib/pyspark_kernel/pyspark_magic.py -> /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel
#11 41.94     byte-compiling /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel/pyspark_kernel.py to pyspark_kernel.cpython-38.pyc
#11 41.94     byte-compiling /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel/__init__.py to __init__.cpython-38.pyc
#11 41.94     byte-compiling /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel/__main__.py to __main__.cpython-38.pyc
#11 41.94     byte-compiling /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel/pyspark_magic.py to pyspark_magic.cpython-38.pyc
#11 41.94     running install_egg_info
#11 41.94     running egg_info
#11 41.94     writing pyspark_kernel.egg-info/PKG-INFO
#11 41.94     writing dependency_links to pyspark_kernel.egg-info/dependency_links.txt
#11 41.94     writing requirements to pyspark_kernel.egg-info/requires.txt
#11 41.94     writing top-level names to pyspark_kernel.egg-info/top_level.txt
#11 41.94     reading manifest file 'pyspark_kernel.egg-info/SOURCES.txt'
#11 41.94     writing manifest file 'pyspark_kernel.egg-info/SOURCES.txt'
#11 41.94     Copying pyspark_kernel.egg-info to /home/notebook/.local/lib/python3.8/site-packages/pyspark_kernel-0.3.0-py3.8.egg-info
#11 41.94     writing list of installed files to '/tmp/pip-record-dvuvon8d/install-record.txt'
#11 41.94     Traceback (most recent call last):
#11 41.94       File "<string>", line 1, in <module>
#11 41.94       File "/tmp/pip-install-6s83qwr7/pyspark-kernel_92ad01ead7a341e2b57109b9973cad88/setup.py", line 47, in <module>
#11 41.94         setup(name='pyspark_kernel',
#11 41.94       File "/opt/bitnami/python/lib/python3.8/site-packages/setuptools-46.4.0-py3.8.egg/setuptools/__init__.py", line 144, in setup
#11 41.94       File "/opt/bitnami/python/lib/python3.8/distutils/core.py", line 148, in setup
#11 41.94         dist.run_commands()
#11 41.94       File "/opt/bitnami/python/lib/python3.8/distutils/dist.py", line 966, in run_commands
#11 41.94         self.run_command(cmd)
#11 41.94       File "/opt/bitnami/python/lib/python3.8/distutils/dist.py", line 985, in run_command
#11 41.94         cmd_obj.run()
#11 41.94       File "/tmp/pip-install-6s83qwr7/pyspark-kernel_92ad01ead7a341e2b57109b9973cad88/setup.py", line 27, in run
#11 41.94         from IPython.kernel.kernelspec import install_kernel_spec
#11 41.94     ModuleNotFoundError: No module named 'IPython.kernel'
#11 41.94     ----------------------------------------
#11 41.94 ERROR: Command errored out with exit status 1: /opt/bitnami/python/bin/python -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-6s83qwr7/pyspark-kernel_92ad01ead7a341e2b57109b9973cad88/setup.py'"'"'; __file__='"'"'/tmp/pip-install-6s83qwr7/pyspark-kernel_92ad01ead7a341e2b57109b9973cad88/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-dvuvon8d/install-record.txt --single-version-externally-managed --user --prefix= --compile --install-headers /home/notebook/.local/include/python3.8/pyspark-kernel Check the logs for full command output.