Non-graceful exit from dask example #34
Description
The example at https://github.com/CoffeaTeam/lpcjobqueue#with-dask provides the expected output, but afterward produces this error:
2024-10-07 18:59:19,866 - tornado.application - ERROR - Exception in callback functools.partial(<bound method IOLoop._discard_future_result of <tornado.platform.asyncio.AsyncIOMainLoop object at 0x7f65de5b27d0>>, <Task finished name='Task-10753' coro=<SpecCluster._correct_state_internal() done, defined at /usr/local/lib/python3.11/site-packages/distributed/deploy/spec.py:346> exception=RuntimeError('cannot schedule new futures after shutdown')>)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/tornado/ioloop.py", line 750, in _run_callback
ret = callback()
^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/tornado/ioloop.py", line 774, in _discard_future_result
future.result()
RuntimeError: cannot schedule new futures after shutdown
2024-10-07 18:59:19,891 - distributed.scheduler - ERROR -
Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/distributed/utils.py", line 806, in wrapper
return await func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/distributed/scheduler.py", line 4595, in add_worker
await self.handle_worker(comm, address)
File "/usr/local/lib/python3.11/site-packages/distributed/scheduler.py", line 6121, in handle_worker
await self.handle_stream(comm=comm, extra={"worker": worker})
File "/usr/local/lib/python3.11/site-packages/distributed/core.py", line 886, in handle_stream
msgs = await comm.read()
^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/distributed/comm/tcp.py", line 225, in read
frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
asyncio.exceptions.CancelledError
Last-ditch attempt to close HTCondor job 43109063 in finalizer! You should confirm the job exits!