fix storage monitor race condition

[neilSchroeder]

#1449

Fixing race condition in StorageMonitor that leads to orphaned jobs and indefinite polling.

Developer's Certificate of Origin 1.1

   By making a contribution to this project, I certify that:

   (a) The contribution was created in whole or in part by me and I
       have the right to submit it under the Apache License 2.0; or

   (b) The contribution is based upon previous work that, to the best
       of my knowledge, is covered under an appropriate open source
       license and I have the right under that license to submit that
       work with modifications, whether created in whole or in part
       by me, under the same open source license (unless I am
       permitted to submit under a different license), as indicated
       in the file; or

   (c) The contribution was provided directly to me by some other
       person who certified (a), (b) or (c) and I have not modified
       it.

   (d) I understand and agree that this project and the contribution
       are public and that a record of the contribution (including all
       personal information I submit with it, including my sign-off) is
       maintained indefinitely and may be redistributed consistent with
       this project or the open source license(s) involved.

[neilSchroeder]

@tomwhite here's the updated PR

[tomwhite]

Thanks @neilSchroeder!

@JosepSampe can you take a look please? Thanks!

[JosepSampe]

It looks good to me. However I haven’t had a chance to test it with Cubed—Can we confirm the issue is fixed there with this change?

@neilSchroeder Could you fix the linting error in:

lithops/monitor.py:468:22: W291 trailing whitespace
1     W291 trailing whitespace

[neilSchroeder]

@JosepSampe I've tested locally with cubed and have confirmed it runs fine. Are there other tests we can run?

[JosepSampe]

@neilSchroeder Thank you for your feedback. The tests for this PR have also run successfully, so I will proceed with merging it.
Thanks for contributing this fix.

[tomwhite]

@JosepSampe it would be good to have a release for this if you are planning one soon?

[JosepSampe]

Sure, I’ll release it this week

[tomwhite]

@JosepSampe thank you!

[JosepSampe]

@tomwhite I already created the release