Skip to content

Fix race condition in Client.scheduler_info - #9375

Open
TomAugspurger wants to merge 1 commit into
dask:mainfrom
TomAugspurger:tom/scheduler-identity-race
Open

TomAugspurger wants to merge 1 commit into
dask:mainfrom
TomAugspurger:tom/scheduler-identity-race

Conversation

@TomAugspurger

Copy link
Copy Markdown
Member

The periodic callback was setting self._scheduler_identity to an identity with 0 workers, so simply returning self._scheduler_identity from Client.scheduler_info() risks giving the wrong result. I think we need a fresh call.

With this, the reproducer from #9374 doesn't error after 2 minutes / 133,000 calls (previously it errored after a couple dozen).

Closes #9374.

The periodic callback was setting `self._scheduler_identity` to an
identity with 0 workers, so simply returning `self._scheduler_identity`
from `Client.scheduler_info()` risks giving the wrong result. I think
we need a fresh call.
@github-actions

Copy link
Copy Markdown
Contributor

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

    39 files   -     1      39 suites   - 1   14h 4m 55s ⏱️ - 17m 18s
 4 160 tests ±    0   3 979 ✅  -     3    178 💤 ±  0  3 ❌ +3 
78 246 runs   - 2 714  74 144 ✅  - 2 576  4 098 💤  - 142  4 ❌ +4 

For more details on these failures, see this check.

Results for commit 44c7592. ± Comparison against base commit dc182bd.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Race condition in client.scheduler_info gives 0 workers

1 participant