Skip to content

Fix flaky test in login.test.ts (normalizes CLI login origins and preserves the allowlist) - #110

Merged
dodok8 merged 2 commits into
mainfrom
109/cli-login-test
Oct 6, 2026
Merged

dodok8 merged 2 commits into
mainfrom
109/cli-login-test

Conversation

@dodok8

@dodok8 dodok8 commented Oct 6, 2026 •

Copy link
Copy Markdown
Member

Summary

This is a testbed PR to measure CLI login integration test timing and investigate intermittent CI failures.

Related to #109.

How to check

  • Push an empty commit to this branch.
  • Compare the login test duration across Ubuntu, macOS, and Windows.

Result

Single tests takes times about 3.21 - 6.89 secs, multiple pararell tests takes about 28 secs. Previous 30 secs limit is not appropriate, even though test is event-driven, it fails before check all events.

However, just in case, an upper limit is necessary to prevent any potential infinite loop errors from causing the entire test to fail due to a timeout. This PR resolves flakiness based on experimental data by changing the existing upper limit to 2 minutes.

AI assistance

Codex reviewed the test and CI configuration, created empty commits at the maintainer’s request, and collected CI timing samples.

Comment thread .github/workflows/temp.yaml Fixed
Comment thread .github/workflows/temp.yaml Fixed
@dodok8
dodok8 force-pushed the 109/cli-login-test branch from 1d9aa84 to 8a6018c Compare October 6, 2026 07:18
@dodok8
dodok8 merged commit e59cb81 into main Oct 6, 2026
11 checks passed
@dodok8
dodok8 deleted the 109/cli-login-test branch October 6, 2026 07:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants