You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Bugbot interprets those status flags as meaning that the fix is present in 122 and 120 but maybe not 121, and so bugbot worries that 121 (current beta) could be affected, which would be a valid concern if this were a fix that we landed on trunk in the 122 cycle and uplifted to 120 but we forgot about 121.
Bugbot sets status firefox121: affected (incorrectly)
Bugbot nags to see if we need an uplift to 121, since 121 is now flagged as affected. This doesn't really make sense since the patch hit trunk in version 120, so uplift to 121 is nonsensical. (Only after reconstructing the history as I have above does it become clear why bugbot is concerned with hypothetical "uplift" here.)
If things remain as they are, we will potentially hit this same issue over and over and over again, any time that a fix lands in version N and QA verifies it in version N+2 (without explicitly setting a status for version N+1).
One mitigation here could be to change QA practices to verify the fix in different versions instead or in addition, but I'm not sure that's really a good use of time. But I think we can improve bugbot to avoid this:
SUGGESTED FIX: in steps 4-5 here, bugbot should perhaps not worry about intermediate versions (121 in this case) if the Milestone flag is set to a lower version (120 in this case). The milestone indicates when the patch hit trunk, and so fixed version-status can be presumed to apply to all subsequent versions. And if version N is the "milestone" and version N+2 gets a verified status, bugbot should infer that that's simply the version that QA tested when verifying the fix, rather than inferring that we cherrypicked the fix to only land on certain versions and skipped intermediate ones.
The text was updated successfully, but these errors were encountered:
We landed on an interesting bugbot edge case in https://bugzilla.mozilla.org/show_bug.cgi?id=1853455#c11 . Here's what happened:
firefox120: fixed
firefox122: verified
. So at this point we have:firefox121: affected
(incorrectly)If things remain as they are, we will potentially hit this same issue over and over and over again, any time that a fix lands in version N and QA verifies it in version N+2 (without explicitly setting a status for version N+1).
One mitigation here could be to change QA practices to verify the fix in different versions instead or in addition, but I'm not sure that's really a good use of time. But I think we can improve bugbot to avoid this:
SUGGESTED FIX: in steps 4-5 here, bugbot should perhaps not worry about intermediate versions (121 in this case) if the
Milestone
flag is set to a lower version (120 in this case). The milestone indicates when the patch hit trunk, and sofixed
version-status can be presumed to apply to all subsequent versions. And if version N is the "milestone" and version N+2 gets averified
status, bugbot should infer that that's simply the version that QA tested when verifying the fix, rather than inferring that we cherrypicked the fix to only land on certain versions and skipped intermediate ones.The text was updated successfully, but these errors were encountered: