V2 Performance Signal Detected by TorchBench CI on '2.6.0.dev20240914+cu124'

[xuzhao9]

TorchBench CI has detected a performance signal.

Base PyTorch version: 2.4.0.dev20240606+cu121

Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1

Affected PyTorch version: 2.6.0.dev20240914+cu124

Affected PyTorch commit: 081c4a966de77dd5187c1cb97d287cae6f3fbc02

Affected Tests:

• test_train[Super_SloMo-cuda-eager]: +14.62073%
• test_eval[Super_SloMo-cuda-eager]: +11.06524%
• test_train[Super_SloMo-cuda-jit]: +14.75104%
• test_eval[Super_SloMo-cuda-jit]: +11.22865%
• test_eval[alexnet-cuda-eager]: +10.52647%
• test_eval[alexnet-cuda-jit]: +13.86864%
• test_train[dcgan-cuda-eager]: +63.60124%
• test_train[dcgan-cuda-jit]: +63.60849%
• test_eval[pytorch_stargan-cpu-eager]: -13.51456%
• test_eval[shufflenet_v2_x1_0-cpu-eager]: +14.21934%
• test_eval[shufflenet_v2_x1_0-cuda-jit]: -27.54311%
• test_train[timm_nfnet-cpu-jit]: -13.11850%
• test_eval[timm_regnet-cuda-eager]: +170.74196%
• test_eval[timm_regnet-cuda-jit]: +355.22499%
• test_train[tts_angular-cpu-eager]: +12.80220%
• test_train[yolov3-cuda-eager]: -9.78467%

cc @xuzhao9

Result json:

{
  "start": "ffaea656b5d8ff6518669494cc8f664b94f8e8b1",
  "end": "081c4a966de77dd5187c1cb97d287cae6f3fbc02",
  "threshold": 7,
  "timeout": 120,
  "torchbench_branch": "v2.0",
  "result": [
    {
      "commit1": "fedae41c57b",
      "commit1_time": "2024-07-16 06:55:46 +0000",
      "commit1_digest": {
        "test_train[tts_angular-cpu-eager]": 0.23825253788381814
      },
      "commit2": "096dc444cee",
      "commit2_time": "2024-07-16 08:39:00 +0000",
      "commit2_digest": {
        "test_train[tts_angular-cpu-eager]": 0.21400512969121338
      }
    }
  ]
}

Bisection workflow link: https://github.com/pytorch/benchmark/actions/runs/10864154281