Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: Agent gets stuck during deployment group task (Powershell) #5097

Open
1 of 4 tasks
itsme112358 opened this issue Jan 22, 2025 · 0 comments
Open
1 of 4 tasks

[BUG]: Agent gets stuck during deployment group task (Powershell) #5097

itsme112358 opened this issue Jan 22, 2025 · 0 comments

Comments

@itsme112358
Copy link

What happened?

We have ~150 Deployment group Agents in a pool.
They update our Business Central applications that we host for our customers.
The upgrade steps worked fine in the past but in the last couple of days we have experienced individual agents getting stuck on a task for no apparent reason after having executed other tasks just fine.
Before the task really does anything there are a couple of write-hosts already, these don't make it to azure devops job log:

Image

Running the script manually results in an error. That is fine, we know how to fix the error:

Image

So the expected behavior would be for the task to fail. Instead it just "hangs around" and does nothing.

As this happened again today, I checked the agent and job logs.
The agent log has a 401 authentication warning every ~55 mins. 10:39 is whe it received the job. The log goes on like this until now (see Agent log)
The worker log doesn't show any issues (see Worker log)

If/when I cancel the release subsequent jobs then get executed fine.

Yes, I could set a timeout for the job but then our deployment group jobs would fail regularly for no apparent reason.

Agent_20250118-191620-utc.log

Worker_20250121-103904-utc.log

Versions

Agent: 3.238.0
OS: Windows Server 2022 21H2 Build 20348.2908
.NET SDK:
Version: 8.0.405
Commit: fb1830d421
Workload version: 8.0.400-manifests.c7afa696
MSBuild version: 17.11.9+a69bbaaf5

Runtime Environment:
OS Name: Windows
OS Version: 10.0.20348
OS Platform: Windows
RID: win-x64
Base Path: C:\Program Files\dotnet\sdk\8.0.405\

.NET workloads installed:
Configured to use loose manifests when installing new manifests.
There are no installed workloads to display.

Host:
Version: 8.0.12
Architecture: x64
Commit: 89ef51c5d8

.NET SDKs installed:
8.0.405 [C:\Program Files\dotnet\sdk]

.NET runtimes installed:
Microsoft.AspNetCore.App 6.0.35 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 8.0.10 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 8.0.12 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 6.0.35 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 8.0.10 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 8.0.12 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 8.0.12 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]

Other architectures found:
x86 [C:\Program Files (x86)\dotnet]
registered at [HKLM\SOFTWARE\dotnet\Setup\InstalledVersions\x86\InstallLocation]

Environment variables:
Not set

global.json file:
Not found

Learn more:
https://aka.ms/dotnet/info

Download .NET:
https://aka.ms/dotnet/download

Environment type (Please select at least one enviroment where you face this issue)

  • Self-Hosted
  • Microsoft Hosted
  • VMSS Pool
  • Container

Azure DevOps Server type

dev.azure.com (formerly visualstudio.com)

Azure DevOps Server Version (if applicable)

No response

Operation system

No response

Version controll system

No response

Relevant log output

**Agent log**
[2025-01-21 09:58:13Z INFO ProcessInvokerWrapper] Process started with process id 16844, waiting for process exit.
[2025-01-21 09:58:13Z INFO JobDispatcher] Send job request message to worker for job 0efd82de-3022-4e1b-b236-66a070ff2f14 (73 KB).
[2025-01-21 09:58:14Z INFO JobDispatcher] Took 780 ms to send job message to worker
[2025-01-21 09:58:14Z INFO JobNotification] Entering JobStarted Notification
[2025-01-21 09:58:14Z INFO JobNotification] Entering StartMonitor
[2025-01-21 09:59:04Z INFO MessageListener] Sleeping for 9.927 seconds before retrying.
[2025-01-21 09:59:07Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 09:59:13Z WARN VisualStudioServices] Authentication failed with status code 401.
Cache-Control: no-cache
Pragma: no-cache
P3P: CP="CAO DSP COR ADMa DEV CONo TELo CUR PSA PSD TAI IVDo OUR SAMi BUS DEM NAV STA UNI COM INT PHY ONL FIN PUR LOC CNT"
WWW-Authenticate: Bearer authorization_uri=https://login.microsoftonline.com/[redacted], Basic realm="https://tfsprodweu3.visualstudio.com/", TFS-Federated
X-TFS-ProcessId: ddcc8aed-aba9-4e61-8474-ce2b968d8e38
Strict-Transport-Security: max-age=31536000; includeSubDomains
ActivityId: 3c008dc5-4ae0-42e8-b16b-fd8a978254a0
X-TFS-Session: efcee7dd-e649-4cf9-8c52-3164e5bff44a
X-VSS-E2EID: acf9e1bb-4c8a-4976-b2c9-b7c0f6fb0166
X-VSS-SenderDeploymentId: 917a458e-1d30-b53d-ff6e-6b3ef9f8a0de
X-Frame-Options: SAMEORIGIN
X-TFS-FedAuthRealm: https://tfsprodweu3.visualstudio.com/
X-TFS-FedAuthIssuer: https://dev.azure.com/[redacted]/
X-VSS-AuthorizationEndpoint: https://vssps.dev.azure.com/[redacted]/
X-VSS-ResourceTenant: [redacted]
X-VSS-S2STargetService: 00000002-0000-8888-8000-000000000000/visualstudio.com
X-TFS-FedAuthRedirect: https://spsprodweu1.vssps.visualstudio.com/_signin?realm=dev.azure.com&reply_to=https%3A%2F%2Fdev.azure.com%2F[redacted]%2F_apis%2Fdistributedtask%2Fpools%2F33%2Fjobrequests%2F877097%3FlockToken%3D00000000-0000-0000-0000-000000000000&redirect=1&hid=387cff66-6c17-438d-acc7-91e6489535f5&context=eyJodCI6MiwiaGlkIjoiMTg1ZWE3MzctM2I1ZS00MzZjLTkzMmEtNDE1MmU1NzEwNmYwIiwicXMiOnt9LCJyciI6IiIsInZoIjoiIiwiY3YiOiIiLCJjcyI6IiJ90#ctx=eyJTaWduSW5Db29raWVEb21haW5zIjpbImh0dHBzOi8vbG9naW4ubWljcm9zb2Z0b25saW5lLmNvbSIsImh0dHBzOi8vbG9naW4ubWljcm9zb2Z0b25saW5lLmNvbSJdfQ2
Request-Context: appId=cid-v1:c8f7fd9a-79c8-4464-b82d-4564078d0a8d
Access-Control-Expose-Headers: Request-Context
X-Content-Type-Options: nosniff
X-Cache: CONFIG_NOCACHE
X-MSEdge-Ref: Ref A: C3A55AADE6904975996DAE99FB4B4E95 Ref B: FRAEDGE1516 Ref C: 2025-01-21T09:59:13Z
Date: Tue, 21 Jan 2025 09:59:13 GMT

[2025-01-21 09:59:13Z INFO RSAEncryptedFileKeyManager] Loading RSA key parameters from file C:\azagent\[redacted]\.credentials_rsaparams
[2025-01-21 09:59:13Z INFO VisualStudioServices] AAD Correlation ID for this token request: Unknown
[2025-01-21 09:59:13Z INFO JobDispatcher] Successfully renew job request 877097, job is valid till 1/21/2025 10:09:13 AM
[2025-01-21 10:00:03Z INFO ProcessInvokerWrapper] STDOUT/STDERR stream read finished.
[2025-01-21 10:00:03Z INFO ProcessInvokerWrapper] STDOUT/STDERR stream read finished.
[2025-01-21 10:00:03Z INFO ProcessInvokerWrapper] Exited process 16844 with exit code 100
[2025-01-21 10:00:03Z INFO ProcessInvokerWrapper] Finished process 16844 with exit code 100, and elapsed time 00:01:50.1441366.
[2025-01-21 10:00:03Z INFO JobDispatcher] Worker finished for job 0efd82de-3022-4e1b-b236-66a070ff2f14. Code: 100
[2025-01-21 10:00:03Z INFO JobDispatcher] finish job request for job 0efd82de-3022-4e1b-b236-66a070ff2f14 with result: Succeeded
[2025-01-21 10:00:03Z INFO Terminal] WRITE LINE: 2025-01-21 10:00:03Z: Job Release completed with result: Succeeded
[2025-01-21 10:00:03Z INFO JobDispatcher] Stop renew job request for job 0efd82de-3022-4e1b-b236-66a070ff2f14.
[2025-01-21 10:00:03Z INFO JobDispatcher] job renew has been canceled, stop renew job request 877097.
[2025-01-21 10:00:03Z INFO JobNotification] Entering JobCompleted Notification
[2025-01-21 10:00:03Z INFO JobNotification] Entering EndMonitor
[2025-01-21 10:00:04Z INFO MessageListener] Sleeping for 13.423 seconds before retrying.
[2025-01-21 10:00:27Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:01:07Z INFO MessageListener] Sleeping for 7.412 seconds before retrying.
[2025-01-21 10:01:47Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:02:05Z INFO MessageListener] Sleeping for 14.426 seconds before retrying.
[2025-01-21 10:03:07Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:03:09Z INFO MessageListener] Sleeping for 7.338 seconds before retrying.
[2025-01-21 10:04:06Z INFO MessageListener] Sleeping for 7.831 seconds before retrying.
[2025-01-21 10:04:27Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:05:04Z INFO MessageListener] Sleeping for 13.388 seconds before retrying.
[2025-01-21 10:05:47Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:06:08Z INFO MessageListener] Sleeping for 14.563 seconds before retrying.
[2025-01-21 10:07:07Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:07:13Z INFO MessageListener] Sleeping for 13.06 seconds before retrying.
[2025-01-21 10:08:16Z INFO MessageListener] Sleeping for 11.008 seconds before retrying.
[2025-01-21 10:08:27Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:09:17Z INFO MessageListener] Sleeping for 10.841 seconds before retrying.
[2025-01-21 10:09:47Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:10:18Z INFO MessageListener] Sleeping for 8.39 seconds before retrying.
[2025-01-21 10:11:07Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:11:16Z INFO MessageListener] Sleeping for 13.746 seconds before retrying.
[2025-01-21 10:12:20Z INFO MessageListener] Sleeping for 14.846 seconds before retrying.
[2025-01-21 10:12:28Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:13:25Z INFO MessageListener] Sleeping for 11.524 seconds before retrying.
[2025-01-21 10:13:48Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:14:26Z INFO MessageListener] Sleeping for 6.555 seconds before retrying.
[2025-01-21 10:15:08Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:15:23Z INFO MessageListener] Sleeping for 7.241 seconds before retrying.
[2025-01-21 10:16:20Z INFO MessageListener] Sleeping for 11.079 seconds before retrying.
[2025-01-21 10:16:28Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:17:21Z INFO MessageListener] Sleeping for 11.762 seconds before retrying.
[2025-01-21 10:17:48Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:18:23Z INFO MessageListener] Sleeping for 9.927 seconds before retrying.
[2025-01-21 10:19:08Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:19:23Z INFO MessageListener] Sleeping for 13.423 seconds before retrying.
[2025-01-21 10:20:26Z INFO MessageListener] Sleeping for 7.412 seconds before retrying.
[2025-01-21 10:20:28Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:21:24Z INFO MessageListener] Sleeping for 14.426 seconds before retrying.
[2025-01-21 10:21:48Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:22:28Z INFO MessageListener] Sleeping for 7.338 seconds before retrying.
[2025-01-21 10:23:08Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:23:26Z INFO MessageListener] Sleeping for 7.831 seconds before retrying.
[2025-01-21 10:24:23Z INFO MessageListener] Sleeping for 13.388 seconds before retrying.
[2025-01-21 10:24:28Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:25:27Z INFO MessageListener] Sleeping for 14.563 seconds before retrying.
[2025-01-21 10:25:48Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:26:31Z INFO MessageListener] Sleeping for 13.06 seconds before retrying.
[2025-01-21 10:26:44Z INFO MessageListener] Sleeping for 11.008 seconds before retrying.
[2025-01-21 10:27:08Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:27:46Z INFO MessageListener] Sleeping for 10.841 seconds before retrying.
[2025-01-21 10:28:28Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:28:46Z INFO MessageListener] No message retrieved from session '54e70385-76e9-426a-bc5e-1e395e3b156f' within last 30 minutes.
[2025-01-21 10:28:46Z INFO MessageListener] Sleeping for 8.39 seconds before retrying.
[2025-01-21 10:29:45Z INFO MessageListener] Sleeping for 13.746 seconds before retrying.
[2025-01-21 10:29:48Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:30:49Z INFO MessageListener] Sleeping for 14.846 seconds before retrying.
[2025-01-21 10:31:08Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:31:53Z INFO MessageListener] Sleeping for 11.524 seconds before retrying.
[2025-01-21 10:32:28Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:32:55Z INFO MessageListener] Sleeping for 6.555 seconds before retrying.
[2025-01-21 10:33:48Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:33:52Z INFO MessageListener] Sleeping for 7.241 seconds before retrying.
[2025-01-21 10:34:49Z INFO MessageListener] Sleeping for 11.079 seconds before retrying.
[2025-01-21 10:35:08Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:35:50Z INFO MessageListener] Sleeping for 11.762 seconds before retrying.
[2025-01-21 10:36:28Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:36:52Z INFO MessageListener] Sleeping for 9.927 seconds before retrying.
[2025-01-21 10:37:48Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:37:52Z INFO MessageListener] Sleeping for 13.423 seconds before retrying.
[2025-01-21 10:38:55Z INFO MessageListener] Sleeping for 7.412 seconds before retrying.
[2025-01-21 10:39:04Z INFO RSAEncryptedFileKeyManager] Loading RSA key parameters from file C:\azagent\[redacted]\.credentials_rsaparams
[2025-01-21 10:39:04Z INFO MessageListener] Message '286' received from session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:39:04Z INFO JobDispatcher] Job request 877178 for plan 2470947e-8f62-466a-b356-2e368b627227 job 6e4130f0-7f52-4fd9-b18e-0b7a8cccef22 received.
[2025-01-21 10:39:04Z INFO JobDispatcher] Job request 0efd82de-3022-4e1b-b236-66a070ff2f14 processed succeed.
[2025-01-21 10:39:04Z INFO Terminal] WRITE LINE: 2025-01-21 10:39:04Z: Running job: Release
[2025-01-21 10:39:04Z INFO AgentServer] Refresh JobRequest VssConnection to get on a different AFD node.
[2025-01-21 10:39:04Z INFO AgentServer] Establish connection with 30 seconds timeout.
[2025-01-21 10:39:04Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:39:04Z INFO VisualStudioServices] Starting operation Location.GetConnectionData
[2025-01-21 10:39:04Z INFO VisualStudioServices] Finished operation Location.GetConnectionData
[2025-01-21 10:39:04Z INFO VisualStudioServices] Starting operation Location.GetConnectionData
[2025-01-21 10:39:04Z INFO VisualStudioServices] Finished operation Location.GetConnectionData
[2025-01-21 10:39:04Z INFO JobDispatcher] Start renew job request 877178 for job 6e4130f0-7f52-4fd9-b18e-0b7a8cccef22.
[2025-01-21 10:39:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:49:04 AM
[2025-01-21 10:39:04Z INFO ConfigurationStore] HasCredentials()
[2025-01-21 10:39:04Z INFO ConfigurationStore] stored True
[2025-01-21 10:39:04Z INFO CredentialManager] GetCredentialProvider
[2025-01-21 10:39:04Z INFO CredentialManager] Creating type OAuth
[2025-01-21 10:39:04Z INFO CredentialManager] Creating credential type: OAuth
[2025-01-21 10:39:04Z INFO RSAEncryptedFileKeyManager] Loading RSA key parameters from file C:\azagent\[redacted]\.credentials_rsaparams
[2025-01-21 10:39:04Z INFO ConfigurationManager] LoadSettings
[2025-01-21 10:39:04Z INFO ConfigurationStore] IsConfigured()
[2025-01-21 10:39:04Z INFO ConfigurationStore] IsConfigured: True
[2025-01-21 10:39:04Z INFO ConfigurationManager] Is configured: True
[2025-01-21 10:39:04Z INFO ConfigurationManager] Settings Loaded
[2025-01-21 10:39:04Z WARN VisualStudioServices] Authentication failed with status code 401.
Cache-Control: no-cache
Pragma: no-cache
P3P: CP="CAO DSP COR ADMa DEV CONo TELo CUR PSA PSD TAI IVDo OUR SAMi BUS DEM NAV STA UNI COM INT PHY ONL FIN PUR LOC CNT"
WWW-Authenticate: Bearer authorization_uri=https://login.microsoftonline.com/[redacted], Basic realm="https://tfsprodweu3.visualstudio.com/", TFS-Federated
X-TFS-ProcessId: 38239150-f739-4a9b-afa1-c071a8332ca3
Strict-Transport-Security: max-age=31536000; includeSubDomains
ActivityId: fd48d076-ffa2-4070-aef5-fcc59d11a62b
X-TFS-Session: efcee7dd-e649-4cf9-8c52-3164e5bff44a
X-VSS-E2EID: cf2c3c00-def0-41ce-b50b-42effa3d9dc3
X-VSS-SenderDeploymentId: 917a458e-1d30-b53d-ff6e-6b3ef9f8a0de
X-Frame-Options: SAMEORIGIN
X-TFS-FedAuthRealm: https://tfsprodweu3.visualstudio.com/
X-TFS-FedAuthIssuer: https://dev.azure.com/[redacted]/
X-VSS-AuthorizationEndpoint: https://vssps.dev.azure.com/[redacted]/
X-VSS-ResourceTenant: [redacted]
X-VSS-S2STargetService: 00000002-0000-8888-8000-000000000000/visualstudio.com
X-TFS-FedAuthRedirect: https://spsprodweu1.vssps.visualstudio.com/_signin?realm=dev.azure.com&reply_to=https%3A%2F%2Fdev.azure.com%2F[redacted]%2F_apis%2FFeatureFlags%2FDistributedTask.Agent.UseMaskingPerformanceEnhancements%3FcheckFeatureExists%3DFalse&redirect=1&hid=387cff66-6c17-438d-acc7-91e6489535f5&context=eyJodCI6MiwiaGlkIjoiMTg1ZWE3MzctM2I1ZS00MzZjLTkzMmEtNDE1MmU1NzEwNmYwIiwicXMiOnt9LCJyciI6IiIsInZoIjoiIiwiY3YiOiIiLCJjcyI6IiJ90#ctx=eyJTaWduSW5Db29raWVEb21haW5zIjpbImh0dHBzOi8vbG9naW4ubWljcm9zb2Z0b25saW5lLmNvbSIsImh0dHBzOi8vbG9naW4ubWljcm9zb2Z0b25saW5lLmNvbSJdfQ2
Request-Context: appId=cid-v1:c8f7fd9a-79c8-4464-b82d-4564078d0a8d
Access-Control-Expose-Headers: Request-Context
X-Content-Type-Options: nosniff
X-Cache: CONFIG_NOCACHE
X-MSEdge-Ref: Ref A: 6B62876121A64CB888CEF8B8B9EC639B Ref B: FRAEDGE2013 Ref C: 2025-01-21T10:39:04Z
Date: Tue, 21 Jan 2025 10:39:03 GMT

[2025-01-21 10:39:04Z INFO RSAEncryptedFileKeyManager] Loading RSA key parameters from file C:\azagent\[redacted]\.credentials_rsaparams
[2025-01-21 10:39:04Z INFO RSAEncryptedFileKeyManager] Loading RSA key parameters from file C:\azagent\[redacted]\.credentials_rsaparams
[2025-01-21 10:39:04Z INFO VisualStudioServices] AAD Correlation ID for this token request: Unknown
[2025-01-21 10:39:04Z INFO HostContext] Well known directory 'Bin': 'C:\azagent\[redacted]\bin'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper] Starting process:
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   File name: 'C:\azagent\[redacted]\bin\Agent.Worker.exe'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Arguments: 'spawnclient 3044 2152'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Working directory: 'C:\azagent\[redacted]\bin'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Require exit code zero: 'False'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Encoding web name:  ; code page: ''
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Force kill process on cancellation: 'True'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Redirected STDIN: 'False'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Persist current code page: 'False'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   Keep redirected STDIN open: 'False'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   High priority process: 'True'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper]   ContinueAfterCancelProcessTreeKillAttempt: 'False'
[2025-01-21 10:39:04Z INFO ProcessInvokerWrapper] Process started with process id 12944, waiting for process exit.
[2025-01-21 10:39:04Z INFO JobDispatcher] Send job request message to worker for job 6e4130f0-7f52-4fd9-b18e-0b7a8cccef22 (34 KB).
[2025-01-21 10:39:04Z INFO JobDispatcher] Took 126 ms to send job message to worker
[2025-01-21 10:39:04Z INFO JobNotification] Entering JobStarted Notification
[2025-01-21 10:39:04Z INFO JobNotification] Entering StartMonitor
[2025-01-21 10:39:54Z INFO MessageListener] Sleeping for 14.426 seconds before retrying.
[2025-01-21 10:40:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:50:04 AM
[2025-01-21 10:40:24Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:40:59Z INFO MessageListener] Sleeping for 7.338 seconds before retrying.
[2025-01-21 10:41:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:51:04 AM
[2025-01-21 10:41:44Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:41:56Z INFO MessageListener] Sleeping for 7.831 seconds before retrying.
[2025-01-21 10:42:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:52:04 AM
[2025-01-21 10:42:54Z INFO MessageListener] Sleeping for 13.388 seconds before retrying.
[2025-01-21 10:43:04Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:43:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:53:04 AM
[2025-01-21 10:43:57Z INFO MessageListener] Sleeping for 14.563 seconds before retrying.
[2025-01-21 10:44:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:54:04 AM
[2025-01-21 10:44:24Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:45:02Z INFO MessageListener] Sleeping for 13.06 seconds before retrying.
[2025-01-21 10:45:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:55:04 AM
[2025-01-21 10:45:44Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:46:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:56:04 AM
[2025-01-21 10:46:05Z INFO MessageListener] Sleeping for 11.008 seconds before retrying.
[2025-01-21 10:47:04Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:47:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:57:04 AM
[2025-01-21 10:47:06Z INFO MessageListener] Sleeping for 10.841 seconds before retrying.
[2025-01-21 10:48:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:58:04 AM
[2025-01-21 10:48:07Z INFO MessageListener] Sleeping for 8.39 seconds before retrying.
[2025-01-21 10:48:24Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:48:54Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:49:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 10:59:04 AM
[2025-01-21 10:49:05Z INFO MessageListener] Sleeping for 13.746 seconds before retrying.
[2025-01-21 10:50:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:00:04 AM
[2025-01-21 10:50:09Z INFO MessageListener] Sleeping for 14.846 seconds before retrying.
[2025-01-21 10:50:14Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:51:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:01:04 AM
[2025-01-21 10:51:14Z INFO MessageListener] Sleeping for 11.524 seconds before retrying.
[2025-01-21 10:51:34Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:52:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:02:04 AM
[2025-01-21 10:52:15Z INFO MessageListener] Sleeping for 6.555 seconds before retrying.
[2025-01-21 10:52:54Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:53:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:03:04 AM
[2025-01-21 10:53:12Z INFO MessageListener] Sleeping for 7.241 seconds before retrying.
[2025-01-21 10:54:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:04:04 AM
[2025-01-21 10:54:09Z INFO MessageListener] Sleeping for 11.079 seconds before retrying.
[2025-01-21 10:54:14Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:54:20Z WARN VisualStudioServices] Authentication failed with status code 401.
Cache-Control: no-cache
Pragma: no-cache
P3P: CP="CAO DSP COR ADMa DEV CONo TELo CUR PSA PSD TAI IVDo OUR SAMi BUS DEM NAV STA UNI COM INT PHY ONL FIN PUR LOC CNT"
WWW-Authenticate: Bearer authorization_uri=https://login.microsoftonline.com/[redacted], Basic realm="https://tfsprodweu3.visualstudio.com/", TFS-Federated
X-TFS-ProcessId: b2e6a8e0-67e3-4d0f-b6c2-e7d8dbd0b26c
Strict-Transport-Security: max-age=31536000; includeSubDomains
ActivityId: 1e9d102b-7e9c-4e39-8fa8-840a29ca64a5
X-TFS-Session: efcee7dd-e649-4cf9-8c52-3164e5bff44a
X-VSS-E2EID: 69b34158-81e2-4495-98de-e3a3dc02fe24
X-VSS-SenderDeploymentId: 917a458e-1d30-b53d-ff6e-6b3ef9f8a0de
X-Frame-Options: SAMEORIGIN
X-TFS-FedAuthRealm: https://tfsprodweu3.visualstudio.com/
X-TFS-FedAuthIssuer: https://dev.azure.com/[redacted]/
X-VSS-AuthorizationEndpoint: https://vssps.dev.azure.com/[redacted]/
X-VSS-ResourceTenant: [redacted]
X-VSS-S2STargetService: 00000002-0000-8888-8000-000000000000/visualstudio.com
X-TFS-FedAuthRedirect: https://spsprodweu1.vssps.visualstudio.com/_signin?realm=dev.azure.com&reply_to=https%3A%2F%2Fdev.azure.com%2F[redacted]%2F_apis%2Fdistributedtask%2Fpools%2F33%2Fmessages%3FsessionId%3D54e70385-76e9-426a-bc5e-1e395e3b156f%26lastMessageId%3D286&redirect=1&hid=387cff66-6c17-438d-acc7-91e6489535f5&context=eyJodCI6MiwiaGlkIjoiMTg1ZWE3MzctM2I1ZS00MzZjLTkzMmEtNDE1MmU1NzEwNmYwIiwicXMiOnt9LCJyciI6IiIsInZoIjoiIiwiY3YiOiIiLCJjcyI6IiJ90#ctx=eyJTaWduSW5Db29raWVEb21haW5zIjpbImh0dHBzOi8vbG9naW4ubWljcm9zb2Z0b25saW5lLmNvbSIsImh0dHBzOi8vbG9naW4ubWljcm9zb2Z0b25saW5lLmNvbSJdfQ2
Request-Context: appId=cid-v1:c8f7fd9a-79c8-4464-b82d-4564078d0a8d
Access-Control-Expose-Headers: Request-Context
X-Content-Type-Options: nosniff
X-Cache: CONFIG_NOCACHE
X-MSEdge-Ref: Ref A: FC5AEC856C374F67A4EABE668CAEA5C8 Ref B: FRAEDGE1622 Ref C: 2025-01-21T10:54:20Z
Date: Tue, 21 Jan 2025 10:54:20 GMT

[2025-01-21 10:54:20Z INFO RSAEncryptedFileKeyManager] Loading RSA key parameters from file C:\azagent\[redacted]\.credentials_rsaparams
[2025-01-21 10:54:21Z INFO VisualStudioServices] AAD Correlation ID for this token request: Unknown
[2025-01-21 10:55:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:05:04 AM
[2025-01-21 10:55:11Z INFO MessageListener] Sleeping for 11.762 seconds before retrying.
[2025-01-21 10:55:34Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:56:04Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:56:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:06:04 AM
[2025-01-21 10:56:13Z INFO MessageListener] Sleeping for 9.927 seconds before retrying.
[2025-01-21 10:57:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:07:04 AM
[2025-01-21 10:57:13Z INFO MessageListener] Sleeping for 13.423 seconds before retrying.
[2025-01-21 10:57:24Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:58:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:08:04 AM
[2025-01-21 10:58:16Z INFO MessageListener] Sleeping for 7.412 seconds before retrying.
[2025-01-21 10:58:44Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 10:59:04Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:09:04 AM
[2025-01-21 10:59:13Z INFO MessageListener] Sleeping for 14.426 seconds before retrying.
[2025-01-21 11:00:04Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-21 11:00:05Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:10:04 AM
[2025-01-21 11:00:18Z INFO MessageListener] Sleeping for 7.338 seconds before retrying.
[2025-01-21 11:01:05Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/21/2025 11:11:05 AM
....

[2025-01-22 09:36:08Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/22/2025 9:46:08 AM
[2025-01-22 09:36:12Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-22 09:36:58Z INFO MessageListener] Sleeping for 10.841 seconds before retrying.
[2025-01-22 09:37:08Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/22/2025 9:47:08 AM
[2025-01-22 09:37:32Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-22 09:37:59Z INFO MessageListener] Sleeping for 8.39 seconds before retrying.
[2025-01-22 09:38:08Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/22/2025 9:48:08 AM
[2025-01-22 09:38:52Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-22 09:38:57Z INFO MessageListener] Sleeping for 13.746 seconds before retrying.
[2025-01-22 09:39:08Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/22/2025 9:49:08 AM
[2025-01-22 09:40:01Z INFO MessageListener] Sleeping for 14.846 seconds before retrying.
[2025-01-22 09:40:08Z INFO JobDispatcher] Successfully renew job request 877178, job is valid till 1/22/2025 9:50:08 AM
[2025-01-22 09:40:12Z INFO MessageListener] Sent GetAgentMessage to keep alive agent 622, session '54e70385-76e9-426a-bc5e-1e395e3b156f'.
[2025-01-22 09:41:06Z INFO MessageListener] Sleeping for 11.524 seconds before retrying.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant