Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
System.Net.Http.HttpRequestException: Resource temporarily unavailable (vms.mysourcenow.com:443)
---> System.Net.Sockets.SocketException (11): Resource temporarily unavailable
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|281_0(AwaitableSocketAsyncEventArgssaea, ValueTaskconnectTask, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(QueueItemqueueItem)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Booleanasync, CancellationTokenrequestCancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/11/2024 15:43:35
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/11/2024 00:00:06
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/10/2024 19:08:14
System.Net.Http.HttpRequestException
Response status code does not indicate success: 504 (Gateway Time-out).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/10/2024 00:00:03
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/09/2024 23:24:09
System.Net.Http.HttpRequestException
Response status code does not indicate success: 504 (Gateway Time-out).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/09/2024 23:23:08
System.Net.Http.HttpRequestException
Response status code does not indicate success: 504 (Gateway Time-out).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/09/2024 23:22:08
System.Net.Http.HttpRequestException
Response status code does not indicate success: 504 (Gateway Time-out).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/09/2024 23:21:08
System.Net.Http.HttpRequestException
Response status code does not indicate success: 504 (Gateway Time-out).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/09/2024 23:20:09
System.Net.Http.HttpRequestException
Response status code does not indicate success: 504 (Gateway Time-out).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)