Failed Jobs

Enqueued 0 / 0 Scheduled 0 Processing 0 Succeeded 3,355,040 Failed 9,638 Deleted 95 Awaiting 0

Failed jobs do not become expired to allow you to re-queue them without any time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete) attribute to delete them automatically.

Id	Job	Failed
#537711	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. Fewer details...	07/11/2024 16:01:57
#537711	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. at System.Net.Http.CancellationHelper.ThrowOperationCanceledException(Exception innerException, CancellationToken cancellationToken) at System.Net.Http.CancellationHelper.ThrowIfCancellationRequested(CancellationToken cancellationToken) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#537707	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 15:57:59
#537707	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: A task was canceled. ---> System.Threading.Tasks.TaskCanceledException: A task was canceled. at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Boolean async, CancellationToken requestCancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#537704	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 15:53:46
#537704	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537683	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 15:46:08
#537683	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537673	DeleteDraftJobsTask.StartDeleteDraftJobs An exception occurred during performance of the job. More details...	07/11/2024 15:43:35
#537673	System.Net.Http.HttpRequestException Resource temporarily unavailable (vms.mysourcenow.com:443) System.Net.Http.HttpRequestException: Resource temporarily unavailable (vms.mysourcenow.com:443) ---> System.Net.Sockets.SocketException (11): Resource temporarily unavailable at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16 token) at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation\|281_0(AwaitableSocketAsyncEventArgs saea, ValueTask connectTask, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(String host, Int32 port, HttpRequestMessage initialRequest, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(QueueItem queueItem) at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Boolean async, CancellationToken requestCancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#537671	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 15:43:35
#537671	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException (125): Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#534832	AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity An exception occurred during performance of the job. More details...	07/11/2024 00:00:06
#534832	System.Net.Http.HttpRequestException Response status code does not indicate success: 422 (Unprocessable Entity). System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 37 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#533941	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/10/2024 19:08:14
#533941	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#530459	AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity An exception occurred during performance of the job. More details...	07/10/2024 00:00:03
#530459	System.Net.Http.HttpRequestException Response status code does not indicate success: 422 (Unprocessable Entity). System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 37 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#530342	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/09/2024 23:24:09
#530342	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`

System.Threading.Tasks.TaskCanceledException

System.Threading.Tasks.TaskCanceledException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Threading.Tasks.TaskCanceledException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException