Failed Jobs

Enqueued 0 / 0 Scheduled 0 Processing 0 Succeeded 2,906,029 Failed 9,392 Deleted 95 Awaiting 0

Failed jobs do not become expired to allow you to re-queue them without any time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete) attribute to delete them automatically.

Id	Job	Failed
#539170	DeleteDraftJobsTask.StartDeleteDraftJobs An exception occurred during performance of the job. Fewer details...	07/12/2024 00:14:23
#539170	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException (125): Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#539168	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/12/2024 00:09:04
#539168	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#539165	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/12/2024 00:09:04
#539165	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#539162	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/12/2024 00:08:52
#539162	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException (125): Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#539161	DeleteDraftJobsTask.StartDeleteDraftJobs An exception occurred during performance of the job. More details...	07/12/2024 00:07:40
#539161	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: A task was canceled. ---> System.Threading.Tasks.TaskCanceledException: A task was canceled. at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Boolean async, CancellationToken requestCancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#539159	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/12/2024 00:06:20
#539159	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: A task was canceled. ---> System.Threading.Tasks.TaskCanceledException: A task was canceled. at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Boolean async, CancellationToken requestCancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#539147	AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity An exception occurred during performance of the job. More details...	07/12/2024 00:00:12
#539147	System.Net.Http.HttpRequestException Response status code does not indicate success: 422 (Unprocessable Entity). System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 37 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#538704	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 21:37:58
#538704	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException (125): Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#538701	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 21:37:55
#538701	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException (125): Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#538698	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 21:36:00
#538698	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537757	DeleteDraftJobsTask.StartDeleteDraftJobs An exception occurred during performance of the job. More details...	07/11/2024 16:24:13
#537757	System.InvalidOperationException Could not get a value of the job parameter `CurrentCulture`. See inner exception for details. System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details. ---> Npgsql.NpgsqlException (0x80004005): Exception while reading from stream ---> System.TimeoutException: Timeout during reading attempt at Npgsql.Internal.NpgsqlReadBuffer.<Ensure>g__EnsureLong\|41_0(NpgsqlReadBuffer buffer, Int32 count, Boolean async, Boolean readingNotifications) at Npgsql.Internal.NpgsqlConnector.RawOpen(SslMode sslMode, NpgsqlTimeout timeout, Boolean async, CancellationToken cancellationToken) at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore\|193_1(NpgsqlConnector conn, SslMode sslMode, NpgsqlTimeout timeout, Boolean async, CancellationToken cancellationToken) at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeout timeout, Boolean async, CancellationToken cancellationToken) at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnection conn, NpgsqlTimeout timeout, Boolean async, CancellationToken cancellationToken) at Npgsql.ConnectorPool.<Get>g__RentAsync\|31_0(NpgsqlConnection conn, NpgsqlTimeout timeout, Boolean async, CancellationToken cancellationToken) at Npgsql.NpgsqlConnection.<Open>g__OpenAsync\|45_0(Boolean async, CancellationToken cancellationToken) at Npgsql.NpgsqlConnection.Open() at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection() at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnection dedicatedConnection, Func`2 func) at Hangfire.PostgreSql.PostgreSqlConnection.GetJobParameter(String id, String name) at Hangfire.Server.PerformContext.GetJobParameter[T](String name, Boolean allowStale) --- End of inner exception stack trace --- at Hangfire.Server.PerformContext.GetJobParameter[T](String name, Boolean allowStale) at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContext context) at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1 tuple) at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstance instance, Func`2 action, String message) at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfiler profiler, TInstance instance, Action`1 action, String message) at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilter filter, PerformingContext preContext, Func`1 continuation)
#537755	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:22:35
#537755	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537752	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:21:55
#537752	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537740	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:16:07
#537740	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537737	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:16:13
#537737	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537734	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:16:00
#537734	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537733	DeleteDraftJobsTask.StartDeleteDraftJobs An exception occurred during performance of the job. More details...	07/11/2024 16:14:34
#537733	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: A task was canceled. ---> System.Threading.Tasks.TaskCanceledException: A task was canceled. at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Boolean async, CancellationToken requestCancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)
#537731	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:11:10
#537731	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537728	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:11:24
#537728	System.Net.Http.HttpRequestException Response status code does not indicate success: 504 (Gateway Time-out). `System.Net.Http.HttpRequestException: Response status code does not indicate success: 504 (Gateway Time-out). at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode() at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)`
#537725	SendNotificationsTask.StartJobSendNotifications An exception occurred during performance of the job. More details...	07/11/2024 16:11:57
#537725	System.Threading.Tasks.TaskCanceledException The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing. ---> System.TimeoutException: The operation was canceled. ---> System.Threading.Tasks.TaskCanceledException: The operation was canceled. ---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled. ---> System.Net.Sockets.SocketException (125): Operation canceled --- End of inner exception stack trace --- at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error, CancellationToken cancellationToken) at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16 token) at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1 buffer, CancellationToken cancellationToken) at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16 token) at System.Net.Http.HttpConnection.InitialFillAsync(Boolean async) at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) --- End of inner exception stack trace --- at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessage request, Boolean async, Boolean doRequestAuth, CancellationToken cancellationToken) at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessage request, Boolean async, CancellationToken cancellationToken) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) --- End of inner exception stack trace --- --- End of inner exception stack trace --- at System.Net.Http.HttpClient.HandleFailure(Exception e, Boolean telemetryStarted, HttpResponseMessage response, CancellationTokenSource cts, CancellationToken cancellationToken, CancellationTokenSource pendingRequestsCts) at System.Net.Http.HttpClient.<SendAsync>g__Core\|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /var/www/ManageRight/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44 at InvokeStub_TaskAwaiter.GetResult(Object, Object, IntPtr) at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr args, BindingFlags invokeAttr)

System.Threading.Tasks.TaskCanceledException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Threading.Tasks.TaskCanceledException

System.Threading.Tasks.TaskCanceledException

System.Threading.Tasks.TaskCanceledException

System.Net.Http.HttpRequestException

System.Threading.Tasks.TaskCanceledException

System.Threading.Tasks.TaskCanceledException

System.Net.Http.HttpRequestException

System.InvalidOperationException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Threading.Tasks.TaskCanceledException

System.Net.Http.HttpRequestException

System.Net.Http.HttpRequestException

System.Threading.Tasks.TaskCanceledException