Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
07/22/2025 14:08:16
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/22/2025 14:07:16
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/21/2025 00:02:49
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/20/2025 00:02:51
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/19/2025 00:04:52
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/19/2025 00:01:51
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 36
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 14:04:12
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 14:04:12
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 14:03:13
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 14:00:57
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendKronnosReport.StartSendKronnosReport() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendKronnosReport.cs:line 26
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 13:50:03
System.InvalidOperationException
Could not get a value of the job parameter `CurrentUICulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentUICulture`. See inner exception for details.
---> Npgsql.PostgresException (0x80004005): 53300: sorry, too many clients already
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|213_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|193_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|31_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.Open()
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.PostgreSql.PostgreSqlConnection.GetJobParameter(Stringid, Stringname)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
Exception data:
Severity: FATAL
SqlState: 53300
MessageText: sorry, too many clients already
File: proc.c
Line: 360
Routine: InitProcess
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
07/17/2025 13:50:03
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
---> Npgsql.PostgresException (0x80004005): 53300: sorry, too many clients already
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|213_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|193_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|31_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.Open()
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.PostgreSql.PostgreSqlConnection.GetJobParameter(Stringid, Stringname)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
Exception data:
Severity: FATAL
SqlState: 53300
MessageText: sorry, too many clients already
File: proc.c
Line: 360
Routine: InitProcess
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
07/17/2025 13:50:03
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 13:46:02
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 13:45:02
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 13:22:13
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/17/2025 01:44:34
System.Net.Http.HttpRequestException
Connection refused (vms.mysourcenow.com:443)
System.Net.Http.HttpRequestException: Connection refused (vms.mysourcenow.com:443)
---> System.Net.Sockets.SocketException (111): Connection refused
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|281_0(AwaitableSocketAsyncEventArgssaea, ValueTaskconnectTask, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(QueueItemqueueItem)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Booleanasync, CancellationTokenrequestCancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/12/2025 00:01:48
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 36
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/08/2025 11:11:07
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/08/2025 11:11:07
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/08/2025 11:10:07
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/08/2025 11:10:07
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/06/2025 00:02:43
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/05/2025 00:01:52
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 36
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:40:15
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:40:15
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:39:44
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:38:47
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:37:46
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:36:46
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:35:45
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:34:56
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:33:52
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:32:49
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:31:44
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:30:43
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:29:47
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:28:46
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:27:52
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:26:43
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:25:44
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:24:43
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:23:47
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:22:42
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:21:29
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:20:46
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 13:19:44
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
07/01/2025 08:08:41
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
06/25/2025 17:36:27
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
06/05/2025 16:29:45
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
06/05/2025 16:28:45
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
06/05/2025 16:25:03
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: The response ended prematurely.
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 36
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
06/05/2025 16:10:34
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.AutoEndAssignmentsDuetoTimesheetInactivity.StartAutoEndAssignmentsDuetoTimesheetInactivity() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/AutoEndAssignmentsDuetoTimesheetInactivity.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/31/2025 11:27:28
System.Exception
Error in UpdateCandidatesInterviewedTask
System.Exception: Error in UpdateCandidatesInterviewedTask
---> System.InvalidOperationException: An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
at System.Net.Http.HttpClient.PrepareRequestMessage(HttpRequestMessagerequest)
at System.Net.Http.HttpClient.SendAsync(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at MR.Schedules.UpdateCandidatesInterviewedTask.StartJobUpdateCandidatesInterviewed() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/UpdateCandidatesInterviewedTask.cs:line 32
--- End of inner exception stack trace ---
at MR.Schedules.UpdateCandidatesInterviewedTask.StartJobUpdateCandidatesInterviewed() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/UpdateCandidatesInterviewedTask.cs:line 38
at System.RuntimeMethodHandle.InvokeMethod(Objecttarget, Void**arguments, Signaturesig, BooleanisConstructor)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/27/2025 10:28:39
System.Net.Http.HttpRequestException
Connection refused (vms.mysourcenow.com:443)
System.Net.Http.HttpRequestException: Connection refused (vms.mysourcenow.com:443)
---> System.Net.Sockets.SocketException (111): Connection refused
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource.GetResult(Int16token)
at System.Net.Sockets.Socket.<ConnectAsync>g__WaitForConnectWithCancellation|281_0(AwaitableSocketAsyncEventArgssaea, ValueTaskconnectTask, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnectionPool.ConnectToTcpHostAsync(Stringhost, Int32port, HttpRequestMessageinitialRequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(QueueItemqueueItem)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellationAsync(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.HttpConnectionWaiter`1.WaitForConnectionAsync(Booleanasync, CancellationTokenrequestCancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/23/2025 10:19:04
System.Exception
Error in UpdateCandidatesInterviewedTask
System.Exception: Error in UpdateCandidatesInterviewedTask
---> System.InvalidOperationException: An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
at System.Net.Http.HttpClient.PrepareRequestMessage(HttpRequestMessagerequest)
at System.Net.Http.HttpClient.SendAsync(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at MR.Schedules.UpdateCandidatesInterviewedTask.StartJobUpdateCandidatesInterviewed() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/UpdateCandidatesInterviewedTask.cs:line 32
--- End of inner exception stack trace ---
at MR.Schedules.UpdateCandidatesInterviewedTask.StartJobUpdateCandidatesInterviewed() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/UpdateCandidatesInterviewedTask.cs:line 38
at System.RuntimeMethodHandle.InvokeMethod(Objecttarget, Void**arguments, Signaturesig, BooleanisConstructor)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/23/2025 04:28:07
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 45
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/23/2025 04:28:07
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/21/2025 13:15:09
System.InvalidOperationException
An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
System.InvalidOperationException: An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
at System.Net.Http.HttpClient.PrepareRequestMessage(HttpRequestMessagerequest)
at System.Net.Http.HttpClient.SendAsync(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at MR.Schedules.CheckUKGProcessTask.StartCheckUKGProcess() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/CheckUKGProcessTask.cs:line 33
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/21/2025 13:15:09
System.Exception
Error in UpdateCandidatesInterviewedTask
System.Exception: Error in UpdateCandidatesInterviewedTask
---> System.InvalidOperationException: An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
at System.Net.Http.HttpClient.PrepareRequestMessage(HttpRequestMessagerequest)
at System.Net.Http.HttpClient.SendAsync(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at MR.Schedules.UpdateCandidatesInterviewedTask.StartJobUpdateCandidatesInterviewed() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/UpdateCandidatesInterviewedTask.cs:line 32
--- End of inner exception stack trace ---
at MR.Schedules.UpdateCandidatesInterviewedTask.StartJobUpdateCandidatesInterviewed() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/UpdateCandidatesInterviewedTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/21/2025 13:15:09
System.InvalidOperationException
An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
System.InvalidOperationException: An invalid request URI was provided. Either the request URI must be an absolute URI or BaseAddress must be set.
at System.Net.Http.HttpClient.PrepareRequestMessage(HttpRequestMessagerequest)
at System.Net.Http.HttpClient.SendAsync(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at MR.Schedules.ReactivateAssignmentTask.ReactivateAssignmentsJob() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/ReactivateAssignmentTask.cs:line 30
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/21/2025 00:05:04
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/21/2025 00:00:03
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.AutoCloseJobEndDateReachedTask.StartAutoCloseJobEndDateReachedTask() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/AutoCloseJobEndDateReachedTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/21/2025 00:00:03
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.CreateApproversReminderNotificationsTask.StartJobCreateApproversReminderNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/CreateApproversReminderNotificationsTask.cs:line 35
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/21/2025 00:00:32
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendKronnosReport.StartSendKronnosReport() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendKronnosReport.cs:line 27
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 21:38:14
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
---> Npgsql.PostgresException (0x80004005): 53300: sorry, too many clients already
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|213_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|193_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|31_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.Open()
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.PostgreSql.PostgreSqlConnection.GetJobParameter(Stringid, Stringname)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
Exception data:
Severity: FATAL
SqlState: 53300
MessageText: sorry, too many clients already
File: proc.c
Line: 360
Routine: InitProcess
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
05/20/2025 19:01:07
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 16:54:04
System.InvalidOperationException
Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentCulture`. See inner exception for details.
---> Npgsql.PostgresException (0x80004005): 53300: sorry, too many clients already
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|213_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|193_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|31_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.Open()
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.PostgreSql.PostgreSqlConnection.GetJobParameter(Stringid, Stringname)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
Exception data:
Severity: FATAL
SqlState: 53300
MessageText: sorry, too many clients already
File: proc.c
Line: 360
Routine: InitProcess
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
05/20/2025 15:00:54
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendKronnosReport.StartSendKronnosReport() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendKronnosReport.cs:line 27
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/20/2025 13:01:05
System.Net.Http.HttpRequestException
Response status code does not indicate success: 422 (Unprocessable Entity).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 422 (Unprocessable Entity).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendKronnosReport.StartSendKronnosReport() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendKronnosReport.cs:line 27
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:38:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:38:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:37:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:37:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:36:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:36:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:35:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:35:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:34:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:34:01
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:33:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:33:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:32:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:32:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:31:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:31:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:30:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:30:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:29:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:29:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:28:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:28:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:27:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:27:00
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:26:15
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:26:15
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:25:15
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.DeleteDraftJobsTask.StartDeleteDraftJobs() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/DeleteDraftJobsTask.cs:line 38
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/16/2025 03:25:14
System.Net.Http.HttpRequestException
Response status code does not indicate success: 502 (Bad Gateway).
System.Net.Http.HttpRequestException: Response status code does not indicate success: 502 (Bad Gateway).
at System.Net.Http.HttpResponseMessage.EnsureSuccessStatusCode()
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 37
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)
An exception occurred during performance of the job. More details...
05/14/2025 18:09:13
System.InvalidOperationException
Could not get a value of the job parameter `CurrentUICulture`. See inner exception for details.
System.InvalidOperationException: Could not get a value of the job parameter `CurrentUICulture`. See inner exception for details.
---> Npgsql.PostgresException (0x80004005): 53300: sorry, too many clients already
at Npgsql.Internal.NpgsqlConnector.<ReadMessage>g__ReadMessageLong|213_0(NpgsqlConnectorconnector, Booleanasync, DataRowLoadingModedataRowLoadingMode, BooleanreadingNotifications, BooleanisReadingPrependedMessage)
at Npgsql.Internal.NpgsqlConnector.Authenticate(Stringusername, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.<Open>g__OpenCore|193_1(NpgsqlConnectorconn, SslModesslMode, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.Internal.NpgsqlConnector.Open(NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.OpenNewConnector(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.ConnectorPool.<Get>g__RentAsync|31_0(NpgsqlConnectionconn, NpgsqlTimeouttimeout, Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.<Open>g__OpenAsync|45_0(Booleanasync, CancellationTokencancellationToken)
at Npgsql.NpgsqlConnection.Open()
at Hangfire.PostgreSql.PostgreSqlStorage.CreateAndOpenConnection()
at Hangfire.PostgreSql.PostgreSqlStorage.UseConnection[T](DbConnectiondedicatedConnection, Func`2func)
at Hangfire.PostgreSql.PostgreSqlConnection.GetJobParameter(Stringid, Stringname)
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
Exception data:
Severity: FATAL
SqlState: 53300
MessageText: sorry, too many clients already
File: proc.c
Line: 360
Routine: InitProcess
--- End of inner exception stack trace ---
at Hangfire.Server.PerformContext.GetJobParameter[T](Stringname, BooleanallowStale)
at Hangfire.CaptureCultureAttribute.OnPerforming(PerformingContextcontext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
05/14/2025 05:50:51
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: The operation was canceled.
---> System.Threading.Tasks.TaskCanceledException: The operation was canceled.
---> System.IO.IOException: Unable to read data from the transport connection: Operation canceled.
---> System.Net.Sockets.SocketException (125): Operation canceled
--- End of inner exception stack trace ---
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketErrorerror, CancellationTokencancellationToken)
at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.System.Threading.Tasks.Sources.IValueTaskSource<System.Int32>.GetResult(Int16token)
at System.Net.Security.SslStream.EnsureFullTlsFrameAsync[TIOAdapter](CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Security.SslStream.ReadAsyncInternal[TIOAdapter](Memory`1buffer, CancellationTokencancellationToken)
at System.Runtime.CompilerServices.PoolingAsyncValueTaskMethodBuilder`1.StateMachineBox`1.System.Threading.Tasks.Sources.IValueTaskSource<TResult>.GetResult(Int16token)
at System.Net.Http.HttpConnection.InitialFillAsync(Booleanasync)
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.HttpConnection.SendAsyncCore(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokenSourcects, BooleandisposeCts, CancellationTokenSourcependingRequestsCts, CancellationTokenoriginalCancellationToken)
at MR.Schedules.SendNotificationsTask.StartJobSendNotifications() in /home/azureuser/sn1/src/BackEnd/MR.Schedules/Tasks/SendNotificationsTask.cs:line 44
at InvokeStub_TaskAwaiter.GetResult(Object,Object, IntPtr*)
at System.Reflection.MethodInvoker.Invoke(Objectobj, IntPtr*args, BindingFlagsinvokeAttr)