copr
copr copied to clipboard
fedora-copr
frontend: Foreman project - weird traceback in error_log
[Tue Sep 16 11:49:00.212262 2025] [wsgi:error] [pid 2268068:tid 2268071] [remote 185.233.188.88:52028] ERROR:coprs:Response error: 500 Request wasn't successful, there is probably a bug in the Copr code.
[Tue Sep 16 11:51:14.849754 2025] [wsgi:error] [pid 2341035:tid 2341038] [remote 185.233.188.88:53316] INFO:coprs:User 'theforeman-bot' allowed to access group 'theforeman' (fas_name='theforeman')
[Tue Sep 16 11:51:16.150462 2025] [wsgi:error] [pid 2341035:tid 2341051] [remote 185.233.188.88:53330] INFO:coprs:User 'theforeman-bot' allowed to update project '@theforeman/plugins-nightly-staging-scratch-fa88c5f3-c44c-584a-89f3-4a91abb46aaf'
[Tue Sep 16 11:51:17.379970 2025] [wsgi:error] [pid 2340860:tid 2340876] [remote 185.233.188.88:53340] ERROR:coprs:Response error: 404 No package with name rubygem-foreman_bootdisk in copr plugins-nightly-staging-scratch-fa88c5f3-c44c-584a-89f3-4a91abb46aaf
[Tue Sep 16 11:51:18.652525 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ERROR:coprs:Admin-only exception
[Tue Sep 16 11:51:18.652566 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] Request: POST https://copr.fedorainfracloud.org/api_3/build/create/upload
[Tue Sep 16 11:51:18.652580 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] User: None
[Tue Sep 16 11:51:18.652588 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] Traceback (most recent call last):
[Tue Sep 16 11:51:18.652597 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
[Tue Sep 16 11:51:18.652694 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self.dialect.do_execute(
[Tue Sep 16 11:51:18.652705 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.652714 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor, str_statement, effective_parameters, context
[Tue Sep 16 11:51:18.652723 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.652731 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.652739 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.652747 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/default.py", line 941, in do_execute
[Tue Sep 16 11:51:18.652778 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor.execute(statement, parameters)
[Tue Sep 16 11:51:18.652786 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.652794 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] psycopg2.OperationalError: server closed the connection unexpectedly
[Tue Sep 16 11:51:18.652803 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tThis probably means the server terminated abnormally
[Tue Sep 16 11:51:18.652811 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tbefore or while processing the request.
[Tue Sep 16 11:51:18.652819 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.652827 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.652834 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] The above exception was the direct cause of the following exception:
[Tue Sep 16 11:51:18.652842 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.652850 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] Traceback (most recent call last):
[Tue Sep 16 11:51:18.652858 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask/app.py", line 880, in full_dispatch_request
[Tue Sep 16 11:51:18.652866 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] rv = self.dispatch_request()
[Tue Sep 16 11:51:18.652874 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask/app.py", line 865, in dispatch_request
[Tue Sep 16 11:51:18.652883 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return]
[Tue Sep 16 11:51:18.652891 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.652899 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask_restx/api.py", line 402, in wrapper
[Tue Sep 16 11:51:18.652907 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] resp = resource(*args, **kwargs)
[Tue Sep 16 11:51:18.652915 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask/views.py", line 110, in view
[Tue Sep 16 11:51:18.652923 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return]
[Tue Sep 16 11:51:18.652931 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
[Tue Sep 16 11:51:18.652939 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask_restx/resource.py", line 41, in dispatch_request
[Tue Sep 16 11:51:18.652947 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] resp = meth(*args, **kwargs)
[Tue Sep 16 11:51:18.652955 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/share/copr/coprs_frontend/coprs/views/apiv3_ns/__init__.py", line 480, in inner
[Tue Sep 16 11:51:18.652963 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return endpoint_method(self, *args, **kwargs)
[Tue Sep 16 11:51:18.652971 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/share/copr/coprs_frontend/coprs/views/misc.py", line 303, in check_if_api_login_is_required
[Tue Sep 16 11:51:18.652989 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] retval = _check_api_login()
[Tue Sep 16 11:51:18.652998 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/share/copr/coprs_frontend/coprs/views/misc.py", line 267, in _check_api_login
[Tue Sep 16 11:51:18.653007 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] user = UsersLogic.get_by_api_login(api_login).first()
[Tue Sep 16 11:51:18.653015 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/query.py", line 2728, in first
[Tue Sep 16 11:51:18.653023 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self.limit(1)._iter().first() # type: ignore
[Tue Sep 16 11:51:18.653032 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~^^
[Tue Sep 16 11:51:18.653040 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/query.py", line 2827, in _iter
[Tue Sep 16 11:51:18.653048 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
[Tue Sep 16 11:51:18.653057 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.653065 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] statement,
[Tue Sep 16 11:51:18.653073 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^
[Tue Sep 16 11:51:18.653081 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] params,
[Tue Sep 16 11:51:18.653089 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^
[Tue Sep 16 11:51:18.653097 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] execution_options={"_sa_orm_load_options": self.load_options},
[Tue Sep 16 11:51:18.653106 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.653114 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653122 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.653130 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/session.py", line 2362, in execute
[Tue Sep 16 11:51:18.653138 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self._execute_internal(
[Tue Sep 16 11:51:18.653147 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.653155 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] statement,
[Tue Sep 16 11:51:18.653163 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^
[Tue Sep 16 11:51:18.653171 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ...<4 lines>...
[Tue Sep 16 11:51:18.653179 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] _add_event=_add_event,
[Tue Sep 16 11:51:18.653187 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.653195 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653203 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.653211 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/session.py", line 2247, in _execute_internal
[Tue Sep 16 11:51:18.653238 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] result: Result[Any] = compile_state_cls.orm_execute_statement(
[Tue Sep 16 11:51:18.653246 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.653255 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self,
[Tue Sep 16 11:51:18.653263 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^
[Tue Sep 16 11:51:18.653271 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ...<4 lines>...
[Tue Sep 16 11:51:18.653279 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] conn,
[Tue Sep 16 11:51:18.653313 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^
[Tue Sep 16 11:51:18.653322 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653330 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.653338 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/context.py", line 305, in orm_execute_statement
[Tue Sep 16 11:51:18.653347 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] result = conn.execute(
[Tue Sep 16 11:51:18.653355 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] statement, params or {}, execution_options=execution_options
[Tue Sep 16 11:51:18.653363 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653371 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1418, in execute
[Tue Sep 16 11:51:18.653379 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return meth(
[Tue Sep 16 11:51:18.653388 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self,
[Tue Sep 16 11:51:18.653396 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] distilled_parameters,
[Tue Sep 16 11:51:18.653404 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] execution_options or NO_OPTIONS,
[Tue Sep 16 11:51:18.653412 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653420 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection
[Tue Sep 16 11:51:18.653428 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return connection._execute_clauseelement(
[Tue Sep 16 11:51:18.653436 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.653445 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self, distilled_params, execution_options
[Tue Sep 16 11:51:18.653453 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.653461 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653469 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.653477 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement
[Tue Sep 16 11:51:18.653486 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ret = self._execute_context(
[Tue Sep 16 11:51:18.653494 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] dialect,
[Tue Sep 16 11:51:18.653512 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ...<8 lines>...
[Tue Sep 16 11:51:18.653520 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cache_hit=cache_hit,
[Tue Sep 16 11:51:18.653528 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653536 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context
[Tue Sep 16 11:51:18.653545 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self._exec_single_context(
[Tue Sep 16 11:51:18.653553 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.653561 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] dialect, context, statement, parameters
[Tue Sep 16 11:51:18.653569 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.653578 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653586 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.653594 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context
[Tue Sep 16 11:51:18.653602 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self._handle_dbapi_exception(
[Tue Sep 16 11:51:18.653610 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.653619 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] e, str_statement, effective_parameters, cursor, context
[Tue Sep 16 11:51:18.653627 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.653635 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653643 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.653651 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 2355, in _handle_dbapi_exception
[Tue Sep 16 11:51:18.653659 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
[Tue Sep 16 11:51:18.653668 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
[Tue Sep 16 11:51:18.653676 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self.dialect.do_execute(
[Tue Sep 16 11:51:18.653684 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.653692 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor, str_statement, effective_parameters, context
[Tue Sep 16 11:51:18.653701 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.653709 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.653717 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.653725 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/default.py", line 941, in do_execute
[Tue Sep 16 11:51:18.653742 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor.execute(statement, parameters)
[Tue Sep 16 11:51:18.653750 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.653758 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) server closed the connection unexpectedly
[Tue Sep 16 11:51:18.653767 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tThis probably means the server terminated abnormally
[Tue Sep 16 11:51:18.653775 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tbefore or while processing the request.
[Tue Sep 16 11:51:18.653783 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.653792 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] [SQL: SELECT "user".id AS user_id, user_private.user_id AS user_private_user_id, "user".username AS user_username, "user".proven AS user_proven, "user".admin AS user_admin, "user".openid_groups AS user_openid_groups, user_private.mail AS user_private_mail, user_private.timezone AS user_private_timezone, user_private.api_login AS user_private_api_login, user_private.api_token AS user_private_api_token, user_private.api_token_expiration AS user_private_api_token_expiration
[Tue Sep 16 11:51:18.653803 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] FROM "user" LEFT OUTER JOIN user_private ON "user".id = user_private.user_id
[Tue Sep 16 11:51:18.653811 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] WHERE user_private.api_login = %(api_login_1)s
[Tue Sep 16 11:51:18.653819 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] LIMIT %(param_1)s]
[Tue Sep 16 11:51:18.653827 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] [parameters: {'api_login_1': 'ubafbakevrqzfjrrjvbs', 'param_1': 1}]
[Tue Sep 16 11:51:18.653835 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] (Background on this error at: https://sqlalche.me/e/20/e3q8)
[Tue Sep 16 11:51:18.654117 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ERROR:coprs:Response error: e3q8 Database error, contact admin
[Tue Sep 16 11:51:18.660683 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ERROR:coprs:Admin-only exception
[Tue Sep 16 11:51:18.660702 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] Request: POST https://copr.fedorainfracloud.org/api_3/build/create/upload
[Tue Sep 16 11:51:18.660711 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] User: None
[Tue Sep 16 11:51:18.660720 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] Traceback (most recent call last):
[Tue Sep 16 11:51:18.660728 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
[Tue Sep 16 11:51:18.660737 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self.dialect.do_execute(
[Tue Sep 16 11:51:18.660745 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.660753 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor, str_statement, effective_parameters, context
[Tue Sep 16 11:51:18.660762 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.660770 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.660778 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.660786 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/default.py", line 941, in do_execute
[Tue Sep 16 11:51:18.660807 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor.execute(statement, parameters)
[Tue Sep 16 11:51:18.660815 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.660824 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] psycopg2.OperationalError: server closed the connection unexpectedly
[Tue Sep 16 11:51:18.660832 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tThis probably means the server terminated abnormally
[Tue Sep 16 11:51:18.660840 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tbefore or while processing the request.
[Tue Sep 16 11:51:18.660848 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.660857 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.660865 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] The above exception was the direct cause of the following exception:
[Tue Sep 16 11:51:18.660873 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.660881 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] Traceback (most recent call last):
[Tue Sep 16 11:51:18.660889 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask/app.py", line 880, in full_dispatch_request
[Tue Sep 16 11:51:18.660898 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] rv = self.dispatch_request()
[Tue Sep 16 11:51:18.660906 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask/app.py", line 865, in dispatch_request
[Tue Sep 16 11:51:18.660914 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return]
[Tue Sep 16 11:51:18.660923 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.660931 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask_restx/api.py", line 402, in wrapper
[Tue Sep 16 11:51:18.660939 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] resp = resource(*args, **kwargs)
[Tue Sep 16 11:51:18.660947 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask/views.py", line 110, in view
[Tue Sep 16 11:51:18.660956 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return]
[Tue Sep 16 11:51:18.660964 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
[Tue Sep 16 11:51:18.660972 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask_restx/resource.py", line 41, in dispatch_request
[Tue Sep 16 11:51:18.660980 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] resp = meth(*args, **kwargs)
[Tue Sep 16 11:51:18.660989 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/share/copr/coprs_frontend/coprs/views/apiv3_ns/__init__.py", line 480, in inner
[Tue Sep 16 11:51:18.660997 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return endpoint_method(self, *args, **kwargs)
[Tue Sep 16 11:51:18.661005 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/share/copr/coprs_frontend/coprs/views/misc.py", line 303, in check_if_api_login_is_required
[Tue Sep 16 11:51:18.661022 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] retval = _check_api_login()
[Tue Sep 16 11:51:18.661031 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/share/copr/coprs_frontend/coprs/views/misc.py", line 267, in _check_api_login
[Tue Sep 16 11:51:18.661039 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] user = UsersLogic.get_by_api_login(api_login).first()
[Tue Sep 16 11:51:18.661047 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/query.py", line 2728, in first
[Tue Sep 16 11:51:18.661055 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self.limit(1)._iter().first() # type: ignore
[Tue Sep 16 11:51:18.661064 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~^^
[Tue Sep 16 11:51:18.661072 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/query.py", line 2827, in _iter
[Tue Sep 16 11:51:18.661080 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(
[Tue Sep 16 11:51:18.661089 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.661097 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] statement,
[Tue Sep 16 11:51:18.661105 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^
[Tue Sep 16 11:51:18.661113 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] params,
[Tue Sep 16 11:51:18.661121 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^
[Tue Sep 16 11:51:18.661129 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] execution_options={"_sa_orm_load_options": self.load_options},
[Tue Sep 16 11:51:18.661137 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661146 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661154 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.661162 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/session.py", line 2362, in execute
[Tue Sep 16 11:51:18.661170 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self._execute_internal(
[Tue Sep 16 11:51:18.661178 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.661186 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] statement,
[Tue Sep 16 11:51:18.661194 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^
[Tue Sep 16 11:51:18.661202 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ...<4 lines>...
[Tue Sep 16 11:51:18.661210 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] _add_event=_add_event,
[Tue Sep 16 11:51:18.661219 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661227 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661235 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.661243 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/session.py", line 2247, in _execute_internal
[Tue Sep 16 11:51:18.661259 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] result: Result[Any] = compile_state_cls.orm_execute_statement(
[Tue Sep 16 11:51:18.661268 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.661276 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self,
[Tue Sep 16 11:51:18.661305 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^
[Tue Sep 16 11:51:18.661315 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ...<4 lines>...
[Tue Sep 16 11:51:18.661323 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] conn,
[Tue Sep 16 11:51:18.661331 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^
[Tue Sep 16 11:51:18.661339 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661347 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.661355 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/orm/context.py", line 305, in orm_execute_statement
[Tue Sep 16 11:51:18.661363 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] result = conn.execute(
[Tue Sep 16 11:51:18.661371 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] statement, params or {}, execution_options=execution_options
[Tue Sep 16 11:51:18.661380 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661388 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1418, in execute
[Tue Sep 16 11:51:18.661396 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return meth(
[Tue Sep 16 11:51:18.661404 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self,
[Tue Sep 16 11:51:18.661412 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] distilled_parameters,
[Tue Sep 16 11:51:18.661420 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] execution_options or NO_OPTIONS,
[Tue Sep 16 11:51:18.661428 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661436 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/sql/elements.py", line 515, in _execute_on_connection
[Tue Sep 16 11:51:18.661445 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return connection._execute_clauseelement(
[Tue Sep 16 11:51:18.661453 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.661461 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self, distilled_params, execution_options
[Tue Sep 16 11:51:18.661469 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661477 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661485 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.661493 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1640, in _execute_clauseelement
[Tue Sep 16 11:51:18.661502 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ret = self._execute_context(
[Tue Sep 16 11:51:18.661510 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] dialect,
[Tue Sep 16 11:51:18.661527 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ...<8 lines>...
[Tue Sep 16 11:51:18.661535 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cache_hit=cache_hit,
[Tue Sep 16 11:51:18.661544 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661552 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context
[Tue Sep 16 11:51:18.661560 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self._exec_single_context(
[Tue Sep 16 11:51:18.661568 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.661576 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] dialect, context, statement, parameters
[Tue Sep 16 11:51:18.661585 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661593 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661601 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.661609 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context
[Tue Sep 16 11:51:18.661617 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self._handle_dbapi_exception(
[Tue Sep 16 11:51:18.661625 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.661633 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] e, str_statement, effective_parameters, cursor, context
[Tue Sep 16 11:51:18.661642 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661650 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661658 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.661666 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 2355, in _handle_dbapi_exception
[Tue Sep 16 11:51:18.661674 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
[Tue Sep 16 11:51:18.661683 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
[Tue Sep 16 11:51:18.661691 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] self.dialect.do_execute(
[Tue Sep 16 11:51:18.661699 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~~~~~~~^
[Tue Sep 16 11:51:18.661707 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor, str_statement, effective_parameters, context
[Tue Sep 16 11:51:18.661715 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661724 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] )
[Tue Sep 16 11:51:18.661732 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^
[Tue Sep 16 11:51:18.661740 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib64/python3.13/site-packages/sqlalchemy/engine/default.py", line 941, in do_execute
[Tue Sep 16 11:51:18.661756 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] cursor.execute(statement, parameters)
[Tue Sep 16 11:51:18.661790 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661799 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) server closed the connection unexpectedly
[Tue Sep 16 11:51:18.661807 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tThis probably means the server terminated abnormally
[Tue Sep 16 11:51:18.661816 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tbefore or while processing the request.
[Tue Sep 16 11:51:18.661824 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.661832 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] [SQL: SELECT "user".id AS user_id, user_private.user_id AS user_private_user_id, "user".username AS user_username, "user".proven AS user_proven, "user".admin AS user_admin, "user".openid_groups AS user_openid_groups, user_private.mail AS user_private_mail, user_private.timezone AS user_private_timezone, user_private.api_login AS user_private_api_login, user_private.api_token AS user_private_api_token, user_private.api_token_expiration AS user_private_api_token_expiration
[Tue Sep 16 11:51:18.661842 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] FROM "user" LEFT OUTER JOIN user_private ON "user".id = user_private.user_id
[Tue Sep 16 11:51:18.661850 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] WHERE user_private.api_login = %(api_login_1)s
[Tue Sep 16 11:51:18.661858 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] LIMIT %(param_1)s]
[Tue Sep 16 11:51:18.661867 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] [parameters: {'api_login_1': 'ubafbakevrqzfjrrjvbs', 'param_1': 1}]
[Tue Sep 16 11:51:18.661875 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] (Background on this error at: https://sqlalche.me/e/20/e3q8)
[Tue Sep 16 11:51:18.661883 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.661891 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] During handling of the above exception, another exception occurred:
[Tue Sep 16 11:51:18.661899 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346]
[Tue Sep 16 11:51:18.661907 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] Traceback (most recent call last):
[Tue Sep 16 11:51:18.661915 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask_restx/api.py", line 669, in error_router
[Tue Sep 16 11:51:18.661924 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] return self.handle_error(e)
[Tue Sep 16 11:51:18.661932 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ~~~~~~~~~~~~~~~~~^^^
[Tue Sep 16 11:51:18.661940 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] File "/usr/lib/python3.13/site-packages/flask_restx/api.py", line 753, in handle_error
[Tue Sep 16 11:51:18.661948 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] if code >= HTTPStatus.INTERNAL_SERVER_ERROR:
[Tue Sep 16 11:51:18.661956 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Tue Sep 16 11:51:18.661965 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] TypeError: '>=' not supported between instances of 'str' and 'HTTPStatus'
per the report: https://matrix.to/#/!rALCnapvdNTxUTuENl:matrix.org/$1KpS7mZ6kbtWitvx9LLWWaXdHEaGaQ_EbHvE9RxiNmc?via=fedoraproject.org&via=matrix.org&via=fedora.im
calling Jenkins run
[2025-09-16T11:51:12.316Z] TASK [include_role : copr_project] *********************************************
[2025-09-16T11:51:12.416Z]
[2025-09-16T11:51:12.416Z] TASK [copr_project : include_tasks] ********************************************
[2025-09-16T11:51:12.416Z] included: /home/jenkins/workspace/foreman-packaging-rpm-copr-pr-test/obal/obal/data/oles/copr_project/tasks/create.yml for rubygem-foreman_bootdisk
[2025-09-16T11:51:15.022Z]
[2025-09-16T11:51:15.022Z] ASK [copr_project : Create Copr project] **************************************
[2025-09-16T11:51:15.022Z] changed: [rubygem-foreman_bootdisk]
[2025-09-16T11:51:16.325Z]
[2025-09-16T11:51:16.325Z] TASK [copr_project : Configure chroots] ****************************************
[2025-09-16T11:51:16.325Z] changed: [rubygem-foreman_bootdisk] => (item={'name': 'rhel-9-x86_64', 'modules': 'nodejs:22'], 'external_repos': ['https://download.copr.fedorainfracloud.org/results/@theforeman/foreman-nightly-staging/hel-9-x86_64', 'https://download.copr.fedorainfracloud.org/results/@theforeman/plugins-nightly-staging/rhel-9-x86_64'], comps_file': '/home/jenkins/workspace/foreman-packaging-rpm-copr-pr-test/comps/comps-foreman-plugins-el9.xml', buildroot_packages': ['foreman-build']})
[2025-09-16T11:51:18.831Z]
[2025-09-16T11:51:18.831Z] TASK [build_package : Run build] ***********************************************
[2025-09-16T11:51:18.831Z] failed: [rubygem-foreman_bootdisk] (item=rhel-9-x86_64) =>
[2025-09-16T11:51:18.831Z] ansible_loop_var: chroot
[2025-09-16T11:51:18.831Z] changed: false
[2025-09-16T11:51:18.831Z] chroot: rhel-9-x86_64
[2025-09-16T11:51:18.831Z] command:
[2025-09-16T11:51:18.831Z] - copr-cli
[2025-09-16T11:51:18.831Z] - --config
[2025-09-16T11:51:18.831Z] - ****
[2025-09-16T11:51:18.831Z] - build
[2025-09-16T11:51:18.831Z] - '@theforeman/plugins-nightly-staging-scratch-fa88c5f3-c44c-584a-89f3-4a91abb46aaf'
[2025-09-16T11:51:18.831Z] - /tmp/ansible.s082tohgsrpms/rubygem-foreman_bootdisk-23.1.2-1.src.rpm
[2025-09-16T11:51:18.831Z] - --chroot
[2025-09-16T11:51:18.831Z] - rhel-9-x86_64
[2025-09-16T11:51:18.831Z] - --nowait
[2025-09-16T11:51:18.831Z] msg: Copr build failed
[2025-09-16T11:51:18.831Z] output: |4-
[2025-09-16T11:51:18.831Z] Something went wrong:
[2025-09-16T11:51:18.831Z] Error: Request wasn't successful, there is probably a bug in the Copr code.
[2025-09-16T11:51:18.831Z] Uploading package /tmp/ansible.s082tohgsrpms/rubygem-foreman_bootdisk-23.1.2-1.src.rpm
[2025-09-16T11:51:18.831Z] repo_name: '@theforeman/plugins-nightly-staging-scratch-fa88c5f3-c44c-584a-89f3-4a91abb46aaf'
[2025-09-16T11:51:18.831Z] srpm: /tmp/ansible.s082tohgsrpms/rubygem-foreman_bootdisk-23.1.2-1.src.rpm
Access log:
185.233.188.88 - - [16/Sep/2025:11:51:13 +0000] "GET /api_3/project/list?ownername=%40theforeman HTTP/1.1" 200 103290 "-" "python-requests/2.25.1"
185.233.188.88 - - [16/Sep/2025:11:51:14 +0000] "POST /api_3/project/add/@theforeman?ownername=%40theforeman&exist_ok=False HTTP/1.1" 200 884 "-" "python-requests/2.25.1"
185.233.188.88 - - [16/Sep/2025:11:51:16 +0000] "POST /api_3/project-chroot/edit/@theforeman/plugins-nightly-staging-scratch-fa88c5f3-c44c-584a-89f3-4a91abb46aaf/rhel-9-x86_64?ownername=%40theforeman&projectname=plugins-nightly-staging-scratch-fa88c5f3-c44c-584a-89f3-4a91abb46aaf&chrootname=rhel-9-x86_64 HTTP/1.1" 200 594 "-" "python-requests/2.25.1"
185.233.188.88 - - [16/Sep/2025:11:51:17 +0000] "GET /api_3/package?ownername=%40theforeman&projectname=plugins-nightly-staging-scratch-fa88c5f3-c44c-584a-89f3-4a91abb46aaf&packagename=rubygem-foreman_bootdisk&with_latest_build=False&with_latest_succeeded_build=False HTTP/1.1" 404 136 "-" "python-requests/2.25.1"
185.233.188.88 - - [16/Sep/2025:11:51:18 +0000] "POST /api_3/build/check-before-build HTTP/1.1" 200 61 "-" "python-requests/2.25.1"
185.233.188.88 - - [16/Sep/2025:11:51:18 +0000] "POST /api_3/build/create/upload HTTP/1.1" 500 81 "-" "python-requests/2.25.1"
[Tue Sep 16 11:51:18.652794 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] psycopg2.OperationalError: server closed the connection unexpectedly
[Tue Sep 16 11:51:18.652803 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tThis probably means the server terminated abnormally
[Tue Sep 16 11:51:18.652811 2025] [wsgi:error] [pid 2267966:tid 2267978] [remote 185.233.188.88:53346] \tbefore or while processing the request.
Does this mean that PostgreSQL interrupted our connection?
We should contact Foreman team, and ask them to let us know when this appears again.
Thanks @evgeni ! Unless/until you hit this again we're lowering the priority.
