event_streaming icon indicating copy to clipboard operation
event_streaming copied to clipboard

Event streaming fail for thousands of records

Open ahmadRagheb opened this issue 3 years ago • 0 comments

how to reproduce : 1- data import data with 5000 or more recorded 2- the system will fail to send it all

my error log

frappe.event_streaming.doctype.event_producer.event_producer.pull_from_node Error Traceback (most recent call last): File "/home/frappe/frappe-bench/apps/frappe/frappe/utils/background_jobs.py", line 104, in execute_job method(**kwargs) File "/home/frappe/frappe-bench/apps/frappe/frappe/event_streaming/doctype/event_producer/event_producer.py", line 209, in pull_from_node updates = get_updates(producer_site, last_update, doctypes) File "/home/frappe/frappe-bench/apps/frappe/frappe/event_streaming/doctype/event_producer/event_producer.py", line 368, in get_updates 'last_update': last_update File "/home/frappe/frappe-bench/apps/frappe/frappe/frappeclient.py", line 308, in post_request res = self.post_process(res) File "/home/frappe/frappe-bench/apps/frappe/frappe/frappeclient.py", line 321, in post_process rjson = response.json() File "/home/frappe/frappe-bench/env/lib/python3.6/site-packages/requests/models.py", line 900, in json return complexjson.loads(self.text, **kwargs) File "/usr/lib/python3.6/json/init.py", line 354, in loads return _default_decoder.decode(s) File "/usr/lib/python3.6/json/decoder.py", line 339, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python3.6/json/decoder.py", line 357, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

ahmadRagheb avatar Nov 11 '21 21:11 ahmadRagheb