tutor
tutor copied to clipboard
overhangio
Emojis in course description cause failures after Olive -> Palm upgrade
Bug description
After upgrading from Olive to Palm, if a single course contains emojis in its short description (such as "📌" or "📣") then the LMS dashboard will fail to load.
How to reproduce
Launch an olive platform:
export TUTOR_ROOT=$(pwd)
pip install 'tutor[full]<16.0.0'
tutor local lauch
tutor local do createuser --superuser --staff --password=1234 admin [email protected]
- Go to http://studio.local.overhang.io, login and create a new course.
- Go to "Schedule & details"
- In "Course Short Description" write "📌". Hit save.
Then, upgrade to Palm:
pip install --upgrade 'tutor[full]'
tutor local launch
Load the LMS dashboard: http://local.overhang.io. It will produce a 500 error with the following logs:
tutor_local-lms-1 | Traceback (most recent call last):
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/core/handlers/exception.py", line 47, in inner
tutor_local-lms-1 | response = get_response(request)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/core/handlers/base.py", line 181, in _get_response
tutor_local-lms-1 | response = wrapped_callback(request, *callback_args, **callback_kwargs)
tutor_local-lms-1 | File "/opt/pyenv/versions/3.8.15/lib/python3.8/contextlib.py", line 75, in inner
tutor_local-lms-1 | return func(*args, **kwds)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/contrib/auth/decorators.py", line 21, in _wrapped_view
tutor_local-lms-1 | return view_func(request, *args, **kwargs)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/utils/decorators.py", line 130, in _wrapped_view
tutor_local-lms-1 | response = view_func(request, *args, **kwargs)
tutor_local-lms-1 | File "/openedx/edx-platform/./openedx/core/djangoapps/util/maintenance_banner.py", line 42, in _decorated
tutor_local-lms-1 | return func(request, *args, **kwargs)
tutor_local-lms-1 | File "/openedx/edx-platform/common/djangoapps/student/views/dashboard.py", line 904, in student_dashboard
tutor_local-lms-1 | response = render_to_response(dashboard_template, context)
tutor_local-lms-1 | File "/openedx/edx-platform/common/djangoapps/edxmako/shortcuts.py", line 188, in render_to_response
tutor_local-lms-1 | return HttpResponse(render_to_string(template_name, dictionary, namespace, request), **kwargs)
tutor_local-lms-1 | File "/openedx/edx-platform/common/djangoapps/edxmako/shortcuts.py", line 178, in render_to_string
tutor_local-lms-1 | return template.render(dictionary, request)
tutor_local-lms-1 | File "/openedx/edx-platform/common/djangoapps/edxmako/template.py", line 82, in render
tutor_local-lms-1 | return self.mako_template.render_unicode(**context_dictionary)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/mako/template.py", line 444, in render_unicode
tutor_local-lms-1 | return runtime._render(
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/mako/runtime.py", line 874, in _render
tutor_local-lms-1 | _render_context(
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/mako/runtime.py", line 916, in _render_context
tutor_local-lms-1 | _exec_template(inherit, lclcontext, args=args, kwargs=kwargs)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/mako/runtime.py", line 943, in _exec_template
tutor_local-lms-1 | callable_(context, *args, **kwargs)
tutor_local-lms-1 | File "/tmp/mako_lms/e2555543ddce7402e2f4f062ddd48a94/main.html.py", line 378, in render_body
tutor_local-lms-1 | __M_writer(filters.html_escape(filters.decode.utf8(next.body())))
tutor_local-lms-1 | File "/tmp/mako_lms/e2555543ddce7402e2f4f062ddd48a94/dashboard.html.py", line 225, in render_body
tutor_local-lms-1 | course_overview = CourseOverview.get_from_id(enrollment.course_id)
tutor_local-lms-1 | File "/openedx/edx-platform/./openedx/core/lib/cache_utils.py", line 74, in decorator
tutor_local-lms-1 | result = wrapped(*args, **kwargs)
tutor_local-lms-1 | File "/openedx/edx-platform/./openedx/core/djangoapps/content/course_overviews/models.py", line 407, in get_from_id
tutor_local-lms-1 | course_overview = cls.load_from_module_store(course_id)
tutor_local-lms-1 | File "/openedx/edx-platform/./openedx/core/djangoapps/content/course_overviews/models.py", line 305, in load_from_module_store
tutor_local-lms-1 | course_overview.save()
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/model_utils/models.py", line 38, in save
tutor_local-lms-1 | super().save(*args, **kwargs)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/models/base.py", line 739, in save
tutor_local-lms-1 | self.save_base(using=using, force_insert=force_insert,
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/models/base.py", line 776, in save_base
tutor_local-lms-1 | updated = self._save_table(
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/models/base.py", line 858, in _save_table
tutor_local-lms-1 | updated = self._do_update(base_qs, using, pk_val, values, update_fields,
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/models/base.py", line 912, in _do_update
tutor_local-lms-1 | return filtered._update(values) > 0
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/models/query.py", line 802, in _update
tutor_local-lms-1 | return query.get_compiler(self.db).execute_sql(CURSOR)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1559, in execute_sql
tutor_local-lms-1 | cursor = super().execute_sql(result_type)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1175, in execute_sql
tutor_local-lms-1 | cursor.execute(sql, params)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/backends/utils.py", line 66, in execute
tutor_local-lms-1 | return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/backends/utils.py", line 75, in _execute_with_wrappers
tutor_local-lms-1 | return executor(sql, params, many, context)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
tutor_local-lms-1 | return self.cursor.execute(sql, params)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
tutor_local-lms-1 | raise dj_exc_value.with_traceback(traceback) from exc_value
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/backends/utils.py", line 84, in _execute
tutor_local-lms-1 | return self.cursor.execute(sql, params)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/django/db/backends/mysql/base.py", line 73, in execute
tutor_local-lms-1 | return self.cursor.execute(query, args)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/MySQLdb/cursors.py", line 206, in execute
tutor_local-lms-1 | res = self._query(query)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/MySQLdb/cursors.py", line 319, in _query
tutor_local-lms-1 | db.query(q)
tutor_local-lms-1 | File "/openedx/venv/lib/python3.8/site-packages/MySQLdb/connections.py", line 254, in query
tutor_local-lms-1 | _mysql.connection.query(self, query)
tutor_local-lms-1 | django.db.utils.OperationalError: (1366, "Incorrect string value: '\\xF0\\x9F\\x93\\x8C' for column 'short_description' at row 1")
tutor_local-caddy-1 | {"level":"error","ts":1696252737.2936494,"logger":"http.log.access.log0","msg":"handled request","request":{"remote_ip":"172.24.0.1","remote_port":"47008","proto":"HTTP/1.1"
,"method":"GET","host":"local.overhang.io","uri":"/dashboard"},"user_id":"","duration":0.312947733,"size":3140,"status":500}
tutor_local-lms-1 | [pid: 7|app: 0|req: 2/18] 172.24.0.3 () {46 vars in 3090 bytes} [Mon Oct 2 13:18:56 2023] GET /dashboard => generated 9591 bytes in 311 msecs (HTTP/1.1 500) 7 headers in 50
7 bytes (1 switches on core 0)
Additional context
This issue was initially raised here: https://discuss.openedx.org/t/mysql-error-after-upgrade-from-olive-to-palm/11304/
It is very likely that this issue is related to #887.
