WikiEduDashboard icon indicating copy to clipboard operation
WikiEduDashboard copied to clipboard

Merge and deploy re-architecture branch

Open ragesoss opened this issue 9 months ago • 4 comments

We are nearing completion of the data re-architecture work: https://github.com/WikiEducationFoundation/WikiEduDashboard/tree/data-rearchitecture-for-dashboard

This is the largest change to the update system we've ever made, so we should do as much as we can to roll it out safely and reversibly.

Preparation for dashboard.wikiedu.org rollout

  • [x] Test migrations against a recent copy of p&e database. NOTE: Modification to existing ArticlesCourses tab is the only migration to worry about. P&E database has 15.5 million ArticlesCourses rows.
  • [x] Open PR to merge data-rearchitecture-for-dashboard
  • [x] Sage reviews PR
  • [x] Estimate database storage requirements for high-activity courses, old vs new system
  • [x] Write message for users about changes and where to report problems

dashboard.wikiedu.org rollout

  • [x] Add message about changes
  • [x] add TIMESLICE_DURATION setting to 1 day (TIMESLICE_DURATION: '86400') in application.yml
  • [x] Pause course updates, pause constant updates, wait for workers to complete current updates
  • [x] Save a server snapshot
  • [x] Clear the course update queues
  • [x] Merge and deploy. (If migration will be slow, run migration manually before Capistrano deployment.)
  • [x] manually add current term courses, ongoing Scholars & Scientists courses, to a queue, enable worker for that queue
  • [x] wait for that queue to process all current courses
  • [ ] Monitor for problems for at least several days

outreachdashboard.wmflabs.org rollout

  • [ ] Add message about changes
  • [ ] add TIMESLICE_DURATION setting to 1 days (TIMESLICE_DURATION: '86400') in application.yml
  • [ ] Pause course updates, pause constant updates, wait for workers to complete current updates
  • [ ] Save a database dump
  • [ ] Clear the course update queues
  • [ ] Run migration manually, server-side.
  • [ ] Merge and deploy to web server
  • [ ] manually add current courses, ordered from least to most revisions, to appropriate queues
  • [ ] update sidekiq process servers, enable queue workers one at a time, monitoring for problems

After rollout

  • [ ] monitor database usage
  • [ ] monitor server resource utilization
  • [ ] monitor course update times. Reduce TIMESLICE_DURATION for courses when updates take a long time
  • [ ] monitor Sentry logs
  • [ ] begin cleanup of now-unused code

ragesoss avatar Feb 10 '25 22:02 ragesoss

Estimate database storage requirements for high-activity courses, old vs new system (10-day timeslices)

There are currently two high-activity courses already ingested that I'm using to estimate database storage requirements.

1. Monthly Outstanding Editor Recognition

Data-rearchitecture link ID: 10002 93.2K* articles, 100 editors, 151K edits

*The data-rearchitecture version has much more articles because it has duplicate articles courses records. This is because there were several processes ingesting the course simultaneously. However, it should not affect the storage for timeslices (even article_course_timeslices depends on article_id not on article_course_id).

Production link ID: 27800 64.3K articles, 100 editors, 152K edits

Data storage

┌───────┬───────────────────────────────┬───────────────┬──────────────────────┬──────────────┐
│ Course│ Table Name                    │ Number of Rows│ Avg Row Length (B)   │ Total Space (MB) │
├───────┼───────────────────────────────┼───────────────┼──────────────────────┼──────────────┤
│ 10002 │ article course timeslice      │  78,154       │  97                  │  7.58        │
│ 10002 │ course wiki timeslice         │  222          │  443                 │  0.10        │
│ 10002 │ course user wiki timeslice    │  1,096        │  114                 │  0.12        │
├───────┼───────────────────────────────┼───────────────┼──────────────────────┼──────────────┤
│       │ TOTAL                         │               │                      │  7.80        │
├───────┼───────────────────────────────┼───────────────┼──────────────────────┼──────────────┤
│ 27800 │ revisions                     │ 152,000 (1)   │  1,040 (1)           │  158.08 (1)  │
├───────┴───────────────────────────────├───────────────├──────────────────────├──────────────┤
│ 27800 │ revisions                     │ 374,043 (2)   │  2,654 (2)           │  992.71 (2)  │
└───────┴───────────────────────────────┴───────────────┴──────────────────────┴──────────────┘

For course 10002 (data-rearchitecture instance) Number of Rows: calculated using COUNT(*) Avg Row Length: calculated via information_schema.tables

For course 27800 (production) (1) The estimate is made on the basis of the following data:

Number of Rows: estimated based on total edits metric Avg Row Length: calculated via information_schema.tables in wiki education db (I didn't have access to outreachdashboard db)

(2) The estimate is made on the basis of the following data: Number of Rows: calculated using COUNT(*) in outreachdashboard db. Avg Row Length: calculated via information_schema.tables in outreachdashboard db.

(2) is a more accurate option

Index storage

I'm unsure how to calculate the storage used by indexes for a specific course. My first naive estimation is to compute the index-to-data ratio for each table (i.e., the proportion of space occupied by indexes relative to data) and then multiply that ratio by the amount of data for the course. However, since the indexes use a B-Tree structure, I suspect the ratio doesn't scale exactly in that manner.

Timeslices tables have 5 indexes (beyond PRIMARY):

  • article_course_timeslice_by_article_course_start_and_end
  • article_course_timeslice_by_tracked
  • article_course_timeslice_by_updated_at
  • course_user_wiki_timeslice_by_course_user_wiki_start_and_end
  • course_wiki_timeslice_by_course_wiki_start_and_end

Query executed on information_schema.tables in data-reachitecture instance db

----------------------------+-----------+------------+----------+--------------+
|table_name                 |data_length|index_length|table_rows|avg_row_length|
+---------------------------+-----------+------------+----------+--------------+
|article_course_timeslices  |   25739264|    35061760|    263822|            97|
+---------------------------+-----------+------------+----------+--------------+
|course_wiki_timeslices     |     458752|       81920|      1250|           367|
+---------------------------+-----------+------------+----------+--------------+
|course_user_wiki_timeslices|     376832|      229376|      3308|           113|
----------------------------+-----------+------------+----------+--------------+

act index/data ratio: 35061760/25739264 = 1.36 cwt index/data ratio: 81920/458752 = 0.18 cuwt index/data ratio: 229376/376832 = 0.61

Index storage for course 10002 = ratio * data storage = (1.36 + 0.18 + 0.61) * 7.80 = 16.77 MB

Revisions table has 4 index (beyond PRIMARY)

  • index_revisions_on_article_id
  • index_revisions_on_article_id_and_date
  • index_revisions_on_user_id
  • index_revisions_on_wiki_id_and_mw_rev_id

(1) Query executed on information_schema.tables in the Wiki Education database

+------------+-------------+--------------+------------+----------------+
| table_name | data_length | index_length | table_rows | avg_row_length |
+------------+-------------+--------------+------------+----------------+
| revisions  |   570228736 |     81969152 |     547811 |           1040 |
+------------+-------------+--------------+------------+----------------+

index/data ratio: 81969152/570228736 = 0.14 Index storage for course 27800 with estimation (1) = ratio * data storage = 0.14 * 158.08 = 22.13 MB

(2) Query executed on information_schema.tables in the outreachdashboard database

+------------+-------------+--------------+------------+----------------+
| table_name | data_length | index_length | table_rows | avg_row_length |
+------------+-------------+--------------+------------+----------------+
| revisions  | 89261932544 |   2022522880 |   33626681 |           2654 |
+------------+-------------+--------------+------------+----------------+

index/data ratio: 2022522880/89261932544 = 0.02 Index storage for course 27800 with estimation (2) = ratio * data storage = 0.02 * 992.71 = 19.85 MB

(2) is a more accurate option Index storage for course 27800 = ratio * data storage = 0.02 * 992.71 = 19.85 MB

Conclusion

Production:

Total storage for course 27800 with estimation (1) = 158.08 + 22.13 = 180.21 MB Total storage for course 27800 with estimation (2) = 992.71 + 19.85 = 1012.56 MB

Data-rearchitecture instance: Total storage for course 10002 = 7.80 + 22.13 = 29.93 MB

2. WikiConecta

Data-rearchitecture link ID: 10000 98.8K articles, 49 editors, 162K edits

Production link ID: 25877 98.2K articles, 51 editors, 160K edits

Data storage

┌───────┬───────────────────────────────┬───────────────┬──────────────────────┬──────────────┐
│ Course│ Table Name                    │ Number of Rows│ Avg Row Length (B)   │ Total Space (MB) │
├───────┼───────────────────────────────┼───────────────┼──────────────────────┼──────────────┤
│ 10000 │ article course timeslice      │  108,042      │  97                  │  10.48       │
│ 10000 │ course wiki timeslice         │  332          │  443                 │  0.15        │
│ 10000 │ course user wiki timeslice    │  925          │  114                 │  0.11        │
├───────┼───────────────────────────────┼───────────────┼──────────────────────┼──────────────┤
│       │ TOTAL                         │               │                      │  10.74       │
├───────┼───────────────────────────────┼───────────────┼──────────────────────┼──────────────┤
│ 25877 │ revisions                     │ 160,000 (1)   │  1,040 (1)           │  166.4  (1)  │
├───────┴───────────────────────────────├───────────────├──────────────────────├──────────────┤
│ 25877 │ revisions                     │ 160,503 (2)   │  2,654 (2)           │  425.97 (2)  │
└───────┴───────────────────────────────┴───────────────┴──────────────────────┴──────────────┘

For course 10000 (data-rearchitecture instance) Number of Rows: calculated using COUNT(*) Avg Row Length: calculated via information_schema.tables

For course 25877 (production) (1) The estimate is made on the basis of the following data:

Number of Rows: estimated based on total edits metric Avg Row Length: calculated via information_schema.tables in wiki education db (I didn't have access to outreachdashboard db)

(2) The estimate is made on the basis of the following data: Number of Rows: calculated using COUNT(*) in outreachdashboard db. Avg Row Length: calculated via information_schema.tables in outreachdashboard db.

(2) is a more accurate option

Index storage

I'm unsure how to calculate the storage used by indexes for a specific course. My first naive estimation is to compute the index-to-data ratio for each table (i.e., the proportion of space occupied by indexes relative to data) and then multiply that ratio by the amount of data for the course. However, since the indexes use a B-Tree structure, I suspect the ratio doesn't scale exactly in that manner.

Timeslices tables have 5 indexes (beyond PRIMARY):

  • article_course_timeslice_by_article_course_start_and_end
  • article_course_timeslice_by_tracked
  • article_course_timeslice_by_updated_at
  • course_user_wiki_timeslice_by_course_user_wiki_start_and_end
  • course_wiki_timeslice_by_course_wiki_start_and_end

Query executed on information_schema.tables in data-reachitecture instance db

----------------------------+-----------+------------+----------+--------------+
|table_name                 |data_length|index_length|table_rows|avg_row_length|
+---------------------------+-----------+------------+----------+--------------+
|article_course_timeslices  |   25739264|    35061760|    263822|            97|
+---------------------------+-----------+------------+----------+--------------+
|course_wiki_timeslices     |     458752|       81920|      1250|           367|
+---------------------------+-----------+------------+----------+--------------+
|course_user_wiki_timeslices|     376832|      229376|      3308|           113|
----------------------------+-----------+------------+----------+--------------+

act index/data ratio: 35061760/25739264 = 1.36 cwt index/data ratio: 81920/458752 = 0.18 cuwt index/data ratio: 229376/376832 = 0.61

Index storage for course 10000 = ratio * data storage = (1.36 + 0.18 + 0.61) * 10.74 = 23.1 MB

Revisions table has 4 index (beyond PRIMARY)

  • index_revisions_on_article_id
  • index_revisions_on_article_id_and_date
  • index_revisions_on_user_id
  • index_revisions_on_wiki_id_and_mw_rev_id

(1) Query executed on information_schema.tables in the Wiki Education database

+------------+-------------+--------------+------------+----------------+
| table_name | data_length | index_length | table_rows | avg_row_length |
+------------+-------------+--------------+------------+----------------+
| revisions  |   570228736 |     81969152 |     547811 |           1040 |
+------------+-------------+--------------+------------+----------------+

index/data ratio: 81969152/570228736 = 0.14 Index storage for course 25877 with estimation (1) = ratio * data storage = 0.14 * 166.4 = 23.3 MB

(2) Query executed on information_schema.tables in the outreachdashboard database

+------------+-------------+--------------+------------+----------------+
| table_name | data_length | index_length | table_rows | avg_row_length |
+------------+-------------+--------------+------------+----------------+
| revisions  | 89261932544 |   2022522880 |   33626681 |           2654 |
+------------+-------------+--------------+------------+----------------+

index/data ratio: 2022522880/89261932544 = 0.02 Index storage for course 25877 with estimation (2) = ratio * data storage = 0.02 * 425.97 = 8.52 MB

(2) is a more accurate option Index storage for course 25877 = ratio * data storage = 0.02 * 425.97 = 8.52 MB

Conclusion

Production:

Total storage for course 25877 with estimation (1) = 166.4 + 23.3 = 189.7 MB Total storage for course 25877 with estimation (2) = 425.97 + 8.52 = 434.49 MB

Data-rearchitecture instance: Total storage for course 10002 = 10.74 + 23.1 = 33.84 MB

gabina avatar Feb 12 '25 23:02 gabina

Some quick notes about what we've observed since starting the rollout for Wiki Education Dashboard on Thursday, February 27:

  • Dramatic reductions in server resource utilization, with about 1/3 as much CPU usage after the deployment and a significantly smaller memory footprint for the Sidekiq workers that handle course updates.
  • We quickly when from just one queue up to the usual 3. All courses except one very long-running high-activity course ( https://dashboard.wikiedu.org/courses/Northeastern_University/Visiting_Scholars_at_Northeastern_University_-Rosiestep(2017) ) completed their initial updates by the end of the day. That long one has been running now for about 30 hours, and still has a long way to go before completion. However, at least during the timeslice data generation phase, memory usage has been very low and stable. We project that it will finish processing over the weekend.
  • For the rest of the courses, the steady state rate of updates is slower than previously with queue latency around 30 minutes with 3 workers (plus the one worker that is still processing the long-running course). This slowness is due to the reprocessing that we do for the latest timeslice, when that timeslice has not yet reached its ending timestamp. We think we can fix this by skipping reprocessing for timeslices where the number of revisions and the timestamp of the latest edit is unchanged; this will avoid refetching the slow data like reference counts.

Based on what we've seen so far, I expect that it will take quite a while to do the initial processing of current courses on Programs & Events Dashboard, but on the system resources front, things are looking great.

ragesoss avatar Mar 01 '25 01:03 ragesoss

The long course finally completed it's first update yesterday. It is currently undergoing its second update, which has been going for 7 hours so far.

Log from the first update:

start_time":"2025-02-27T22:03:40.530+00:00",
"end_time":"2025-03-03T10:10:14.263+00:00",
"sentry_tag_uuid":"18bd3411-bd0e-480f-8e83-48101375f282",
"error_count":1,
"proccesed":2705,
"reprocessed":139

I didn't spot a corresponding error log in Sentry.

@gabina: how should we investigate this? I'm not sure why the second update is taking multiple hours, whether that's because of problems during the first update that necessitate a considerable amount of reprocessing, or if something else is slower than expected.

ragesoss avatar Mar 03 '25 17:03 ragesoss

I'm not sure why the second update is taking multiple hours, whether that's because of problems during the first update that necessitate a considerable amount of reprocessing, or if something else is slower than expected.

hmm acording to some queries I ran, there are 2779 CWT rows with last_mw_rev_datetime different from null (meaning that those rows had a non-trivial update). The number of CWT rows with needs_update set to true is 2203, so the second update is reprocessing most timeslices. I had to check if the needs_update set to true is related to a non-transient error when getting scores or if there is something in the "preparing timeslices" process that marks most timeslices as needs_update. I'll run a (partial) course update locally to see what's going on.

EDIT: 40 minutes after the comment, the number of CWT rows with needs_update set to true is 2152. That means that 50 timeslices were reprocessed with no fails.

I just noticed that is a VisitingScholarship course, so I will check if the problem is related to that.

gabina avatar Mar 03 '25 18:03 gabina

The strategy of ordering courses by revision count ( docs/debugging_scripts/prioritize_updates.rb) has a significant flaw: revision counts don't include out-of-scope revisions for ArticleScopedPrograms, so some courses with low or zero revision counts actually have a very large number of revisions to process.

ragesoss avatar Mar 10 '25 20:03 ragesoss

One thing that we may want to improve in the future: one timeslice may be processed twice in the same course update (one because it's marked as "needs_update" and the second time because it's the "current" timeslice).

[2025-03-13 17:50:34.204 INFO ] UpdateCourseWikiTimeslices: Course: Northeastern_University/Visiting_Scholars_at_Northeastern_University_-_Rosiestep_(March_2025) Wiki: 1.    Reprocessing timeslice [2018-12-01 00:00:00 UTC, 2018-12-01 23:59:59 UTC]

[2025-03-13 17:50:34.900 INFO ] UpdateCourseWikiTimeslices: Course: Northeastern_University/Visiting_Scholars_at_Northeastern_University_-_Rosiestep_(March_2025) Wiki: 1.    Processing timeslice [2018-12-01 00:00:00 UTC, 2018-12-01 23:59:59 UTC]

gabina avatar Mar 13 '25 21:03 gabina

A new course (which covers 2022-2023) is taking a very long time to generate data, and may be stuck somehow: https://outreachdashboard.wmflabs.org/courses/Levant/Editing_and_Contributing_Training_-_University_Students

The update for it has currently been running for 8 days (and it was previously running for several days before the job was killed for a deployment).

ragesoss avatar Apr 15 '25 16:04 ragesoss

hmm looking at the course_wiki_timeslices table for course 31480 Editing and Contributing Training - University Students, it doesn't look like the process is stuck but it's just too slow. The updated_at field in this table shows that new revisions were fetched every day (the last timeslice was updated one hour ago). All the revisions are from ar.wikipedia. For now we have 553,897 revisions from 2022-04-07 to 2022-09-30.

EDIT: one interesting thing for this course is that all edits seem to have been done by JarBot. In addition, I'm not completely sure but maybe there are no edits made on en.wikipedia and wikidata, so every time the update restarts (because of a deployment for example), it tries to retrieve all the revisions for those wikis again.

+---------+-----------+---------+----------------------------+----------------------------+---------------+------------------+----------------+-------+----------------------------+--------------+----------------------------+----------------------------+
| id      | course_id | wiki_id | start                      | end                        | character_sum | references_count | revision_count | stats | last_mw_rev_datetime       | needs_update | created_at                 | updated_at                 |
+---------+-----------+---------+----------------------------+----------------------------+---------------+------------------+----------------+-------+----------------------------+--------------+----------------------------+----------------------------+
| 1050017 |     31480 |       4 | 2022-04-07 22:03:00.000000 | 2022-04-08 22:03:00.000000 |        141769 |                0 |           2370 | NULL  | 2022-04-08 22:02:41.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 00:35:12.338013 |
| 1050018 |     31480 |       4 | 2022-04-08 22:03:00.000000 | 2022-04-09 22:03:00.000000 |        168542 |                0 |           1866 | NULL  | 2022-04-09 22:02:43.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 01:48:31.561688 |
| 1050019 |     31480 |       4 | 2022-04-09 22:03:00.000000 | 2022-04-10 22:03:00.000000 |        130799 |                0 |           1732 | NULL  | 2022-04-10 22:02:41.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 02:55:09.441433 |
| 1050020 |     31480 |       4 | 2022-04-10 22:03:00.000000 | 2022-04-11 22:03:00.000000 |        156162 |               -1 |           3030 | NULL  | 2022-04-11 22:02:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 04:59:41.009035 |
| 1050021 |     31480 |       4 | 2022-04-11 22:03:00.000000 | 2022-04-12 22:03:00.000000 |        101473 |               -1 |           1503 | NULL  | 2022-04-12 22:02:50.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 07:43:45.854793 |
| 1050022 |     31480 |       4 | 2022-04-12 22:03:00.000000 | 2022-04-13 22:03:00.000000 |        141406 |                0 |           8639 | NULL  | 2022-04-13 22:02:59.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-07 11:59:01.789487 |
| 1050023 |     31480 |       4 | 2022-04-13 22:03:00.000000 | 2022-04-14 22:03:00.000000 |        182111 |                0 |           2345 | NULL  | 2022-04-14 22:02:59.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 16:54:08.070931 |
| 1050024 |     31480 |       4 | 2022-04-14 22:03:00.000000 | 2022-04-15 22:03:00.000000 |        196553 |                6 |          13332 | NULL  | 2022-04-15 22:00:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 20:38:42.997597 |
| 1050025 |     31480 |       4 | 2022-04-15 22:03:00.000000 | 2022-04-16 22:03:00.000000 |        200629 |                0 |           1656 | NULL  | 2022-04-16 22:02:55.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-30 22:28:28.335002 |
| 1050026 |     31480 |       4 | 2022-04-16 22:03:00.000000 | 2022-04-17 22:03:00.000000 |        212238 |                0 |           2210 | NULL  | 2022-04-17 22:02:30.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-31 00:16:48.679486 |
| 1050027 |     31480 |       4 | 2022-04-17 22:03:00.000000 | 2022-04-18 22:03:00.000000 |        135161 |                2 |           2345 | NULL  | 2022-04-18 22:01:34.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-31 02:01:54.189372 |
| 1050028 |     31480 |       4 | 2022-04-18 22:03:00.000000 | 2022-04-19 22:03:00.000000 |        169477 |               -1 |           3327 | NULL  | 2022-04-19 22:02:41.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-31 04:50:21.338361 |
| 1050029 |     31480 |       4 | 2022-04-19 22:03:00.000000 | 2022-04-20 22:03:00.000000 |        161830 |               -5 |           2755 | NULL  | 2022-04-20 22:00:45.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 01:44:23.268789 |
| 1050030 |     31480 |       4 | 2022-04-20 22:03:00.000000 | 2022-04-21 22:03:00.000000 |        945508 |              155 |           7791 | NULL  | 2022-04-21 21:59:40.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-31 13:18:05.117936 |
| 1050031 |     31480 |       4 | 2022-04-21 22:03:00.000000 | 2022-04-22 22:03:00.000000 |        240158 |             -381 |           5629 | NULL  | 2022-04-22 22:00:27.000000 |            1 | 2025-03-29 22:46:09.110319 | 2025-04-04 05:51:02.036695 |
| 1050032 |     31480 |       4 | 2022-04-22 22:03:00.000000 | 2022-04-23 22:03:00.000000 |        113942 |               -5 |           1625 | NULL  | 2022-04-23 22:02:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-31 19:19:09.941594 |
| 1050033 |     31480 |       4 | 2022-04-23 22:03:00.000000 | 2022-04-24 22:03:00.000000 |        151759 |               -8 |           2103 | NULL  | 2022-04-24 22:02:16.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-03-31 21:08:40.106717 |
| 1050034 |     31480 |       4 | 2022-04-24 22:03:00.000000 | 2022-04-25 22:03:00.000000 |        452421 |              -15 |           4296 | NULL  | 2022-04-25 22:02:35.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-02 06:35:08.386792 |
| 1050035 |     31480 |       4 | 2022-04-25 22:03:00.000000 | 2022-04-26 22:03:00.000000 |        223634 |              298 |           4333 | NULL  | 2022-04-26 22:02:59.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 03:44:43.065908 |
| 1050036 |     31480 |       4 | 2022-04-26 22:03:00.000000 | 2022-04-27 22:03:00.000000 |        135184 |              -30 |           2336 | NULL  | 2022-04-27 22:02:58.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 05:20:00.667349 |
| 1050037 |     31480 |       4 | 2022-04-27 22:03:00.000000 | 2022-04-28 22:03:00.000000 |        129051 |              -42 |           1982 | NULL  | 2022-04-28 22:00:48.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 06:25:36.083230 |
| 1050038 |     31480 |       4 | 2022-04-28 22:03:00.000000 | 2022-04-29 22:03:00.000000 |        134590 |              -34 |           3333 | NULL  | 2022-04-29 22:00:22.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 07:57:06.668312 |
| 1050039 |     31480 |       4 | 2022-04-29 22:03:00.000000 | 2022-04-30 22:03:00.000000 |        126308 |              -32 |           1399 | NULL  | 2022-04-30 22:01:39.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 08:47:02.457088 |
| 1050040 |     31480 |       4 | 2022-04-30 22:03:00.000000 | 2022-05-01 22:03:00.000000 |        100224 |              -44 |           1727 | NULL  | 2022-05-01 22:02:31.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 09:47:39.132758 |
| 1050041 |     31480 |       4 | 2022-05-01 22:03:00.000000 | 2022-05-02 22:03:00.000000 |        135517 |              -48 |           1947 | NULL  | 2022-05-02 21:56:55.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 11:00:16.215654 |
| 1050042 |     31480 |       4 | 2022-05-02 22:03:00.000000 | 2022-05-03 22:03:00.000000 |        247433 |               17 |           2789 | NULL  | 2022-05-03 22:02:12.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 12:55:42.399228 |
| 1050043 |     31480 |       4 | 2022-05-03 22:03:00.000000 | 2022-05-04 22:03:00.000000 |        254924 |               29 |           2708 | NULL  | 2022-05-04 21:59:10.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-01 14:59:39.474200 |
| 1050044 |     31480 |       4 | 2022-05-04 22:03:00.000000 | 2022-05-05 22:03:00.000000 |        391043 |               32 |           5307 | NULL  | 2022-05-05 21:50:43.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-02 10:48:21.399626 |
| 1050045 |     31480 |       4 | 2022-05-05 22:03:00.000000 | 2022-05-06 22:03:00.000000 |        310277 |              -17 |           2043 | NULL  | 2022-05-06 22:01:13.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-02 12:12:42.327639 |
| 1050046 |     31480 |       4 | 2022-05-06 22:03:00.000000 | 2022-05-07 22:03:00.000000 |        243411 |               10 |           2959 | NULL  | 2022-05-07 21:50:38.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-07 18:06:46.240197 |
| 1050047 |     31480 |       4 | 2022-05-07 22:03:00.000000 | 2022-05-08 22:03:00.000000 |        298789 |              -41 |           2594 | NULL  | 2022-05-08 21:57:33.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-02 16:14:06.583526 |
| 1050048 |     31480 |       4 | 2022-05-08 22:03:00.000000 | 2022-05-09 22:03:00.000000 |        117797 |              -26 |           3299 | NULL  | 2022-05-09 21:55:20.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-02 18:53:35.412832 |
| 1050049 |     31480 |       4 | 2022-05-09 22:03:00.000000 | 2022-05-10 22:03:00.000000 |        268238 |               -5 |           1203 | NULL  | 2022-05-10 22:02:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-02 19:33:54.259031 |
| 1050050 |     31480 |       4 | 2022-05-10 22:03:00.000000 | 2022-05-11 22:03:00.000000 |        143326 |              -63 |           3407 | NULL  | 2022-05-11 18:52:30.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-02 21:55:57.696415 |
| 1050051 |     31480 |       4 | 2022-05-11 22:03:00.000000 | 2022-05-12 22:03:00.000000 |        412822 |              -16 |           4634 | NULL  | 2022-05-12 22:01:07.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 01:23:53.021412 |
| 1050052 |     31480 |       4 | 2022-05-12 22:03:00.000000 | 2022-05-13 22:03:00.000000 |        781426 |             2397 |           4449 | NULL  | 2022-05-13 22:01:58.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 04:07:51.901518 |
| 1050053 |     31480 |       4 | 2022-05-13 22:03:00.000000 | 2022-05-14 22:03:00.000000 |        148496 |              -17 |           1827 | NULL  | 2022-05-14 22:02:54.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 05:22:29.066834 |
| 1050054 |     31480 |       4 | 2022-05-14 22:03:00.000000 | 2022-05-15 22:03:00.000000 |        141887 |              -19 |           2103 | NULL  | 2022-05-15 21:58:47.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 06:36:31.785348 |
| 1050055 |     31480 |       4 | 2022-05-15 22:03:00.000000 | 2022-05-16 22:03:00.000000 |        183234 |              -24 |           2343 | NULL  | 2022-05-16 22:02:04.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 08:00:32.925842 |
| 1050056 |     31480 |       4 | 2022-05-16 22:03:00.000000 | 2022-05-17 22:03:00.000000 |        326260 |              -70 |           1690 | NULL  | 2022-05-17 22:02:15.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 09:03:58.697379 |
| 1050057 |     31480 |       4 | 2022-05-17 22:03:00.000000 | 2022-05-18 22:03:00.000000 |        276985 |              -52 |           2363 | NULL  | 2022-05-18 22:02:32.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 10:32:00.866955 |
| 1050058 |     31480 |       4 | 2022-05-18 22:03:00.000000 | 2022-05-19 22:03:00.000000 |        173548 |              -19 |           2919 | NULL  | 2022-05-19 22:01:07.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 12:54:27.598982 |
| 1050059 |     31480 |       4 | 2022-05-19 22:03:00.000000 | 2022-05-20 22:03:00.000000 |        197361 |               -1 |           1469 | NULL  | 2022-05-20 22:00:37.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 13:42:08.681134 |
| 1050060 |     31480 |       4 | 2022-05-20 22:03:00.000000 | 2022-05-21 22:03:00.000000 |        221023 |              -98 |           1811 | NULL  | 2022-05-21 22:02:52.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 14:56:29.114974 |
| 1050061 |     31480 |       4 | 2022-05-21 22:03:00.000000 | 2022-05-22 22:03:00.000000 |        142326 |              -29 |           1220 | NULL  | 2022-05-22 22:01:32.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 15:40:27.085867 |
| 1050062 |     31480 |       4 | 2022-05-22 22:03:00.000000 | 2022-05-23 22:03:00.000000 |        135233 |             -176 |           1424 | NULL  | 2022-05-23 22:01:09.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 16:25:02.117764 |
| 1050063 |     31480 |       4 | 2022-05-23 22:03:00.000000 | 2022-05-24 22:03:00.000000 |        182543 |              -80 |           1317 | NULL  | 2022-05-24 21:55:24.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 17:07:54.126130 |
| 1050064 |     31480 |       4 | 2022-05-24 22:03:00.000000 | 2022-05-25 22:03:00.000000 |        133269 |              -20 |           1410 | NULL  | 2022-05-25 21:56:20.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 18:00:31.074481 |
| 1050065 |     31480 |       4 | 2022-05-25 22:03:00.000000 | 2022-05-26 22:03:00.000000 |        110996 |              -49 |           1302 | NULL  | 2022-05-26 21:47:14.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 18:45:27.744478 |
| 1050066 |     31480 |       4 | 2022-05-26 22:03:00.000000 | 2022-05-27 22:03:00.000000 |        212694 |                0 |           1766 | NULL  | 2022-05-27 21:59:16.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-03 19:33:44.211300 |
| 1050067 |     31480 |       4 | 2022-05-27 22:03:00.000000 | 2022-05-28 22:03:00.000000 |        178368 |             -118 |           1535 | NULL  | 2022-05-28 21:57:15.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 08:35:20.202801 |
| 1050068 |     31480 |       4 | 2022-05-28 22:03:00.000000 | 2022-05-29 22:03:00.000000 |        880781 |              -55 |           4816 | NULL  | 2022-05-29 21:55:13.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 12:08:24.456194 |
| 1050069 |     31480 |       4 | 2022-05-29 22:03:00.000000 | 2022-05-30 22:03:00.000000 |        532236 |              -71 |           3675 | NULL  | 2022-05-30 22:00:33.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 14:39:51.178721 |
| 1050070 |     31480 |       4 | 2022-05-30 22:03:00.000000 | 2022-05-31 22:03:00.000000 |        152981 |              -89 |           1678 | NULL  | 2022-05-31 21:59:39.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 15:39:36.095248 |
| 1050071 |     31480 |       4 | 2022-05-31 22:03:00.000000 | 2022-06-01 22:03:00.000000 |        122115 |              -51 |           1056 | NULL  | 2022-06-01 21:36:07.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 16:20:57.426346 |
| 1050072 |     31480 |       4 | 2022-06-01 22:03:00.000000 | 2022-06-02 22:03:00.000000 |        113631 |              -53 |           1102 | NULL  | 2022-06-02 21:46:10.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 17:13:19.131822 |
| 1050073 |     31480 |       4 | 2022-06-02 22:03:00.000000 | 2022-06-03 22:03:00.000000 |         80493 |              -72 |           1612 | NULL  | 2022-06-03 21:58:22.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 18:13:13.347679 |
| 1050074 |     31480 |       4 | 2022-06-03 22:03:00.000000 | 2022-06-04 22:03:00.000000 |        100577 |              -60 |           1712 | NULL  | 2022-06-04 22:00:31.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 19:20:50.201671 |
| 1050075 |     31480 |       4 | 2022-06-04 22:03:00.000000 | 2022-06-05 22:03:00.000000 |        372334 |                6 |           1768 | NULL  | 2022-06-05 22:02:54.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 20:26:29.406389 |
| 1050076 |     31480 |       4 | 2022-06-05 22:03:00.000000 | 2022-06-06 22:03:00.000000 |        145954 |                7 |           1658 | NULL  | 2022-06-06 22:02:33.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 21:27:52.283995 |
| 1050077 |     31480 |       4 | 2022-06-06 22:03:00.000000 | 2022-06-07 22:03:00.000000 |        160059 |             -396 |           2245 | NULL  | 2022-06-07 22:02:12.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-04 23:00:48.444776 |
| 1050078 |     31480 |       4 | 2022-06-07 22:03:00.000000 | 2022-06-08 22:03:00.000000 |        179067 |              -69 |           2672 | NULL  | 2022-06-08 22:00:50.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 00:49:01.202867 |
| 1050079 |     31480 |       4 | 2022-06-08 22:03:00.000000 | 2022-06-09 22:03:00.000000 |        148255 |             -169 |           1545 | NULL  | 2022-06-09 22:01:42.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 01:40:55.720247 |
| 1050080 |     31480 |       4 | 2022-06-09 22:03:00.000000 | 2022-06-10 22:03:00.000000 |        136342 |              -33 |           3771 | NULL  | 2022-06-10 21:55:24.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 04:04:17.841654 |
| 1050081 |     31480 |       4 | 2022-06-10 22:03:00.000000 | 2022-06-11 22:03:00.000000 |        321088 |              -57 |           3573 | NULL  | 2022-06-11 22:01:27.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 06:42:34.898716 |
| 1050082 |     31480 |       4 | 2022-06-11 22:03:00.000000 | 2022-06-12 22:03:00.000000 |        103140 |             -214 |           2136 | NULL  | 2022-06-12 22:01:28.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 07:55:27.932515 |
| 1050083 |     31480 |       4 | 2022-06-12 22:03:00.000000 | 2022-06-13 22:03:00.000000 |        160091 |             -149 |           4125 | NULL  | 2022-06-13 22:02:51.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-07 21:00:45.401150 |
| 1050084 |     31480 |       4 | 2022-06-13 22:03:00.000000 | 2022-06-14 22:03:00.000000 |        311440 |              379 |           3149 | NULL  | 2022-06-14 22:00:59.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 12:30:46.393744 |
| 1050085 |     31480 |       4 | 2022-06-14 22:03:00.000000 | 2022-06-15 22:03:00.000000 |        805011 |             2651 |           5620 | NULL  | 2022-06-15 22:02:40.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 15:44:05.328047 |
| 1050086 |     31480 |       4 | 2022-06-15 22:03:00.000000 | 2022-06-16 22:03:00.000000 |        323778 |              -50 |           2650 | NULL  | 2022-06-16 22:02:35.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-07 22:44:16.305319 |
| 1050087 |     31480 |       4 | 2022-06-16 22:03:00.000000 | 2022-06-17 22:03:00.000000 |        170849 |              -74 |           2160 | NULL  | 2022-06-17 22:01:09.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 00:10:45.023296 |
| 1050088 |     31480 |       4 | 2022-06-17 22:03:00.000000 | 2022-06-18 22:03:00.000000 |        159326 |              -22 |           1515 | NULL  | 2022-06-18 22:02:57.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 19:45:07.616548 |
| 1050089 |     31480 |       4 | 2022-06-18 22:03:00.000000 | 2022-06-19 22:03:00.000000 |        138694 |              -42 |           2521 | NULL  | 2022-06-19 22:01:44.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 21:32:24.727181 |
| 1050090 |     31480 |       4 | 2022-06-19 22:03:00.000000 | 2022-06-20 22:03:00.000000 |        184249 |              -71 |           2362 | NULL  | 2022-06-20 21:59:06.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-05 22:58:14.699192 |
| 1050091 |     31480 |       4 | 2022-06-20 22:03:00.000000 | 2022-06-21 22:03:00.000000 |        291690 |                8 |           2120 | NULL  | 2022-06-21 22:02:50.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 00:21:51.769277 |
| 1050092 |     31480 |       4 | 2022-06-21 22:03:00.000000 | 2022-06-22 22:03:00.000000 |        553567 |                6 |           4278 | NULL  | 2022-06-22 22:02:50.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 03:22:06.550583 |
| 1050093 |     31480 |       4 | 2022-06-22 22:03:00.000000 | 2022-06-23 22:03:00.000000 |        311831 |               -2 |           2697 | NULL  | 2022-06-23 22:01:28.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 05:13:58.978854 |
| 1050094 |     31480 |       4 | 2022-06-23 22:03:00.000000 | 2022-06-24 22:03:00.000000 |        144479 |              -40 |           2979 | NULL  | 2022-06-24 22:02:06.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 02:04:59.594290 |
| 1050095 |     31480 |       4 | 2022-06-24 22:03:00.000000 | 2022-06-25 22:03:00.000000 |         97340 |              -25 |           1208 | NULL  | 2022-06-25 22:00:53.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 07:52:04.135275 |
| 1050096 |     31480 |       4 | 2022-06-25 22:03:00.000000 | 2022-06-26 22:03:00.000000 |        177043 |              -29 |           2064 | NULL  | 2022-06-26 22:02:05.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 03:22:10.380129 |
| 1050097 |     31480 |       4 | 2022-06-26 22:03:00.000000 | 2022-06-27 22:03:00.000000 |        150302 |               -2 |           2002 | NULL  | 2022-06-27 22:00:52.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 10:30:48.754315 |
| 1050098 |     31480 |       4 | 2022-06-27 22:03:00.000000 | 2022-06-28 22:03:00.000000 |        272576 |             -195 |           2250 | NULL  | 2022-06-28 21:55:45.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 11:48:07.683087 |
| 1050099 |     31480 |       4 | 2022-06-28 22:03:00.000000 | 2022-06-29 22:03:00.000000 |        235232 |              -23 |           2424 | NULL  | 2022-06-29 22:01:16.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 13:28:46.536079 |
| 1050100 |     31480 |       4 | 2022-06-29 22:03:00.000000 | 2022-06-30 22:03:00.000000 |        205381 |             -187 |           1618 | NULL  | 2022-06-30 22:02:35.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 14:26:07.708019 |
| 1050101 |     31480 |       4 | 2022-06-30 22:03:00.000000 | 2022-07-01 22:03:00.000000 |        236319 |              -63 |           4162 | NULL  | 2022-07-01 22:02:47.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-06 17:12:59.919737 |
| 1050102 |     31480 |       4 | 2022-07-01 22:03:00.000000 | 2022-07-02 22:03:00.000000 |        250068 |             -104 |           8511 | NULL  | 2022-07-02 22:02:15.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 09:07:55.519026 |
| 1050103 |     31480 |       4 | 2022-07-02 22:03:00.000000 | 2022-07-03 22:03:00.000000 |        272690 |               -4 |           5968 | NULL  | 2022-07-03 22:01:50.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 13:13:35.297866 |
| 1050104 |     31480 |       4 | 2022-07-03 22:03:00.000000 | 2022-07-04 22:03:00.000000 |        188169 |              -23 |           2107 | NULL  | 2022-07-04 22:01:15.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 14:29:10.571044 |
| 1050105 |     31480 |       4 | 2022-07-04 22:03:00.000000 | 2022-07-05 22:03:00.000000 |        129834 |               -3 |           2483 | NULL  | 2022-07-05 21:59:07.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 16:05:46.868547 |
| 1050106 |     31480 |       4 | 2022-07-05 22:03:00.000000 | 2022-07-06 22:03:00.000000 |        135810 |              -23 |           4142 | NULL  | 2022-07-06 22:02:59.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 19:12:53.592059 |
| 1050107 |     31480 |       4 | 2022-07-06 22:03:00.000000 | 2022-07-07 22:03:00.000000 |        140352 |             -146 |           4520 | NULL  | 2022-07-07 22:02:23.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-08 23:15:00.203852 |
| 1050108 |     31480 |       4 | 2022-07-07 22:03:00.000000 | 2022-07-08 22:03:00.000000 |        204677 |             -111 |           9147 | NULL  | 2022-07-08 22:02:55.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-09 05:43:58.230665 |
| 1050109 |     31480 |       4 | 2022-07-08 22:03:00.000000 | 2022-07-09 22:03:00.000000 |        171297 |               -1 |           6732 | NULL  | 2022-07-09 21:57:43.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-09 10:23:28.735213 |
| 1050110 |     31480 |       4 | 2022-07-09 22:03:00.000000 | 2022-07-10 22:03:00.000000 |        419080 |              -22 |           4122 | NULL  | 2022-07-10 22:02:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-09 13:07:00.541078 |
| 1050111 |     31480 |       4 | 2022-07-10 22:03:00.000000 | 2022-07-11 22:03:00.000000 |        804145 |              115 |           6755 | NULL  | 2022-07-11 22:02:59.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-09 18:05:01.773314 |
| 1050112 |     31480 |       4 | 2022-07-11 22:03:00.000000 | 2022-07-12 22:03:00.000000 |        248781 |              -64 |           8080 | NULL  | 2022-07-12 21:56:47.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-10 00:05:25.175641 |
| 1050113 |     31480 |       4 | 2022-07-12 22:03:00.000000 | 2022-07-13 22:03:00.000000 |        136927 |               -9 |           6838 | NULL  | 2022-07-13 22:00:50.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-10 04:39:41.734380 |
| 1050114 |     31480 |       4 | 2022-07-13 22:03:00.000000 | 2022-07-14 22:03:00.000000 |        189747 |               -6 |           7017 | NULL  | 2022-07-14 22:02:29.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-10 09:35:43.116872 |
| 1050115 |     31480 |       4 | 2022-07-14 22:03:00.000000 | 2022-07-15 22:03:00.000000 |        149462 |               -4 |           6611 | NULL  | 2022-07-15 21:58:36.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-10 14:18:08.226785 |
| 1050116 |     31480 |       4 | 2022-07-15 22:03:00.000000 | 2022-07-16 22:03:00.000000 |        249968 |              -11 |           7354 | NULL  | 2022-07-16 22:02:38.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-10 19:17:08.189859 |
| 1050117 |     31480 |       4 | 2022-07-16 22:03:00.000000 | 2022-07-17 22:03:00.000000 |        144063 |              -12 |           2352 | NULL  | 2022-07-17 22:02:46.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-10 20:59:39.825902 |
| 1050118 |     31480 |       4 | 2022-07-17 22:03:00.000000 | 2022-07-18 22:03:00.000000 |        150284 |              -14 |           4557 | NULL  | 2022-07-18 22:02:43.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-10 23:58:42.049093 |
| 1050119 |     31480 |       4 | 2022-07-18 22:03:00.000000 | 2022-07-19 22:03:00.000000 |        139496 |               -3 |           4345 | NULL  | 2022-07-19 22:02:12.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-11 02:41:28.773176 |
| 1050120 |     31480 |       4 | 2022-07-19 22:03:00.000000 | 2022-07-20 22:03:00.000000 |        386675 |                2 |           3143 | NULL  | 2022-07-20 22:02:57.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-11 04:50:33.650142 |
| 1050121 |     31480 |       4 | 2022-07-20 22:03:00.000000 | 2022-07-21 22:03:00.000000 |        394552 |               30 |           5689 | NULL  | 2022-07-21 22:01:40.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-11 09:07:53.085287 |
| 1050122 |     31480 |       4 | 2022-07-21 22:03:00.000000 | 2022-07-22 22:03:00.000000 |        442308 |               33 |           7393 | NULL  | 2022-07-22 22:02:09.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-11 14:29:07.093291 |
| 1050123 |     31480 |       4 | 2022-07-22 22:03:00.000000 | 2022-07-23 22:03:00.000000 |      27182885 |             8512 |          18953 | NULL  | 2022-07-23 22:02:35.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-11 23:51:57.444365 |
| 1050124 |     31480 |       4 | 2022-07-23 22:03:00.000000 | 2022-07-24 22:03:00.000000 |       1655032 |              211 |           3406 | NULL  | 2022-07-24 22:02:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 01:53:33.931166 |
| 1050125 |     31480 |       4 | 2022-07-24 22:03:00.000000 | 2022-07-25 22:03:00.000000 |        156295 |               -2 |           1752 | NULL  | 2022-07-25 21:59:37.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 02:46:50.002888 |
| 1050126 |     31480 |       4 | 2022-07-25 22:03:00.000000 | 2022-07-26 22:03:00.000000 |        123588 |              -16 |           4482 | NULL  | 2022-07-26 21:58:31.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 05:52:41.157859 |
| 1050127 |     31480 |       4 | 2022-07-26 22:03:00.000000 | 2022-07-27 22:03:00.000000 |        133662 |               -3 |           1303 | NULL  | 2022-07-27 21:51:40.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 06:37:49.171525 |
| 1050128 |     31480 |       4 | 2022-07-27 22:03:00.000000 | 2022-07-28 22:03:00.000000 |        440412 |               41 |           1906 | NULL  | 2022-07-28 22:02:48.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 07:49:53.277840 |
| 1050129 |     31480 |       4 | 2022-07-28 22:03:00.000000 | 2022-07-29 22:03:00.000000 |        150745 |              -54 |           1131 | NULL  | 2022-07-29 22:02:06.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 08:29:06.074696 |
| 1050130 |     31480 |       4 | 2022-07-29 22:03:00.000000 | 2022-07-30 22:03:00.000000 |        126246 |               -3 |           1285 | NULL  | 2022-07-30 22:01:32.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 09:15:47.378416 |
| 1050131 |     31480 |       4 | 2022-07-30 22:03:00.000000 | 2022-07-31 22:03:00.000000 |        130851 |              -12 |           1226 | NULL  | 2022-07-31 21:55:24.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 10:00:52.773132 |
| 1050132 |     31480 |       4 | 2022-07-31 22:03:00.000000 | 2022-08-01 22:03:00.000000 |        137744 |                0 |           1623 | NULL  | 2022-08-01 21:54:57.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 10:45:12.598897 |
| 1050133 |     31480 |       4 | 2022-08-01 22:03:00.000000 | 2022-08-02 22:03:00.000000 |        368723 |               17 |           1710 | NULL  | 2022-08-02 21:58:35.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 11:48:14.160270 |
| 1050134 |     31480 |       4 | 2022-08-02 22:03:00.000000 | 2022-08-03 22:03:00.000000 |        323500 |               -1 |           8667 | NULL  | 2022-08-03 21:57:31.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 17:57:42.494500 |
| 1050135 |     31480 |       4 | 2022-08-03 22:03:00.000000 | 2022-08-04 22:03:00.000000 |        125972 |               -6 |           2087 | NULL  | 2022-08-04 22:02:23.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 19:29:48.999819 |
| 1050136 |     31480 |       4 | 2022-08-04 22:03:00.000000 | 2022-08-05 22:03:00.000000 |         85823 |                0 |           1184 | NULL  | 2022-08-05 22:02:39.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 20:19:27.619974 |
| 1050137 |     31480 |       4 | 2022-08-05 22:03:00.000000 | 2022-08-06 22:03:00.000000 |         79884 |               -9 |           1230 | NULL  | 2022-08-06 21:58:50.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 21:06:17.067556 |
| 1050138 |     31480 |       4 | 2022-08-06 22:03:00.000000 | 2022-08-07 22:03:00.000000 |        171571 |               -7 |           1364 | NULL  | 2022-08-07 21:57:41.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 22:06:34.703164 |
| 1050139 |     31480 |       4 | 2022-08-07 22:03:00.000000 | 2022-08-08 22:03:00.000000 |        200105 |               -4 |           1774 | NULL  | 2022-08-08 22:01:51.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-12 23:11:47.822000 |
| 1050140 |     31480 |       4 | 2022-08-08 22:03:00.000000 | 2022-08-09 22:03:00.000000 |        269509 |               -9 |           1890 | NULL  | 2022-08-09 22:02:36.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 00:13:13.856279 |
| 1050141 |     31480 |       4 | 2022-08-09 22:03:00.000000 | 2022-08-10 22:03:00.000000 |        229489 |              -21 |           1791 | NULL  | 2022-08-10 22:02:36.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 01:24:07.596055 |
| 1050142 |     31480 |       4 | 2022-08-10 22:03:00.000000 | 2022-08-11 22:03:00.000000 |        299392 |              690 |           2360 | NULL  | 2022-08-11 22:02:57.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 02:50:57.799256 |
| 1050143 |     31480 |       4 | 2022-08-11 22:03:00.000000 | 2022-08-12 22:03:00.000000 |        631517 |               35 |           5228 | NULL  | 2022-08-12 22:02:42.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 06:25:03.120130 |
| 1050144 |     31480 |       4 | 2022-08-12 22:03:00.000000 | 2022-08-13 22:03:00.000000 |        396592 |               34 |           3185 | NULL  | 2022-08-13 22:02:39.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 08:30:56.183729 |
| 1050145 |     31480 |       4 | 2022-08-13 22:03:00.000000 | 2022-08-14 22:03:00.000000 |        342844 |               81 |           2166 | NULL  | 2022-08-14 21:59:09.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 09:39:28.357497 |
| 1050146 |     31480 |       4 | 2022-08-14 22:03:00.000000 | 2022-08-15 22:03:00.000000 |        317601 |              -85 |           2862 | NULL  | 2022-08-15 22:02:43.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 11:27:04.337559 |
| 1050147 |     31480 |       4 | 2022-08-15 22:03:00.000000 | 2022-08-16 22:03:00.000000 |        247590 |               -6 |           2504 | NULL  | 2022-08-16 22:02:27.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 13:03:55.419945 |
| 1050148 |     31480 |       4 | 2022-08-16 22:03:00.000000 | 2022-08-17 22:03:00.000000 |        302436 |               -8 |           5912 | NULL  | 2022-08-17 21:55:10.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 17:07:03.866364 |
| 1050149 |     31480 |       4 | 2022-08-17 22:03:00.000000 | 2022-08-18 22:03:00.000000 |        375136 |               17 |           2064 | NULL  | 2022-08-18 21:58:26.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 18:29:51.791712 |
| 1050150 |     31480 |       4 | 2022-08-18 22:03:00.000000 | 2022-08-19 22:03:00.000000 |        137731 |               -6 |           1340 | NULL  | 2022-08-19 22:02:48.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 19:17:05.537015 |
| 1050151 |     31480 |       4 | 2022-08-19 22:03:00.000000 | 2022-08-20 22:03:00.000000 |        135390 |               -2 |           1559 | NULL  | 2022-08-20 22:02:27.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 20:06:15.889509 |
| 1050152 |     31480 |       4 | 2022-08-20 22:03:00.000000 | 2022-08-21 22:03:00.000000 |        165807 |               -3 |           1944 | NULL  | 2022-08-21 21:57:25.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 21:01:49.919973 |
| 1050153 |     31480 |       4 | 2022-08-21 22:03:00.000000 | 2022-08-22 22:03:00.000000 |        271823 |               23 |           2550 | NULL  | 2022-08-22 22:01:00.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 22:38:46.371412 |
| 1050154 |     31480 |       4 | 2022-08-22 22:03:00.000000 | 2022-08-23 22:03:00.000000 |        122255 |              -16 |           1316 | NULL  | 2022-08-23 21:58:12.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-13 23:24:35.099723 |
| 1050155 |     31480 |       4 | 2022-08-23 22:03:00.000000 | 2022-08-24 22:03:00.000000 |        190702 |                0 |           3594 | NULL  | 2022-08-24 22:02:17.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 01:55:23.569826 |
| 1050156 |     31480 |       4 | 2022-08-24 22:03:00.000000 | 2022-08-25 22:03:00.000000 |         78587 |               -1 |           1074 | NULL  | 2022-08-25 22:02:35.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 02:30:52.471969 |
| 1050157 |     31480 |       4 | 2022-08-25 22:03:00.000000 | 2022-08-26 22:03:00.000000 |        140924 |                0 |           1420 | NULL  | 2022-08-26 21:57:29.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 03:19:09.400601 |
| 1050158 |     31480 |       4 | 2022-08-26 22:03:00.000000 | 2022-08-27 22:03:00.000000 |        129345 |               -8 |           1358 | NULL  | 2022-08-27 22:02:55.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 04:07:56.655148 |
| 1050159 |     31480 |       4 | 2022-08-27 22:03:00.000000 | 2022-08-28 22:03:00.000000 |        145678 |               -8 |           1531 | NULL  | 2022-08-28 22:02:11.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 05:04:15.175422 |
| 1050160 |     31480 |       4 | 2022-08-28 22:03:00.000000 | 2022-08-29 22:03:00.000000 |        203870 |               -2 |           2813 | NULL  | 2022-08-29 22:01:55.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 07:06:07.562417 |
| 1050161 |     31480 |       4 | 2022-08-29 22:03:00.000000 | 2022-08-30 22:03:00.000000 |        167348 |              -10 |           1780 | NULL  | 2022-08-30 22:01:52.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 08:04:39.370159 |
| 1050162 |     31480 |       4 | 2022-08-30 22:03:00.000000 | 2022-08-31 22:03:00.000000 |        278960 |              434 |           2060 | NULL  | 2022-08-31 22:02:36.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 09:19:09.402750 |
| 1050163 |     31480 |       4 | 2022-08-31 22:03:00.000000 | 2022-09-01 22:03:00.000000 |        190741 |              -17 |           1649 | NULL  | 2022-09-01 22:02:22.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 10:17:58.973528 |
| 1050164 |     31480 |       4 | 2022-09-01 22:03:00.000000 | 2022-09-02 22:03:00.000000 |        436353 |               35 |           3162 | NULL  | 2022-09-02 22:02:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 12:31:46.020862 |
| 1050165 |     31480 |       4 | 2022-09-02 22:03:00.000000 | 2022-09-03 22:03:00.000000 |        630941 |               57 |           4254 | NULL  | 2022-09-03 22:02:56.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-14 15:33:00.035105 |
| 1050166 |     31480 |       4 | 2022-09-03 22:03:00.000000 | 2022-09-04 22:03:00.000000 |        521008 |               -9 |          13120 | NULL  | 2022-09-04 22:01:37.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 00:48:50.422534 |
| 1050167 |     31480 |       4 | 2022-09-04 22:03:00.000000 | 2022-09-05 22:03:00.000000 |         96396 |              -12 |           1634 | NULL  | 2022-09-05 22:02:47.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 01:42:35.963375 |
| 1050168 |     31480 |       4 | 2022-09-05 22:03:00.000000 | 2022-09-06 22:03:00.000000 |        104681 |               -7 |           1550 | NULL  | 2022-09-06 22:02:23.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 02:43:40.554513 |
| 1050169 |     31480 |       4 | 2022-09-06 22:03:00.000000 | 2022-09-07 22:03:00.000000 |         64618 |               -5 |           1151 | NULL  | 2022-09-07 21:59:49.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 03:24:01.523398 |
| 1050170 |     31480 |       4 | 2022-09-07 22:03:00.000000 | 2022-09-08 22:03:00.000000 |         75057 |               -6 |           1156 | NULL  | 2022-09-08 22:00:54.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 04:02:05.256993 |
| 1050171 |     31480 |       4 | 2022-09-08 22:03:00.000000 | 2022-09-09 22:03:00.000000 |        213536 |               19 |           1891 | NULL  | 2022-09-09 21:56:59.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 05:20:06.891675 |
| 1050172 |     31480 |       4 | 2022-09-09 22:03:00.000000 | 2022-09-10 22:03:00.000000 |         94651 |               -9 |           1709 | NULL  | 2022-09-10 22:02:47.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 06:25:43.095912 |
| 1050173 |     31480 |       4 | 2022-09-10 22:03:00.000000 | 2022-09-11 22:03:00.000000 |        112775 |               -2 |           1901 | NULL  | 2022-09-11 22:01:37.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 07:49:34.773069 |
| 1050174 |     31480 |       4 | 2022-09-11 22:03:00.000000 | 2022-09-12 22:03:00.000000 |        305313 |              -15 |           8074 | NULL  | 2022-09-12 22:02:52.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 13:10:15.292782 |
| 1050175 |     31480 |       4 | 2022-09-12 22:03:00.000000 | 2022-09-13 22:03:00.000000 |        110608 |               -3 |           1822 | NULL  | 2022-09-13 22:01:04.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 14:18:56.674116 |
| 1050176 |     31480 |       4 | 2022-09-13 22:03:00.000000 | 2022-09-14 22:03:00.000000 |         66703 |               -2 |           1279 | NULL  | 2022-09-14 21:59:47.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 15:07:25.822588 |
| 1050177 |     31480 |       4 | 2022-09-14 22:03:00.000000 | 2022-09-15 22:03:00.000000 |        240151 |               50 |           2228 | NULL  | 2022-09-15 22:02:53.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 16:41:24.647272 |
| 1050178 |     31480 |       4 | 2022-09-15 22:03:00.000000 | 2022-09-16 22:03:00.000000 |        173430 |               -2 |           2674 | NULL  | 2022-09-16 22:01:54.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 18:37:30.895912 |
| 1050179 |     31480 |       4 | 2022-09-16 22:03:00.000000 | 2022-09-17 22:03:00.000000 |        245473 |               17 |           2324 | NULL  | 2022-09-17 22:02:02.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 20:07:59.748728 |
| 1050180 |     31480 |       4 | 2022-09-17 22:03:00.000000 | 2022-09-18 22:03:00.000000 |        103719 |              -18 |           1348 | NULL  | 2022-09-18 21:59:05.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 20:59:35.792129 |
| 1050181 |     31480 |       4 | 2022-09-18 22:03:00.000000 | 2022-09-19 22:03:00.000000 |        263266 |               22 |           2779 | NULL  | 2022-09-19 22:01:39.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-15 22:57:10.591474 |
| 1050182 |     31480 |       4 | 2022-09-19 22:03:00.000000 | 2022-09-20 22:03:00.000000 |         65656 |               -2 |           2083 | NULL  | 2022-09-20 22:00:44.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 00:29:28.497859 |
| 1050183 |     31480 |       4 | 2022-09-20 22:03:00.000000 | 2022-09-21 22:03:00.000000 |         65826 |              -14 |           2390 | NULL  | 2022-09-21 22:02:21.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 02:02:53.529690 |
| 1050184 |     31480 |       4 | 2022-09-21 22:03:00.000000 | 2022-09-22 22:03:00.000000 |         50706 |              -11 |           1350 | NULL  | 2022-09-22 22:01:23.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 02:55:26.602690 |
| 1050185 |     31480 |       4 | 2022-09-22 22:03:00.000000 | 2022-09-23 22:03:00.000000 |        430216 |               68 |           3557 | NULL  | 2022-09-23 22:02:51.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 05:15:24.357337 |
| 1050186 |     31480 |       4 | 2022-09-23 22:03:00.000000 | 2022-09-24 22:03:00.000000 |        130046 |               18 |           2073 | NULL  | 2022-09-24 22:01:51.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 06:39:45.522541 |
| 1050187 |     31480 |       4 | 2022-09-24 22:03:00.000000 | 2022-09-25 22:03:00.000000 |        420532 |              -19 |           1985 | NULL  | 2022-09-25 22:02:58.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 07:51:48.227774 |
| 1050188 |     31480 |       4 | 2022-09-25 22:03:00.000000 | 2022-09-26 22:03:00.000000 |        454519 |               27 |           4216 | NULL  | 2022-09-26 21:59:25.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 10:57:45.957335 |
| 1050189 |     31480 |       4 | 2022-09-26 22:03:00.000000 | 2022-09-27 22:03:00.000000 |        357556 |               17 |           3031 | NULL  | 2022-09-27 22:02:43.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 13:08:51.192210 |
| 1050190 |     31480 |       4 | 2022-09-27 22:03:00.000000 | 2022-09-28 22:03:00.000000 |        227645 |                9 |           1817 | NULL  | 2022-09-28 22:02:29.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 14:20:02.358771 |
| 1050191 |     31480 |       4 | 2022-09-28 22:03:00.000000 | 2022-09-29 22:03:00.000000 |        220040 |               -9 |          10048 | NULL  | 2022-09-29 21:54:23.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-16 22:49:19.736473 |
| 1050192 |     31480 |       4 | 2022-09-29 22:03:00.000000 | 2022-09-30 22:03:00.000000 |        133735 |               -5 |           2798 | NULL  | 2022-09-30 22:02:16.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-17 00:53:46.326380 |
| 1050193 |     31480 |       4 | 2022-09-30 22:03:00.000000 | 2022-10-01 22:03:00.000000 |        120816 |               -1 |           1169 | NULL  | 2022-10-01 22:02:40.000000 |            0 | 2025-03-29 22:46:09.110319 | 2025-04-17 01:32:21.659863 |
+---------+-----------+---------+----------------------------+----------------------------+---------------+------------------+----------------+-------+----------------------------+--------------+----------------------------+----------------------------+

gabina avatar Apr 17 '25 02:04 gabina

Ah! JarBot is a bot account that has made millions of edits, so it makes sense that this is taking longer than any course we've successfully processed so far. I guess this is a good stress-test for the new system. Even though it's taking a long time to process, memory usage is acceptable and it looks like it will eventually finish.

ragesoss avatar Apr 17 '25 16:04 ragesoss

Course update for 31480 Editing and Contributing Training - University Students finished some days ago. The only editor that has revisions is the JarBot. While the course finished in 2023, we keep putting it in the update queue. I guess that's because there is are timeslices marked as "needs_update". The course update takes more than 10 hours, so I'm trying to fix those timeslices to prevent further processing.

Edit: right not there are no timeslices that needs update so I guess the course won't be scheduled for updates any more.

gabina avatar Apr 25 '25 17:04 gabina

Course 31480 was queued again and it looks like it gets updated once per month.

"update_logs": {
                "1": {
                    "start_time": "2025-04-07T05:46:33.173+00:00",
                    "end_time": "2025-04-22T09:11:05.685+00:00",
                    "sentry_tag_uuid": "e60d51f6-aa13-4e6d-9c6c-03d89a1d5768",
                    "error_count": 10,
                    "processed": 732,
                    "reprocessed": 9
                },
                "2": {
                    "start_time": "2025-04-22T11:43:41.837+00:00",
                    "end_time": "2025-04-22T22:16:49.384+00:00",
                    "sentry_tag_uuid": "1914a30e-f515-4ed0-ad61-c1a0131f266c",
                    "error_count": 0,
                    "processed": 332,
                    "reprocessed": 4
                },
                "3": {
                    "start_time": "2025-04-23T05:18:02.271+00:00",
                    "end_time": "2025-04-24T00:56:52.147+00:00",
                    "sentry_tag_uuid": "f0d260a1-dd70-44e9-b7f7-37b476a014a4",
                    "error_count": 2,
                    "processed": 332,
                    "reprocessed": 2
                },
                "4": {
                    "start_time": "2025-04-24T02:57:21.039+00:00",
                    "end_time": "2025-04-24T11:27:44.027+00:00",
                    "sentry_tag_uuid": "5da17d91-3d14-4dcf-8213-2a316df9b2f5",
                    "error_count": 0,
                    "processed": 332,
                    "reprocessed": 1
                },
                "5": {
                    "start_time": "2025-04-29T08:14:46.708+00:00",
                    "end_time": "2025-04-29T14:13:30.126+00:00",
                    "sentry_tag_uuid": "6fbfb7f0-0187-4c44-99b5-72b22bc03246",
                    "error_count": 0,
                    "processed": 332,
                    "reprocessed": 1
                },
                "6": {
                    "start_time": "2025-05-04T15:32:43.367+00:00",
                    "end_time": "2025-05-04T22:31:04.931+00:00",
                    "sentry_tag_uuid": "a38211be-aafa-4f91-9f8a-285ca9f0b71a",
                    "error_count": 0,
                    "processed": 332,
                    "reprocessed": 2
                },
                "7": {
                    "start_time": "2025-06-04T04:36:15.659+00:00",
                    "end_time": "2025-06-04T16:07:39.044+00:00",
                    "sentry_tag_uuid": "0944267f-66c2-4650-82c1-f13fd479ba11",
                    "error_count": 0,
                    "processed": 332,
                    "reprocessed": 2
                },
                "8": {
                    "start_time": "2025-06-29T03:47:58.486+00:00",
                    "end_time": "2025-06-29T23:56:31.888+00:00",
                    "sentry_tag_uuid": "0c36b56d-e637-469c-9dcc-c457c8eb2515",
                    "error_count": 0,
                    "processed": 332,
                    "reprocessed": 4
                },
                "9": {
                    "start_time": "2025-07-04T14:29:39.611+00:00",
                    "end_time": "2025-07-05T00:21:32.263+00:00",
                    "sentry_tag_uuid": "f1293e47-8eef-49b4-a116-3bc6b4e55c83",
                    "error_count": 0,
                    "processed": 332,
                    "reprocessed": 2
                }

I suspect that someone changes the course dates once per month, so some timeslices are set to reprocess and the process gets queued again. I'm copying the course dates for the future:

        "id": 31480,
        "title": "Editing and Contributing Training - University Students",
        "start": "2022-04-07T22:03:00.000Z",
        "end": "2023-01-04T03:05:00.000Z",
        "timeline_start": "2022-04-10T22:03:00.000Z",
        "timeline_end": "2023-01-04T03:05:00.000Z",

gabina avatar Jul 05 '25 00:07 gabina