Understanding of scripts

[Sagar1094]

Hi Ethan,

First of all amazing project. Have been trying my hands on it and just wanted to understand that from json data of 9.4 mil rows after running the parse.py I am left with 1.9 mil rows, is this due to some error or the script is written in such a way. I reviewed the script and there is no such condition that I came across and due to the large size of json file unable to see the file as well. Please help. While running the second script I am getting an error UnicodeEncodeError: 'charmap' codec can't encode character '\ufffd' in position 49: character maps to --> this might be resolved by adding utf-8 encoding while reading the file. Will be experimenting on the same. Thanks