LouisPlisso
Null or zero results
When running the tool there are several fields which are either zero or NULL. Would this be a result of YouTube now running HTTPS?
it should not be an issue as the HTTPS is end-to-end, but at application layer data is decrypted
Should take a further look to understand it
@LouisPlisso Yes, I see the same thing. The factory.py file keeps truing for different video types and none of them seem to work.
the fix is in this PR: https://github.com/LouisPlisso/pytomo/pull/7 @pari685 can you take a look
the code in branch fix_null_values if working for me: @jwidhalm can you check, please? https://github.com/LouisPlisso/pytomo/tree/fix_null_values
Ok.. will check it now...
On Sun, Jul 12, 2015 at 2:12 PM, Louis [email protected] wrote:
the fix is in this PR: #7 https://github.com/LouisPlisso/pytomo/pull/7 @pari685 https://github.com/pari685 can you take a look
the code in branch fix_null_values if working for me: @jwidhalm https://github.com/jwidhalm can you check, please? https://github.com/LouisPlisso/pytomo/tree/fix_null_values
— Reply to this email directly or view it on GitHub https://github.com/LouisPlisso/pytomo/issues/6#issuecomment-120754919.
It seems to be working now. However, it still does not populate the AS number. Also, the crawl seems to stop after 10 videos.
Attached is a database and log file.
On Sun, Jul 12, 2015 at 2:25 PM, Parikshit [email protected] wrote:
Ok.. will check it now...
Thanks, Parikshit Email: [email protected] Cell : +1-816-585-4103
On Sun, Jul 12, 2015 at 2:12 PM, Louis [email protected] wrote:
the fix is in this PR: #7 https://github.com/LouisPlisso/pytomo/pull/7 @pari685 https://github.com/pari685 can you take a look
the code in branch fix_null_values if working for me: @jwidhalm https://github.com/jwidhalm can you check, please? https://github.com/LouisPlisso/pytomo/tree/fix_null_values
— Reply to this email directly or view it on GitHub https://github.com/LouisPlisso/pytomo/issues/6#issuecomment-120754919.
Louis, Thank you for this update. I did run some tests and see that some of the previously NULL values are now being populated. However, I still see NULL values for the following: VideoType, InitialPlaybackBuffer, and RedirectUrl. A NULL value for RedirectUrl may be expected behavior if the Url was not redirected but I will leave that assessment up to you. Also BufferingDuration and BufferingDurationAtEnd were all 0.0 values - this may be related to the IntiialPlaybackBuffer being NULL, but again I'll leave that assessment up to you. Also, I ran several crawls and noticed that each crawl stopped at 10. Thank you again for your attention to this. Please let me know if there is any other information I can provide to assist with this.
@jwidhalm it's expected when you have no interruptions, because you have no buffering
the stop after 10 is not expected: I'll try to reproduce
@pari685 the AS matching IPs may have to be updated, but it worked on my personal connection have you tried from UMKC or a public ISP
also it's better to create a new issue in order not to mix things up
Thanks Louis
I've created a new issue for the stop after 10: https://github.com/LouisPlisso/pytomo/issues/8
as per AS number, I've created this issue: https://github.com/LouisPlisso/pytomo/issues/9
Can you please confirm if the following formula can be used to derive the Time to start play? TimeToStartPlay(sec) = TimeTogetFirstByte + (InitialData x 8 /(InitialRate x 1000))
