live_log_analyzer_spark

Spark Application for analysis of Apache Access logs and detect anamolies!

Link to My Medium Article in Towards Data Science Publication : Article

The Application has features to extract information from unstrucutred text logs, and analyze the trends the trends based on Response codes, Traffic, Frequent Visitors, Top End Points, Content Flow etc to detect the anamolies.

Frequent End Points

Response Code Analysis

Traffic Flow Weekly Analysis

Traffic Flow Particular Day

The Above plot, depicts the anamolies of spikes on certain times, which can be crucial starting point to detect the anamolies.