renames README.txt to .md and adds shebang to logsanalysis.py

Author: kotamichael

README.md

@@ -0,0 +1,72 @@
+# Logs Analysis Project
+
+This application will answer three questions regarding the newsdata.sql dataset.  
+It utilizes PostgreSQL and psycopg2. It uses three methods: "popular_article"
+(to find the three most popular articles), popular_author (which lists the most
+popular authors, in terms of page views, in descending order), and error_days
+(which calculates on which days more than 1% of requests led to errors).
+
+
+## Getting Started
+
+In order to run this program the user will need to have access to newsdata.sql,
+psycopg2, python (preferable 3.0 or newer), in addition to several views which need to be 
+created in the database. The structure of the queries (breaking them into views) allows
+the logsanalysis.py file to be as readable as possible.
+
+### Necessary Views:
+
+As stated above, the user must create these views in order to run the analysis: popularthree, questionone,
+mostviews, 
+
+```sql
+popularthree:
+	CREATE VIEW popularthree AS
+		SELECT (regexp_split_to_array(path, E'/article/'))[2], COUNT(*) AS views FROM log
+		WHERE path != '/' GROUP BY (regexp_split_to_array(path, E'/article/'))[2] 
+		ORDER BY views DESC LIMIT 3;
+
+questionone:
+	CREATE VIEW questionone AS
+		SELECT articles.title, popularthree.views from articles, popularthree
+		WHERE articles.slug = popularthree.regexp_split_to_array
+		ORDER BY views DESC;
+
+mostviews:
+	CREATE VIEW mostviews AS
+		SELECT (regexp_split_to_array(path, E'/article/'))[2] AS title, COUNT(*) AS views FROM log
+		WHERE path != '/' AND status != '404 NOT FOUND' GROUP BY title ORDER BY views DESC;
+
+popularauthor:
+	CREATE VIEW popularauthor AS
+		SELECT articles.author, SUM(mostviews.views) AS articleViews FROM articles, mostviews
+		WHERE articles.slug = mostviews.title GROUP BY author ORDER BY articleViews desc;
+
+ mostpopularauthors:
+	CREATE VIEW mostpopularauthors AS
+		SELECT authors.name, popularauthor.articleViews FROM authors, popularauthor
+		WHERE authors.id = popularauthor.author ORDER BY popularauthor.articleViews DESC;
+
+days:
+	CREATE VIEW days AS
+		SELECT time ::TIMESTAMP::DATE, status FROM log ORDER BY time;
+
+okrsts:
+	CREATE VIEW okrqsts AS
+		SELECT time, COUNT(status) AS ok FROM days
+		WHERE status = '200 OK' GROUP BY time ORDER BY time;
+
+badrqsts:
+	CREATE VIEW badrqsts AS
+		SELECT time, COUNT(status) AS bad FROM days
+		WHERE status = '404 NOT FOUND' GROUP BY time ORDER BY time;
+
+dailyerrors:
+	CREATE VIEW dailyerrors AS
+		SELECT okrqsts.time, CAST(badrqsts.bad AS FLOAT) / CAST(okrqsts.ok AS FLOAT) * 100 AS percent
+		FROM okrqsts, badrqsts WHERE okrqsts.time = badrqsts.time;
+
+baddays:
+	CREATE VIEW baddays AS
+		SELECT time, percent FROM dailyerrors WHERE percent > 1;
+```

logs_analysis.txt

@@ -0,0 +1,44 @@
+The top three articles are:
+
+ 
+
+   Candidate is jerk, alleges rival - 338647 views
+
+
+
+    Bears love berries, alleges bear - 253801 views
+
+
+ 
+   Bad things gone, say good people - 170098 views
+
+
+
+   
+
+The most popular authors are as follow:
+
+
+
+   Ursula La Multa - 507594 hits
+
+
+
+   Rudolf von Treppenwitz - 423457 hits
+
+
+
+   Anonymous Contributor - 170098 hits
+
+
+
+   Markoff Chaney - 84557 hits
+
+
+
+
+These days more than 1 percent of requests resulted in error:
+
+
+
+   2016-07-17 - 2.31506899455 percent

logsanalysis.py

@@ -0,0 +1,55 @@
+"""When file run from the command line, all three operations
+ are called in order."""
+
+#!/usr/bin/env python3
+import psycopg2
+import datetime
+
+
+def popular_article():
+    """Returns most popular 3 articles along with number of views."""
+    db = psycopg2.connect("dbname='news'")
+    c = db.cursor()
+    c.execute("select * from questionone;")
+    rows = c.fetchall()
+    print('The top three articles are: ')
+    for row in rows:
+        x, y = row
+        print('\n   %s - %s views' % (x, y))
+    db.close()
+
+
+def popular_author():
+    """Lists most popular authors and number of views in descending order."""
+    db = psycopg2.connect("dbname='news'")
+    c = db.cursor()
+    c.execute("select * from mostpopularauthors;")
+    authors = c.fetchall()
+    print('\n\n The most popular authors are as follow:')
+    for row in authors:
+        a, b = row
+        print('\n   %s - %s hits' % (a, b))
+    db.close()
+
+
+def error_days():
+    """Lists days where more than 1% of requests were erroneously resultant."""
+    db = psycopg2.connect("dbname='news'")
+    c = db.cursor()
+    c.execute("select * from baddays;")
+    days = c.fetchall()
+    print('\n These days more than 1 percent of requests resulted in error:')
+    for row in days:
+        a, b = row
+        print('\n   %s - %s percent' % (a, b))
+    db.close()
+
+
+def logs_analysis():
+    """Runs all three analyses consecutively"""
+    popular_article()
+    popular_author()
+    error_days()
+
+
+logs_analysis()