Weekly Journal

DREU 2014 @ Arizona State University

Week 8


Last weekend wasn't super eventful apart from 4th of July so here is a picture of Camelback Mountain from the weekend before! It was both a beautiful and challenging hike—I probably crawled most of the way.

After doing some introductory JSP and servlet tutorials, Dr. Bansal and I agreed it would be best to go back and incorporate our other course providers, edX and Udacity, into the RDF before proceeding to implementing the web page.

Coursera have a RESTful API for querying their course catalog so retrieving their data was very simple. edX and Udacity on the other hand do not have an API so I was happy to play with writing crawlers in Scrapy this week.

Despite a couple of missing properties because of inconsistencies with the crawler selectors, we have valid RDF of about 30,000 n-triples! Query away.

Looking forward to seeing Cloud Nothings tomorrow in Phoenix! I've had this show bookmarked since before I flew into Arizona. Here's a song off of their last album:

-Sebastian