Posts
by Matt Revelle
-
Distributed processing and Unix philosophy
A few months back I started working on a news classifier for Highput. I had originally planned to use Clojure to write Hadoop jobs, but found that most of the input data was available as a stream and the allure of continuously producing results was too much. RSS feeds, twitter streams, and collaborative ranking (e.g, HN, reddit) are continuous, the classifier should be as well. The data retrieval, extraction, transformation, and loading (ETL) was done using a distributed workflow built from three simple components...
January, 3 2010 • 0 Comments • 1 Faves
-
Finger, decentralized social networks, and ownership
A group of developers have started WebFinger, an open source project to revive finger by implementing it atop HTTP. Although finger was historically used for supplying contact information and personal news, similar to personal blogs, a new webfinger + online storage gives users the ability to consolidate their online persona and retain ownership of content such as photos, videos, blog posts, and personal opinions. This is a step towards reclaiming personal ownership of online content and not filling out the same...
August, 16 2009 • 0 Comments • 0 Faves
I explore data, write algorithms, and build systems.
