January 21, 2013
- Kuler (via Liz Gerber) – Adobe-owned site for user-uploaded color combinations. Elegant color combinations can be wonderful tools for data visualization, graphic design, and more. In this case, the names provided for the combinations are more colorful than the combinations.
- Metro Chicago Data – A handy repository of public datasets from various government agencies and other public sources.
- Chicago Crime Map – Crime statistics with a friendly interface. Provided by the Chicago Tribune.
- Bewtween the Bars – Brilliant prison blogging project initiated (as I understand it) by Charlie de Tar at the MIT Center for Civic Media. Best of all, you can help transcribe posts!
- Bikenapped (via Mako) – A site mapping bicycle theft data around the Boston area. This should exist for every city.
January 14, 2013
Aaron Swartz’s suicide over the weekend is a tragedy. His death has affected many people very deeply, including many of my friends who were very close with Aaron.
Personally, I did not know Aaron well, but I regard him as an inspiration – as much for his quiet thoughtfulness and kindness as for his amazing achievements, intellect, projects, and democratic (small “d”) ideals.
I don’t have much to add to some of the heartfelt responses many people (including Cory Doctorow, Larry Lessig, and Matt Stoller) have posted elsewhere; however, as I have thought and read about Aaron over the past couple of days, I have decided that I want to commemorate his life and work through some concrete actions. Specifically, I have made some vows to myself about how I want to live, work, and relate to people in the future. Most of these vows are fundamentally democratic in spirit, which was part of what I find so inspiring about so much Aaron’s work. Not all of my commitments are coherent enough or sensible enough to list here, but I will put one out there as a public tribute to Aaron:
I will promote access to knowledge by ensuring that as much of my work as possible is always available at no cost and under minimally restrictive licenses that ensure ongoing access for as many people in as many forms as possible. I will also work to convince my colleagues, students, publishers, and elected or appointed representatives that they should embrace and promote a similar position.
This is a very small and inadequate act given the circumstances.
August 12, 2012
The news that during the creation of Bain Capital Mitt Romney sought large investments from some of El Salvador’s notorious “oligarchs” should not be particularly surprising given the extent of the support the US government and private sector provided to the Salvadoran government and political elites during the country’s civil war from 1980-92.
In the grand narrative of the 2012 presidential campaign, I suspect this story will figure as (at most) a very minor footnote. Nevertheless, I wanted to draw attention to it because of my personal connections to El Salvador and the persistence of that country’s civil war in the lives of so many of its residents.
During and after my first year of college, I visited El Salvador for almost 9 months. At the time, I worked with a small community organization called Grupo Tamarindo (that would later be known as the Tamarindo Foundation – warning: link is to their Facebook page).
The Tamarindo Foundation online presence doesn’t really do the group justice. By the standards of the nonprofit and NGO sector, it’s a tiny organization with almost no budget and even less in the way of public relations materials to document what its members have accomplished in the group’s nearly 20 years of existence.
During that time, the group and it’s leader John Guiliano have sought to rebuild the town of Guarjila, El Salvador and, in particular, to create opportunities for the town’s young people to pursue education, arts, athletics, and entrepreneurship.
The Tamarindo has made progress towards all of these goals and more while working on a shoestring budget, microscopic scale, and generational time-horizon. That said, any progress has been slow, and the underlying cycles of poverty and violence that make life in El Salvador and in Guarjila so precarious persist.
In this way, over twenty years since the Salvadoran civil war ended, its effects can still be felt, whether in the gangs that were formed in U.S. prisons by war refugees or in the lack of adequate educational and career opportunities that lead so many of El Salvador’s young people to seek employment and security through illegal migration.
The current goal of the Tamarindo is to build a community center where the organization can continue to do its work. In order to support this goal, John has started a bicycle ride across the United States. After handing in my dissertation draft last Sunday, I joined the first three days of the ride from Boston to New Haven. You can follow the ride through John’s Facebook updates and donate (via their ImAthlete page). The itinerary includes stops across the country and, if you want to learn more about the Tamarindo, the ride, or El Salvador, I encourage you to contact John and attend one of the tour events.
July 29, 2012
Crowdsourcing, outsourcing, and other sorts of distributed work have long since made inroads into professional journalism, but a recent scandal involving a few major metropolitan newspapers outsourcing their local reporting to a company named Journatic reveals the scope and extent of those inroads.
Since This American Life first broke the story a couple of weeks ago, the details of the Journatic story have made their way all over the Internet (See, e.g., coverage from Poynter, Romenesko, and Gigaom for some of the more thoughtful examples).
The basics are straightforward: Journatic is a company that specializes in generating content for a variety of purposes, among them local news stories (they also have a sister company called Blockshopper that provides a similar service for real estate listings). It seems that typically a client – say, a major U.S. newspaper like the Chicago Tribune, for example – contracts with Journatic, which then hires dozens of independent subcontractors (mainly in the Philippines and the U.S.) who construct and edit hyperlocal news items in a distributed, piecemeal fashion before passing the finished product back to the client for publication.
You can get a much better feel for the process by listening to the TAL interviews with Journatic editor Ryan Smith, or by reading Smith’s tendentious editorial about his experience (has has subsequently quit working for Journatic, although – interestingly – he was not fired or even reprimanded for his efforts to publicly criticize the company’s practices and products).
The stickiest part of the scandal seems to be that the Trib, along with several other major metropolitan dailies (the San Francisco and Houston Chronicles as well as the Chicago Sun Times) , had been printing these stories under false by-lines (such as Jake Barnes – the name of a famous Hemingway character), which violates the paper’s own ethical standards.
I find the story pretty engaging for several reasons:
The fact that Journatic figured out how to crowdsource journalism is actually pretty impressive. Some friends at CMU have been trying for a while now to generate magazine-style writing using workers on Amazon’s Mechanical Turk. Likewise, I’d like to develop and test methods for crowdsourcing peer review of academic papers. Apparently, the folks at Journatic have already solved many of the practical problems involved in performing a complex knowledge-based task like reporting using a globally distributed workforce of highly variable skill.
Second, despite the rhetoric surrounding the story, Journatic is neither the end of journalism as we know it nor its salvation. While I share the concerns voiced by Smith, TAL reporter Sarah Koenig, and others over the wages paid to Journatic’s Philippino contractors as well as the confusion about the Tribune’s apparent willingness to buck its own editorial policies about attribution in this case, these issues need to be distinguished from questions about whether crowdsourcing is “bad” or “good” for the future of media. I believe the emergence of companies specializing in crowdsourced journalism is merely another wrinkle in a complex organizational ecosystem where incumbent firms are struggling to retain some sort of comparative, competitive advantage in the face of declining revenues. When you consider Journatic in the context of other experiments in crowdsourced journalism, such as some of ProPublica’s distributed reporting project, CNN’s iReports, or even the political blogosphere, paying workers around the world to assemble stories sounds less like a violation of basic journalistic principles and more like the latest in a long line of process innovations that might or might not help to reinvent the field.
Last, but not least, many of us (myself included) may not like the fact that the cost of local news coverage has exceeded the demand in many places, but I think there’s got to be a more effective response than petitioning Sam Zell to stop outsourcing. Instead, I’d like to see a combined effort to improve Journatic’s models of content production in order to (1) address the ethical concerns raised in the Tribune scandal; (2) improve the quality of coverage in order to correct some of the terrible reporting practices documented by Smith in his op-ed; and (3) more effectively integrate teams of remote and on-site local reporters.
Ultimately, you can’t ignore the fact that Journatic smells bad. They paid off contractors not to talk to the media a few months ago, provide SEO and content farm services on the backs of cheap overseas labor, and when faced with complaints about the fact that their real estate listing service, BlockShopper, violated people’s privacy, they responded by issuing a Zuckerbergian declaration against expectations of privacy online and hiding the identities of their writers. Oh, and they also hide their company’s website from Google’s robots (go to http://journatic.com and use the “view source” option in your browser to see their robots.txt policy).
That said, the whole situation offers a chance to think about what a more responsible, ethical, and constructive version of crowdsourced journalism could look like. For that reason alone, I think Journatic deserves even more attention than it has already received.
July 9, 2012
Following up on my last post on the tie between Allyson Felix and Jeneba Tarmoh in the qualifiers for the U.S. women’s 100 meter team, I thought I would briefly revisit the subject and, in the process, respond to Hal’s comment.
The reason I thought this story merited a second post is that, amazingly, Tarmoh withdrew from the run off, thereby conceding her spot on the Olympic team to Felix!
You can watch Tarmoh explain her decision in this highly unusual SportsCenter clip.
The video is pretty interesting – as is Tarmoh’s choice to make the statement at all! She reveals a number of additional details about her experience as well as her interactions with Felix after the race. After watching it, I came away thinking that her overall manner had suggested that she felt conflicted about her decision.
While I don’t think it makes sense to draw too many conclusions about what happened from Tarmoh’s statement, the events that have transpired since the original race suggest that it may make more sense to approach the whole situation from a game theoretic perspective (like Daniel Lametti started to do) rather than from the sort of statistical vs. moral fairness point of view I tried to articulate in my post.
That brings me to my response to Hal’s suggestion that a run off would (assuming it was announced ahead of time) represent the most “morally fair” way to settle a tie (at least more morally fair than a coin flip).
I think I actually agree with most of Hal’s points – especially, insofar as moral fairness does seem to be more important than statistical fairness when it comes to how most people view athletic contests. I should have clarified that the kind of fairness I had in mind was more statistical than moral. Given the rise of statistical tools in sports and the fact that it is possible to think of athletic contests in terms of the probabilities of particular outcomes, I think my argument is more focused on the fact that the probabilities of victory are never equal and that (at least in the case of many sports) that doesn’t seem to bother many fans.
In any event, I love Hal’s idea for a world-wide coin flip tournament! We should make sure to incorporate the descendants of Paul the Octopus somehow.