Wired’s cover story this month is a terrific look at craigslist and why it’s awesome and not very good, all at the same time.
Don’t get me wrong. I’ve been using craigslist for seven years now and am a big fan. It’s far superior to anything the newspapers have offered up—and the papers don’t “deserve” any of their lost billions. Craigslist is a huge boon for regular folks, who get a free, easy way to buy, sell, or rent stuff. And I love the craigslist ethos.
But Wired, in a well-written piece, raises some critical points about the site’s flaws, ones that could jeopardize its future if it doesn’t adapt.
Gary Wolf, the piece’s author, zeroes in on usability problems like spam, which is all over the site, and how Craigslist doesn’t really invest much in new, obvious features that would enhance its usability.
What really interests me, though, in Wired’s reporting—and what’s problematic for those who lionize it but demonize the press’s Web efforts—is this: Craigslist doesn’t allow you to reuse its information in any systematic way to try to build on it or improve it—especially if you want to sell ads against it.
In other words, craigslist doesn’t let you aggregate it (wholesale anyway, which is what the AP was trying to snuff out).
I was thinking a couple of months ago as I was looking through the craigslist real estate ads how nice it would be to be able to browse by map.
So by the logic of the Web, or at least its vanguard, I should be able to design a site that automatically scans craigslist for housing ads and plots them out on a map, quoting part of the text, with links (preferably small and toward the bottom a la Newser) pointing back to the originator of the content, no?
Well, no.
If you try to build a third-party application designed to make craigslist work better, the management will almost certainly throw up technical roadblocks to shut you down.
So certain precincts of blogville reach for the torches and pitchforks when the Associated Press announces it will go after wholesale scraping and repurposing of its work by aggregators. And they fly into a rage if someone suggests it might be a wise business move to block aggregators. Free speech! Fair use!
But, hey, if craigslist does it, it’s cool. Apparently, anyway. I don’t see much sturm und drang in said precincts about its anti-aggregation moves.
Here’s Jeff Jarvis on the AP:
The Associated Press is becoming the enemy of the internet because it is fighting the link and the link is the basis of the internet.
Well then, is craigslist “becoming the enemy of the internet because it is fighting the link and the link is the basis of the internet”?
For instance, when craigslist shuts down an innocuous little site like Craig’s Little Buddy, which allowed people to search (user-generated) content in multiple craigslist cities and click on links that took them to craigslist, is that bad?
Craigslist will still let you quote it and link to it on your blog here and there, but not systematically—just like the AP.
Is it just as retrograde?

Well as they say, if you don't like it make your own. Craig did.
#1 Posted by from, CJR on Mon 21 Sep 2009 at 04:57 PM
You raise an interesting issue, Ryan, but I can't help thinking you're comparing apples and oranges. In the case of news organizations such as the AP, the trend is for links to stories to remain permanent in the interest of archives, and things such as related stories and tag clouds. The craigslist model is different in that items are more volatile based on real-world person-to-person exchanges. Try to sell a beat-up sofa for $500 and it may stay up for days; post a well-maintained BMW for $500 and it may be gone in an hour and the link removed.
So you have to ask yourself why craigslist would want to incur additional bandwidth costs to benefit a third-party aggregator with a 'bot which pounds on the servers and/or generates a bunch of 404 errors. The latter of which also provide no benefit for someone needing a couch or a car.
Although there may be some appeal to the idea of leveraging craigslist's existing content, I would point out that an alternative approach is to build a better online classified system. Make no mistake, CL is very good at what it does, but that doesn't mean it couldn't be done better.
#2 Posted by Perry Gaskill, CJR on Mon 21 Sep 2009 at 05:53 PM
Hi Ryan - first, thanks for your comments on the story. It provoked a lot of reaction, and I appreciate your having read the story for its double perspective. I left out an explicit analysis of newspaper competition, being pressed for space, but I made a long post on this topic on the Wired web site, and it might be of interest to your readers. It is called "Bad Advice for Newspapers."
http://www.wired.com/epicenter/2009/08/the-craigslist-credo-bad-advice-for-newspapers/
#3 Posted by Gary Wolf, CJR on Mon 21 Sep 2009 at 06:52 PM
i've been using www.mapskrieg.com for at least 2 years...it aggregates all the info in the housing section of , in my case, craigslist philadelphia, and plots them out on a google map, based on the address info given in the ad.
#4 Posted by Lorena G, CJR on Mon 21 Sep 2009 at 11:03 PM
Hmm, how is this site able to do exactly what Gary Wolf says craigslist won't allow:
http://mullinslab2.ucsf.edu/SFrentstats/
??
#5 Posted by David, CJR on Tue 22 Sep 2009 at 10:54 AM
Not sure if you've written a follow up to this post, but there are several aggregators out there now. I've been on searchtempest & craiggers for over a year & just came across another one (yourlist) that I'm really liking. Can you recommend any others?
#6 Posted by Sammy Lars, CJR on Thu 8 Sep 2011 at 06:03 PM