Yearly Archives ⇒ 2007

Working with Pipes #2: A DIY personalized community with Del​.icio​.us, Flickr and Google Blog Search

March 17, 2007
· Martin Kelley

It’s
not nec­es­sary to devel­op your own Web 2.0 soft­ware infra­struc­ture to
cre­ate an inde­pen­dent Web 2.0‑powered com­mu­ni­ty online. It’s far
sim­pler to set a stan­dard for your com­mu­ni­ty to use on exisiting
net­works and then to use Yahoo Pipes to pull it together.

I decid­ed on about a dozen cat­e­gories to use with my DIY blog aggre­ga­tor (Quak­erQuak­er).
I only want to pull in posts that are being gen­er­at­ed for my site by
com­mu­ni­ty mem­bers so we use a com­mu­ni­ty iden­ti­fi­er, a unique prefix
that isn’t like­ly to be used by others. 

This post will show you how to pull in tagged feeds from three sources: the Del​.icio​.us social book­mark­ing sys­tem, the Flickr pho­to shar­ing site and Google Blog Search.

Step 1: Pick a community designator

I’ve been using the com­mu­ni­ty name fol­lowed by a dot. The prefix
goes in front of cat­e­go­ry descrip­tion to make a set of unique tags for
the aggre­ga­tor. When some­one wants to add some­thing for the site they
tag it with this “community.category” tag. In my exam­ple, when someone
wants to list a new Quak­er blog they use “quak​er​.blog”, “quak­er” being
the com­mu­ni­ty name, “blog” being the cat­e­go­ry name for the “New Blogs”
page.

Step 2: Collect the community prefix and category name in Pipes


You begin by going into Pipes and pulling over two text inputs: one for
the com­mu­ni­ty pre­fix, the oth­er for the spe­cif­ic category.

Step 3: Construct these into tags


Now use the “String Con­cate­na­tion” mod­ule to turn this into the
“community.category” mod­el. The com­mu­ni­ty input goes into the top slot,
a dot is the sec­ond slot and the cat­e­go­ry input goes into the last slot.

blank Now, when you have a tag in Flickr with a dot in it, Flickr auto­mat­i­cal­ly removes it in the resul­tant RSS feed.
So with Flickr you want your tag to be “com­mu­ni­ty­cat­e­go­ry” with­out a
dot. Sim­ple enough: just pull anoth­er “String Con­cate­na­tion” module
onto your Pipes work space. It should look the same except that it
won’t have the mid­dle slot with the dot.

Step 4: Turn these tags into RSS URLs

blank
Pull three “URL­Builder” mod­ules into Pipes, one for each of the
ser­vices we’re going to query. For the Base, use the non-tag specific
part of the URL that each ser­vice uses for its RSS feeds. Here they are:

Del​.icio​.us http://​del​.icio​.us/​r​s​s​/​tag
Flickr http://​api​.flickr​.com/​s​e​r​v​i​c​e​s​/​f​e​eds
Google Blog Search http://​blogsearch​.google​.com

Under path ele­ments, put the cor­rect tag: for Del​.icio​.us and Google it should be the community.category tag, for Flickr the dot-less com­mu­ni­ty­cat­e­go­ry tag.

Step 5: Fetch and Dedupe

blank Fetch is the Pipes mod­ule that pulls in URLs and out­puts RSS feeds. It can also com­bine them. Send each URLBuilder out­put into the same Fetch routine.

Since it’s pos­si­ble that you’ll might have dupli­cate posts, use the “Unique” mod­ule to dedu­pli­cate entries by URL.
Through a lit­tle tri­al and error I’ve deter­mined that in cas­es of
dupli­cates, feeds low­er in the Fetch list trump those high­er. In the
actu­al Pipe pow­er­ing my aggre­ga­tor I pull a sec­ond Del​.icio​.us feed: my
own. I have that as the last entry in the Fetch list so that I can
per­son­al­ly over­ride every oth­er input.

Step 6: Sort by Date

blank
With exper­i­men­ta­tion it seems like Pipes orders the out­put entries by
descend­ing date, which is prob­a­bly what you want. But I want to show
how Pipes can work with “dc” data, the “Dublin Core” mod­el that allows
you to extend stan­dard RSS feeds (see yes­ter­day’s post for more on this).

Google Blog Search and Del​.icio​.us feeds use the “dc:date” field to
record the time when the post was made. Flickr uses “dc:date.Taken” to
pass on the pho­tograph’s meta­da­ta about when it was tak­en. Pipes’
“Rename” mod­ule lets you copy both fields into one you cre­ate (I’ve
sim­ply used “date”), which you can then run through its “Sort” module.
Again, it’s a moot point since Pipes seems to do this automatically.
But it’s good to know how to manip­u­late and rename “dc” data if only
because many PHP parsers have trou­ble lay­ing it out on a webpage.

Update: it’s all moot: accord­ing to a ZDNet blog, “Pipes now auto­mat­i­cal­ly appends a pub­Date tag to any RSS feed that has any of the oth­er allow­able date tags.” This is nice: no need to hack the date every time you want to make a Pipe!

Step 7: Output

blank The final step for any Pipe is the “Pipe Out­put” module.

In action

You can see this pub­lished Pipe here, and copy and play with it your­self. The result lets you build an RSS feed based on the two inputs. 

Call off the search parties

March 10, 2007
· Martin Kelley

The retreat at the Carmelite Monastery was nice. Here’s some pic­tures, the first of those “long-remembered”:/if_i_dont_make_it_back.php tall stone walls and the rest of the beau­ti­ful chapel:
Carmelite Monastery, Philadelphia Carmelite Monastery, Philadelphia Carmelite Monastery, Philadelphia Carmelite Monastery, Philadelphia
It was a silent retreat – for us at least. There were three talks about “Tere­sa of Avila”:http://en.wikipedia.org/wiki/Teresa_of_Avila giv­en by Father Tim Byer­ley, who also works with the “Col­legium Center”:http://www.collegiumcenter.org/about.php, a kind of reli­gious edu­ca­tion out­reach project for young adult Catholics in South Jer­sey (I men­tioned it “a few months ago”:https://www.quakerranter.org/teaching_quakerism_again.php as a mod­el of young adult youth out­reach that Friends might want to con­sid­er). Much of what Tere­sa has to say about prayer is uni­ver­sal and very applic­a­ble to Friends, though I have to admit I start­ed spac­ing out by around the fourth man­sion of the “Inte­ri­or Castle”:http://www.ccel.org/ccel/teresa/castle2.toc.html (I’ve nev­er been good with num­bered reli­gious steps!).
I’m in no dan­ger of fol­low­ing my wife Julie’s jour­ney from Friends to Catholi­cism, though as always I very much enjoyed being in the midst of a gath­ered group com­mit­ted to a spir­i­tu­al­i­ty. The idea of reli­gious life as self-abnegation is an impor­tant one for all Chris­tians in an age where “me-ism”:http://www.youtube.com/watch?v=ScWdek6_Ids&eurl has become the “sec­u­lar state religion”:http://www.walmart.com/ and I hope to return to it in the near future.

If I don’t make it back.…

March 9, 2007
· Martin Kelley

Monastery entranceTomor­row Julie and I are going on an all-day Lenten retreat at a Carmelite Monastery on Old York Road in Philadel­phia. She’s giv­en me creedal cheat sheets in case I feel led to read along, as I have to fake it on any­thing past the The Lord’s Prayer.
The monastery has forty-foot tall stone walls all around and is locat­ed a few blocks from where I grew up (pic­ture cour­tesy the “monastery’s organ­ist’s webpage”:http://home.att.net/~lucycarroll/page5.html) and it was a place of some intrigue. When­ev­er we would dri­ve by I’d press my face against the car win­dows think­ing maybe I’d catch a glimpse of a nun swing­ing her­self over the wall in an escape attempt. Need­less to say I was­n’t brought up Catholic or even Catholic-friendly and so did­n’t real­ize how ridicu­lous this imag­in­ing of mine was. Still, I’ve prob­a­bly nev­er passed the monastery as an adult with­out tak­ing a quick peek at those walls. In twelve hours I enter them myself!
Julie’s gone on the retreat a num­ber of times (it’s usu­al­ly women-only) and has always been released to my con­nu­bial arms at end’s day. Still, just in case some­thing hap­pens, y’all know where to look! The kids are going to be with Julie’s sis­ter and their cousin and should have a good time.

Friendship even when cutting edges don’t overlap

March 8, 2007
· Martin Kelley

C Wess Daniels has a good “post fol­low­ing up the Quak­er Her­itage Day events”:http://gatheringinlight.com/2007/03/08/learning-a-new-language-while-building-a-house-reflections-on-quaker-heritage-day/ last week­end in Berke­ley. The fea­tured speak­er was Bri­an Dray­ton, a New Eng­land Friend in the lib­er­al unpro­grammed tra­di­tion who’s been doing a lot of good work around reclaim­ing traditionally-minded Quak­er min­istry (at least that’s how _I’d_ pigeon-hole him from afar, I’ve nev­er actu­al­ly met him!).

Con­tin­ue read­ing →

SEO Myths II: Content Content Content, the Secret to SEO

February 27, 2007
· Martin Kelley

When­ev­er
I talk with fel­low web design­ers, the issue of “SEO” invari­ably comes
up. That’s techie slang for “search engine opti­miza­tion,” of course,
that black sci­ence of mak­ing sure Google lists your site high­er than
your com­peti­tors. Over the years a small army of shady char­ac­ters have
tried to game the search engine results.

I’ve always thought such tricks were pathet­ic and bound to lose over
the long term. Search engines want to fea­ture good sites. It’s in their
best inter­est to make sure the sites list­ed are the ones peo­ple want to
see. A search engine that returns unsat­is­fac­to­ry results quickly
becomes a has-been in the search engine com­pe­ti­tion. So as soon as a
site such as Google notices some new SEO trick is skew­ing the rank­ings they tweak their secret search algo­rithm to fix the SEO loop­hole.

Just Give Google the Content It Loves

In the­o­ry it’s easy to make Google, Yahoo, MSN and
the oth­er big search engines hap­py: give poten­tial vis­i­tors site
they’ll want to vis­it. For­get the tricks and spend your time putting
togeth­er an amaz­ing site. Search engines like text, so write, write,
write. 

I’m look­ing to join a web design house, which means I’ve been
inter­view­ing with slick web devel­op­ers late­ly and when­ev­er they ask me
the best way to increase SEO for their
clients, I tell them to start a blog. They look at me like I’m an idiot
but it’s absolute­ly true: two blog posts a week will end up being over
100 pages of pure con­tent. All of these sites full of Flash animation
get you nowhere with Google.

Just a note that any kind of text-rich web sys­tem can achieve many
of the same results – blogs are just the eas­i­est way yet to get content
on your site.

Presenting What You Already Have: Blog your Water Cooler Chat

When I talk to peo­ple about start­ing a cor­po­rate blog they quickly
start telling me how much work it will be. Bah and Hum­bug – your
com­pa­ny’s life is prob­a­bly already filled with blog­gable material! 

I used to work in a book­store where I did most of the customer
ser­vice, much of it by email. About two or three times a week I’d get a
par­tic­u­lar­ly intrigu­ing query and would spend a lit­tle time researching
an answer (most­ly by look­ing through the index­es of our books and
search­ing the arcane sites of our niche). This research did­n’t always
pan out to a book sale, but it marked our book­store as a place to get
answers and gave us a com­pet­i­tive advan­tage over Ama­zon and its ilk.
Each of my email answers could have eas­i­ly been refor­mat­ted to become a
blog post. By the end of a year, I’m sure the vol­ume com­ing from these
obscure search­es would be quite high (see yes­ter­day’s Long Tail Strategy
post on the Hit­Tail blog for an account of how atten­tion to search
engine’s one-hit-wonders helped achieve a wide­spread key­word dominance).

When­ev­er some­thing new hap­pens that breaks you out of your routine,
think about whether it’s blog­gable. At the book­store, a new book would
come in and we’d spend ten min­utes talk­ing about it. That conversation
reached half-a-dozen peo­ple at most. In that same ten min­utes we could
have writ­ten up a blog post say­ing much the same thing.

Last Spring a con­tro­ver­sial arti­cle appeared in the local newspaper
that tan­gen­tial­ly involved my employ­er. That morn­ing my workmates
gath­ered togeth­er in the recep­tion area for the bet­ter part of an hour
trad­ing opin­ions and wise­cracks. After about five min­utes of this, I
slipped back to my office and wrote my opin­ions and wise­cracks down
into my blog. I hit post and came back to the recep­tion area – to find my
work­mates still blath­er­ing on, natch. My post reached hun­dreds and took
no more time out of the work day than the recep­tion pontifications.

Humans are social ani­mals. We’re always blog­ging. It’s just that
most of the time we’re doing it ver­bal­ly around the water cool­er with
three oth­er peo­ple. Learn to type it in and you’ve got your­self a
high-volume blog that will add invalu­able con­tent and SEO mag­ic to your site.

Mix up your content: Tag Your Site

Last­ly, a point to web­mas­ters: it usu­al­ly pays to think about ways
to re-package your con­tent. My most recent­ly expe­ri­ence of this was
tag­i­fy­ing my per­son­al blog over at “Quak​er​Ran​ter​.org.” Every time I
post there a Mov­able Type plu­g­in fish­es out the key words in the
arti­cle and lists them after­wards as tags. These tags are all linked in
such a way that results send the term through the site’s search engine
to give back an on-the-fly index page of all the posts where I’ve used
that term.

Tags are like cat­e­gories except they pick up every­thing we talk
about (when we use them aggres­sive­ly at least, and espe­cial­ly when we
auto­mate them). We don’t nec­es­sar­i­ly know the cat­e­gories that our
poten­tial audi­ence might be search­ing for and tag­i­fy­ing our sites
increas­es our key­word out­reach expo­nen­tial­ly. My per­son­al blog has 239
entries but 3,860 pages accord­ing to Google.
It’s the parsed out and re-packaged con­tent that accounts for all of
this extra vol­ume. This does­n’t increase traf­fic by that near­ly that
much, but last month about 30% of my Google vis­its came from these tag
index­es. More on the mechan­ics of this on my post about the tag­ging.

Creating an RSS feed from scratch

February 26, 2007
· Martin Kelley

RSS feeds
are the lin­gua fran­ca of the mod­ern inter­net, the glue that binds
togeth­er the hun­dreds of ser­vices that make up “Web 2.0.” The term
stands for “Real­ly Sim­ple Syn­di­ca­tion” and can be thought of as a
machine-code table of con­tents to a web­site. An RSS feed
for a blog will typ­i­cal­ly list the last dozen-or-so arti­cles, with the
title, date, sum­ma­ry and con­tent all laid out in spe­cial fields. Once
you have a web­site’s RSS feed you can syn­di­cate, or re-publish, its con­tents by email, RSS read­er
or as a side­bar on anoth­er web­site. This post will show you a
ridicu­lous­ly easy way to “roll your own” RSS feed with­out hav­ing to
wor­ry about your web­site’s con­tent platform.

Just about every native Web 2.0 appli­ca­tions comes built-in with mul­ti­ple RSS feeds.
But in the real world, web­sites are built using an almost-infinite
num­ber of con­tent man­age­ment sys­tems and web devel­op­ment software
pro­grams. Some­times a sin­gle web­site will use dif­fer­ent pro­grams for
putting its con­tents online and some­times a sin­gle orga­ni­za­tion spreads
its func­tions over mul­ti­ple domains.

Step 1: Make it Del​.icio​.us

To begin, sign up with Del​.icio​.us,
the pop­u­lar “social book­mark­ing” web ser­vice (sim­i­lar ser­vices can be
eas­i­ly adapt­ed to work). Then add a “post to Del​.icio​.us” but­ton to
your browser’s tool­bar fol­low­ing the instruc­tions here.
Now when­ev­er you put new con­tent up on your site, go that new page,
click on your “post to Del​.icio​.us” but­ton and fill out a good title
and descrip­tion. Choose a tag to use. A tag is sim­ply a cat­e­go­ry and
you can make it what­ev­er you want but “mysites” or your busi­ness name
will be the eas­i­est to remem­ber. Hit save and you’ve start­ed an RSS feed.

How? Well, Del​.icio​.us turns each tag into a RSS feed.
You can see it in all its machine code glo­ry at
del​.icio​.us/​r​s​s​/​u​s​e​r​n​a​m​e​/​m​y​s​i​tes (replac­ing “user­name” with your
user­name and “mysites” with what­ev­er tag you chose).

Now you could just adver­tise that Del​.icio​.us RSS feed
to your audi­ence but there are a few prob­lems doing this. One is that
Del​.icio​.us accounts are usu­al­ly per­son­al. If your web­mas­ter leaves,
then your pub­lished RSS feed will need to
change. Not a good sce­nario, espe­cial­ly since you won’t even be able to
tell who’s still using that old feed. Before you adver­tise your feed
you should “future proof” it by run­ning it through Feedburner.

Cloak that Feed

Go to Feed​burn​er​.com. Right there on the home­page they invite you to type in a URL.
Enter your Del​.icio​.us feed’s address and sign up for a Feedburner
account. In the field next to feed address give it some sen­si­ble name
relat­ing to your com­pa­ny or site, let’s say “mycompa­ny” for our
exam­ple. You’ll now have a new RSS feed at
feeds​.feed​burn​er​.com/​m​y​c​o​m​p​any. Now you’re in busi­ness: this is the
feed you adver­tise to the world. If you ever need to change the source RSS feed you can do that from with­in Feed­burn­er and no one need know.

The default title of your Feed­burn­er feed will still show it’s
Del​.icio​.us roots (and the web­mas­ter’s user­name). To clear that out, go
into Feed­burn­er’s “Opti­mize” tab and turn on the “Title/Description
Burn­er,” fill­ing it out with a title and descrip­tion that better
match­es your feed’s pur­pose. For an exam­ple of all this in action, the
Del​.icio​.us feed that pow­ers my tech link blog and its Feed­burn­er “cloak” can be found here:

Get that Feed out there

Under Feed­burn­er’s “Pub­li­cize” tag there are lots of neat features
to repub­lish your feed your­self. First off is the “Chick­let chooser”
which will give you that ubiq­ui­tous RSS feed
icon to let vis­i­tors know you’ve entered the 21st Cen­tu­ry. Their “Buzz
Boost” fea­ture lets you cre­ate a snip­pet of code for your home­page that
will list the lat­est addi­tions. “Email sub­scrip­tions” lets your
audi­ence sign up for auto­mat­ic emails when­ev­er you add some­thing to
your site.

Final Thoughts

RSS feeds are great ways of communicating
excit­ing news to your audi­ences. If you’re lucky, impor­tant blog­gers in
your audi­ence will sub­scribe to your feed and spread your news to their
net­works. Cre­at­ing a feed through a book­mark­ing ser­vice allows you to
add any page on any site regard­less of its under­ly­ing structure.

Neat idea: postcard for World Peace

February 22, 2007
· Martin Kelley

A project from Esto­nia, a “blog of post­cards for world peace”:http://postcardworldpeace.blogspot.com. From the site:
bq. The idea is sim­ple: Send us a post­card from your country/city (or any post­card you want) writ­ing in the back­side a mes­sage of peace to the World. All the post­cards will be uploaded in the blog, and there will be a record of how many post­cards per coun­try we receive (includ­ing a map show­ing the coverage).

Pete Seeger gets YouTubed

February 12, 2007
· Martin Kelley

pete seeger album coverThis morn­ing I’m work­ing on the “Pete Seeger”:http://www.quakersong.org/pete_seeger/ sec­tion of Quak​er​song​.org, the web­site of Annie Pater­son and Peter Blood (I’m their web­mas­ter). Parts of their site are amaz­ing – the “Quak­ers and Music”:http://www.quakersong.org/quakers_and_music/ page has become a direc­to­ry of sorts for all the many Quak­er musi­cians out there (who knew there were so many!). But the Pete Seeger is still most­ly a col­lec­tion of CDs that Peter & Annie have for sale.
So I was won­der­ing what a good Pete Seeger page might look like and start­ing surf­ing around. There’s a great “fan page”:http://www.peteseeger.net/ which is reg­u­lar­ly updat­ed but has brave­ly decid­ed to main­tain its orig­i­nal design since it was found­ed eleven years ago. And “Wikipedia”:http://en.wikipedia.org/wiki/Pete_seeger does its usu­al fine job at a biog­ra­phy. But the “gold mine is YouTube”:http://youtube.com/results?search_query=pete+seeger&search=Search.
A year ago a user uploaded three clips from _Rainbow Quest_, a short-lived TV pro­gram Pete put togeth­er for a low-wattage UHF sta­tion out of Newark in the mid-60s (it’s now a Tele­mu­n­do affil­i­ate broad­cast­ing recy­cled Mex­i­can soaps for its prime time sched­ule). I don’t know what kind of copy­right issues there are on some­thing like this but it’s great fun to see these old clips. Mak­ing this mate­r­i­al wide­ly avail­able is one of the joys of YouTube (well, that and watch­ing “recap­tur­ing the inno­cence of our over-commercialized youth”:http://ofthebest.blogspot.com/2007/02/how-to-shed-20-years-in-20-seconds.html). I’ll leave you with this, a clip of Pete singing with June Carter and John­ny “I’m soooo stoooned” Cash a few years before they married.