The new aggregators

October 13, 2006

A look at the new class of “Sin­gle Page Aggregators.”

Way back in 1997 I was one of dozens of lots of web design­ers trying
to fig­ure out how to bring an edi­to­r­i­al voice to the inter­net. The web
had tak­en off and there pages and links every­where but few places where
they were actu­al­ly orga­nized in a use­ful man­ner. As I’ve writ­ten before,
in Decem­ber of that year I start­ed a week­ly updat­ed list of annotated
links to arti­cles on non­vi­o­lence, a form we’d now would rec­og­nize as a
blog.

About
eigh­teen months ago I start­ed a “links blog” of inter­est­ing Quaker
links, incor­po­rat­ed as a side­bar on my pop­u­lar “Quak­er­Ran­ter” personal
blog. I even­tu­al­ly gave the links their own URL (Quak​erQuak​er​.org)
and invit­ed oth­ers to join the link­ing. I always stum­ble when try­ing to
tell peo­ple what Quak­erQuak­er is all about. The best def­i­n­i­tion is that
its a “col­lab­o­ra­tive­ly edit­ed blog aggre­ga­tor” but that’s a horribly
tech description.

The rise of blogs is cre­at­ing the neces­si­ty for these sort of theme-based aggre­ga­tors. This morn­ing I stum­bled on Orig­i­nal Sig­nal, a new site that organzes the best Web 2.0 blogs. A site called Pop­URLs does the same for “the lat­est web buzz.” A site called Solu­tion­Watch has writ­ten about these in Track­ing the web with Sin­gle Page Aggre­ga­tors. We’re all on to some­thing here. I sus­pect that some­time this fall some clever per­son will coin a new term for these sites.

I am the King of Folksonomy

September 1, 2006

I just relaunched my per­son­al blog a few days ago, mov­ing it from non​vi​o​lence​.org/​m​a​r​t​ink to quak​er​ran​ter​.org. I plan to write a whole big piece about it in the near future. But my access logs just picked up some­thing amazing.

An
impor­tant part of the redesign was an auto­mat­ic key­word generator.
Posts were run through a script that auto­mat­i­cal­ly pulled out keywords
from the text. My 2003 arti­cle, Going all the way with Mov­able Type gen­er­at­ed the fol­low­ing tags, which appear as links after the post:

Fol­low­ing the links takes you to similarly-tagged arti­cles. At least
that’s the con­ceit. When you fol­low a tag’s link you’re sim­ply doing a
site search for that key­word. A lit­tle htac­cess rewrite mag­ic is making
the result look like it’s a sta­t­ic cat­e­go­ry page.

“Fine and well” you’re think­ing, “big deal.” Well, here’s what’s
cool. There are 225 entries on the Quak­er­Ran­ter blog. Google’s just
gone through and indexed the site and is now claim­ing it con­tains 1300 pages.
Each tag is being indexed as its own page. Every time I men­tion any
inter­est­ing term, it becomes a page that Google index­es and deliv­ers to
its searchers.

Which brings us to today’s cool piece from the access logs. In
Decem­ber of 2004 a rather inno­cent post on Quak­er Ranter became the
cen­ter of a mini-whirlwind on the polit­i­cal blogs when it mentioned
that I had got­ten a call from a CBS News pub­li­cist inter­est­ed in Non​vi​o​lence​.org.
All polit­i­cal blogs get pub­lic­i­ty calls from news and opin­ion think
tanks try­ing to sug­gest (or plant) sto­ries but no one’s sup­posed to
talk about it. I only men­tioned it because it was so unusu­al. One of
the blogs denounc­ing the lib­er­al con­spir­a­cy my post revealed was the
some­what slimy Lit­tle Green Foot­balls. After a few weeks the
denun­ci­a­tions died down. 

But this morn­ing, some­one looked up lit­tle­green­foot­balls in Google and came to my site. Because of my auto­mat­ic key­word gen­er­a­tor, tags, and static-loooking links, I’m now the num­ber two entry, on two three-year old posts, now relo­cat­ed to a days old quak​er​ran​ter​.org. Cool. 

This mix­ing and match­ing of con­tent and rich manip­u­la­tion of data is some­times lumped togeth­er in the cool bu zzphrase folk­son­o­my.
Note that none of what I’ve done is a trick­ing of Google. Every tag is
real­ly going to a page with that con­tent. These are “nat­ur­al” and
“organ­ic” search results in the lin­go of SEO. I’m just pre­sent­ing my infor­ma­tion in mul­ti­ple for­mats that appeal that the widest array of audiences.

For what it’s worth, I don’t think I deserve #2 sta­tus for
“lit­tle­green­foot­balls” and I don’t think Google will keep it there for
long. It’s a bit odd that they have ele­vat­ed that par­tic­u­lar term so
high and no oth­ers tags seem so stratospheric.


Positive Results:

As of Feb­ru­ary 2007, Google index­es 3,540 pages
on Quak​er​Ran​ter​.org, a blog of only 239 posts. In Decem­ber 2006 30% of
my Google vis­its were to one of the “tags” page. Recon­fig­ur­ing the blog
in this kind of tag-intensive way has more than dou­bled search engines
vis­its, again in a very nat­ur­al and organ­ic way. Adding tags has simply
made what I’ve writ­ten more acces­si­ble to search engines. Very cool.

Negative Ramifications:

Short­ly after installing this new sys­tem, my servers started
peri­od­i­cal­ly crash­ing (about once/week). The prob­lem would be multiple
MT-Search process­es over­load­ing the memory. 

My guess is that a search engine spi­der came along and started
index­ing all of the tags. Each link ini­ti­at­ed a search query in Movable
Type. The built-in search for Mov­able Type is just not able to handle
this vol­ume of traffic.

I installed Fast Search to solve the prob­lem (tip of the hat to Al-Muhajabah). It took awhile: Fast Search required a MySQL upgrade at my host. After that I need­ed to install these plu­g­in fix­es.
Then it was fine-tuning the htac­cess files. It was been more work than
I ini­tial­ly expect­ed and the tag results now for­ward to a fun­ny URL that Google does­n’t love as much.

Simple Design does not mean simple execution

August 23, 2006

Every
web­site should try to serve a clear set of pur­pos­es. Even a personal
blog has a tar­get audi­ence, one’s friends or fam­i­ly per­haps. While a
good site looks sim­ple, it is often very com­pli­cat­ed “under the hood.”

Google
went from being a grad school project to the world’s most important
search engine by ditch­ing the design clut­ter of its com­peti­tors for a
very clean home­page with max­i­mum white space. This effect focused one’s
atten­tion on the search func­tion. More PhD’s are said to work at Google
than at any oth­er com­pa­ny in the world, yet the com­pli­cat­ed engineering
and the tremen­dous com­put­er infra­struc­ture that brings that logo and
search box to your com­put­er is invis­i­ble to the aver­age user.

Even web­sites with­out PhD design­ers need to mar­ry a sim­ple outward
appear­ance with a more com­pli­cat­ed set of cal­cu­la­tions around intended
audi­ences. The aver­age vis­i­tor looks at one or two pages on a site and
then hits the back but­ton. Often they’ll be fol­low­ing a search link and
look­ing at a page buried deep in your site. They’ll be there seeking
out spe­cif­ic infor­ma­tion and you only have about twen­ty sec­onds to
pitch your site and keep them there. You need to give them a very
con­cise descrip­tion of your­self or prod­uct and you need to entice them
with relat­ed material.

Any site that con­sists of more than three pages presents visitors
with more infor­ma­tion than they can han­dle. Good design works to funnel
vis­i­tors to the spe­cif­ic con­tent they are look­ing for. It’s relatively
easy to get a first-time vis­i­tor but suc­cess­ful web­sites keep them on
your site and give them rea­sons to return. The key to this is defining
your audi­ence and pre­sent­ing your mate­r­i­al with them in mind.

Once you’ve iden­ti­fied your con­stituen­cy and built your design, the
next step is release. You don’t want to pan­der to a poten­tial audience,
but instead con­verse with them. It’s fine to mix dif­fer­ent ele­ments of
your life togeth­er and to write cre­ative­ly off-topic once in awhile.
There are a thou­sand gener­ic web­sites crammed full of use­less bu
zzphras­es and unused fea­tured. What you want is one that will have a
voice, that builds a niche that no one else might ever have identified.
When it comes time to pro­duce con­tent, for­get all the slick marketing
cal­cu­la­tions you’ve done and let your quirk­i­ness shine.

Marketing and Publicizing Your Site

August 8, 2006

“Build it and they will come” is not a very good web strategy.
Instead, think “if I spent $3000 on a website but no visitors came, did
I spend $3000?” There are no guarantees that anyone will ever visit a
site. But there are ways to make sure they do.

Much of web mar­ket­ing fol­lows the rules of any oth­er mode of
pub­lic­i­ty: iden­ti­fy an audi­ence, build a brand, appeal to a lifestyle
and keep in touch with your cus­tomers and their needs. A sucess­ful web
cam­paign uti­lizes print mail­ings, man­u­fac­tured buzz, gen­uine word of
mouth and email. Finances can lim­it the options avail­able but everyone
can do something.

One of the most excit­ing aspects of the inter­net is that the most
pop­u­lar sites are usu­al­ly those that have some­thing inter­est­ing to
offer vis­i­tors. The cost of entry to the web is so low that the little
guys can com­pete with giant cor­po­ra­tions. A good strat­e­gy involves
find­ing a niche and build­ing a com­mu­ni­ty around it. Per­son­al­i­ty and idio­syn­cra­cy are actu­al­ly com­pet­i­tive advantages!

It would be cru­el of me to just drop off a com­plet­ed web­site at the
end of two months and wash my hands of the project. Many web designers
do that, but I’m more inter­est­ed in build­ing sites that are used. I can
work with you on all aspects of pub­lic­i­ty, from design to launch and
beyond to ana­lyz­ing vis­i­tor pat­terns to learn how we can serve them better.

Making sites sticky

We don’t want some­one to vis­it your site once, click on a few links
and then dis­ap­pear for­ev­er. We want to give your vis­i­tors rea­sons to
come back fre­quent­ly, a qual­i­ty we call “sticky” in web par­lance. Is
your site a use­ful ref­er­ence site? Can we get vis­i­tors to sign up for
email updates? Is there a com­mu­ni­ty of users around your site?

Making sites search engine friendly

Google. We all want Google to vis­it our sites. One of the biggest
scams out there are the com­pa­nies that will reg­is­ter your site for only
$300 or $500 or $700. The search engines get their
com­pet­i­tive advan­tage by includ­ing the whole web and there’s no reason
you need to pay any­one to get the atten­tion of the big search engines. 

The most impor­tant way to bring Google to your site is to build it
with your audi­ence in mind. What are the key­words you want peo­ple to
find you with? Your town name? Your busi­ness? Some spe­cif­ic qual­i­ty of
your work? I can build the site from the ground up to high­light those
phras­es. Here too, being a niche play­er is an advantage. 

I know lots of Google tricks. One site of mine start­ed attract­ing four times the vis­its after its pro­gram­mer and I redesigned it for Google. My sites are so well indexed that if I often get vis­i­tors search­ing for
the odd­est things. We can actu­al­ly tell when vis­i­tors come from search
engines and we can even tell what they’re search­ing for! Google
appar­ent­ly thinks I know “how to flat­ten used sod” and am the guy to
ask if you won­der “do amish women wear bras.” I can make sure your impor­tant search terms also get noticed by Google and the rest!

Maguire​On​line​.com

May 18, 2006

Pro­fes­sion­al jour­nal­ist James Maguire came to me with an exist­ing site built in Mov­able Type. I’ll redesigned the nav­i­ga­tion, cre­at­ing cus­tomized side­bars that changed accord­ing to the cat­e­go­ry. He’s done great stuff with his site and it’s well worth look­ing through. Favorites of mine: his video appear­ances on talk shows and his 100 Books Worth Read­ing list.

Vis­it: James Maguire Online.

Con­tin­ue read­ing

Quak​er​song​.org

March 10, 2006

Quakersong.orgWeb­site for Peter Blood & Annie Pat­ter­son, musi­cians most well known for their insanely-popular song­book Rise Up Singing. They sell books and tapes on the site (e‑commerce han­dled ably and sim­ply by Pay­pal) and they also have lots of high-quality con­tent includ­ing a lot of hard-to-find Pete Seeger CDs. Mov­able Type is used as a con­tent man­age­ment sys­tem (CMS).

Tech­nolo­gies: Mov­able Type, Pay­pal. Vis­it Site.

Going all the way with MovableType

August 5, 2005

An
ear­ly descrip­tion of my using the Mov­able Type blog­ging plat­form as a
con­tent man­age­ment sys­tem (CMS) for an entire web­site. I’ve used these
tech­niques to build web­sites which clients can eas­i­ly manip­u­late and
update.

Inspired by Doing Your Whole Site with MT
on Brad Choate’s site, I start­ed exper­i­ment­ing today with putting the
whole Non​vi​o​lence​.org site into Mov­able Type. At first I thought it was
just a tri­al exper­i­ment but I’m hooked. I espe­cial­ly love how much
clean­er the entry for the links page now looks and I might actu­al­ly be inspired to keep it up to date more now. (I’ve also inte­grat­ed Choate’s MT-Textile which makes a big dif­fer­ence in keep­ing entries clean of HMTL garbage, and the semi-related Smar­ty­Pants which makes the site more typo­graph­i­cal­ly ele­gant with easy M‑dashes and curly quotes).

So here’s what I’m doing: there are three Mov­able Type blogs inter­act­ing with one anoth­er (not includ­ing this per­son­al blog):

  • One is the more-or-less stan­dard one that is pow­er­ing the main home­page blog of Non​vi​o​lence​.org.
  • The sec­ond I call “NV:Static” which holds my sta­t­ic pages, much as Brad out­lines. I put my desired URL path
    into the Title field (i.e., “info/index”) and then put the page’s real
    title into the Key­words field (i.e., “About Non​vi​o​lence​.org”) and have
    that give the data for the title field and the first head­line of the
    page. It might seem back­wards to use Title for URL and then use Key­words for Title, but this means that when I’m in MT look­ing to edit a par­tic­u­lar file, it will be the URL paths that are listed.
  • The third blog is my “NV:Design Ele­ments.” This con­tains the block
    of graph­ics on the top and left of every page. I know I’ll have to
    redesign this all soon and I can do it from wher­ev­er. This blog outputs
    to HTML. All the oth­er pages on the site are PHP and its a sim­ple include to pull the top and left bars into each PHP page.

Oh yes, I’m also think­ing of incor­po­rat­ing guest blogs in the near
future and all of these ele­ments should make that much easier.

Here’s anoth­er site to check out, about how some­one inte­grat­ed Mov­able Type into their church web­site using some inter­est­ing techniques.

The Early Blogging Days

June 17, 2005

I start­ed Non​vi​o​lence​.org in late 1995 as a place to pub­li­cize the work of the US peace move­ment which was not get­ting out to a wide (or a young) audi­ence. I built and main­tained the web­sites of a few dozen host­ed groups (includ­ing the War Resisters League, Fel­low­ship of Rec­on­cil­i­a­tion and Pax Christi USA) but I quick­ly real­ized that the Non​vi​o​lence​.org home­page itself could be used for more than just as a place to put links to mem­ber groups. I could use it to high­light the arti­cles I thought should get more pub­lic­i­ty, whether on or off the Non​vi​o​lence​.org domain.

The home­page adapt­ed into what is now a rec­og­niz­able blog for­mat on Novem­ber 13, 1997 when I re-named the home­page “Non­vi­o­lence Web Upfront” and start­ed post­ing links to inter­est­ing arti­cles from Non​vi​o​lence​.org mem­ber groups. In response to a com­ment the oth­er day I won­dered how that fit in with the evo­lu­tion of blog­ging. I was shocked to learn from Wikipedi­a’s that the term “weblog” was­n’t coined until Decem­ber of that year. I think is less a coin­ci­dence than a con­fir­ma­tion that many of us were try­ing to fig­ure out a for­mat for shar­ing the web with others.

blank

The ear­li­est edi­tion stored on Archive​.org is from Decem­ber 4, 1997. It focused on the hun­dredth anniver­sary of the birth of Catholic Work­er co-founder Dorothy Day. To give you an sense of the ear­ly independently-published arti­cles, the Jan­u­ary 2, 1998 edi­tion includ­ed a guest piece by John Steitz, “Is the Non­vi­o­lence Web a Move­ment Half-Way House” that sounds eeri­ly sim­i­lar to recent dis­cus­sions on Quak­er Ranter.

Below is an excerpt from the email announce­ment for “Non­vi­o­lence Web Upfront” (typ­i­cal­ly for me, I sent it out after I had been run­ning the new for­mat for awhile):

NONVIOLENCE WEB NEWS, by Mar­tin Kel­ley Week of Decem­ber 29, 1997

CONTENTS

Intro­duc­ing “Non­vi­o­lence Web Upfront”

New Pro­ce­dures
New Web­site #1: SERPAJ
New Web­site #2: Stop the Cassi­ni Fly­by
Two Awards
Num­bers Avail­able Upon Request
Week­ly Vis­i­tor Counts

With my trav­el­ling and hol­i­day sched­ule, it’s been hard to keep reg­u­lar NVWeb News updates com­ing along, but it’s been a great month and there’s a lot. I’m espe­cial­ly proud of the con­tin­u­ing evo­lu­tion of what I’m now call­ing “Non­vi­o­lence Web Upfront,” seen by 1800 – 2200 peo­ple a month!


INTRODUCING “NONVIOLENCE WEB UPFRONT”

The new mag­a­zine for­mat of the NVWe­b’s home­page has been need­ing a name. It need­ed to men­tioned the “Non­vi­o­lence Web” and I want­ed it to imply that it was the site’s home­page (some­times referred to as a “front­page”) and that it con­tained mate­r­i­al tak­en from the sites of the NVWeb.

So the name is “Non­vi­o­lence Web Upfront” and a trip to http://​www​.non​vi​o​lence​.org will see that spelled out big on top of the weekly-updated articles.

There’s also an archive of the week­ly install­ments found at the bot­tom of NVWeb Upfront. It’s quite a good col­lec­tion already!

Now that this is mov­ing for­ward, I encour­age every­one to think about how they might con­tribute arti­cles. If you write an inter­est­ing opin­ion piece, essay, or sto­ry that you think would fit, send it along to me. For exam­ple, “War Toys: Re-Action-ist Fig­ures” FOR’s Vin­cent Romano’s piece from the Nov. 27 edi­tion, was an essay he had already writ­ten and made a good com­pli­men­ta­ry piece for the Youth­Peace Week spe­cial. But don’t wor­ry about themes: NVWeb Upfront is meant not only to be time­ly but to show the breadth of the non­vi­o­lence move­ment, so send your pieces along!