Different kinds of tags

So what do you make of this?

This picture shows a number of tags that have been grouped according to high level linguistic analysis of the terms. I will not explain the specific semantic abstraction in this post, because I want to see if people (if there are any out there watching my poor blog!) can make any sense of it? That is, do the terms in each branch seem to belong to the same “kind”?
Enough for now.

Advertisement

Folksonomy to Ontology

So after presenting all my views on why it should be possible to transform tag clouds to structured data entities (ontologies of sorts), I have gone about devising a method to do so.

When it is ready, I will release a Protege project showing how it is done. In the meantime look at my Protege page on this blog, which is where the project will eventually go.

More thoughts on tag frequency

I was slightly on the wrong track in a previous blog, I think. It happens …
So, the mistake was that I was thinking that all of the popular tags that had survived in a historical context, could be thought of as “category labels” and the less popular ones were the highly individual ones. This would certainly have made things easy. Of course it is good that this is not the case, because that would have been TOO easy. And things that are easy, are not interesting. So why is it not true? Just look at the table below, which shows the top four most popular tags for some of the 50 most popular sites on delicious:

Site Slashdot Flickr Pandora Digg BBC News New York Times
Tags News, Technology, Geek, Daily Photos, Flickr, Photography, Sharing Music, Radio, Recommendation, MP3 News, Technology, Blog, Daily News, BBC, UK, Daily News, Newspaper, Daily, NYC

It is self evident that the popular tags form a heterogeneous collection. Some are clear category labels that would feel at home in a formal taxonomy (e.g. “News”, “Movies”, “Music”). Some, like “Daily” and “Recommendation” appear to describe resources with a particular property which is nevertheless fixed and user independent. Others like “Fun” and “Geek” describe more personal properties that depend on individual interpretation. Finally there are proper names like “UK” and “NYC”.

So, what are the facts telling us???

technorati tags: ,

Our Mind the Taxonomist

So finally after the many pages of blogs and thoughts, I think my main points finally came into focus after the last blog, after Clay Shirky’s clear and direct claim which I reiterate here:Here’s what’s radical about what del.icio.us protends: My vocabulary on del.icio.us folksonomy is personal, not vernacular — no one knows or needs to know which class I’m talking about when I tag something ‘class’, or that I use LOC to mean Library of Congress. This isn’t the same as, say, the dictionary of thieves slang from the mid-18th c. because no one else needs to know my bookmark system, and I don’t need to know anyone else’s,

So here is what’s radical about what Shirky protends: if I want to, I can tag my bookmarks with any vocabulary I chose. So here goes, a sample of my tags: “hdfjkfb”, “orjfkido”, “hjfoå”, “krlofpke”. So this certainly ensures that no one else knows my system, and if everyone else does the same, I won’t know theirs. But how useful would this be to anyone?? So at this rather radical extreme the Shirky claim is without content.
But maybe the example is too radical because the notion of vocabulary precludes the use of random tags. Fine. Let us think of a different example which is perhaps closer to the spirit of Clay’s idea. So I make up a system that only I know, where all interesting sites end with “xyz”, technical sites begin with “krp”, and so on. Everyone else can make up their own system, and no one knows anybody else’s. But an immediate problem with this is that it is cheating … it smuggles in the more natural English vocabulary via the back door by simply equating each English term with an expression in the new “vocabulary system”. Still, this is private knowledge so maybe that is O.K. for the example. But this leads to the interesting hypothesis: suppose you made up vocabularies like “krp…”, “…xyz”, and so on, and got users to adopt them. These can be mapped onto their “parent” vocabularies that they are derived from (remember “krp…” = “technical site”, etc.). To the individual user, each system would be equivalent (more or less, as Katie Melua would say). But which vocabularies would make a better del.icio.us?

I think it is pretty clear that we DO need to know SOMETHING about everyone else’s bookmark system! The success of a “social bookmarking system” depends on the fact that we do understand each others vocabularies (to some extent), and can extract value from that shared understanding.

What I have been arguing is that the aggregate data shows us something about what we know about everyone else’s bookmark system. Why are some terms so “natural”? Do all “natural” terms become popular? Are all “natural” terms natural in the same way, or are there different categories according to which terms can naturally relate to their categories (a bit like facets in taxonomies).
So my position is that folksonomies can provide interesting data which can give a clue about the way humans organize knowledge, AND about the ways in which we share each other’s organizational systems. My Ph.D. was originally in Cognitive Psychology, and during my studies I came to believe in the hypothesis that mental architecture fundamentally shapes our perceptions and organization of the world in which we live. Further, essential aspects of the mental architecture are fixed and therefore shared by all humans, which is what makes communication and shared understanding possible. The overlap is not perfect. I say Library of Congress, but Clay wants to say LOC. Good for him. But pity the poor soul who calls it “the square root of negative 2”!
The mind creates categories, because that is what minds do (there is an awful lot more to say about that!). The mental architecture enforces the range of possible ontologies and taxonomies that we can bring to bear on the understanding of our universe. All humans share fundamental aspects of mental architecture and therefore properties of possible taxonomies. Folksonomies provide a fantastic window into the worshop of the mental taxonomist!