Scattering data and need for universal search 08:53 on Wednesday

MG 5615

Yesterday I started a new private stikiwiki to accompany our “team wiki” (which is used to store and brainstorm project ideas for our group of friends). My blog count at the moment is three, this blog, Softys, and the blog for our upcoming book. I also use and store stuff in Basecamp, Flickr, Clicktime, SlimTimer, Google Spreadsheets, EditGrid, Zoho Writer, BackPackIt, GooToDo, Writeboards and Google Calendar. On top of that I have 70GB of stuff on my laptop.

Nice to know. So…?

A modern day knowledge worker accumulates a huge amount of data. Hierarchical access to this data works only so far. The OS manufacturers know this and concentrate on building better search (witness OS X Spotlight or WinFS). Web 2.0 developers know this and concentrate on classification (witness tags). Google knows this and being the masters of search, I’m sure we have not yet seen what they’re capable of.

The result of using web apps is that more and more data moves out of the desktop and onto the network. This breaks the information management system based on local file system search, and a management system is at best only when every manageable tidbit is managed through the system.

So… we need systems that enable us to search across all our data, regardless of medium. I want my spotlight search to deep index the content of my wikis and return wiki pages among the files and emails listed. I want spotlight to give me links to Basecamp project discussions. I want it to take me to the exact chapter and paragraph on my Zoho writer document. I want to find drafts stored in my wordpress blog. I want quick searching of my Flickr photos.

I could envision that by the magic of APIs this global search would not be just a dream. But for now, all we can do is wait… and see what Google comes up with.

[tags]web 2.0, web, 2.0, search, filesystem, info management, information management, editgrid[/tags]

2 Responses to “Scattering data and need for universal search”


  1. David Lee Says:

    Hi, this is David from EditGrid.

    For this universal search to exist, individual services need to implement an effective searching API according to some agreed standard. May be Google/Yahoo should take the responsibility to come up with such standard.

    We at EditGrid have tried to make searching your data as efficient as possible.

    Firstly, we have EditGrid Finder (http://www.editgrid.com/finder) which allow you to search your data contextually without opening your spreadsheet.

    Secondly, we have EditGrid Sync, which download all your spreadsheet to your desktop periodically, so your desktop search will be able to reach it.

    In the future, when the standard is emerged, we would be happy to implement our searching interface according to the standard such that your vision would be achieved!

  2. Niko Says:

    Hi David. It looks like you have definitely thought of this problem and the solutions you mention make the link title above even more appropriate: EditGrid is a true Excel replacement. I don’t know how you did it but it’s just awesome…

    EditGrid Sync seems to work on Mac as well with some tinkering. No idea how the technology works, but maybe it could be possible to make a dedicated Spotlight plugin for a web app…?