
After the search it generates a long HTML page with all the information it found on the molecule you queried for. This approach is much more scalable than storing all in one database.
This crawling of information is something I was working on myself a bit too, and I think this is a good approach. However, I think the use of a central website is not the right approach. Instead, the search should be distributed too: the crawling should be done on the client machine; it should be done in Taverna or Bioclipse instead.
My conclusion: excellent idea, bad implementation.
Egon...watch this space...we named ourselves ChemSpider for a reason. SPidering is on the list of things to do and this capability is already being defined in terms of how to execute. Keep watching as usual...
ReplyDelete