Comments on: Deep Web, NOW Web – more headaches for Google

By: Dave

Dave — Fri, 13 Mar 2009 12:10:57 +0000

Google is going to be very fast to crawl all the dynamic pages in the web these days. The information is changing so fast and those kind of service really make it difficult to follow and report to the search engines.

By: retrove

retrove — Mon, 09 Mar 2009 20:57:39 +0000

This is near & dear to us as we tackle the deep web of the real estate space. This data is notorious for being hidden behind forms. The reality, is that there is so much content being created on a daily basis its a nearly impossible task to index the now and be one size fits all as G is attempting to do. I think there will be small vertical / deep search companies who will reap big wins from applying Druckers Focus, Focus, Focus as users continue to learn how to really search… which is evidenced by trend in longer keyword searches, they will find it will be easier to just use vertical search sites instead.

By: Online Shopping

Online Shopping — Mon, 09 Mar 2009 07:50:43 +0000

This seems to be a great implementation that google are touching on. I believed google will change their algorithm to meet their goals.

By: CashMakers

CashMakers — Fri, 06 Mar 2009 23:59:10 +0000

Have to admit, that Google spiders weren’t as fast as they are now. Back in the days, it could take up to a month or even two to index your site. Today, if you know how, you can get your site indexed in less than 24 hours.

By: Tal

Tal — Mon, 02 Mar 2009 19:23:33 +0000

This is true, but google is way ahead and his spiders are fast enough to get all the necessary information.

By: Dean

Dean — Sat, 28 Feb 2009 00:29:10 +0000

Interesting points Barry, i never really gave much thought to this, i have always made use of what was available never really considering the untouchable.

I have also stopped by Matthews website and ISEN is a brand new concept to me but i get the ISBN metaphor without understanding the end user experience for reading databases.

Deep Web, we have not even started to understand the possibilities. It`s good to step out of your comfort zone once in a while.

By: Barry Welford

Barry Welford — Fri, 27 Feb 2009 14:11:55 +0000

I’m not sure they will ever attempt to index the NOW Web since much of it is without URLs. Even trying to cover the smaller Deep Web will be a challenge. They are beginning that but I’m not sure how worth-while that effort will be.

By: Alex

Alex — Fri, 27 Feb 2009 11:58:32 +0000

Hi,

I’m just wondering (seriously though) why is Google so eager to index and control this so called NOW Web? Could this be a serious step to a live surveillance of the Internet users? (or of the people through the Internet) You know, just a little bit before “Minority Report”…

By: Pelit

Pelit — Thu, 26 Feb 2009 20:39:36 +0000

By: Jeet

Jeet — Wed, 25 Feb 2009 02:44:26 +0000

I wonder if forums and usenet made ‘NOW web’ earlier Now it also includes social media sites, twitter, social networking status messages and a lot of things I haven’t even heard about.

Deep web is being explored by people search companies (including wink), I think the onus should be on webmasters to make a crawlable URI for their sites. Why should search engine be guessing these path?

For NOW Web, I believe the publishers should start pushing the content towards search engines using a pre-defined protocol. Otherwise the problem would remain unsolved.