多年来,我一直在建立网站,主要在网址上。 其中一些地点有 cr,通常每天运行一次。 网址文件存放在服务器上,同时存放网页的档案。
我知道,各种拖网者,无论合法还是非合法,都参观了我的各页。 现在,如果拖网人将访问我的一个 cr手档案,就会引发争执,有时会带来不良结果。
我确信,这种情况从未发生,尽管我对此表示感谢,但我却试图理解原因。 当然,在任何地方与我的任何争斗都没有任何联系,但我很相信,各种拖网者已经访问过其他网页,尽管他们从未有过联系。
其他开发商如何解决这一问题? Put a line in the robots. txt file? 是否允许Conjob-relate php档案?
提前感谢。
Don 公开发行的目录中储存任何 cr。
加上“Jeff”的伟大答案:
如果与搜索引擎有某种联系,那么搜索引擎将破坏你的网页。 这或许是贵网站的另一页、另一页的网页或你自己的地图。
不管你们的艰巨工作永远不能从外部直接获得。
I have a list of link which I want to get crawled. I would like to all other links the crawler finds by himself to not be crawled. Directions I looked into: create a robots.txt which will disallow ...
I have the following problem. My sitemap s content is shown in GOOGLE search results. There is a link to the sitemap on the main page. That can cause it. I have added this URL to GOOGLE as sitemap and ...
there is a strange problem, i followed each and every step as told in http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=146897 implementd the review section, hreview ...
I am working on a project. I need help crawling the android marketplace and retrieving absolutely everything possible. I found many third party crawler api s which help with this. However there a ...
多年来,我一直在建立网站,主要在网址上。 其中一些地点有 cr,通常每天运行一次。 The php file that the cronjobsîs are used on the services, ...
i have 5 dynmic artcile in my home page, (random) How quick google will read my content , First tell me Really Google will cron my content or not becoz am changes my content every page refresh , So ...
Here is my case: I use some external source to load html data to my page, after that I put content of this html to div. So, as soon as page loaded and ajax call finished, I see the results. It works, ...
hi I am currently working on improving the SEO on a website containing dropdown list menu. currently when you select options and then submit a javascript is redirecting you to the next page I heard ...
