40m QIL Cryo_Lab CTN SUS_Lab TCS_Lab OMC_Lab CRIME_Lab FEA ENG_Labs OptContFac Mariner WBEEShop
  40m Log  Not logged in ELOG logo
 List  |  Find  |  Login  |  Help 
Entry  Wed Nov 16 01:45:37 2011, Zach, Update, elog, restarted 
    Reply  Wed Nov 16 02:36:35 2011, Koji, Update, elog, restarted 
       Reply  Wed Nov 16 10:13:13 2011, jamie, Update, elog, restarted 
          Reply  Wed Nov 16 12:21:33 2011, Koji, Update, elog, googlebot (Re: restarted) 
Message ID: 5911     Entry time: Wed Nov 16 12:21:33 2011     In reply to: 5908
Author: Koji 
Type: Update 
Category: elog 
Subject: googlebot (Re: restarted) 

- elogd itself is a sort of web server which has no freedom to put our own file, we can not put robots.txt

- If we include elog using proxy in the usual web tree of Apache, we can put robots.txt at the root.

- So far, if we prevent "page0" browse by google, we will be saved for a while.

- It seems that the indexing is set to be refused by the following meta tags. But it does not prohibit googlebot to use "page0" URL, of course.

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
ELOG V3.1.3-