Questions and Answers : Wish list : robots.txt missing
Message board moderation
Author | Message |
---|---|
Send message Joined: 31 Oct 04 Posts: 336 Credit: 3,316,482 RAC: 0 |
This is sure important for all BOINC based projects : Currently the search engines index the result pages, result lists, work unit pages and so on. From the traffic, those search engines produce on my own web site, I can imagine they produce a lot of queries on BOINC databases too. Maybe someone should think about a robots.txt (or .htaccess) that at least excludes the pages with database queries from beeing indexed by search spiders. (I posted this in the SETI@BOINC forum too) |
Send message Joined: 5 Aug 04 Posts: 426 Credit: 2,426,069 RAC: 0 |
The fix is in. The projects will have to update the server side software for it to take effect though. BOINC WIKI BOINCing since 2002/12/8 |
©2024 cpdn.org