I was curious to see what people were clicking on and which photograph was the most popular.
Each time a photograph is viewed on Doric 4x4 the details of that photo, its size and the
browser viewing the photo is logged in a
MySQL
database.
From a valid statistics point of view there are two types of views being counted - human and Internet bots.
Internet bots, also known as web robots, WWW robots or simply bots, are software applications that run
automated tasks over the Internet.
A record is created in the database when you click on any of the thumbnails to view a larger image. Details
of both the larger image and your web browser are logged. This will apply to almost every site you view.
Internet bots generally perform tasks that are both simple and structurally
repetitive at a much higher rate than would be possible for a human editor alone. The largest use of
bots is in web spidering, in which an automated script fetches, analyses and files information from
web servers at many times the speed of a human. Each server can have a file called robots.txt
containing rules for the spidering of that server that the bot is supposed to obey.
For more information about bots please read the web page on
Wikipedia
The statistics show the number of times a human has viewed the picture. There is however some overlap which
is caused by new web robots indexing this site. I do try to correct these as often as I can however there are
new robots each week. Every time I encounter a robot I add it to the robots list and the total is recounted.
The list below shows the robot, number of photographs it has looked at, and the last time it visited. The records
marked "Doric 4x4 Testing" show my testing of the photographs. This list is reset, to save space, each week.
| Agents | Removed | Last Seen |
| SBIder/Nutch-1.0-dev (http://www.sitesell.com/sbider.html) | 0 | 2009-11-12 05:43:32 |
| Huasai/1.0 | 0 | 2009-11-12 07:17:53 |
| Java/1.5.0_08 | 0 | 2009-11-12 07:17:53 |
| Java/1.6.0_03 | 0 | 2009-11-12 07:17:53 |
| Java/1.6.0_05 | 0 | 2009-11-12 07:17:53 |
| Java/1.6.0_10 | 0 | 2009-11-12 07:17:53 |
| Java/1.6.0_11 | 0 | 2009-11-12 07:17:54 |
| larbin_2.6.3 myemail@address.co.uk | 0 | 2009-11-12 07:17:54 |
| li_viewer larbin2.6.3@unspecified.mail | 0 | 2009-11-12 07:17:54 |
| Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; info@netcraft.com) | 0 | 2009-11-12 07:17:54 |
| Mozilla/5.0 (compatible; NetcraftSurveyAgent/1.0; +info@netcraft.com) | 0 | 2009-11-12 07:17:54 |
| Mozilla/5.0 (compatible;picmole/1.0 http://www.picmole.com) | 0 | 2009-11-12 07:17:54 |
| finalwave_aa larbin2.6.3@unspecified.mail | 0 | 2009-11-12 07:17:53 |
| al_viewer larbin2.6.3@unspecified.mail | 0 | 2009-11-12 07:17:52 |
| SBIder/SBIder-1.0 (http://www.sitesell.com/sbider.html) | 0 | 2009-11-12 05:43:33 |
| SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Crawler; http://www.similarpages.com; info at similarpages dot com) | 0 | 2009-11-12 05:43:33 |
| SimilarPages/Nutch-1.0-dev (SimilarPages Nutch Crawler; http://www.similarpages.com; info@similarpages.com) | 0 | 2009-11-12 05:43:33 |
| slurp, yahoo! slurp, slurp/2.0, inktomi slurp, slurp.so/1.0 | 0 | 2009-11-12 05:43:33 |
| SurveyBot/2.3 (Whois Source) | 0 | 2009-11-12 05:43:33 |
| W3C-checklink/4.5 [4.160] libwww-perl/5.823 | 0 | 2009-11-12 05:43:33 |
| wwwster/1.4 (Beta, mailto:gue@cis.uni-muenchen.de) | 0 | 2009-11-12 05:43:33 |
| Yandex/1.01.001 (compatible; Win16; H) | 0 | 2009-11-12 05:43:33 |
| Yandex/1.01.001 (compatible; Win16; I) | 0 | 2009-11-12 05:43:33 |
| Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/) | 0 | 2009-11-12 05:43:34 |
| Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/) | 0 | 2009-11-12 05:43:34 |
| msnbot/2.0b (+http://search.msn.com/msnbot.htm) | 0 | 2009-11-12 07:17:55 |
| page_viewer2 larbin2.6.3@unspecified.mail | 0 | 2009-11-12 07:17:55 |
| Gigabot/3.0 (http://www.gigablast.com/spider.html) | 0 | 2009-12-27 23:35:03 |
| ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com) | 0 | 2009-12-27 23:35:03 |
| Jyxobot/1 | 0 | 2009-12-27 23:35:04 |
| LG/U990/v1.0 | 0 | 2009-12-27 23:35:04 |
| Linguee Bot (bot@linguee.com) | 0 | 2009-12-27 23:35:04 |
| Linguee Bot (http://www.linguee.com/bot; bot@linguee.com) | 0 | 2009-12-27 23:35:04 |
| Neliveto/0.6 alpha (+http://www.m-brain.com/neliveto/ neliveto at m-brain.fi) | 0 | 2009-12-27 23:35:04 |
| sedo_parking_robot | 0 | 2009-12-27 23:35:04 |
| WinHttp | 0 | 2009-12-27 23:35:04 |
| W3C_Validator/1.654 | 0 | 2009-12-27 23:35:04 |
| Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/) | 0 | 2010-01-11 09:22:37 |
| Mediapartners-Google | 0 | 2009-12-27 23:24:41 |
| Mozilla/5.0 (Twiceler-0.9 http://www.cuil.com/twiceler/robot.html) | 0 | 2009-12-26 02:53:28 |
| page_test larbin2.6.3@unspecified.mail | 0 | 2009-11-12 07:17:55 |
| Python-urllib/1.17 | 0 | 2009-11-12 07:17:55 |
| temaseek.com/Nutch-1.0 (temaseek.com; crawler@temaseek.com) | 0 | 2009-11-12 07:17:55 |
| us_viewer larbin2.6.3@unspecified.mail | 0 | 2009-11-12 07:17:55 |
| us_web larbin2.6.3@unspecified.mail | 0 | 2009-11-12 07:17:56 |
| Wget/1.10.2 | 0 | 2009-11-12 07:17:56 |
| Wget/1.10.2 (Red Hat modified) | 0 | 2009-11-12 07:17:56 |
| Wget/1.11.4 Red Hat modified | 0 | 2009-11-12 07:17:56 |
| YandexSomething/1.0 | 0 | 2009-11-12 07:17:56 |
| Linguee Bot (http://www.linguee.com/bot) | 0 | 2009-12-11 00:16:09 |
| Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) | 0 | 2009-12-11 00:16:09 |
| +Doric 4x4 Testing | 0 | 2010-02-25 01:58:44 |
| 1 | 0 | 2009-11-12 05:19:45 |
| kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler) | 0 | 2009-11-12 05:19:47 |
| librabot/2.0 (+http://academic.research.microsoft.com/) | 0 | 2009-11-12 05:19:47 |
| LocalBot/1.1 (+http://www.localbot.co.uk/) | 0 | 2009-11-12 05:19:47 |
| Microsoft Data Access Internet Publishing Provider DAV 1.1 | 0 | 2009-11-12 05:19:47 |
| MLBot (www.metadatalabs.com/mlbot) | 0 | 2009-11-12 05:19:47 |
| Mozilla/4.0 (compatible; Vagabondo/4.0; webcrawler at wise-guys dot nl; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/) | 0 | 2009-11-12 05:19:47 |
| Mozilla/5.0 (compatible; 008/0.83; http://www.80legs.com/spider.html;) Gecko/2008032620 | 0 | 2009-11-12 05:19:47 |
| Mozilla/5.0 (compatible; arste.info_bot/1.1; +http://www.arste.info) | 0 | 2009-11-12 05:19:48 |
| Mozilla/5.0 (compatible; askpeter_bot/5.1; +http://countries.askpeter.info) | 0 | 2009-11-12 05:19:48 |
| Mozilla/5.0 (compatible; askpeter_bot/5.1; +http://www.askpeter.info) | 0 | 2009-11-12 05:19:48 |
| Mozilla/5.0 (compatible; Charlotte/1.0t; http://www.searchme.com/support/) | 0 | 2009-11-12 05:19:48 |
| hcsrnkB3vkqavawhgfooqrfsfyvub3nfak | 0 | 2009-11-12 05:19:47 |
| GingerCrawler/1.0 (Language Assistant for Dyslexics; www.gingersoftware.com/crawler_agent.htm; support at ginger software dot com) | 0 | 2009-11-12 05:19:47 |
| ; | 0 | 2009-11-12 05:19:45 |
| Abrave Spider v2.3 Robot 1 (http://robot.abrave.co.uk) | 0 | 2009-11-12 05:19:45 |
| Abrave Spider v2.3 Robot 6 (http://robot.abrave.co.uk) | 0 | 2009-11-12 05:19:45 |
| Abrave Spider v2.5 Robot 8 (http://robot.abrave.co.uk) | 0 | 2009-11-12 05:19:46 |
| Baiduspider+(+http://www.baidu.jp/spider/) | 0 | 2009-11-12 05:19:46 |
| BotTracer; (+http://www.informacja.pl) visited doric4x4.co.uk | 0 | 2009-11-12 05:19:46 |
| CatchBot/1.0; +http://www.catchbot.com | 0 | 2009-11-12 05:19:46 |
| CCBot/1.0 (+http://www.commoncrawl.org/bot.html) | 0 | 2009-11-12 05:19:46 |
| DataCha0s/2.0 | 0 | 2009-11-12 05:19:46 |
| Eurobot/1.1 (http://eurobot.ayell.eu) | 0 | 2009-11-12 05:19:46 |
| Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) | 0 | 2009-11-12 05:19:46 |
| Mozilla/5.0 (compatible; Charlotte/1.1; http://www.searchme.com/support/) | 0 | 2009-11-12 05:19:48 |
| Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html) | 0 | 2009-11-12 05:19:48 |
| Mozilla/5.0 (compatible; Plukkie/1.1; http://www.botje.com/plukkie.htm) | 0 | 2009-11-12 05:19:50 |
| Mozilla/5.0 (compatible; Plukkie/1.2; http://www.botje.com/plukkie.htm) | 0 | 2009-11-12 05:19:50 |
| Mozilla/5.0 (compatible; Yahoo! SearchMonkey 1.0; http://developer.yahoo.com/searchmonkey/useragent) | 0 | 2009-11-12 05:19:50 |
| Mozilla/5.0 (compatible; Yahoo! Slurp/3.0; http://help.yahoo.com/help/us/ysearch/slurp) | 0 | 2009-11-12 05:19:50 |
| Mozilla/5.0 (compatible; YesupBot/1.0; +http://www.yesup.net/bot.html) | 0 | 2009-11-12 05:19:50 |
| Mozilla/5.0 (compatible;picmole/1.0 +http://www.picmole.com) | 0 | 2009-11-12 05:19:51 |
| mseyeajmlrgjkkH ijtq | 0 | 2009-11-12 05:19:51 |
| nutch.us/Nutch-1.0 (nutch.us; crawler@nutch.us) | 0 | 2009-11-12 05:19:51 |
| psbot/0.1 (+http://www.picsearch.com/bot.html) | 0 | 2009-11-12 05:19:51 |
| renlifangbot/1.0 (+http://search.msn.com/msnbot.htm) | 0 | 2009-11-12 05:43:32 |
| robotgenius (http://robotgenius.net) | 0 | 2009-11-12 05:43:32 |
| Mozilla/5.0 (compatible; MJ12bot/v1.3.1; http://www.majestic12.co.uk/bot.php?+) | 0 | 2009-11-12 05:19:50 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.5; http://www.majestic12.co.uk/bot.php?+) | 0 | 2009-11-12 05:19:50 |
| Mozilla/5.0 (compatible; Dolphin/1.0; +http://tele-house.ru/crawler.html) | 0 | 2009-11-12 05:19:48 |
| Mozilla/5.0 (compatible; DotBot/1.1; http://www.dotnetdotcom.org/, crawler@dotnetdotcom.org) | 0 | 2009-11-12 05:19:48 |
| Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; GurujiBot/1.0; +http://www.guruji.com/en/WebmasterFAQ.html) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.accelobot.com) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.bl.uk/aboutus/stratpolprog/digi/domresproj/index.html) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; heritrix/1.14.3 +http://www.cs.ucl.ac.uk/staff/C.Raiciu/crawl.html) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; KaloogaBot; http://www.kalooga.com/info.html?page=crawler) | 0 | 2009-11-12 05:19:49 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.4; http://www.majestic12.co.uk/bot.php?+) | 0 | 2009-11-12 05:19:50 |
| SaladSpoon/ShopSalad 1.0 (Search Engine crawler for ShopSalad.com; http://shopsalad.com/en/partners.html; crawler@shopsalad.com) | 0 | 2009-11-12 05:43:32 |
| | | |
| Total | 0 | |
