Project Computing - pageVault LogSummary program

Some sample outputs from the LogSummary program. Send your results to contact@projectcomputing.com along with a description of your web server (see examples below), and we'll add it here. You and your web site will remain unidentified (unless you explicitly request otherwise).

Directory

A large database generated site with 500,000 "pages", hundreds of new target pages added each day and most output generated via searches
A very large and busy site with significant searching activity.
A medium sized commercial site with many search queries.

Gallery

A large database generated site with 500,000 "pages", hundreds of new target pages added each day and most output generated via searches

Date Request Analyzed Same New Updated

Total Can't Parse Non 200 Count Vol
MB Count Vol Count Vol Count Vol

Num % MB % Num % MB % Num % MB %

12/Nov 21098 0 853 20245 137 14132 66 56 40 4715 22 63 46 1398 6 18 13

13/Nov 15166 0 419 14747 104 10264 67 50 48 3386 22 41 39 1097 7 13 12

14/Nov 16746 0 597 16149 105 12585 75 56 53 2672 15 36 34 892 5 13 12

15/Nov 13524 0 809 12715 87 9576 70 48 54 2199 16 29 33 940 6 10 11

16/Nov 1899 0 115 1784 20 1368 72 12 62 194 10 3 15 222 11 4 21

17/Nov 2589 0 191 2398 23 1900 73 15 64 285 11 4 19 213 8 4 16

18/Nov 22609 0 773 21836 135 16606 73 76 56 4009 17 42 31 1221 5 17 12

19/Nov 23243 0 804 22439 132 17605 75 79 59 3676 15 39 29 1158 4 14 10

20/Nov 21852 0 806 21046 147 15855 72 79 53 3839 17 44 30 1352 6 24 16

21/Nov 22276 0 758 21518 135 16702 74 80 59 3607 16 38 28 1209 5 17 12

22/Nov 20413 6 973 19434 109 15576 76 68 62 2814 13 28 25 1044 5 13 12

23/Nov 2232 0 120 2112 21 1411 63 12 56 441 19 5 25 260 11 4 17

24/Nov 2260 0 185 2075 19 1874 82 17 88 130 5 1 6 71 3 1 5

25/Nov 26294 0 650 25644 131 21505 81 89 68 3345 12 32 24 794 3 10 7

26/Nov 27087 0 1007 26080 155 20972 77 92 59 3793 14 46 29 1315 4 17 11

27/Nov 22159 0 687 21472 131 17351 78 87 66 3207 14 30 22 914 4 14 10

Commentary:

Many pages are personalised based on the user, and include other "non material" content (such as the current up-to-the-minute size of the database), which greatly inflates the "updated" volumes. In reality, actual updated content is very very low. Additionally, the "new" volumes are greatly inflated by the inclusion of pages generated by the site maintenance function (visible only to the site's maintainers), which would usually be excluded from the archive.

A very large and busy site with significant image and other searching activity.

Date Request Analyzed Same New Updated

Total Can't Parse Non 200 Count Vol
MB Count Vol Count Vol Count Vol

Num % MB % Num % MB % Num % MB %

25/Nov 435723 18 128427 307278 4013 243359 55 2247 56 56249 12 1539 38 7670 1 226 5

26/Nov 489577 40 140298 349239 4016 305239 62 2403 59 34893 7 1282 31 9107 1 332 8

27/Nov 441150 46 121562 319542 3342 293764 66 2423 72 20565 4 701 20 5213 1 218 6

28/Nov 425405 36 138954 286415 3324 265446 62 2339 70 17222 4 802 24 3747 0 183 5

29/Nov 369993 55 124419 245519 2767 222709 60 2006 72 19658 5 597 21 3152 0 165 5

Commentary:

Search results contribute most of the new and updated traffic. Many of the found items are images from a very large database of images. Many search results are incorrectly classified as "new" rather than "update". A significant number of "updates" are also bogus - they result from differences in HTTP 1.0 and HTTP 1.1 responses, not from actual content.

A medium sized commercial site with many search queries.

Date Request Analyzed Same New Updated

Total Can't Parse Non 200 Count Vol
MB Count Vol Count Vol Count Vol

Num % MB % Num % MB % Num % MB %

26/Nov/2002 15676 4 3069 12603 177 11695 74 139 78 12 0 0 0 896 5 39 21

27/Nov/2002 10344 0 2075 8269 133 7882 76 113 85 17 0 0 0 370 3 19 14

28/Nov/2002 5326 8 1209 4109 55 3991 74 49 88 1 0 0 0 117 2 6 11

29/Nov/2002 5639 0 1291 4348 56 4210 74 48 86 1 0 0 0 137 2 8 13

30/Nov/2002 5071 1 1089 3981 49 3893 76 44 90 3 0 0 0 85 1 5 9

01/Dec/2002 7760 1 1726 6033 81 5855 75 68 84 1 0 0 0 177 2 13 15

02/Dec/2002 15466 7 3329 12130 174 11791 76 158 90 3 0 0 0 336 2 16 9

03/Dec/2002 17067 4 2995 14068 196 13767 80 180 92 3 0 0 0 298 1 15 7

04/Dec/2002 14301 0 2913 11388 146 11137 77 133 90 2 0 0 0 249 1 14 9

05/Dec/2002 14688 8 2927 11753 164 11524 78 149 91 3 0 0 0 226 1 14 8

06/Dec/2002 11600 1 2256 9343 136 9181 79 125 92 0 0 0 0 162 1 11 7

07/Dec/2002 5288 0 1123 4165 53 4102 77 50 94 0 0 0 0 63 1 3 5

08/Dec/2002 6792 1 1317 5474 71 5380 79 65 91 0 0 0 0 94 1 6 8

09/Dec/2002 13923 1 2789 11133 152 10945 78 142 93 5 0 0 0 183 1 10 6

10/Dec/2002 16538 2 3620 12916 182 12690 76 173 95 13 0 1 0 213 1 9 4

11/Dec/2002 14359 0 3184 11175 140 10996 76 130 93 6 0 0 0 173 1 10 6

Commentary:

Most of the traffic to this site is POSTed search queries, to a relatively small database, so the number of URL's is very small.