Sub Menu
Links Menu
Online Users

In total there are 315 users online :: 2 registered, 0 hidden and 313 guests

Most users ever online was 1091 on Wed Aug 16, 2023 5:27 pm

Registered users: Bing [Bot], Google [Bot] based on users active over the past 60 minutes

Adding CrawlTrack

Mods etc.

Moderator: Integra Moderator

Adding CrawlTrack

PostAuthor: CaNNon » Sun Oct 07, 2007 8:19 am

Your phpBB Version: 2.0.
phpBB Type: Standard phpBB
MODs: No
Your knowledge: Beginner
Board URL: [url]http://[/url]

PHP Version:
MySQL Version:


What was done before the problem appeared?



What was done to try to solve the problem?




De.scription and Message

This package is really something for working with robots. It's pretty much stand alone except for linking it to your install.

The edits are necessary in two files, due to the way the portal works. The site can be accessed from either file. So both should have your code inserted. The install info usually only mentions one though. The code to add is supplied in the install and except for the second location it's what i used.

Please note this needs to be the first code to run so you must place the edits at the start.

Portal.php

Code: Select all
//-- adding CrawlTracker ( location 1 ) ----------------------------------------------------$crawltsite=1;require_once("/your-site-path/your-crawltrack-folder/crawltrack.php");// end add




common.php

Code: Select all
//-- adding CrawlTracker ( location 2 ) ----------------------------------------------------$crawltsite=1;require_once("/your-site-path/your-crawltrack-folder/crawltrack.php");// end add


Link to site at the demo page [url=http]http]

I also have the security functions enabled, I thought there would be some conflicts with the 2 included packages in integramod but have found no problems.

From the way this is working I'm pretty sure it could be run with all integra versions as long as you meet the posted requirements

To use CrawlTrack you need a web hosting with:

-php version 4.3 minimum

-graphique library GD2 to be able to see the graphs

-one MySQL database, it needs its own it won't mess with others so you must be able to make and link to another.

* Edited with a better choice of second include
Last edited by CaNNon on Wed Nov 21, 2007 9:44 pm, edited 1 time in total.
Image
Image
User avatar
CaNNon
Sr Integra Member
Sr Integra Member
 
Posts: 750
Likes: 0 post
Liked in: 0 post
Joined: Thu Apr 19, 2007 11:15 am
Cash on hand: 0.00

Re: Adding CrawlTrack

PostAuthor: CaNNon » Mon Oct 08, 2007 7:04 am

I have submitted the edits, so now you can view the Integramod edits at:
[url=http]http://www.crawltrack.fr/doccms.php[/url]

If anyone tests this on other Integramod versions Please make sure your edits are submitted.
Last edited by CaNNon on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.
Image
Image
User avatar
CaNNon
Sr Integra Member
Sr Integra Member
 
Posts: 750
Likes: 0 post
Liked in: 0 post
Joined: Thu Apr 19, 2007 11:15 am
Cash on hand: 0.00

PostAuthor: richiebgood » Fri Oct 26, 2007 7:14 am

sorry, what does it do?
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

Re: Adding CrawlTrack

PostAuthor: CaNNon » Fri Oct 26, 2007 7:51 am

It allows you to do things like optimize the the way your found by search words.
It will keep track and allow you to pick the ones you get the most hits from.

Complete graphing of all the bot activity, our bot mod tracks like a dozen types of bots? other than allow or block them you can't work with it much. This tracks 100's and gives 5x more info. you need to know if a bot is moving tru a private area or has bad manners (not obeying your robots.txt) this will tell you. It also allows you to create test robots for your site to help you see what happening.

It also adds a small extra security package, if you would like PM me and I will give you a url/pass/user to look at a working one. you'll see everything except the tool page.
Last edited by CaNNon on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.
Image
Image
User avatar
CaNNon
Sr Integra Member
Sr Integra Member
 
Posts: 750
Likes: 0 post
Liked in: 0 post
Joined: Thu Apr 19, 2007 11:15 am
Cash on hand: 0.00

PostAuthor: richiebgood » Fri Oct 26, 2007 8:00 am

pretty cool, i saw the demo there alright.

And are all the bots added automatically i.e. ip ranges etc? or is there some maintenance with it?
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

Re: Adding CrawlTrack

PostAuthor: CaNNon » Fri Oct 26, 2007 8:22 am

No, you get updates from the mod site it's trough 2 buttons one does the bot updates and the other is security updates. That stuff is on the tool page and for security you won't get that access (if it's a working demo).

The demo is the same as you can allow for your users and pretty close to what you can show if you use the public viewing pages. this area could be added to your site and as it's using css I'm sure a little work and it could fit right in with any style sheet your using.
Last edited by CaNNon on Fri Oct 26, 2007 8:29 am, edited 1 time in total.
Image
Image
User avatar
CaNNon
Sr Integra Member
Sr Integra Member
 
Posts: 750
Likes: 0 post
Liked in: 0 post
Joined: Thu Apr 19, 2007 11:15 am
Cash on hand: 0.00

PostAuthor: richiebgood » Fri Oct 26, 2007 8:27 am

cool, i will add it to my 'to do' list of things i am doing to improve my site
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

PostAuthor: richiebgood » Thu Nov 15, 2007 6:50 pm

Installed it there now, the crawl tracker works but i got an error when adding tags to portal and index. Perhaps i have it done wrong.

Code: Select all
<?php//-- adding CrawlTracker ( location 2 ) ----------------------------------------------------$crawltsite=1;require_once("/crawltrack/crawltrack.php");// end add



Is it the full url to the crawl tracker folder needed?


*edit, i did not need the first '/', solved
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

Re: Adding CrawlTrack

PostAuthor: CaNNon » Thu Nov 15, 2007 6:59 pm

your site path is missing in front ---> /your-site-path/

yea the "/" would make it look off root instead off the working folder.
Last edited by CaNNon on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.
Image
Image
User avatar
CaNNon
Sr Integra Member
Sr Integra Member
 
Posts: 750
Likes: 0 post
Liked in: 0 post
Joined: Thu Apr 19, 2007 11:15 am
Cash on hand: 0.00

PostAuthor: richiebgood » Thu Nov 15, 2007 7:04 pm

do you mean the paintballer.ie bit?

all i have at the moment is 'crawltrack/crawltrack.php'

the url is http://www.paintballer.ie/crawltrack/crawltrack.php.

So is what i have correct?
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

Re: Adding CrawlTrack

PostAuthor: CaNNon » Thu Nov 15, 2007 7:10 pm

create a test robot, and see you may not need that?
Last edited by CaNNon on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.
Image
Image
User avatar
CaNNon
Sr Integra Member
Sr Integra Member
 
Posts: 750
Likes: 0 post
Liked in: 0 post
Joined: Thu Apr 19, 2007 11:15 am
Cash on hand: 0.00

PostAuthor: richiebgood » Thu Nov 15, 2007 7:24 pm

ok test robot is working.

In the admin index, is shows a google bot on the forum but that is not showing up on the crawltrack. Does the bot have to hit the portal or index in order to get registered?
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

Re: Adding CrawlTrack

PostAuthor: CaNNon » Thu Nov 15, 2007 7:27 pm

If the bot was on the site before the install it won't see it.
The bot would not have passed tru your additional code.
Last edited by CaNNon on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.
Image
Image
User avatar
CaNNon
Sr Integra Member
Sr Integra Member
 
Posts: 750
Likes: 0 post
Liked in: 0 post
Joined: Thu Apr 19, 2007 11:15 am
Cash on hand: 0.00

PostAuthor: richiebgood » Thu Nov 15, 2007 7:31 pm

i see. nice one, cheers for the help. I will report back in a few days.
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

PostAuthor: richiebgood » Sat Nov 17, 2007 5:11 am

Well i have had crawl track for a few days now and i think it is great. It showing up more bots and differienciating more bots that the acp/bots managment.

Here is my public stats: http://www.paintballer.ie/crawltrack
Last edited by richiebgood on Wed Dec 31, 1969 4:00 pm, edited 1 time in total.

richiebgood
Sr Integra Member
Sr Integra Member
 
Posts: 329
Likes: 0 post
Liked in: 0 post
Joined: Tue Aug 08, 2006 12:01 am
Cash on hand: 0.00
Location: Ireland

Next

Return to IntegraMOD Modifications

Who is online

Registered users: Bing [Bot], Google [Bot]

cron