jetNEXUS Homepage
Forum Home Forum Home > jetNEXUS Products > jetNEXUS ALB-X > flightPATH
  New Posts New Posts RSS Feed - SEO: detect search engines robots
  FAQ FAQ  Forum Search   Register Register  Login Login

SEO: detect search engines robots

 Post Reply Post Reply
Author
Message
softscrape View Drop Down
Newbie
Newbie
Avatar

Joined: 09 Mar 2011
Status: Offline
Points: 2
Post Options Post Options   Thanks (0) Thanks(0)   Quote softscrape Quote  Post ReplyReply Direct Link To This Post Topic: SEO: detect search engines robots
    Posted: 15 Mar 2011 at 7:04am
With power of flightPATH it's possible to detect spiders visits.
There are number of advantages to have that ability.

SEO masters can log such visits and use that info for SEO statistics.

SEO Masters may need to be notified about spiders visits immediately by e-mail.

Another powerful ability is you can provide different page to spider than to end user.
This page may have content optimised for Search Engines.

Following are sample rules:

[jetnexusdaemon-Path-15]
Desc="Log spider requests of popular search engines"
Name="Log Spider"

[jetnexusdaemon-Path-15-Condition-1]
Check="match"
Condition="header"
Match="User-Agent"
Sense="does"
Value="Gogglebot|Slurp|msnbot|ia_archiver"

[jetnexusdaemon-Path-15-Evaluate-4]
Detail="User-Agent"
Source="header"
Variable="$crawler$"

[jetnexusdaemon-Path-15-Function-1]
Action="log"
Target="[$crawler$] $host$$path$?$querystring$"

[jetnexusdaemon-Path-23]
Desc="Give a spider different page"
Name="Cheat Spider"

[jetnexusdaemon-Path-23-Condition-1]
Check="match"
Condition="header"
Match="User-Agent"
Sense="does"
Value="Gogglebot|Slurp|msnbot|ia_archiver"

[jetnexusdaemon-Path-23-Function-1]
Action="rewrite_path"
Target="$path$-seo.html"



Edited by softscrape - 17 Mar 2011 at 7:29am
Back to Top
What Lies Beneath View Drop Down
Newbie
Newbie


Joined: 12 Nov 2012
Location: UK
Status: Offline
Points: 11
Post Options Post Options   Thanks (0) Thanks(0)   Quote What Lies Beneath Quote  Post ReplyReply Direct Link To This Post Posted: 22 Nov 2012 at 11:13am
Hey Softscrape, do you have any more examples? I'm keen to learn more about flightPATH and I'd love to see more text examples if you have any please?
-Steve
Back to Top
What Lies Beneath View Drop Down
Newbie
Newbie


Joined: 12 Nov 2012
Location: UK
Status: Offline
Points: 11
Post Options Post Options   Thanks (0) Thanks(0)   Quote What Lies Beneath Quote  Post ReplyReply Direct Link To This Post Posted: 22 Nov 2012 at 3:38pm
It's OK, I worked it out.
-Steve
Back to Top
 Post Reply Post Reply
  Share Topic   

Forum Jump Forum Permissions View Drop Down

Forum Software by Web Wiz Forums® version 10.14
Copyright ©2001-2012 Web Wiz Ltd.

This page was generated in 0.063 seconds.