Home Sign Up Sign In
bitkwan
V2EX  ›  问与答

MJ12bot 这个 bot 是干嘛的= =

  •   
  •   bitkwan · Feb 16, 2016 · 1632 views
    This topic created in 3777 days ago, the information mentioned may be changed or developed.
    151.80.41.169 - - [15/Feb/2016:13:12:14 +0800] "GET /robots.txt HTTP/1.0" 200 257 "-" "Mozilla/5.0 (compatible; MJ12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)"; -

    一天同一个页面爬好几次。

    google 上只找到说是 万维网搜索引擎研究项目
  • mj12bot
  • 万维网
  • 151.80.41.169
  • v1.4.5
    1 replies  •  2016-02-16 20:40:38 +08:00
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   791 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 27ms · UTC 21:32 · PVG 05:32 · LAX 14:32 · JFK 17:32
    ♥ Do have faith in what you're doing.