ããžãã¹ã®ãªã³ã©ã€ã³æåã«ã¯ãæ€çŽ¢ãšã³ãžã³æé©åïŒSEOïŒãæ¬ ãããŸããããããããµã€ããæ€çŽ¢ãšã³ãžã³ã«æ£ããèªèãããããã«ã¯ãrobots.txtã®èšå®ãéèŠã§ãããã®å°ããªãã¡ã€ã«ããã©ã®ããã«ããªãã®ãµã€ããžã®ã¢ã¯ã»ã¹ãå¶åŸ¡ããSEOãžã®åœ±é¿ãäžããã®ããç解ããããšã¯ããµã€ãã®å¯èŠæ§ãé«ããäžã§å¿ é ã§ããä»åã¯ãã®èšå®æ¹æ³ãšSEOã«ããããã®åœ¹å²ãæ·±æãããããžãã¹ããŒãœã³ãæŒãããã¹ãç¹ãæ確ã«ããŸããã¯ããŒã«ã®ä»çµã¿ãé©åãªèšå®æ¹æ³ããããŠæé©åãã¯ããã¯ãéããŠããµã€ãã®æ€çŽ¢ã©ã³ãã³ã°åäžã«ã€ãªããç¥èãæäŸããŸãããŸãããã©ãã«ã·ã¥ãŒãã£ã³ã°ãå®éã®äºäŸãåãäžããç¶ç¶çãªç®¡çã®éèŠæ§ã«ã觊ããŸããSEO察çãšããŠã®robots.txtã®ç解ãæ·±ããããžãã¹ã®æé·ã«åœ¹ç«ãŠãŸãããã
robots.txtãšã¯ïŒåºç€ç¥è
robots.txtãã¡ã€ã«ã¯ããŠã§ããµã€ãã®ã«ãŒããã£ã¬ã¯ããªã«é 眮ãããæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ããµã€ãã®ç¹å®éšåãã€ã³ããã¯ã¹äœæããªãããã«æ瀺ãã圹å²ãæã£ãŠããŸãããã®ãã¡ã€ã«ãéããŠããŠã§ããµã€ã管çè ã¯ã©ã®ããŒãžãæ€çŽ¢çµæã«è¡šç€ºãããããäžå®çšåºŠã³ã³ãããŒã«ã§ããããã«ãªããŸãã
robots.txtã®ç®ç
robots.txtãã¡ã€ã«ã®äž»ãªç®çã¯ããŠã§ããµã€ãäžã®ç¹å®ã®ã³ã³ãã³ããæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ããé ãããšã§ããããã«ããããã©ã€ããŒãæ å ±ãéè€ããã³ã³ãã³ããéçºäžã®ããŒãžãªã©ãäžè¬å ¬éãæãŸãªãã³ã³ãã³ããã€ã³ããã¯ã¹ããé€å€ã§ããŸãã
ãŸãããã®ãã¡ã€ã«ãå©çšããããšã§ããµãŒããŒã®è² è·ãæžå°ãããããšãå¯èœã§ããäžèŠãªã¯ããŒãªã³ã°ãé²ãããšã«ããããµãŒããŒã®ãªãœãŒã¹ãå¹ççã«äœ¿çšã§ããããã«ãªããŸãã
ããã«ãæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ããµã€ãã®éèŠãªéšåãåªå çã«ã€ã³ããã¯ã¹äœæããããå°ãããšãã§ããŸããããã«ããããŠã§ããµã€ãã®SEOããã©ãŒãã³ã¹ãåäžããŸãã
ã©ã®ããã«æ©èœããã
æ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ã¯éåžžããŠã§ããµã€ãã蚪ããéã«æåã«robots.txtãã¡ã€ã«ããã§ãã¯ããŸãããã®ãã¡ã€ã«ã«ã¯ãã¯ããŒã©ã«å¯Ÿããæ瀺ãæžãããŠããããŠã§ããµã€ãäžã®ã©ã®é åãã¯ããŒã«ããŠãããããŸãã¯ã¯ããŒã«ãã¹ãã§ã¯ãªãããå®çŸ©ãããŠããŸãã
robots.txtãã¡ã€ã«ã¯ã”User-agent”ãš”Disallow”ã®äºã€ã®äž»èŠãªãã£ã¬ã¯ãã£ããçšããŠã¯ããŒã©ãžã®æ瀺ãèšè¿°ããŸãã”User-agent”ãã£ã¬ã¯ãã£ãã¯ãæ瀺ã®å¯Ÿè±¡ãšãªãã¯ããŒã©ãæå®ããããã«äœ¿çšããã”Disallow”ãã£ã¬ã¯ãã£ãã¯ã¯ããŒã«ãçŠæ¢ãããã¹ãæå®ããŸãã
ããããrobots.txtãã¡ã€ã«ã®æ瀺ã¯åŒ·å¶åãæã€ãã®ã§ã¯ãªããè¯å¿ã«åºã¥ããã®ã§ãããããã£ãŠããã¹ãŠã®ã¯ããŒã©ãããã«åŸããšã¯éããªããããæ©å¯æ å ±ã¯å¥ã®æ¹æ³ã§ä¿è·ããããšãéèŠã§ãã
robots.txtãã¡ã€ã«ã®éèŠæ§
robots.txtãã¡ã€ã«ãé©åã«èšå®ããããšã§ãæ€çŽ¢ãšã³ãžã³ã«ãŠã§ããµã€ãã®ã©ã®éšåãã¯ããŒã«ããŠã»ãããããŸãã¯ã¯ããŒã«ããŠã»ãããªãããå¹æçã«äŒããããšãã§ããŸããããã«ãããSEOæŠç¥ã®äžç°ãšããŠããŠã§ããµã€ãã®å¯èŠæ§ãé«ããããšãå¯èœã«ãªããŸãã
ãŸããäžèŠãªããŒãžããªãœãŒã¹ã®ã¯ããŒãªã³ã°ãé²ãããšã§ããµãŒããŒã®ãªãœãŒã¹ãä¿è·ãããŠã§ããµã€ãã®ããã©ãŒãã³ã¹ãåäžãããããšãã§ããŸããããã¯ãç¹ã«å€§èŠæš¡ãªãµã€ããé«ããã©ãã£ãã¯ãæã€ãµã€ãã«ãšã£ãŠéèŠã§ãã
ããã«ãé©åãªrobots.txtãã¡ã€ã«ã®äœ¿çšã¯ããŠã§ããµã€ãã®ã¯ããŒã«äºç®ã®æé©åã«ãç¹ãããŸããæ€çŽ¢ãšã³ãžã³ãéèŠã§ãªãããŒãžã®ã¯ããŒãªã³ã°ã«æéãè²»ãããã«æžããããããéèŠãªã³ã³ãã³ããéããã«ã€ã³ããã¯ã¹ãããå¯èœæ§ãé«ããªããŸãã
äžè¬çãªèª€è§£ãšæ³šæç¹
robots.txtãã¡ã€ã«ã«é¢ããäžè¬çãªèª€è§£ã®äžã€ã¯ããã®ãã¡ã€ã«ããŠã§ããµã€ãã®ã»ãã¥ãªãã£ã匷åãããã®ã ãšèããããšã§ããããããå®éã«ã¯ãrobots.txtãã¡ã€ã«ã¯æ å ±ãå ¬éãããã®ã§ãããæ©å¯æ å ±ãä¿è·ããããã®ãã®ã§ã¯ãããŸããã
ãŸããrobots.txtãã¡ã€ã«ã®èšå®ãã¹ã«ãããéèŠãªããŒãžãæ€çŽ¢çµæããé€å€ãããŠããŸããªã¹ã¯ããããŸãããã®ããããã¡ã€ã«ãæŽæ°ããéã«ã¯æ éã«è¡ããå€æŽåŸã¯å¹æãå®æçã«ç¢ºèªããããšãéèŠã§ãã
ããã«ãrobots.txtãã¡ã€ã«ãæ€çŽ¢ãšã³ãžã³ã«ãã£ãŠå®å šã«å°éããããšã¯éããªãããšãç解ããŠããããšãéèŠã§ããæªæã®ããã¯ããŒã©ã¯ãããç¡èŠããããšããããŸãã®ã§ãã»ãã¥ãªãã£å¯Ÿçã¯ãã¡ã€ã«ã®èšå®ãè¶ ããã¬ãã«ã§è¡ãå¿ èŠããããŸãã
SEOã«ãããrobots.txtã®åœ¹å²
æ€çŽ¢ãšã³ãžã³ããµã€ããã¯ããŒã«ããä»çµã¿
æ€çŽ¢ãšã³ãžã³ã«ãããµã€ãã®ã¯ããŒã«ãšã¯ãWebäžã®æ å ±ãèªåçã«æ€çŽ¢ãåéããããã»ã¹ã®ããšãæããŸãããã®ããã»ã¹ãéããŠããŠã§ãããŒãžãããŒã¿ããŒã¹ã«ä¿åãããæ€çŽ¢çµæãšããŠãŠãŒã¶ãŒã«è¡šç€ºãããããã«ãªããŸããrobots.txtãã¡ã€ã«ã¯ããã®ã¯ããŒãªã³ã°ããã»ã¹ã«ãããéèŠãªã¬ã€ããšãªããŸãã
ã¯ããŒã©ãŒïŒãŸãã¯ã¹ãã€ããŒïŒã¯ãrobots.txtãã¡ã€ã«ãå©çšããŠããµã€ãææè ãæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒãªã³ã°ãèš±å¯ããããŒãžãšæåŠããããŒãžãå€æããŸãããããã£ãŠãrobots.txtãã¡ã€ã«ã®èšå®ã¯ããµã€ããã©ã®ããã«ã¯ããŒãªã³ã°ãããããçŽæ¥çã«ã³ã³ãããŒã«ããŸãã
æ£ããèšå®ãããrobots.txtã¯ãã¯ããŒã©ãŒãéèŠãªã³ã³ãã³ããèŠã€ããããããããšã§ããµã€ãã®SEOå¹æãæ倧åããŸãã
robots.txtãæ€çŽ¢çµæã«äžãã圱é¿
robots.txtãã¡ã€ã«ã¯ãæ€çŽ¢ãšã³ãžã³ã«å¯ŸããŠãã©ã®ããŒãžãã¯ããŒã«ããã¹ãããã©ã®ãªãœãŒã¹ãç¡èŠããã¹ãããæ瀺ããŸããããã«ããããµã€ãã®æ§é ãéèŠåºŠãæ€çŽ¢ãšã³ãžã³ã«äŒãããæ€çŽ¢çµæã«ããã衚瀺ãæé©åãããŸãã
ãŸããç¡é¢ä¿ãŸãã¯éè€ããã³ã³ãã³ãã®ã¯ããŒã«ãå¶éããããšã§ãæ€çŽ¢ãšã³ãžã³ã®ãªãœãŒã¹ãç¯çŽãããã䟡å€ã®ããããŒãžã匷調衚瀺ããããšãå¯èœã«ãªããŸããããã«ããããŠã§ããµã€ãã®æ€çŽ¢ã©ã³ãã³ã°ãåäžããå¯èœæ§ããããŸãã
ãã ããèšå®ã®èª€ãã¯éå¹æã«ãªãå ŽåããããŸããéèŠãªã³ã³ãã³ããã¯ããŒã«ãããªãããã«èšå®ããŠããŸããšãæ€çŽ¢çµæããé€å€ãããå¯èœæ§ãããããã泚æãå¿ èŠã§ãã
æ£ããèšå®ã§éæã§ããSEOã®æ¹å
robots.txtã®æ£ããèšå®ã¯ããŠã§ããµã€ãã®SEOããã©ãŒãã³ã¹ãåäžãããéµãšãªããŸããç¹å®ã®ããŒãžããªãœãŒã¹ãæ€çŽ¢ãšã³ãžã³ããé ãããšã§ãããé¢é£æ§ã®é«ãã³ã³ãã³ãã«çŠç¹ãåœãŠãããšãã§ããŸãã
äŸãã°ããã°ã€ã³ããŒãžã管çããŒãžãªã©ããŠãŒã¶ãŒã«ãšã£ãŠäŸ¡å€ãäœããšèããããããŒãžãã¯ããŒã«ããé€å€ããããšã§ãããéèŠãªããŒãžã«ãªãœãŒã¹ãéäžãããããšãå¯èœã§ããããã«ãã£ãŠãæ€çŽ¢ãšã³ãžã³ã®ã€ã³ããã¯ã¹ã®è³ªãåäžããæ€çŽ¢ã©ã³ãã³ã°ãé«ãŸããŸãã
ãŸãããµã€ããããã®URLãrobots.txtãã¡ã€ã«ã«å«ããããšã§ãã¯ããŒã©ãŒããµã€ãã®æ§é ãããå¹ççã«ç解ããéèŠãªããŒãžãèŠéããªãããã«ããããšãã§ããŸãã
ããã«ãã£ã®åé¿
誀ã£ãrobots.txtã®èšå®ã¯ãæ€çŽ¢ãšã³ãžã³ããã®ããã«ãã£ãåŒãèµ·ãããªã¹ã¯ãæã¡ãŸããç¹ã«ãéèŠãªã³ã³ãã³ããå ¬éãã¹ãããŒãžã誀ã£ãŠãããã¯ããŠããŸããšããµã€ãã®æ€çŽ¢ã©ã³ãã³ã°ã«å€§ããªæªåœ±é¿ãåãŒãå¯èœæ§ããããŸãã
ããã«ããã¯ããŒãªã³ã°ãããªãããã«ããšæå³çã«èšå®ããå Žåã§ããæ€çŽ¢ãšã³ãžã³ãèªèãã䟡å€ã®ããã³ã³ãã³ããé ããŠãããšã¿ãªããããµã€ãå šäœã®è©äŸ¡ãäœäžããããšããããŸãã
åŸã£ãŠãrobots.txtã®èšå®ã¯æ éã«è¡ããå®æçã«ã¬ãã¥ãŒããããšãéèŠã§ãããŸããæ€çŽ¢ãšã³ãžã³ã®ã¬ã€ãã©ã€ã³ã«åŸããããã«ãã£ãé¿ããããã«æé©ãªå®è·µãæ¡çšããããšãæšå¥šãããŸãã
robots.txtã®èšå®æ¹æ³
robots.txtãã¡ã€ã«ã®äœæ
robots.txtãã¡ã€ã«ã¯ãæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒã«å¯Ÿãããµã€ãå ã®ã©ã®ããŒãžãã¯ããŒã«ãã¹ããããŸãã¯é¿ããã¹ãããæ瀺ããããã®ããã¹ããã¡ã€ã«ã§ãããŸãããµãŒããŒã®ã«ãŒããã£ã¬ã¯ããªã«ãrobots.txtããšããååã®ããã¹ããã¡ã€ã«ãäœæããŸãããããå šãŠã®èšå®ã®åºç€ãšãªããŸãã
ãã®ãã¡ã€ã«ã¯åçŽãªããã¹ããã¡ã€ã«ã§ãããããã©ããªããã¹ããšãã£ã¿ã§ãäœæã§ããŸããããããæ§æãæ£ããããšã確èªããããšãéèŠã§ãã誀ã£ãæ§æã¯ãæå³ããªãããŒãžãã¯ããŒã©ãŒã«ãã£ãŠã€ã³ããã¯ã¹ãããåå ãšãªãããŸãã
ãã¡ã€ã«ãäœæããããããŸãã¯ãã®ãã¡ã€ã«ããŠã§ãäžã§ã¢ã¯ã»ã¹å¯èœã§ããããšã確èªããŸããããéåžžã¯ãhttp://www.yourdomain.com/robots.txtãã®ããã«å ¥åããŠã¢ã¯ã»ã¹ã§ããã¯ãã§ããããã§ã¯ããŒã©ãŒããã®ãã¡ã€ã«ãåç §ã§ããããã«ãªããŸãã
ãŠãŒã¶ãŒãšãŒãžã§ã³ãã®æå®
robots.txtãã¡ã€ã«å ã§æåã«è¡ãã¹ãããšã¯ãã©ã®æ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒã«æ瀺ãåºãããæå®ããããšã§ããããã¯ãUser-agentããšãããã£ã¬ã¯ãã£ãã䜿ã£ãŠè¡ããŸããå šãŠã®ã¯ããŒã©ãŒã«å¯ŸããŠæ瀺ãåºãå Žåã¯ãUser-agent: *ããšèšè¿°ããŸããç¹å®ã®ã¯ããŒã©ãŒã®ã¿ãæå®ããããšãå¯èœã§ãã
äŸãã°ãGoogleã®ã¯ããŒã©ãŒã®ã¿ã察象ã«ãããå ŽåããUser-agent: Googlebotããšæå®ããŸããããã«ãããèšè¿°ãããã£ã¬ã¯ãã£ãã¯Googlebotã«ã®ã¿é©çšãããä»ã®æ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒã«ã¯åœ±é¿ãäžããŸããã
ç°ãªãã¯ããŒã©ãŒã«å¯ŸããŠç°ãªãæ瀺ãåºãããå Žåã¯ãããããã®ãUser-agentããã£ã¬ã¯ãã£ãã«ç¶ããŠãé©çšãããæ瀺ãèšè¿°ããŸããããã«ããããµã€ãã®ç¹å®ã®éšåãç¹å®ã®ã¯ããŒã©ãŒããé ãããšãå¯èœã«ãªããŸãã
èš±å¯ãšçŠæ¢ã®ãã£ã¬ã¯ãã£ã
robots.txtãã¡ã€ã«ã䜿ã£ãŠãã¯ããŒã©ãŒã«å¯Ÿãç¹å®ã®ãã£ã¬ã¯ããªããã¡ã€ã«ãžã®ã¢ã¯ã»ã¹ãèš±å¯ãŸãã¯çŠæ¢ããããšãã§ããŸããããã¯ãDisallowããšãAllowãã®äºã€ã®ãã£ã¬ã¯ãã£ãã䜿çšããŠè¡ããŸãããDisallowãã¯ç¹å®ã®URLã®ã¯ããŒã«ãçŠæ¢ããŸããããAllowãã¯ç¹å®ã®URLãžã®ã¢ã¯ã»ã¹ãèš±å¯ããŸãã
äŸãã°ãããªãã®ãµã€ãã®ç¹å®ã®ãã£ã¬ã¯ããªã«å人æ å ±ãå«ãŸããŠãããæ€çŽ¢ãšã³ãžã³ã«ã€ã³ããã¯ã¹ãããããªãå Žåããã®ãã£ã¬ã¯ããªã®ãã¹ããDisallowããã£ã¬ã¯ãã£ãã«èšè¿°ããããšã§ãã¢ã¯ã»ã¹ãçŠæ¢ã§ããŸããéã«ãå šãŠãçŠæ¢ããäžã§ç¹å®ã®ãã¡ã€ã«ã®ã¿ãèš±å¯ãããå Žåã¯ããAllowããã£ã¬ã¯ãã£ãã䜿çšããŸãã
éèŠãªã®ã¯ããããã®ãã£ã¬ã¯ãã£ãããUser-agentããã£ã¬ã¯ãã£ããšçµã¿åãããŠäœ¿çšãããå Žåããã®é åºã圱é¿ãäžãããšããããšã§ããäžè¬çã«ã¯ããAllowããã£ã¬ã¯ãã£ããå ã«èšè¿°ãããã®åŸã«ãDisallowããã£ã¬ã¯ãã£ããèšè¿°ããã®ãè¯ããšãããŠããŸãã
ãµã€ããããã®è¿œå
æåŸã«ãrobots.txtãã¡ã€ã«ã«ãµã€ãããããžã®ãªã³ã¯ãè¿œå ããããšãå¿ããªãã§ãã ããããµã€ããããã¯ããµã€ãã«å«ãŸããå šãŠã®ããŒãžããªã¹ãã¢ããããæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒããµã€ããããå¹ççã«ã¯ããŒã«ã§ããããã«ããXMLãã¡ã€ã«ã§ãã
ãµã€ãããããè¿œå ããã«ã¯ããSitemap:ããšãããã£ã¬ã¯ãã£ãã䜿çšããŸããããã«ç¶ããŠããµã€ããããã®URLãèšè¿°ããŸããäŸãã°ããSitemap: http://www.yourdomain.com/sitemap.xmlããšèšè¿°ããããšã§ãæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒã¯ãã®URLãããµã€ãããããèŠã€ãããµã€ãã®æ§é ãããæ·±ãç解ããããšãã§ããŸãã
ãµã€ããããã®è¿œå ã¯ããµã€ãå ã®å šãŠã®éèŠãªããŒãžãæ€çŽ¢ãšã³ãžã³ã«ãã£ãŠèŠã€ãããã確çãé«ããŸããç¹ã«å€§ããªãµã€ãããã³ã³ãã³ããé »ç¹ã«æŽæ°ãããµã€ãã§ã¯ããã®ã¹ããããã¯ããŒã©ããªãã£ãšã€ã³ããã¯ã¹äœæã«å€§ããè²¢ç®ããŸãã
robots.txtã®æé©åãã¯ããã¯
æ€çŽ¢ãšã³ãžã³æé©åïŒSEOïŒã®èŠ³ç¹ãããrobots.txtãã¡ã€ã«ã®é©åãªç®¡çãšèšå®ã¯éèŠãªåœ¹å²ãæãããŸãããã®ãã¡ã€ã«ãéããŠããŠã§ããµã€ãã®ã©ã®éšåãã¯ããŒã«ãããã©ã®éšåãé€å€ããããæ€çŽ¢ãšã³ãžã³ã«äŒããããšãã§ããŸãã以äžã®ãã¯ããã¯ãçšããããšã§ããµã€ãã®SEOå¹æãæ倧åããæ€çŽ¢çµæã§ã®ã©ã³ãã³ã°åäžãç®æããŸãã
ã¯ããŒã«äºç®ã®ç®¡ç
ã¯ããŒã«äºç®ãšã¯ãæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒãããªãã®ãµã€ãã蚪åããŠã€ã³ããã¯ã¹ãäœæããéã«è²»ãããªãœãŒã¹ã®éãæããŸããé©åãªrobots.txtã®èšå®ã«ãã£ãŠãéèŠãªã³ã³ãã³ããžã®ã¢ã¯ã»ã¹ãåªå ãããã¯ããŒã«äºç®ã®ç¡é§é£ããé²ããŸãã
å ·äœçã«ã¯ãæŽæ°é »åºŠã®äœãããŸãã¯SEOäžã®äŸ¡å€ãäœããšå€æãããããŒãžïŒäŸ: ãã°ã€ã³ããŒãžã管çããŒãžãªã©ïŒãDisallowæ什ãçšããŠã¯ããŒã©ãŒã®ã¢ã¯ã»ã¹ããé€å€ããŸãããã®ããã«ããããšã§ãããéèŠãªã³ã³ãã³ãã«ã¯ããŒã«äºç®ãéäžãããµã€ãå šäœã®æçšæ§ãåäžããŸãã
ãŸãããµã€ããããã®URLãrobots.txtãã¡ã€ã«å ã§æå®ããããšã«ãããã¯ããŒã©ãŒããµã€ãã®æ§é ãããå¹ççã«ç解ããã¯ããŒã«äºç®ãæå¹æŽ»çšããããšãã§ããŸãã
éè€ã³ã³ãã³ãã®ç®¡ç
éè€ã³ã³ãã³ãåé¡ã¯SEOã«ãããŠãã€ãã¹ã®åœ±é¿ãåãŒãå¯èœæ§ããããŸããrobots.txtãã¡ã€ã«ã䜿çšããŠãæ€çŽ¢ãšã³ãžã³ã«ããç¹å®ã®ã³ã³ãã³ãé åã®ã¯ããŒã«ãå¶éããããšã§ãéè€ã³ã³ãã³ãã®åé¡ãå¹æçã«ç®¡çã§ããŸãã
äŸãã°ãããªã³ãçšããŒãžãããŒãžå ã®ç¹å®ã®ã³ã³ãã³ããã¡ã€ã³ã³ã³ãã³ããšéè€ããå Žåããã®URLãDisallowæ什ãçšããŠã¯ããŒã«ããæé€ããŸããããã«ãããéè€ã³ã³ãã³ãã«ããããã«ãã£ã®ãªã¹ã¯ãæžããããšãã§ããŸãã
éè€ããã³ã³ãã³ãã¯ããµã€ãå ã§ã®ã©ã³ã¯åãã«ã圱é¿ãåãŒããããéè€ã³ã³ãã³ãã®å¯èœæ§ã®ããããŒãžã¯æ éã«ç®¡çããããšãå¿ èŠã§ãã
åçã³ã³ãã³ããšã®å¯Ÿå¿
åçã«çæãããã³ã³ãã³ãã¯ãç¹ã«å€§èŠæš¡ãªãµã€ããEã³ããŒã¹ãµã€ãã«ãããŠããèŠãããæ§é ã§ããrobots.txtã®èšå®ãé©åã«è¡ãããšã§ãæ€çŽ¢ãšã³ãžã³ãæå³ããªãåçã³ã³ãã³ããã¯ããŒã«ããã®ãé²ããŸãã
URLãã©ã¡ãŒã¿ã«ãã£ãŠçæãããéè€ã³ã³ãã³ããããŠãŒã¶ãŒäœéšã«ã¯äžèŠãªåçããŒãžããrobots.txtã§ã¯ããŒã«ããé€å€ããããšãå¯èœã§ãããã®ææ³ã«ãããæ€çŽ¢ãšã³ãžã³ããµã€ãã®äž»èŠãªã³ã³ãã³ãã«çŠç¹ãåœãŠãããšãã§ããã€ã³ããã¯ã¹ã®è³ªãåäžããŸãã
åçã³ã³ãã³ãã®èšå®ã¯è€éã«ãªãããšãããããããã¹ããšç£èŠãå®æçã«è¡ããSEOãžã®åœ±é¿ãæå°éã«æããããšãéèŠã§ãã
ã¢ãã€ã«ãšãã¹ã¯ãããã®åºå¥
ã¢ãã€ã«ãã¡ãŒã¹ãã®ã€ã³ããã¯ã¹ãæšæºã«ãªã£ãŠããçŸåšãã¢ãã€ã«ãšãã¹ã¯ãããã®ã³ã³ãã³ããé©åã«åºå¥ããããšã¯éåžžã«éèŠã§ããrobots.txtãã¡ã€ã«ãéããŠãã¢ãã€ã«çšãšãã¹ã¯ãããçšã®ããŒãžãé©åã«ã¯ããŒã«ãããããšãããµã€ãã®SEOããã©ãŒãã³ã¹ã«çŽæ¥åœ±é¿ãäžããŸãã
äŸãã°ãã¢ãã€ã«ãŠãŒã¶ãŒã«ç¹åããããŒãžãããå Žåããã®ããŒãžã®URLãã¢ãã€ã«çšã®ã¯ããŒã©ãŒã®ã¿ãã¢ã¯ã»ã¹ã§ããããã«èšå®ããŸããéã«ããã¹ã¯ãããå°çšã®ã³ã³ãã³ãã¯ãã¹ã¯ãããã®ã¯ããŒã©ãŒã®ã¿ãã¢ã¯ã»ã¹ã§ããããã«èª¿æŽããããšãæãŸããã§ãã
ãã®ããã«ããŠãã¢ãã€ã«ãšãã¹ã¯ãããã®ããããã«é©ããã³ã³ãã³ããæäŸãã€ã€ãã¯ããŒã«äºç®ã®æå¹å©çšãå³ãããšãããµã€ãå šäœã®æ€çŽ¢å¯Ÿè±¡æ§ã®åäžã«ã€ãªãããŸãã
robots.txtã®ãã¹ããšãã©ãã«ã·ã¥ãŒãã£ã³ã°
robots.txtãã¡ã€ã«ã¯Webãµã€ãã®SEOããã©ãŒãã³ã¹ã«ãããŠéèŠãªåœ¹å²ãæãããŸããé©åãªèšå®ãšç¶ç¶çãªç£èŠã¯ãæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒããµã€ããç解ããã€ã³ããã¯ã¹åããã®ã«åœ¹ç«ã¡ãŸãããã®ã»ã¯ã·ã§ã³ã§ã¯ãrobots.txtã®èšå®åŸã®ãã¹ãæ¹æ³ãããããèšå®ãã¹ãšãã®ä¿®æ£ãå€æŽåŸã®åœ±é¿ç£èŠã«ã€ããŠè§£èª¬ããŸãã
Google Search Consoleã䜿ã£ããã¹ã
Google Search Consoleã¯ãrobots.txtãã¡ã€ã«ã®ãã¹ãã«éåžžã«æçšãªããŒã«ã§ãããã®ããŒã«ã§ã¯ãç¹å®ã®URLãGooglebotã«ãã£ãŠã¯ããŒã«ããããã©ããããã¹ãããããšãã§ããŸãã
ãã¹ããè¡ãã«ã¯ããŸãGoogle Search Consoleã«ãã°ã€ã³ããããµã€ãããããã»ã¯ã·ã§ã³ãéããŸãããã®åŸããrobots.txtãã¹ã¿ãŒããéžæãããã¹ããããURLãå ¥åããŸãããã¹ãçµæã確èªããŠãURLãé©åã«ã¯ããŒã«ãããŠãããã©ããã確èªããŠãã ããã
åé¡ãããå Žåã¯ããã¹ã¿ãŒãå ·äœçãªåé¡ç®æãææããŠããããããè¿ éã«ä¿®æ£ãè¡ãããšãã§ããŸãã
ããããèšå®ãã¹ãšãã®ä¿®æ£
robots.txtã®èšå®ã«ãããŠãããããã¹ã«ã¯ãã¯ããŒã«ãå®å šã«ãããã¯ãããŠããŸããDisallow: /ãã®èª€äœ¿çšããç¹å®ã®ã¯ããŒã©ãŒã®ã¿èš±å¯ãããå Žåã«ãAllowãåœä»€ã誀çšããããšããããŸãã
ãããã®ãã¹ã¯ãããŒã±ãã£ã³ã°ãSEOã®åªåãç¡é§ã«ããŠããŸãããšããããŸããèšå®ãã¹ãä¿®æ£ããã«ã¯ããŸãrobots.txtãã¡ã€ã«ãéããå ·äœçãªåœä»€ãæ£ç¢ºãã©ããã確èªããŠãã ãããå¿ èŠã«å¿ããŠãäžé©åãªåœä»€ãåé€ãŸãã¯ä¿®æ£ãããµã€ãã®ã¯ããŒã«ãé©åã«å¶åŸ¡ããŠãã ããã
ä¿®æ£åŸã«ã¯ãGoogle Search Consoleã䜿çšããŠåãã¹ãããå€æŽãé©åã«åæ ãããŠããããšã確èªããŠãã ããã
å€æŽåŸã®åœ±é¿ã®ç£èŠ
robots.txtã®èšå®ãå€æŽããåŸã¯ããã®åœ±é¿ãç¶ç¶çã«ç£èŠããããšãéèŠã§ããå€æŽãæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒã«æ£ããäŒããããµã€ãã®ã€ã³ããã¯ã¹åã«åœ±é¿ãäžããŠããªããã確èªããå¿ èŠããããŸãã
Google Search Consoleã®ãã¯ããŒã«çµ±èšãã»ã¯ã·ã§ã³ãå©çšãããšãã¯ããŒã«ã®åæ°ãã¯ããŒã«ãããããŒãžã®æ°ãªã©ãéèŠãªããŒã¿ã確èªããããšãã§ããŸããããã«ãããå€æŽããµã€ãã®ããã©ãŒãã³ã¹ã«ããžãã£ããªåœ±é¿ãäžããŠãããããŸãã¯èª¿æŽãå¿ èŠãã©ãããå€æããããšãå¯èœã§ãã
å€æŽãåå ã§åé¡ãçºçããå Žåã¯ãçŽã¡ã«å ã®ç¶æ ã«æ»ãããé©åãªä¿®æ£ãå ããå¿ èŠããããŸãã
ãã©ãã«ã·ã¥ãŒãã£ã³ã°ã®ãã³ã
robots.txtã®èšå®ã«åé¡ãç«ã¡ã¯ã ãã£ãå ŽåããŸãè¡ãã¹ãããšã¯ããã¡ã€ã«ãæ£ãããã©ãŒãããã§èšè¿°ãããŠãããã確èªããããšã§ããææ³ãšã©ãŒãã¿ã€ãã³ã°ã®ãã¹ã¯ãã¯ããŒã©ãŒã«èª€ã£ãæ瀺ãåºãåå ãšãªããŸãã
次ã«ãGoogle Search Consoleã䜿çšããŠããµã€ãã«å¯ŸããŠèšå®ããã¯ããŒã«å¶åŸ¡ãæå³ããéãã«æ©èœããŠããããå確èªããŠãã ãããäžæãªç¹ãããã°ãSearch Consoleå ã®ãã«ãã»ã¯ã·ã§ã³ãå ¬åŒã®ãã©ãŒã©ã ãåç §ããŠè§£æ±ºçãèŠã€ããŸãããã
æåŸã«ãSEOããŠã§ããã¹ã¿ãŒã®ã³ãã¥ããã£ã掻çšããŠçžè«ããããšãæå¹ã§ããä»ã®ãŠã§ããã¹ã¿ãŒãåæ§ã®åé¡ã«çŽé¢ããããã解決ããçµéšãããå ŽåããããŸãã
å®éã®äºäŸã«åŠã¶ïŒæåäºäŸãšå€±æäºäŸ
æåäºäŸã®åæ
äžã€ã®æåäºäŸãšããŠãããäŒæ¥ã®ãŠã§ããµã€ããGoogleã®æ€çŽ¢çµæã§åžžã«äžäœã«ã©ã³ã¯ãããããã«ãªã£ãã±ãŒã¹ããããŸãããã®äŒæ¥ã¯ãrobots.txtã®èšå®ãé©åã«è¡ããæ€çŽ¢ãšã³ãžã³ã®ã¯ããŒã©ãŒãéèŠãªã³ã³ãã³ããžã¢ã¯ã»ã¹ããããããã«ããŸããã圌ãã¯ãäžèŠãªãªãœãŒã¹ã®ã¯ããŒãªã³ã°ãé²ãããã«User-agentãDisallowæ什ãå¹æçã«äœ¿çšããŸããã
ãŸãã圌ãã¯Sitemapæ什ãå©çšããŠæ€çŽ¢ãšã³ãžã³ã«ãµã€ãã®æ§é ãæ確ã«äŒããããšã«æåããŸãããããã«ãããæ°ããããŒãžãè¿œå ããããšãã«è¿ éã«ã€ã³ããã¯ã¹ããããŠã§ããµã€ãã®å¯èŠæ§ã倧ããåäžããŸããã
æåã®éµã¯ãå®æçã«robots.txtãã¡ã€ã«ãç£èŠãããŠã§ããµã€ãã®å€æŽã«åãããŠé©åã«æŽæ°ããããšã«ãããŸãããããã«ãããSEOã®å¹çãæ倧éã«åŒãåºãããšãã§ããŸããã
倱æäºäŸã®åæ
äžæ¹ã倱æäºäŸãšããŠæããããã®ã¯ãrobots.txtã®èª€ã£ãèšå®ã«ããéèŠãªããŒãžãæ€çŽ¢ãšã³ãžã³ã«ã€ã³ããã¯ã¹ãããªãã£ãã±ãŒã¹ã§ãããããŠã§ããµã€ãã¯ãDisallowæ什ã䜿çšããããçµæãéèŠãªã³ã³ãã³ããã¯ããŒã©ãŒã«ãã£ãŠèŠéããããç¶æ³ãçºçããŸããã
ãŸããrobots.txtãã¡ã€ã«ã«èª€ã£ããã¹ãæå®ããŠããŸãããšã§ãæ€çŽ¢ãšã³ãžã³ããµã€ãã®éèŠãªã»ã¯ã·ã§ã³ãžã¢ã¯ã»ã¹ã§ããªããªã£ãäŸããããŸãããã®ãããªãã¹ã¯ããŠã§ããµã€ãã®æ€çŽ¢ãšã³ãžã³ã©ã³ãã³ã°ã«å€§ããªæªåœ±é¿ãåãŒããŸããã
倱æããåŠã¶ã¹ãæèšã¯ãrobots.txtã®èšå®ã«ã¯çŽ°å¿ã®æ³šæãæããç¹ã«Disallowæ什ã®äœ¿çšã¯æ éã«è¡ãå¿ èŠããããšããããšã§ãããŸããå€æŽåŸã¯å¿ ãå¹æã確èªããå¿ èŠã«å¿ããŠèª¿æŽããããšãéèŠã§ãã
å°é家ã®ã¢ããã€ã¹
SEOã®å°é家ã¯ãrobots.txtã®èšå®ã«ããã£ãŠã¯ããŸããŠã§ããµã€ãã®ç®çãšå¿ èŠãšãããã¯ããŒã©ãŒã®ã¢ã¯ã»ã¹ã¬ãã«ãæ確ã«ããããšãæšå¥šããŸãããŠã§ããµã€ãã«ãšã£ãŠéèŠãªãªãœãŒã¹ãèå¥ããããããä¿è·ããªãããæ€çŽ¢ãšã³ãžã³ã®ã¢ã¯ã»ã¹ãæé©åããããšãå¿ èŠã§ãã
ãŸããå°é家ã¯ãæ€çŽ¢ãšã³ãžã³ããšã«ç°ãªãã¯ããŒãªã³ã°ã®ä»çµã¿ã«å¯Ÿå¿ããããã«ãUser-agentæ什ã䜿çšããŠç¹å®ã®æ€çŽ¢ãšã³ãžã³åãã«ã«ã¹ã¿ãã€ãºããããšã®éèŠæ§ã匷調ããŸãããã®ã¢ãããŒãã«ããããŠã§ããµã€ãã®å¯èŠæ§ãšããã©ãŒãã³ã¹ãåäžããŸãã
æåŸã«ããŠã§ããµã€ãã®æ§é ãã³ã³ãã³ããå€æŽãããéã«ã¯ãrobots.txtãã¡ã€ã«ãé©å®æŽæ°ããããšãéåžžã«éèŠã§ãããšå°é家ã¯èšåããŠããŸããããã«ãããSEOæŠç¥ã®æå¹æ§ãç¶æããããŠã§ããµã€ãã®ã©ã³ãã³ã°ãåäžããŸãã
ç¶ç¶çãªç®¡çãšæŽæ°ã®éèŠæ§
robots.txtãã¡ã€ã«ã®ç®¡çã¯ãäžåºŠèšå®ããã°çµããã§ã¯ãããŸããããŠã§ããµã€ããé²åããæ°ããããŒãžãè¿œå ãããããæ¢åã®ã³ã³ãã³ããå€æŽãããããããã³ã«ãrobots.txtã®èšå®ãèŠçŽããæé©åããå¿ èŠããããŸãã
ç¶ç¶çãªç®¡çãšæŽæ°ã¯ããŠã§ããµã€ãã®SEOã«å¯Ÿããå¹æãé·æçã«ç¶æããããã«äžå¯æ¬ ã§ããå®æçã«ããããã®åäœã確èªããå¿ èŠã«å¿ããŠèšå®ã調æŽããããšã§ãã¯ããŒã©ãŒããŠã§ããµã€ãã®éèŠãªã³ã³ãã³ãã«é©åã«ã¢ã¯ã»ã¹ã§ããããã«ããŸãã
æçµçã«ããŠã§ããµã€ãã®SEOææãæ倧åããããã«ã¯ãrobots.txtãã¡ã€ã«ã®ç¶ç¶çãªç®¡çãšæŽæ°ãããŒãšãªããŸãããã®ã¢ãããŒãã«ããããŠã§ããµã€ãã®æ€çŽ¢ãšã³ãžã³ã©ã³ãã³ã°ã®æ¹åãšãªã³ã©ã€ã³ã§ã®å¯èŠæ§ã®åäžãæåŸ ã§ããŸãã
ãŸãšã
ããããæé€æšæºãrobots.txtã¯ããµã€ãã®ã©ã®éšåãæ€çŽ¢ãšã³ãžã³ãã¯ããŒã«ããŠããããäŒããããã¹ããã¡ã€ã«ã§ããSEOã«ãããŠã¯ãäžèŠãªããŒãžã®ã¯ããŒã«ãé²ããã¯ããŒã«äºç®ãæå¹ã«æŽ»çšããããã«éèŠã§ããèšå®æ¹æ³ã¯æ¯èŒçç°¡åã§ããŠãŒã¶ãŒãšãŒãžã§ã³ããæå®ããã¯ããŒã«ãèš±å¯ãŸãã¯çŠæ¢ãããã£ã¬ã¯ãã£ããå ¥åããŸãããŸãããµã€ããããã®è¿œå ãå¿ããã«ãæ£ããèšå®ãè¡ãããšã§ããµã€ãã®SEOãæ¹åããæ€çŽ¢ãšã³ãžã³ã«ããããã«ãã£ãåé¿ããããšãã§ããŸããGoogle Search Consoleãå©çšããŠãã¹ãããç¶ç¶çã«ç®¡çãšæŽæ°ãè¡ããŸããããæåäºäŸãšå€±æäºäŸããåŠã³ãããžãã¹ã«ãšã£ãŠæé©ãªSEOæŠç¥ãç·ŽãããšãéèŠã§ãã