{"id":366,"date":"2015-07-29T09:42:32","date_gmt":"2015-07-29T06:42:32","guid":{"rendered":"http:\/\/www.erenali.com\/?p=366"},"modified":"2016-06-28T09:06:15","modified_gmt":"2016-06-28T06:06:15","slug":"robots-txt-ve-sitemap-xml-olusturma","status":"publish","type":"post","link":"https:\/\/www.erenali.com\/index.php\/2015\/07\/29\/robots-txt-ve-sitemap-xml-olusturma\/","title":{"rendered":"Robots.txt ve Sitemap.xml Olu\u015fturma"},"content":{"rendered":"<div class=\"38128c0007b0f41e35c6013bb0abf0bf\" data-index=\"1\" style=\"float: left; margin: 10px 10px 10px 0;\">\n<script async src=\"\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block; text-align:center;\"\r\n     data-ad-layout=\"in-article\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-client=\"ca-pub-3908223554810378\"\r\n     data-ad-slot=\"5522206140\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script>\r\n\n<\/div>\n<p><span style=\"color: #ff0000;\"><strong>Sitemap.xml<\/strong><\/span> dosyas\u0131 indekslenmek istenen sitenin haritas\u0131 niteli\u011findedir. Google gibi arama motorlar\u0131n\u0131n i\u015flerini kolayla\u015ft\u0131rmak ve bu sayede sitenin daha performansl\u0131 aranabilmesini sa\u011flamak ad\u0131na kullan\u0131lmas\u0131 iyi olacakt\u0131r.<\/p><div class=\"38128c0007b0f41e35c6013bb0abf0bf\" data-index=\"1\" style=\"float: left; margin: 10px 10px 10px 0;\">\n<script async src=\"\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block; text-align:center;\"\r\n     data-ad-layout=\"in-article\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-client=\"ca-pub-3908223554810378\"\r\n     data-ad-slot=\"5522206140\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script>\r\n\n<\/div>\n\n<p>Peki bu dosyay\u0131 nas\u0131l olu\u015fturaca\u011f\u0131z\u0131 ara\u015ft\u0131rd\u0131\u011f\u0131mda elle yada otomatik olarak olu\u015fturabilece\u011fimizi g\u00f6rd\u00fcm. Tabi ki otomatik olan\u0131 se\u00e7tim ve bu y\u00f6ntem i\u00e7inde programlar ve websiteleri oldu\u011funu g\u00f6rd\u00fcm. Bu konuda da Google bizim i\u00e7in detayl\u0131 bir liste haz\u0131rlam\u0131\u015f. Bu listeye a\u015fa\u011f\u0131daki linkten ula\u015fabilirsiniz.<\/p>\n<p><a href=\"https:\/\/code.google.com\/p\/sitemap-generators\/wiki\/SitemapGenerators\" target=\"_blank\">Kullan\u0131labilecek program ve siteler<\/a><\/p>\n<p>\u015eimdi ben en kolay yoldan listedeki websitelerinden birini se\u00e7tim ve xml dosyam\u0131 olu\u015fturmaya ba\u015flad\u0131m.<\/p>\n<p><a href=\"http:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u0131.png\"><img loading=\"lazy\" class=\"  wp-image-367 alignleft\" src=\"http:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u0131-275x300.png\" alt=\"Ekran Al\u0131nt\u0131s\u0131\" width=\"215\" height=\"235\" srcset=\"https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u0131-275x300.png 275w, https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u0131-290x316.png 290w, https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u0131.png 680w\" sizes=\"(max-width: 215px) 100vw, 215px\" \/><\/a><\/p>\n<p>Yandaki\u00a0gibi 4 ad\u0131mda dosyam\u0131 haz\u0131rlayaca\u011f\u0131m\u0131 s\u00f6yleyen bir site.<\/p>\n<p><strong> Starting URL:<\/strong> \u00a0 k\u0131sm\u0131na haritaland\u0131rmak istedi\u011finiz sitenin adresi.<\/p>\n<p><strong>Change Frequency:<\/strong> \u00a0k\u0131sm\u0131nda sitenin ne s\u0131kl\u0131kla de\u011fi\u015fece\u011fi se\u00e7ilmelidir. Se\u00e7enekler ise \u015fu<\/p>\n<p>\u015fekilde\u00a0 s\u00fcrekli\/ saatlik\/ g\u00fcnl\u00fck\/ haftal\u0131k\/ ayl\u0131k\/ y\u0131ll\u0131k\/ asla<\/p>\n<p>&nbsp;<\/p>\n<p>Bunlar\u0131 se\u00e7tikten sonra <strong>Start<\/strong> ile sayfay\u0131 \u00e7al\u0131\u015ft\u0131rd\u0131\u011f\u0131m\u0131zda bir s\u00fcre sayfam\u0131z\u0131n taranmas\u0131 s\u00fcr\u00fcyor ve sonunda bize xml dosyas\u0131 olarak indirebilece\u011fimiz \u00e7\u0131kt\u0131 veriliyor. Bu dosyay\u0131 indirip sitemizin ana dizinine at\u0131yoruz ve <strong>www.xxx.xxx\/sitemap.xml<\/strong> olarak dosyan\u0131n \u00e7al\u0131\u015f\u0131p \u00e7al\u0131\u015fmad\u0131\u011f\u0131n\u0131 kontrol ediyoruz. E\u011fer sorun yoksa devam edebiliriz.<\/p>\n<p>&nbsp;<\/p>\n<p><img loading=\"lazy\" class=\"  wp-image-368 alignleft\" src=\"http:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01311-210x300.png\" alt=\"Ekran Al\u0131nt\u0131s\u0131\" width=\"192\" height=\"275\" srcset=\"https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01311-210x300.png 210w, https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01311-290x415.png 290w, https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01311.png 635w\" sizes=\"(max-width: 192px) 100vw, 192px\" \/><\/p>\n<p>\u015eimdi s\u0131ra bu xml dosyas\u0131n\u0131 google a tan\u0131tmakta.<\/p>\n<p><a href=\"https:\/\/www.google.com\/webmasters\/tools\/home?hl=tr\" target=\"_blank\">https:\/\/www.google.com\/webmasters\/tools\/home? \u00a0 \u00a0 \u00a0hl=tr<\/a>\u00a0adresine giriyoruz ve daha \u00f6nceden<\/p>\n<p>tan\u0131mlamas\u0131n\u0131 yapt\u0131\u011f\u0131m\u0131z ve <strong>sitemap<\/strong> dosyas\u0131n\u0131 y\u00fckleyece\u011fimiz sitenin y\u00f6netimine giriyoruz.<\/p>\n<p><strong>\u00a0 \u00a0 \u00a0 Tarama<\/strong><span style=\"line-height: 1.5;\">\u00a0 men\u00fcs\u00fc alt\u0131nda <strong>Site Haritalar\u0131<\/strong> k\u0131sm\u0131na giriyoruz. <strong>Site haritas\u0131 ekleme \/ Test etme <\/strong><\/span><\/p>\n<p><span style=\"line-height: 1.5;\">\u00a0 \u00a0 \u00a0 \u00a0k\u0131sm\u0131ndan \u00e7<\/span>al\u0131\u015fmad\u0131\u011f\u0131n\u0131 test etti\u011fimiz sitemap dosyam\u0131z\u0131n yolunu\u00a0<strong>www.xxx.xxx\/sitemap.xml <\/strong><\/p>\n<p>giriyoruz \u00f6nce test\u00a0edip sorun yoksa g\u00f6nderi se\u00e7erek tan\u0131mlama i\u015flemini bitiriyoruz.<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<hr \/>\n<p>\u015eimdi s\u0131rada sitemizin<strong><span style=\"color: #ff0000;\"> robots.txt<\/span><\/strong> dosyas\u0131n\u0131 olu\u015fturmak var. Peki bu dosya ne i\u015fe yarar diye incelerken konuyu anlatan g\u00fczel bir g\u00f6rsel buldum. Resimde \u00f6zetledi\u011fi gibi arama motorlar\u0131 robotlar\u0131n\u0131n nerelere bak\u0131p nerelere bakmayaca\u011f\u0131n\u0131 g\u00f6sterece\u011fimiz dosyad\u0131r.<\/p>\n<p><a href=\"http:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/robots_txt.gif\"><img loading=\"lazy\" class=\" size-medium wp-image-369 alignleft\" src=\"http:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/robots_txt-277x300.gif\" alt=\"robots_txt\" width=\"277\" height=\"300\" srcset=\"https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/robots_txt-277x300.gif 277w, https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/robots_txt-290x314.gif 290w\" sizes=\"(max-width: 277px) 100vw, 277px\" \/><\/a>\u00a0Peki bu robots.txt dosyas\u0131n\u0131 nas\u0131l olu\u015ftururuz. Bunun i\u00e7inde sa\u011folsun bir site yapm\u0131\u015flar<\/p>\n<p><a href=\"http:\/\/www.mcanerin.com\/EN\/search-engine\/robots-txt.asp\" target=\"_blank\">http:\/\/www.mcanerin.com\/EN\/search-engine\/robots-txt.asp<\/a>\u00a0adresinden direk dosyay\u0131 olu\u015fturabiliyoruz.<\/p>\n<p>Burda yap\u0131lan i\u015flemde kabaca \u015fu \u015fekilde.<\/p>\n<p><strong>User-agent: *<\/strong><br \/>\n<strong>Disallow: \/<\/strong><\/p>\n<p><strong>User-agent<\/strong> ile arama motorlar\u0131n\u0131n ajan yaz\u0131l\u0131mlar\u0131n\u0131 bildiriyoruz. <strong>*<\/strong> kullanarak t\u00fcm ajan yaz\u0131l\u0131mlar\u0131n\u0131 kapsamas\u0131n\u0131 sa\u011flad\u0131k.<\/p>\n<p><strong>Disallow<\/strong> ile hangi dizinleri taramayaca\u011f\u0131n\u0131 belirtiyoruz.<\/p>\n<p>&nbsp;<\/p>\n<p><a href=\"http:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01312.png\"><img loading=\"lazy\" class=\" size-medium wp-image-372 alignleft\" src=\"http:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01312-228x300.png\" alt=\"Ekran Al\u0131nt\u0131s\u0131\" width=\"228\" height=\"300\" srcset=\"https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01312-228x300.png 228w, https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01312-290x381.png 290w, https:\/\/www.erenali.com\/wp-content\/uploads\/2015\/07\/Ekran-Al\u0131nt\u0131s\u01312.png 611w\" sizes=\"(max-width: 228px) 100vw, 228px\" \/><\/a><\/p>\n<p>Siteye girdi\u011fimizde arama robotlar\u0131na izin verip vermeyece\u011fimiz hangi robotlara nas\u0131l yetki verece\u011fimiz, hangi dizinlere ula\u015fmayaca\u011f\u0131n\u0131 ve hangi site i\u00e7in olu\u015fturaca\u011f\u0131m\u0131z\u0131 girerek<\/p>\n<p>Create Robots.txt tu\u015fu ile dosyan\u0131n olu\u015fmas\u0131 sa\u011flanabilir. Bu dosyay\u0131da sitemizin ana dizine yerle\u015ftirmemiz gerekecek. Sayfa \u00fczerinden eri\u015febildi\u011fimizi do\u011frulad\u0131ktan sonra<\/p>\n<p><a href=\"https:\/\/www.google.com\/webmasters\/tools\/home?hl=tr\" target=\"_blank\">https:\/\/www.google.com\/webmasters\/tools\/home? \u00a0 \u00a0 \u00a0hl=tr<\/a>\u00a0adresine giriyoruz ve daha \u00f6nceden<\/p>\n<p>tan\u0131mlamas\u0131n\u0131 yapt\u0131\u011f\u0131m\u0131z ve <strong>robots.txt\u00a0<\/strong>dosyas\u0131n\u0131 y\u00fckleyece\u011fimiz sitenin y\u00f6netimine giriyoruz.<\/p>\n<p><strong>Tarama<\/strong><span style=\"line-height: 1.5;\">\u00a0 men\u00fcs\u00fc alt\u0131nda <strong>robots.txt Test Arac\u0131<\/strong> k\u0131sm\u0131na giriyoruz. Olu\u015fturdu\u011fumuz dosyan\u0131n i\u00e7eri\u011fini kopyalay\u0131p yap\u0131\u015ft\u0131r\u0131yor ve g\u00f6nder diyoruz. 3 basamak halinde yapmam\u0131z gerekenleri bize g\u00f6steriyor. 3 basama\u011f\u0131 tamamlad\u0131ktan sonra y\u00fckleme i\u015flemimiz sonlanm\u0131\u015f oluyor.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<div class=\"38128c0007b0f41e35c6013bb0abf0bf\" data-index=\"2\" style=\"float: none; margin:10px 0 10px 0; text-align:center;\">\n<script async src=\"\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block; text-align:center;\"\r\n     data-ad-layout=\"in-article\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-client=\"ca-pub-3908223554810378\"\r\n     data-ad-slot=\"5522206140\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script>\r\n\n<\/div>\n\n<div style=\"font-size: 0px; height: 0px; line-height: 0px; margin: 0; padding: 0; clear: both;\"><\/div>","protected":false},"excerpt":{"rendered":"<p>Sitemap.xml dosyas\u0131 indekslenmek istenen sitenin haritas\u0131 niteli\u011findedir. Google gibi arama motorlar\u0131n\u0131n i\u015flerini kolayla\u015ft\u0131rmak ve bu sayede sitenin daha performansl\u0131 aranabilmesini sa\u011flamak ad\u0131na kullan\u0131lmas\u0131 iyi olacakt\u0131r. Peki bu dosyay\u0131 nas\u0131l olu\u015fturaca\u011f\u0131z\u0131 ara\u015ft\u0131rd\u0131\u011f\u0131mda elle yada otomatik olarak olu\u015fturabilece\u011fimizi g\u00f6rd\u00fcm. Tabi ki otomatik olan\u0131 se\u00e7tim ve bu y\u00f6ntem i\u00e7inde programlar ve websiteleri oldu\u011funu&#8230;<\/p>\n<div class=\"more-link-wrapper\"><a class=\"more-link\" href=\"https:\/\/www.erenali.com\/index.php\/2015\/07\/29\/robots-txt-ve-sitemap-xml-olusturma\/\">Devam\u0131n\u0131 Oku<span class=\"screen-reader-text\">Robots.txt ve Sitemap.xml Olu\u015fturma<\/span> <i class=\"fas fa-angle-right\"><\/i><\/a><\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[137,134,139,136,141,138,135,140],"_links":{"self":[{"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/posts\/366"}],"collection":[{"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/comments?post=366"}],"version-history":[{"count":3,"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/posts\/366\/revisions"}],"predecessor-version":[{"id":373,"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/posts\/366\/revisions\/373"}],"wp:attachment":[{"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/media?parent=366"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/categories?post=366"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.erenali.com\/index.php\/wp-json\/wp\/v2\/tags?post=366"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}