{"id":2314,"date":"2026-02-26T18:19:29","date_gmt":"2026-02-26T18:19:29","guid":{"rendered":"https:\/\/www.nerecyilmaz.com\/?p=2314"},"modified":"2026-02-26T18:19:29","modified_gmt":"2026-02-26T18:19:29","slug":"robots-txt","status":"publish","type":"post","link":"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/","title":{"rendered":"Robots.txt Nedir? Robots.txt Olu\u015fturma"},"content":{"rendered":"<p><b>Robots txt<\/b><span style=\"font-weight: 400;\">, arama motoru botlar\u0131na sitende hangi URL\u2019leri taray\u0131p hangilerini taramamas\u0131 gerekti\u011fini s\u00f6yleyen bir y\u00f6nerge dosyas\u0131d\u0131r. Robots.txt do\u011fru kurguland\u0131\u011f\u0131nda tarama b\u00fct\u00e7eni (crawl budget) daha verimli kullan\u0131r, gereksiz sayfalar\u0131n indexlenmesini azalt\u0131r ve robots txt olu\u015fturma s\u00fcrecini <\/span><a href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/seo-nasil-yapilir-seo-rehberi\/\"><b>teknik SEO<\/b><\/a><span style=\"font-weight: 400;\">\u2019nun en kritik kontrol noktalar\u0131ndan biri haline getirir.<\/span><\/p><div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-light-blue ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table Of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"\u0130\u00e7indekiler Tablosunu A\u00e7\/Kapat\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Robotstxt_Nedir\" >Robots.txt Nedir?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Robots_Dosyasi_Neden_Onemlidir\" >Robots Dosyas\u0131 Neden \u00d6nemlidir?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Robottxt_Olusturma_Nasil_Yapilir\" >Robot.txt Olu\u015fturma Nas\u0131l Yap\u0131l\u0131r?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Temel_ornek_genel_kullanim\" >Temel \u00f6rnek (genel kullan\u0131m)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Admin_ve_ozel_dizinleri_kapatma_ornegi\" >Admin ve \u00f6zel dizinleri kapatma \u00f6rne\u011fi<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Robots_txt_generator_ve_robotstxt_checker_kullanimi\" >Robots txt generator ve robots.txt checker kullan\u0131m\u0131<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#WordPress_Robots_txt_Olusturma\" >WordPress Robots txt Olu\u015fturma<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#1_Fiziksel_robotstxt_onerilen_kontrol\" >1) Fiziksel robots.txt (\u00f6nerilen kontrol)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#2_SEO_eklentisi_ile_Rank_Math_Yoast\" >2) SEO eklentisi ile (Rank Math \/ Yoast)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#WordPress_icin_%E2%80%9Cen_sik_yapilan_hata%E2%80%9D\" >WordPress i\u00e7in \u201cen s\u0131k yap\u0131lan hata\u201d<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Sonuc\" >Sonu\u00e7<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#SSS\" >SSS<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Robots_txt_ile_sayfa_indexleme_nasil_engellenir\" >Robots txt ile sayfa indexleme nas\u0131l engellenir?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Robotstxt_checker_ile_test_nasil_yapilir\" >Robots.txt checker ile test nas\u0131l yap\u0131l\u0131r?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Sitemap_robotstxt_icine_eklenmeli_mi\" >Sitemap robots.txt i\u00e7ine eklenmeli mi?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/robots-txt\/#Robots_txt_yanlis_olursa_SEOya_etkisi_ne_olur\" >Robots txt yanl\u0131\u015f olursa SEO\u2019ya etkisi ne olur?<\/a><\/li><\/ul><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n\n<h2><span class=\"ez-toc-section\" id=\"Robotstxt_Nedir\"><\/span><b>Robots.txt Nedir?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Robots txt<\/b><span style=\"font-weight: 400;\">, sitenin k\u00f6k dizininde yer alan <\/span><span style=\"font-weight: 400;\">robots.txt<\/span><span style=\"font-weight: 400;\"> dosyas\u0131d\u0131r ve botlara \u201c\u015fu klas\u00f6re girme \/ \u015fu sayfay\u0131 tarayabilirsin\u201d gibi talimatlar verir. Bu dosya, sayfalar\u0131 \u201cindexleme\u201d komutu de\u011fil; a\u011f\u0131rl\u0131kl\u0131 olarak <\/span><b>tarama (crawl) y\u00f6netimi<\/b><span style=\"font-weight: 400;\"> sa\u011flar. Bu y\u00fczden robots txt ile bir URL\u2019i engellersen, Google \u00e7o\u011fu durumda o sayfay\u0131 tarayamaz ve i\u00e7erik sinyalini de g\u00f6remez.<\/span><\/p>\n<p><b>K\u0131sa kritik: <\/b><span style=\"font-weight: 400;\">Robots txt bir \u201cyasak\u201d de\u011fil, bir \u201ckural seti\u201ddir; baz\u0131 botlar uymayabilir ama b\u00fcy\u00fck arama motorlar\u0131 genel olarak uyar.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Robots_Dosyasi_Neden_Onemlidir\"><\/span><b>Robots Dosyas\u0131 Neden \u00d6nemlidir?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-2312\" src=\"https:\/\/www.nerecyilmaz.com\/wp-content\/uploads\/2026\/02\/robots-txt-olusturma-scaled.webp\" alt=\"robots.txt olu\u015fturma\" width=\"777\" height=\"358\" \/><\/p>\n<p><b>Robots txt<\/b><span style=\"font-weight: 400;\"> dosyas\u0131, \u00f6zellikle b\u00fcy\u00fck sitelerde teknik SEO\u2019nun kontrol paneli gibi \u00e7al\u0131\u015f\u0131r. Robots dosyas\u0131 neden \u00f6nemlidir? \u00c7\u00fcnk\u00fc:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Crawl b\u00fct\u00e7esini korur:<\/b><span style=\"font-weight: 400;\"> Botun enerjisini gereksiz URL\u2019lere harcamas\u0131n\u0131 engeller.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Parametreli URL patlamas\u0131n\u0131 y\u00f6netir:<\/b><span style=\"font-weight: 400;\"> Filtre\/s\u0131ralama\/utm gibi URL\u2019lerin taranmas\u0131n\u0131 azaltabilir.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Kritik alanlar\u0131 korur:<\/b><span style=\"font-weight: 400;\"> Admin panelleri, staging ortamlar\u0131, test dizinleri gibi alanlar\u0131n taranmas\u0131n\u0131 engelleyebilir.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><a href=\"https:\/\/www.nerecyilmaz.com\/tr\/blog\/sitemap-site-haritasi\/\"><b>Sitemap<\/b><\/a><b> ke\u015ffini destekler:<\/b><span style=\"font-weight: 400;\"> Robots i\u00e7ine sitemap sat\u0131r\u0131 ekleyerek botlar\u0131n sitemap\u2019i daha h\u0131zl\u0131 bulmas\u0131n\u0131 sa\u011flayabilirsin.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>AI bot eri\u015fiminde de rol oynar:<\/b><span style=\"font-weight: 400;\"> LLM crawler\u2019lar\u0131 (siteyi tarayan botlar) i\u00e7in de robots kurallar\u0131 bazen belirleyici olabilir; ama her botun uyumu ayn\u0131 de\u011fildir.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"Robottxt_Olusturma_Nasil_Yapilir\"><\/span><b>Robot.txt Olu\u015fturma Nas\u0131l Yap\u0131l\u0131r?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Robots txt olu\u015fturma<\/b><span style=\"font-weight: 400;\">, temel mant\u0131kta 3 par\u00e7aya dayan\u0131r: Hangi bot? Hangi alan? Ne kadar izin? Bunun en g\u00fcvenli yakla\u015f\u0131m\u0131, minimum k\u0131s\u0131t ile ba\u015flay\u0131p ihtiya\u00e7 olduk\u00e7a geni\u015fletmektir.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Temel_ornek_genel_kullanim\"><\/span><b>Temel \u00f6rnek (genel kullan\u0131m)<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">User-agent: *<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Disallow:<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Sitemap: https:\/\/site.com\/sitemap_index.xml<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Bu yap\u0131, t\u00fcm botlara tarama izni verir ve sitemap\u2019i belirtir.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Admin_ve_ozel_dizinleri_kapatma_ornegi\"><\/span><b>Admin ve \u00f6zel dizinleri kapatma \u00f6rne\u011fi<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">User-agent: *<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Disallow: \/wp-admin\/<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Disallow: \/cgi-bin\/<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Allow: \/wp-admin\/admin-ajax.php<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Sitemap: https:\/\/site.com\/sitemap_index.xml<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Robots_txt_generator_ve_robotstxt_checker_kullanimi\"><\/span><b>Robots txt generator ve robots.txt checker kullan\u0131m\u0131<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Robots txt generator:<\/b><span style=\"font-weight: 400;\"> Kurallar\u0131 h\u0131zl\u0131ca \u00fcretmek i\u00e7in kullan\u0131l\u0131r, ama her site ayn\u0131 de\u011fildir; \u201chaz\u0131r \u015fablon\u201d kopyalamak riskli olabilir.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><b>Robots txt checker:<\/b><span style=\"font-weight: 400;\"> Dosyan\u0131n eri\u015filebilir olup olmad\u0131\u011f\u0131n\u0131 ve belirli URL\u2019lerin \u201cizinli mi\/engelli mi\u201d oldu\u011funu test etmeni sa\u011flar.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Not: Robots txt olu\u015fturma bittikten sonra Google Search Console\u2019daki robots test arac\u0131yla da kontrol etmen iyi olur (\u00f6zellikle kritik URL\u2019lerde).<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"WordPress_Robots_txt_Olusturma\"><\/span><b>WordPress Robots txt Olu\u015fturma<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>WordPress robots txt olu\u015fturma<\/b><span style=\"font-weight: 400;\"> iki \u015fekilde olur: fiziksel dosya ya da WordPress\u2019in sanal (virtual) robots \u00e7\u0131kt\u0131s\u0131.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"1_Fiziksel_robotstxt_onerilen_kontrol\"><\/span><b>1) Fiziksel robots.txt (\u00f6nerilen kontrol)<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">FTP \/ File Manager \u00fczerinden sitenin k\u00f6k dizinine <\/span><span style=\"font-weight: 400;\">robots.txt<\/span><span style=\"font-weight: 400;\"> dosyas\u0131 eklenir.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">En stabil ve kontrol edilebilir y\u00f6ntemdir.<\/span><\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"2_SEO_eklentisi_ile_Rank_Math_Yoast\"><\/span><b>2) SEO eklentisi ile (Rank Math \/ Yoast)<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Baz\u0131 eklentiler robots dosyas\u0131 d\u00fczenlemeyi panel \u00fczerinden sa\u011flar.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Ancak baz\u0131 kurulumlarda bu dosya \u201cvirtual\u201d \u00e7al\u0131\u015fabilir; cache\/CDN ile \u00e7ak\u0131\u015fma olursa bekledi\u011fin g\u00fcncelleme g\u00f6r\u00fcnmeyebilir.<\/span><\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"WordPress_icin_%E2%80%9Cen_sik_yapilan_hata%E2%80%9D\"><\/span><b>WordPress i\u00e7in \u201cen s\u0131k yap\u0131lan hata\u201d<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">wp-content<\/span><span style=\"font-weight: 400;\">, <\/span><span style=\"font-weight: 400;\">uploads<\/span><span style=\"font-weight: 400;\"> veya CSS\/JS dosyalar\u0131n\u0131 yanl\u0131\u015fl\u0131kla engellemek. Bu durumda Google sayfay\u0131 do\u011fru render edemez ve kalite sinyali d\u00fc\u015febilir.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"Sonuc\"><\/span><b>Sonu\u00e7<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Robots txt<\/b><span style=\"font-weight: 400;\">, tarama b\u00fct\u00e7esini y\u00f6neterek organik g\u00f6r\u00fcn\u00fcrl\u00fckte \u201ctemiz sinyal\u201d olu\u015fturman\u0131n en kritik par\u00e7alar\u0131ndan biridir. Do\u011fru robots txt olu\u015fturma ile gereksiz URL\u2019leri k\u0131sar, \u00f6nemli sayfalara tarama \u00f6nceli\u011fi verirsin. E\u011fer sitende indexleme dalgalan\u0131yor, tarama b\u00fct\u00e7esi bo\u015fa gidiyor veya robots.txt checker testlerinde \u00e7eli\u015fkiler g\u00f6r\u00fcyorsan, <\/span><a href=\"https:\/\/www.nerecyilmaz.com\/tr\/seo-danismanligi\/\"><b>SEO dan\u0131\u015fmanl\u0131\u011f\u0131<\/b><\/a><span style=\"font-weight: 400;\"> ile sitene \u00f6zel robots stratejisini (sitemap + <\/span><b>canonical<\/b><span style=\"font-weight: 400;\"> + internal link uyumuyla) kurup organikte ger\u00e7ekten harikalar yaratabiliriz.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"SSS\"><\/span><b>SSS<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<h4><span class=\"ez-toc-section\" id=\"Robots_txt_ile_sayfa_indexleme_nasil_engellenir\"><\/span><b>Robots txt ile sayfa indexleme nas\u0131l engellenir?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<p><span style=\"font-weight: 400;\">Robots.txt tek ba\u015f\u0131na \u201ckesin index engelleme\u201d arac\u0131 de\u011fildir; <\/span><b>noindex<\/b><span style=\"font-weight: 400;\"> bunun i\u00e7in daha do\u011fru sinyaldir. Robotstxt bir URL\u2019i <\/span><b>taramadan (crawl)<\/b><span style=\"font-weight: 400;\"> men eder; Google sayfay\u0131 tarayamazsa i\u00e7eri\u011fi g\u00f6remez, fakat URL ba\u015fka yerlerden link al\u0131yorsa bazen i\u00e7erik g\u00f6r\u00fclmeden de dizinde g\u00f6r\u00fcnebilir. \u201cIndexlenmesin\u201d istiyorsan en g\u00fcvenlisi sayfay\u0131 taranabilir b\u0131rak\u0131p <\/span><b>meta robots: noindex<\/b><span style=\"font-weight: 400;\"> kullanmak; private alanlarda <\/span><b>401\/403<\/b><span style=\"font-weight: 400;\"> ile eri\u015fimi k\u0131s\u0131tlamak; kal\u0131c\u0131 kald\u0131rmada <\/span><b>404\/410<\/b><span style=\"font-weight: 400;\"> veya do\u011fru <\/span><b>301<\/b><span style=\"font-weight: 400;\"> y\u00f6nlendirme uygulamakt\u0131r.<\/span><\/p>\n<h4><span class=\"ez-toc-section\" id=\"Robotstxt_checker_ile_test_nasil_yapilir\"><\/span><b>Robots.txt checker ile test nas\u0131l yap\u0131l\u0131r?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<p><span style=\"font-weight: 400;\">Robots.txt checker ile belirli bir URL\u2019in robots kurallar\u0131na g\u00f6re \u201cAllowed \/ Disallowed\u201d olup olmad\u0131\u011f\u0131n\u0131 test edersin. \u00d6nce <\/span><span style=\"font-weight: 400;\">site.com\/robots.txt<\/span><span style=\"font-weight: 400;\"> dosyas\u0131n\u0131n <\/span><b>200<\/b><span style=\"font-weight: 400;\"> d\u00f6nd\u00fc\u011f\u00fcn\u00fc kontrol et; ard\u0131ndan checker arac\u0131nda robots i\u00e7eri\u011fini okut ve test etmek istedi\u011fin URL\u2019i gir. Sonu\u00e7 \u201cDisallowed\u201d \u00e7\u0131karsa kural\u0131n hangi sat\u0131rdan tetiklendi\u011fini bul. Cache\/CDN kullan\u0131yorsan robots dosyas\u0131 g\u00fcncellemesi gecikebilir; testin \u201cyay\u0131ndaki g\u00fcncel dosya\u201d \u00fczerinden yap\u0131ld\u0131\u011f\u0131ndan emin ol.<\/span><\/p>\n<h4><span class=\"ez-toc-section\" id=\"Sitemap_robotstxt_icine_eklenmeli_mi\"><\/span><b>Sitemap robots.txt i\u00e7ine eklenmeli mi?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<p><span style=\"font-weight: 400;\">Evet, \u00f6nerilir; zorunlu de\u011fildir ama botlar\u0131n sitemap\u2019i daha h\u0131zl\u0131 ke\u015ffetmesini destekler. Robots dosyas\u0131na sitemap sat\u0131r\u0131 ekleyebilirsin: <\/span><span style=\"font-weight: 400;\">Sitemap: https:\/\/site.com\/sitemap_index.xml<\/span><span style=\"font-weight: 400;\">. Birden fazla sitemap varsa ayr\u0131 sat\u0131rlar halinde eklenebilir. URL\u2019in https ve www\/non-www versiyonu sitenin ana versiyonuyla tutarl\u0131 olmal\u0131d\u0131r.<\/span><\/p>\n<h4><span class=\"ez-toc-section\" id=\"Robots_txt_yanlis_olursa_SEOya_etkisi_ne_olur\"><\/span><b>Robots txt yanl\u0131\u015f olursa SEO\u2019ya etkisi ne olur?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h4>\n<p><span style=\"font-weight: 400;\">Yanl\u0131\u015f robots txt organik g\u00f6r\u00fcn\u00fcrl\u00fc\u011f\u00fc do\u011frudan d\u00fc\u015f\u00fcrebilir \u00e7\u00fcnk\u00fc botlar \u00f6nemli sayfalara eri\u015femez. \u00d6nemli sayfalar taranamazsa indexleme yava\u015flar\/d\u00fc\u015fer; CSS\/JS engellenirse render bozulup kalite sinyali d\u00fc\u015febilir; parametreli\/kopya URL\u2019ler a\u00e7\u0131k kal\u0131rsa crawl b\u00fct\u00e7esi bo\u015fa gider; en kritik senaryoda <\/span><span style=\"font-weight: 400;\">Disallow: \/<\/span><span style=\"font-weight: 400;\"> gibi bir kural t\u00fcm siteyi engelleyip g\u00f6r\u00fcn\u00fcrl\u00fc\u011f\u00fc sert d\u00fc\u015f\u00fcrebilir. Bu y\u00fczden de\u011fi\u015fiklik sonras\u0131 mutlaka robots txt checker ile kritik URL\u2019leri test etmelisin.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Robots txt, arama motoru botlar\u0131na sitende hangi URL\u2019leri taray\u0131p hangilerini taramamas\u0131 gerekti\u011fini s\u00f6yleyen bir y\u00f6nerge dosyas\u0131d\u0131r. Robots.txt do\u011fru kurguland\u0131\u011f\u0131nda tarama b\u00fct\u00e7eni (crawl budget) daha verimli kullan\u0131r, gereksiz sayfalar\u0131n indexlenmesini azalt\u0131r ve robots txt olu\u015fturma s\u00fcrecini teknik SEO\u2019nun en kritik kontrol noktalar\u0131ndan biri haline getirir. Robots.txt Nedir? Robots txt, sitenin k\u00f6k dizininde yer alan robots.txt dosyas\u0131d\u0131r&#8230;<\/p>\n","protected":false},"author":1,"featured_media":2315,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[22],"tags":[],"class_list":["post-2314","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-seo"],"_links":{"self":[{"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/posts\/2314","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/comments?post=2314"}],"version-history":[{"count":1,"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/posts\/2314\/revisions"}],"predecessor-version":[{"id":2317,"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/posts\/2314\/revisions\/2317"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/media\/2315"}],"wp:attachment":[{"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/media?parent=2314"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/categories?post=2314"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nerecyilmaz.com\/tr\/wp-json\/wp\/v2\/tags?post=2314"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}