mercredi 25 mars 2009ﻛﻴﻒ ﺗﺴﺘﻔﻴﺪ ﻣﻦ robots.txt ﻭﺗﺠﻌﻞ ﺍﻟﻌﻨﺎﻛﺐ ﺗﻌﺸﺶ ﻓﻲ ﻣﻮﻗﻌﻚﺍﻟﺴﻼ‌ﻡ ﻋﻠﻴﻜﻢ ﻭﺭﺣﻤﺔ ﺍﻟﻠﻪ ﻭ ﺑﺮﻛﺎﺗﺔ

ﺃﺧﻮﺍﻧﻲ ﺷﺪ ﺍﻧﺘﺒﺎﻫﻲ ﺗﻘﻨﻴﺔ robots.txtﺍﻟﻤﺴﺘﺨﺪﻣﺔ ﻓﻲ ﻛﺜﻴﺮ ﻣﻦ ﺍﻟﻤﻮﺍﻗﻊ ﺍﻷ‌ﺟﻨﺒﻴﺔ
ﻓﺄﺣﺒﺒﺖ ﺍﻥ ﺃﻟﺨﺺ ﻟﻜﻢ ﻣﺎ ﻓﻬﻤﺘﻪ ﺓ ﻣﺎ ﺍﺳﺘﻄﻌﺖ ﺗﺤﺼﻴﻠﺔ ﻣﻦ ﻣﻮﺍﻗﻊ ﺍﻻ‌ﻧﺘﺮﻧﺖ ﺍﻻ‌ﺟﻨﺒﻴﺔ ﻭﻟﺒﺤﺚ ﻳﻮﻡ ﻛﺎﻣﻞ ﻭ ﺍﻋﻄﻴﻜﻢ ﺍﻟﺨﻼ‌ﺻﺔ ﻋﻠﻰ ﻃﺒﻖ ﻣﻦ ﺫﻫﺐ...


ﺑﺴﻢ ﺍﻟﻠﻪ ﺍﻟﺮﺣﻤﻦ ﺍﻟﺮﺣﻴﻢ

ﺃﻭﻻ‌ ﺍﻟﺮﻭﺑﻮﺗﺲ ﻫﻮ ﻋﺒﺎﺭﺓ ﻋﻦ ﻣﻠﻒ ﻧﺼﻲ ﻳﻮﺿﻊ ﻓﻲ ﺍﻟﻤﺠﻠﺪ ﺍﻟﺮﺋﻴﺴﻲ ﻟﻠﻤﻮﻗﻊ www ﻭ ﻳﻮﺿﻊ ﻓﻴﻪ ﺃﻭﺍﻣﺮ ﻻ‌ ﻳﺴﺘﻄﻴﻊ ﻗﺮﺍﺋﺘﻬﺎ ﻏﻴﺮ ﻋﻨﺎﻛﺐ ﺍﻹ‌ﻧﺘﺮﻧﺖ
ﻛﺎﻧﺖ ﺍﻟﺘﻘﻨﻴﺔ ﻗﺪ ﻇﻬﺮﺕ ﻓﻲ ﻋﺎﻡ 1994 ﻣﻴﻼ‌ﺩﻱ ﻭ ﻗﺪ ﺍﻧﺘﺸﺮﺕ ﻣﻊ ﺍﻟﺰﻣﻦ ﺣﺘﻰ ﺍﺻﺒﺤﺖ ﺫﺍﺕ ﺍﻧﺘﺸﺎﺭ ﻭﺍﺳﻊ...

ﻟﻦ ﺃﻃﻴﻞ ﻋﻠﻴﻜﻢ

ﺍﻭﺍﻣﺮ ﻣﻠﻒ ﺍﻟﺮﻳﺒﻮﺭﺗﺲ... ﻣﻊ ﺍﻣﺜﻠﺔ...

ﺃﺫﺍ ﻛﻨﺖ ﺗﺮﻏﺐ ﺑﺎﻥ ﺗﺰﻭﺭ ﻋﻨﺎﻛﺐ ﺍﻟﺒﺤﺚ ﻣﻮﻗﻌﻚ ﻭﻟﻜﻦ ﻻ‌ﺗﺮﻳﺪﻫﺎ ﺍﻥ ﺗﺰﻭﺭ ﺻﻔﺤﺎﺕ ﻣﻌﻴﻨﺔ ﻣﻦ ﻣﻮﻗﻌﻚ ﻣﺜﻞ admin ﺍﻭ ﺍﻱ ﺻﻔﺤﺎﺕ ﺃﺧﺮﻯ ﻻ‌ ﺗﺮﻏﺐ ﺑﺄﻥ ﺗﻈﻬﺮ ﻟﻠﺰﻭﺍﺭ ﻛﻞ ﻣﺎ ﻋﻠﻴﻚ ﻓﻌﻠﺔ ﻫﻮ ﺍﻧﺸﺎﺀ ﻣﻠﻒ ﻭ ﺗﺴﻤﻴﺘﺔ ﺑـ robots.txt ﻭ ﺛﻢ ﻗﻢ ﺑﻔﺘﺤﺔ ﻭﻭﺿﻊ ﺍﻟﺒﺮﻣﺠﻴﺔ ﺍﻟﺘﺎﻟﻴﺔ:

User-agent: * = ﺍﻟﺴﻤﺎﺡ ﻟﺠﻤﻴﻊ ﺍﻧﻮﺍﻉ ﺍﻟﻌﻨﺎﻛﺐ ﺑﺪﺧﻮﻝ ﺍﻟﻤﻮﻗﻊ

ﻛﻮﺩ PHP:

Disallow: /admin/password/ = ﻋﺎﺩﺍ ﻫﺬﺍ ﺍﻟﻤﻠﻒ

Disallow: /tmp/ = ﻭﻫﺬﺍ

Disallow: /mypage.html = ﻭﻫﺬﺍ ﺍﻳﻀﺎً


User-agent: * = ﺗﻜﺘﺐ ﺍﺳﻢ ﻋﻨﻜﺒﻮﺕ ﻣﻌﻴﻦ ﺃﻭ ﻧﺠﻤﺔ ﺗﻌﻨﻲ ﺍﻟﺴﻤﺎﺡ ﻟﺠﻤﻴﻊ ﻋﻨﺎﻛﺐ ﺍﻟﺒﺤﺚ

Disallow: = ﺗﻌﻨﻲ ﻣﻨﻊ ﺛﻢ ﺍﻟﻤﺠﻠﺪ ﺍﻭ ﺍﻷ‌ﻣﺘﺪﺍﺩ ﺃﻭ ﺍﺳﻢ ﺍﻟﻤﻠﻒ ﺍﻟﻤﻤﻨﻮﻉ ﺍﺭﺷﻔﺘﺔ ﻓﻲ ﻣﺤﺮﻛﺎﺕ ﺍﻟﺒﺤﺚ


ﻃﻴﺐ ﻟﻮ ﺍﺭﺩﻧﺎ ﺍﻥ ﻧﺴﻤﺢ ﻟﻌﻨﺎﻛﺐ ﻣﻌﻴﻨﺔ ﺍﻥ ﺗﺰﻭﺭ ﻣﻠﻒ ﻣﻌﻴﻦ ﺩﻭﻥ ﻏﻴﺮﻫﺎ
ﻣﺜﻞ ﺍﻟﻌﻨﻜﺒﻮﺕxxxx ﺗﺎﺑﻊ ﻟﺸﺮﻛﺔ ﺑﺤﺚ ﺿﺨﻤﺔ ﻭ ﺗﺮﻳﺪﺓ ﻫﻮ ﻓﻘﻂ ﺍﻥ ﻳﻄﻠﻊ ﻋﻠﻰ ﺟﻤﻴﻊ ﻣﺤﺘﻮﻯ ﺍﻟﻤﻮﻗﻊ ﻭ ﺍﻟﻤﺠﻠﺪﺍﺕ .



ﻛﻮﺩ PHP:

User-agent: *

Disallow: /admin/passwords/

User-agent: xxxx = ﺍﺳﻢ ﺍﻟﻌﻨﻜﺒﻮﺕ ﺍﻟﻤﺴﺘﺜﻨﻰ ﻣﻦ ﺍﻟﻤﻨﻊ

Disallow: = ﻓﺎﺭﻍ ﻳﻌﻨﻲ ﻋﺪﻡ ﻣﻨﻊ



ﻃﻴﺐ ﺗﺒﻐﻰ ﺗﻄﺮﺩ ﺟﻤﻴﻊ ﺍﻟﻌﻨﺎﻛﺐ ﻭﺵ ﺗﺴﻮﻱ...

ﺣﻂ ﺍﻟﻜﻮﺩ ﻫﺬﺍ
ﻛﻮﺩ PHP:


User
-agent: *

Disallow: /


ﻭﺍﻟﺴﻤﺎﺣﺔ ﻟﻠﻌﻨﺎﻛﺐ ﺑﺠﻤﻴﻊ ﺃﻧﻮﺍﻋﻬﺎ ﻳﻜﻮﻥ ﻛﺎﻟﺘﺎﻟﻲ



ﻛﻮﺩ PHP:

User-agent: *

Disallow:



ﺍﺫﺍ ﻋﺠﺒﻜﻢ ﺍﻟﻤﻮﺿﻮﻉ ﻓﻼ‌ ﺗﺤﺮﻣﻮﻧﻰ ﻣﻦ ﺗﻘﻴﻤﻜﻢ

عودتنا على كل ما هو جديد