Indexed, though blocked by robots.txt


(ravinder) #1

MERE BLOGSPOT BLOG KA ROBOT.TXT YE HAI >>>>

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

ISME IS TRHA KE ERROR SHOW HO RAHE HAI …GOOGLE CONSOLE YE ERROR SHOW KAR RAHA HAI >>>>

|https:/www.XYZcom/search/label/15%20august|8/6/18|

|https:/www.XYZcom/search/label/WEB%20MASTER|8/5/18|
|https:/www.XYZom/search/label/SEO|8/3/18|
|https:/www.XYZncom/search/label/mobimasala|8/3/18|
|https:/www.XYZcom/search/label/ACTION%20MOVIES|

YAHA SABHI ERROR SEARCH OR LABEL SE AA RAHE HAI

ISKA KYA SOLUTION HAI …

THANK YOU


(Sanjay jadav) #2

Se label noindex ho jate hai, ise index karne se koi fayada nahi, (bahot se blogger ise noindex hi rakhte hai)
Aap ise samsya na samjhe

Agar aap label index karna chahte hai to disallow:/search ko remove kar dijiye,


(Jumedeen khan) #3

@Sanjay007 good answer dear lekin isse future me google disallow pages ko index nahi karega, google me pahle se index page remove nahi honge iske liye aapko page header me rel=“noindex,follow” tag add karna hai. jab aapke sare page google se remove ho jaye tab robots.txt se disallow karna hai.


(Sanjay jadav) #4

Mere sath bhi aisa hi ho raha hai, mene kai page delet kar diye hai aur wo search results se ja hi nahi rahe, iska kya kare?
Aur duplicate problem iski vajah se aa raha hai,


(Jumedeen khan) #5

Solution ek hi hai aap un pages me rel=“noindex,follow” tag add karo, ab isme kitna time lagega ye google par depend karta ki wo aapke kis kis page ko kab kab crawl karega, tab tab remove kar dega.


(Sanjay jadav) #6

Kaise, kis tarah, aur kaha add karna hai, please explain kare, (blogger blog par)

Vaise ye teen code is tarah add hai meri site me,


(Sanjay jadav) #7

Please reply @iamjdk sir


(Jumedeen khan) #8

Lijiye aapko complete guide hi bta deta hu