FREE TOOL

Robots.txt Generator

Robots.txt tells search engines which parts of your site to crawl. Fill in the details below and copy a ready-to-use robots.txt file.

Settings

Leave blank to allow crawling of everything.

Your robots.txt


          

          

            Save this as robots.txt and upload it to your website's root folder (e.g. yourwebsite.com/robots.txt).
          

        

      


      

        
Need your sitemap.xml too? Try our free Sitemap Generator. Want Webtization, a Delhi-based technical SEO agency serving clients across India and worldwide, to handle your site's technical SEO end-to-end?

      

      

        Run a Free Audit
        Talk to Us 
      

    

  







  
  
  
  

    

      

        
Let's work together

        
Ready to build what's next?

        
Let's create a digital experience that moves your business forward.

        

          Start a Project 
          Talk to Us
        

        

                       Reply within 24 hours
                       Free project consultation
                       No obligation
                  

        

          Not ready to talk? Take our 60-second quote quiz →
        

      


      

  
Tell us about your project


  
  

    
    
  

  
  

  
  
  
  

  
  
We reply within 24 hours. No spam, ever.