Est. 2005 - Serving Peoria AZ and all US                Call 623-243-7379 or Toll Free 1-877-717-8503
Website Design, Website Hosting and Web Management
Click here for BBB Business Review

Website SEO Tools: robots.txt file Generator

INSTRUCTIONS (please read carefully):

1. Select a user agent (robot) in the left column, then click on the "ADD USER AGENT" button.
2. Type in directories and/or web pages that you do not want indexed, then click on the "ADD" button. Make sure there is a forward "slash" in-between directories and pages, and at the end of directories (indicated in red below). Repeat this step until you have added all of the files you want under the "User Agent". If you don't want a user agent to index ANY of your site, LEAVE THE TEXTFIELD BLANK and click on the "ADD" button. A "/" will appear after "Disallow:" in the code below.
3. Once step 2 is complete, you may repeat steps 1 & 2 again until you have added all of the "User Agents" you want, and files under each that you want to "Disallow".
4. When complete, click on "COPY CODE" to save the robots.txt code.

Robots.txt Generator

Select a User Agent

Add directories/files you DO NOT want indexed

Directory/Page.html >
Three Examples:  1: folderName/myPage.html
2: folderName
3: myPage.html

Copy and paste the code into a text file and name it "robots.txt", then upload it into your root directory where your "index" page is.
For example:


Do-It-Yourself Website Design and SEO tools

Do-it-Yourself Tools for Web Design & SEO:

SEO Toolkit
The SEO (Search Engine Optimization) Toolkit provides everything you need to promote and optimize your web pages for the search engines.
Features include: Ranking, Keyword Density Analysis, Keyword Research, URL Submission, Optimization wizards, just to name a few. [More...]

Submit Wolf
Award winning web site promotion software can dramatically increase your web site traffic. Submit your web site details to thousands of Search Engines, directories and link pages. [More...]

Internet Studio
The Internet Studio suite is comprised of some of Trellian's best long running, proven and award winning software. It includes a range of tools for web authoring, ecommerce, search and Internet. [More...]

Base64 Decryption Tool
Character Codes for HTML and Alt Codes
robots.txt File Generator
Meta Tag Generator
HTTP Header Check Tool
MS Internet Explorer Shortcuts

More coming soon!