Submitting URLs directly to search engines has been outdated. The proven way SE spiders travel is along web links. So, when your link popularity increases, SEs will find you in many ways. Once found, they will revisit and index your content according to their own time parameters. What you have to do is preparing your site for easy indexing and increasing link popularity (which ensures frequent visits of SE spiders). In addition, you can follow specific features of each search engine (like Google Webmaster Tools) to gain more visibility.

Preparing Your Site for Easy Indexing

The main thing you can do is enhancing the navigation of your site.Make sure you use text links wherever possible. Those are more preferred by SEs than image links. Also make sure that important content are not too buried (4, 5 links deeper from home page). Always link relevant pages together. Basically make it more accessible. A highly used way is to create a sitemap listing all parent and important pages in it and link to it from all major pages.

For some reasons, you may not want some pages or directories to index (empty pages like redirecting pages). In those cases you have to use a robots.txt (these are the exact file name and file extension you should use) file. It’s a simple text file that carries instructions to SE spiders on what not to index. It should be kept in your root directory. Some basics are as follows,

User-agent: *
Disallow: /redirects/

This tells not to index any content in redirects folder.

User-agent: *
Disallow: /design/test.html

This tells not to index test.html file in design folder.

For user-agent: attribute, you can give specific name(s) of a SE spider which prevents that particular spider but allows other spiders to index mentioned content. This technique was used in blackhat SEO and you probably won’t need to use. You can get all these instructions at

Google Webmaster Tools

Google Webmaster Tools offer features to make your site more Google-friendly. Even though you won’t get an extra advantage in rankings by using them, Google will better index your site which then can lead to proper rankings. The basic element of these tools is Google Sitemaps which is an XML file in a specific format that you can place in your site to update Google about your content. Google provides more information and tools to create your own sitemaps.

Yahoo Site Explore

Yahoo also provides a webmaster service called Site Explore. By signing in, you can add URLs and RSS feeds for a particular web site. Yahoo will show you, number of indexed pages and number of incoming links it has found for your web site. It also shows last crawled day of each page and you can see how many backlinks each page of your site has. You can track any number of sites with it.

Manual Submission

You can still try manual submission in some search engines. Visit to get a list of SEs that you can add your URLs manually. Below are submission forms of major SEs.

Checking Indexed Pages

SEs provide operators to find indexed pages of a certain web site. Most of the time it’s site: You can use HomeBizPal Keyword Profitability Search to accelerate your search.

See how they have listed your pages. The titles will be same as the titles of your pages. Depending on search queries, page descriptions may differ. However for indexed pages search, SEs show the default descriptions they have about your pages. Most of the time these are created using Meta Description tag in your pages. In such cases, if your descriptions are not that attractive, consider improving them.