Main content

Alert message

3 D rendering - colourful domain extensions using cubes


If you are NOT getting the number of hits to your domain that you are expecting, you should research and discover all that you can about Search Engine Optimisation (SEO). The Digital Ready blog site already contains two useful articles to get you started (Understanding the art of SEO; Beginners Guide to SEO) and in this third one we help you ensure you have set up your domain name correctly.

Blocking Robots?

If you are not getting the traffic you expect, check to see if your domain has been set up to block robots. Visitors will not find you in an organic search using Google, Bing, Yahoo, etc. if the site is setup to block ‘robots’ because this includes search engine robots (e.g. Googlebot) that index your site. These robots pick up the content inside your articles, rather than just look at the structure of your website. Robots may have been blocked at the time of set up for security reasons, but this can result in a lot of missed traffic - up to 80% in some cases.

Unless you want to miss out on the majority of traffic to your site, your domain should be set up in all search engines to allow robots to crawl it and you should then use a firewall (configured to allow geoblocking) to manage potential threats or unwanted traffic. Your site should be monitored regularly to prevent attacks.

What do I need to manually register on search engines?

1) You need to manually register a site map using search engine webmaster tools. A site map is a webpage that describes the structure of your website. There are many plugins available that will generate a site map for you - in most cases you will need to choose an xml site map.

2) Each search engine will have its own version of webmaster tools. With Google Webmaster Tools you can even ‘ask’ Googlebot to come and index your site or, if you’ve had major changes to your site, to re-index it (other webmaster tools will have similar options). By using webmaster tools, rather than waiting for a search engine robot to find your site, it will rank higher in the search engine results.

3) If your domain has only been registered on Google.com, other search engines may not rank it highly so you will need to manually register it with each search engine (see ‘adding a domain’ below)

4) Similarly, there may be a number of different forms of your web address that will be used e.g.:

        • ‘HTTPS://www.yourdomain.com.au’ or ‘HTTP://www.yourdomain.com.au’
        • ‘HTTPS://yourdomain.com.au’ or ‘HTTP://yourdomain.com.au’

These need to be explicitly registered with the search engines (see ‘adding a domain’ below)

5) Also, if your domain is ‘yourdomain.com.au’ and you have set up extra domains to cover other potential means of getting to your site (e.g. ‘yourdomain.com’, ‘yd.com’, ‘yd.com.au’, etc.) you will need to setup your site’s Domain Name System (DNS) to point these extra domains to ‘yourdomain.com.au’. This stops search engine robots thinking there’s a duplication of content which counts against search engine ranking. The same applies to ensuring ‘www.yourdomain.com .au’ points to ‘yourdomain.com.au’

How do I do I achieve all this on the search engines?

a) Adding a domain to Google

In Google Webmaster Tools there is a page for submitting new URLs:
this is a copy of the google domain addition page

 

 

 

 

 

 

 

 

 

 

 



Use this to submit your URL (repeat for all the URLs needed). Note, Google points out that ‘We don't add all submitted URLs to our index, and we can't make predictions or guarantees about when or if submitted URLs will appear in our index.’ Note: It can take several weeks for this and nothing is guaranteed.

Similar domain name submission mechanisms are provided on other search engines.

b) Adding your site map to Google

You will need to add authentication and analytics tracking codes to the website to register the site with Google Webmaster Tools. Then you can:

• Select your site on your Google Search Console home page.
• Click Crawl.
• Click Sitemaps.
• Click ADD/TEST SITEMAP.
• Type sitemap.xml.
• Click Submit Sitemap.

Similar site map submission mechanisms are provided on other search engines.