Wed Dec 19 20:04:15 PST 2018

Page | 26 ramthoughts

? Externalize your CSS and JavaScript code as much as possible
? Optimize your images so you are not using unnecessarily large image files without gaining in visual
? Use server side caching & Gzip to reduce render time and file size
? Reduce 301 redirects
? If possible, use a content delivery network
The robots
txt, which is a creation of the Robots Exclusion Protocol, is a file stored in a website's root
directory (
, example
txt), and is used to provide crawl instructions to automated web
crawlers (including search engine spiders) which visit your website

The robots
txt file is used by webmasters to instruct crawlers which parts of their site they would like to
disallow from crawls
They also set crawl-delay parameters, and point out the location of the sitemap

Note: Not all web spiders follow robots
txt directions
Malicious bots can be programmed to ignore
directions from the robots
txt file

404 Pages
Users are redirected to a 404 page when they have tried to locate or reach a page that longer exists,
often because they have either clicked a broken link or mistyped the URL

By default, a 404 page is just an empty page (save for a small notice stating that the page that has been
requested could not be found), which usually means that the user (and search engine spiders) will simply
turn back and leave the site, and this is certainly not something you want happening
To solve this issue,
and avoid 301 redirecting all error pages to your home page or some other destination on your website,
you can utilize a custom 404 page which gives the users (or search engine spiders) links and navigational
elements to follow into your site
A custom 404 page could simply be smaller version of your website's
sitemap which directs the user or search engine spider to the main sections of your site

Of course, not every 404 page should be redirected somewhere, and that is where a custom 404 page
would come into play
These 404 pages can be shown by default, but creating a customized 404 page is
highly recommended


No comments:

Post a Comment

Featured Post


Indeed SEO is Not Cost: SEO Training and Solutions Kindle Store : See all matching items $1.99 seo,optimizati...