|
|
|
Finding the Right Web Host
Choosing the right Web Hosting service for your website can be a little bit confusing. There's so many choices out there and many people aren't exactly sure what they should be looking for. Here's a few things you should take into consideration...
How to Choose a Web Host
Choosing a web hosting company to host your website isn't easy these days. There are literally thousands of web hosting companies to choose from, each offering different combinations of web space, bandwidth, extras (such as databases, asp, php, cgi,...
Important considerations before choosing a web hosting provider
The first thing before choosing a web host is that you should be
fully aware of your hosting requirements. If you are a beginner
wanting to host a personal web site, then your only concern is
that you get a decent amount of disk space for your...
Quick Intro to PHP Development
Chances are that if you’ve been around the Internet long enough, you’ve heard of server-side scripting languages such as PERL, ASP and ColdFusion. These are all popular languages that are used to add interactivity to Web sites, but one stands out...
Website Hosting 101 - Learning The Basics
As a beginner trying to find the right web host for your website is often daunting. The jargon used by most web hosts often goes way over your head. In the Hosting 101 section, BrandBlast has 6 lessons for the beginner who wishes to learn the basics...
|
|
| |
|
|
|
|
|
from our sponsors
Internet Home Business Training Course
Your privacy is safe.
|
The proper way to use the robots.txt file
When optimizing your web site most webmasters don’t consider using the robots.txt file. This is a very important file for your site. It let the spiders and crawlers know what they can and can not index. This is helpful in keeping them out of folders that you do not want index like the admin or stats folder or content that they can not index.
Here is a list of variables that you can include in a robots.txt file and there meaning:
1)User-agent: In this field you can specify a specific robot to describe access policy for or a “*” for all robots more explained in example.
2)Disallow: In the field you specify the files and folders not to include in the crawl.
3)# the number sign represents comments
Here are some examples
CONTINUE BELOW...
Didn't Find What You Were Looking For?
Try a Specialized Search HERE
MOST RECENT ARTICLES
Article Dashboard: Internet Business | Web Design
Web Design articles from Article Dashboard
web design croydon Posted By : Jenk Sakalli
All the businesses now need their web existence. It seems that all of them have their individual web sites. Its not possible for each to design their web site by his or herself. For this web designers are hired.
The Death of Bedroom Designers Posted By : Jack Mack
How now the days of a bedroom web designer are numbered
Basic Dos and donts to create a website Posted By : Tutu Ghosh
Today, in the scenario of global market every business concerns wants an online presence as it connects the worldwide people through common platform, web very quickly.
Website is an asset of a company Posted By : Tutu Ghosh
Having a website is not a big deal because anybody can make it for business purpose or for personal use at a cheap rate. But the matter is how to maintain it so that it can serves at its best for a long time.
Why do you choose a Professional Website Design Company? Posted By : Tutu Ghosh
Website design is not a tough job at all. But the first thing you should consider whenever you want to create your website is to select a Professional website design company.
Newsfeed display by CaRP
CONTINUE HERE...
of a robots.txt file for redball.com
User-agent: *
Disallow:
The above would let all spiders index all content.
Here another example
User-agent: *
Disallow: /cgi-bin/
The above would block all spiders from indexing the cgi-bin directory.
User-agent: googlebot
Disallow:
User-agent: *
Disallow: /admin.php
Disallow: /cgi-bin/
Disallow: /admin/
Disallow: /stats/
In the above example googlebot can index everything while all other spiders can not index admin.php, cgi-bin, admin, and stats directory. Notice that you can block single files like admin.php.
About the Author
Jimmy Whisenhunt is the owner of VIP Enterprises
|
|
|
|
|
|