SEO ialah "Search Engine Optimization" juga "Search Engine Optimizer."
Contoh Robot Text sederhana yang dipakai pada umumnya:
Jangan lupa menulis di Directory dengan huruf "/robots.txt"
User-agent: * # applies to all robots
Disallow: / # disallow indexing of all pages
Pilihan jika banyak keperluan untuk lebih terperinci:
Disallow: /administrator/Disallow: /cache/
Disallow: /components/
Disallow: /editor/
Disallow: /help/
Disallow: /images/
Disallow: /includes/
Disallow: /language/
Disallow: /media/
Disallow: /modules/
Disallow: /templates/
Disallow: /installation/
Disallow: /index.php
Disallow: /# disallow indexing of all pages
Selain itu juga ada contoh untuk META:
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title>www.myexample.com</title>
<meta name="description" content="Love is forever, at the first sight" />
<meta name="keywords" content="Love is forever, at the first sight" />
<meta name="Generator" content="MyExample - Copyright (C) 2005 - 2007. All rights reserved." />
<meta name="robots" content="index, follow" />
<link rel="shortcut icon" href="http://www.myexample.com/images/xxx.icon" />
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1" />
<link href="http://www.myexample.com/dir/forever_ii/css/forever_css.css" rel="stylesheet" type="text/css" />
</head>
</html>
Kunjungi juga Google Add URL
Belajar lebih terperinci di Robotstxt Organisation
Sampai Jumpa !