|
Indexer's HTML parser currently understands the
following META tags. Note that "HTTP-EQUIV" may be
used instead of "NAME" in all entries.
<META
NAME="Content-Type" Content="text/html; charset=xxxx">
This is used to detect document character set if it is not specified
in Content-type HTTP header.
<META
NAME="REFRESH" Content="5; URL=http://www.somewhere.com">
URL value will be inserted in database.
<META NAME="Keywords" Content="xxx">
<META NAME="Description" Content="xxx">
<META NAME="Robots" Content="xxx"> with content value
ALL, NONE, INDEX, NOINDEX, FOLLOW, NOFOLLOW, NOARCHIVE.
<META NAME="DP.PopRank" Content="xxx"> with Content value as a real number. This is used to assign the initial
value of PopularityRank for the page.
|