|
Over time the Apache Group has discovered or been notified of problems with various clients which we have had to work around, or explain. This document describes these problems and the workarounds available. It's not arranged in any particular order. Some familiarity with the standards is assumed, but not necessary.
For brevity, Navigator will refer to Netscape's Navigator product (which in later versions was renamed "Communicator" and various other names), and MSIE will refer to Microsoft's Internet Explorer product. All trademarks and copyrights belong to their respective companies. We welcome input from the various client authors to correct inconsistencies in this paper, or to provide us with exact version numbers where things are broken/fixed.
For reference, RFC1945 defines HTTP/1.0, and RFC2068 defines HTTP/1.1. Apache as of version 1.2 is an HTTP/1.1 server (with an optional HTTP/1.0 proxy).
Various of these workarounds are triggered by environment variables. The admin typically controls which are set, and for which clients, by using mod_browser. Unless otherwise noted all of these workarounds exist in versions 1.2 and later.
This is a legacy issue. The CERN webserver required POST
data to have an extra CRLF
following it. Thus many
clients send an extra CRLF
that
is not included in the Content-Length
of the request.
Apache works around this problem by eating any empty lines which
appear before a request.
Various clients have had broken implementations of keepalive (persistent connections). In particular the Windows versions of Navigator 2.0 get very confused when the server times out an idle connection. The workaround is present in the default config files:
BrowserMatch Mozilla/2 nokeepalive
Note that this matches some earlier versions of MSIE, which began the
practice of calling themselves Mozilla in their user-agent
strings just like Navigator.
MSIE 4.0b2, which claims to support HTTP/1.1, does not properly
support keepalive when it is used on 301 or 302 (redirect)
responses. Unfortunately Apache's nokeepalive
code
prior to 1.2.2 would not work with HTTP/1.1 clients. You must apply
this patch to version 1.2.1. Then add this to your config:
BrowserMatch "MSIE 4\.0b2;" nokeepalive
HTTP/1.1
in responseTo quote from section 3.1 of RFC1945:
HTTP uses a "<MAJOR>.<MINOR>" numbering scheme to indicate versions of the protocol. The protocol versioning policy is intended to allow the sender to indicate the format of a message and its capacity for understanding further HTTP communication, rather than the features obtained via that communication.Since Apache is an HTTP/1.1 server, it indicates so as part of its response. Many client authors mistakenly treat this part of the response as an indication of the protocol that the response is in, and then refuse to accept the response.
The first major indication of this problem was with AOL's proxy servers.
When Apache 1.2 went into beta it was the first wide-spread HTTP/1.1
server. After some discussion, AOL fixed their proxies. In
anticipation of similar problems, the force-response-1.0
environment variable was added to Apache. When present Apache will
indicate "HTTP/1.0" in response to an HTTP/1.0 client,
but will not in any other way change the response.
The pre-1.1 Java Development Kit (JDK) that is used in many clients (including Navigator 3.x and MSIE 3.x) exhibits this problem. As do some of the early pre-releases of the 1.1 JDK. We think it is fixed in the 1.1 JDK release. In any event the workaround:
BrowserMatch Java/1.0 force-response-1.0
BrowserMatch JDK/1.0 force-response-1.0
RealPlayer 4.0 from Progressive Networks also exhibits this problem.
However they have fixed it in version 4.01 of the player, but version
4.01 uses the same User-Agent
as version 4.0. The
workaround is still:
BrowserMatch "RealPlayer 4.0" force-response-1.0
MSIE 4.0b2 has this problem. Its Java VM makes requests in HTTP/1.1 format but the responses must be in HTTP/1.0 format (in particular, it does not understand chunked responses). The workaround is to fool Apache into believing the request came in HTTP/1.0 format.
BrowserMatch "MSIE 4\.0b2;" downgrade-1.0 force-response-1.0
This workaround is available in 1.2.2, and in a
patch against 1.2.1.
All versions of Navigator from 2.0 through 4.0b2 (and possibly later) have a problem if the trailing CRLF of the response header starts at offset 256, 257 or 258 of the response. A BrowserMatch for this would match on nearly every hit, so the workaround is enabled automatically on all responses. The workaround implemented detects when this condition would occur in a response and adds extra padding to the header to push the trailing CRLF past offset 258 of the response.
On multipart responses some clients will not accept quotes (") around the boundary string. The MIME standard recommends that such quotes be used. But the clients were probably written based on one of the examples in RFC2068, which does not include quotes. Apache does not include quotes on its boundary strings to workaround this problem.
A byterange request is used when the client wishes to retrieve a portion of an object, not necessarily the entire object. There was a very old draft which included these byteranges in the URL. Old clients such as Navigator 2.0b1 and MSIE 3.0 for the MAC exhibit this behaviour, and it will appear in the servers' access logs as (failed) attempts to retrieve a URL with a trailing ";xxx-yyy". Apache does not attempt to implement this at all.
A subsequent draft of this standard defines a header
Request-Range
, and a response type
multipart/x-byteranges
. The HTTP/1.1 standard includes
this draft with a few fixes, and it defines the header
Range
and type multipart/byteranges
.
Navigator (versions 2 and 3) sends both Range
and
Request-Range
headers (with the same value), but does not
accept a multipart/byteranges
response. The response must
be multipart/x-byteranges
. As a workaround, if Apache
receives a Request-Range
header it considers it "higher
priority" than a Range
header and in response uses
multipart/x-byteranges
.
The Adobe Acrobat Reader plugin makes extensive use of byteranges and
prior to version 3.01 supports only the multipart/x-byterange
response. Unfortunately there is no clue that it is the plugin
making the request. If the plugin is used with Navigator, the above
workaround works fine. But if the plugin is used with MSIE 3 (on
Windows) the workaround won't work because MSIE 3 doesn't give the
Range-Request
clue that Navigator does. To workaround this,
Apache special cases "MSIE 3" in the User-Agent
and serves
multipart/x-byteranges
. Note that the necessity for this
with MSIE 3 is actually due to the Acrobat plugin, not due to the browser.
Netscape Communicator appears to not issue the non-standard
Request-Range
header. When an Acrobat plugin prior to
version 3.01 is used with it, it will not properly understand byteranges.
The user must upgrade their Acrobat reader to 3.01.
Set-Cookie
header is
unmergeableThe HTTP specifications say that it is legal to merge headers with
duplicate names into one (separated by commas). Some browsers
that support Cookies don't like merged headers and prefer that each
Set-Cookie
header is sent separately. When parsing the
headers returned by a CGI, Apache will explicitly avoid merging any
Set-Cookie
headers.
Expires
headers and GIF89A
animationsNavigator versions 2 through 4 will erroneously re-request
GIF89A animations on each loop of the animation if the first
response included an Expires
header. This happens
regardless of how far in the future the expiry time is set. There
is no workaround supplied with Apache, however there are hacks for 1.2
and for 1.3.
POST
without
Content-Length
In certain situations Navigator 3.01 through 3.03 appear to incorrectly issue a POST without the request body. There is no known workaround. It has been fixed in Navigator 3.04, Netscapes provides some information. There's also some information about the actual problem.
The http client in the JDK1.2beta2 and beta3 will throw away the first part of the response body when both the headers and the first part of the body are sent in the same network packet AND keep-alive's are being used. If either condition is not met then it works fine.
See also Bug-ID's 4124329 and 4125538 at the java developer connection.
If you are seeing this bug yourself, you can add the following BrowserMatch directive to work around it:
BrowserMatch "Java1\.2beta[23]" nokeepalive
We don't advocate this though since bending over backwards for beta software is usually not a good idea; ideally it gets fixed, new betas or a final release comes out, and no one uses the broken old software anymore. In theory.
Content-Type
change
is not noticed after reloadNavigator (all versions?) will cache the content-type
for an object "forever". Using reload or shift-reload will not cause
Navigator to notice a content-type
change. The only
work-around is for the user to flush their caches (memory and disk). By
way of an example, some folks may be using an old mime.types
file which does not map .htm
to text/html
,
in this case Apache will default to sending text/plain
.
If the user requests the page and it is served as text/plain
.
After the admin fixes the server, the user will have to flush their caches
before the object will be shown with the correct text/html
type.
MSIE versions 3.00 and 3.02 (without the Y2K patch) do not handle cookie expiry dates in the year 2000 properly. Years after 2000 and before 2000 work fine. This is fixed in IE4.01 service pack 1, and in the Y2K patch for IE3.02. Users should avoid using expiry dates in the year 2000.
The Lynx browser versions 2.7 and 2.8 send a "negotiate: trans" header in their requests, which is an indication the browser supports transparent content negotiation (TCN). However the browser does not support TCN. As of version 1.3.4, Apache supports TCN, and this causes problems with these versions of Lynx. As a workaround future versions of Apache will ignore this header when sent by the Lynx client.
MSIE 4.0 does not handle a Vary header properly. The Vary header is generated by mod_rewrite in apache 1.3. The result is an error from MSIE saying it cannot download the requested file. There are more details in PR#4118.
A workaround is to add the following to your server's configuration files:
BrowserMatch "MSIE 4\.0" force-no-vary
(This workaround is only available with releases after 1.3.6 of the Apache Web server.)