Varnish FetchError: straight insufficient bytes

Want to help support this blog? Try out Oh Dear, the best all-in-one monitoring tool for your entire website, co-founded by me (the guy that wrote this blogpost). Start with a 10-day trial, no strings attached.

We offer uptime monitoring, SSL checks, broken links checking, performance & cronjob monitoring, branded status pages & so much more. Try us out today!

Profile image of Mattias Geniar

Mattias Geniar, December 08, 2014

Follow me on Twitter as @mattiasgeniar

In your varnishlog, you may see the following error appearing.

11 ObjProtocol  c HTTP/1.1
   11 ObjResponse  c OK
   11 ObjHeader    c Content-Length: 482350
...
   11 FetchError   c straight insufficient bytes
   11 Gzip         c u F - 437646 482350 80 3501088 3501098
   11 VCL_call     c error deliver
   11 VCL_call     c deliver deliver
   11 TxProtocol   c HTTP/1.1
   11 TxStatus     c 503
   11 TxResponse   c Service Unavailable
   11 TxHeader     c Accept-Ranges: bytes

When you check the access logs on your backend server, you may notice something odd about the Content-Length header. For instance, here’s an access logs from my backend webserver.

... "GET /some/file.pdf HTTP/1.1" 200 437646 "referer" "user-agent"

The access logs show the size of the request is 437646 bytes, whereas Varnish thinks the request is 482350 bytes (Content-Length header). So the “straight insufficient bytes” literally means: the response I got from the backend did not contain enough bytes, I was expecting more. I’ll panic now, kthxbye.

The backend indicated the request was 482KB in size, but it only sent along 437KB according to the logs. No wonder Varnish freaks out.

There’s no real fix, though, except to make sure your backend sends along as much bytes to Varnish as it indicates with the Content-Length header. There are odd cases where Gzip/Deflate compression can screw up these numbers, if you’re debugging this – disable the gzip compression or mod_deflate in Apache and try again. See if it helps. If so, you’re on the right track and you may be experiencing mod_fastcgi + mod_deflate combination errors.

Alternatively, you can return (pipe); those requests. A piped request won’t do extensive checks on what the backend responds and just pass everything to the client as-is.



Want to subscribe to the cron.weekly newsletter?

I write a weekly-ish newsletter on Linux, open source & webdevelopment called cron.weekly.

It features the latest news, guides & tutorials and new open source projects. You can sign up via email below.

No spam. Just some good, practical Linux & open source content.