1,733 view, 0 RAMs, and 1 comment
I have been trying to figure out how to do my own web maintenance, but I am not very well versed in it yet. I keep getting this one error: "Error 503: maximum threads for service reached." How can I fix this?
This is a debug account.
This is an error that
the fastly CDN Varnish throws when a user makes an excessive number of requests, that may cause strain on a website's server. See:
Error 503 maximum threads for service reached
This error occurs when Varnish detects that a service has exceeded a safety limit on the number of concurrent requests. Typically this indicates that a service is experiencing an unusually high load, that an origin is slow, or that features like request collapsing are being intentionally avoided.
The first thing that you should try is slowing down your number of requests. If you're running a web crawler or scraper, it's generally a good practice to wait at least one second between requests; one request per five seconds would be a more conservative approach, especially if you're planning on crawling thousands of pages. Large sites will generally have a page with their best practices/recommendations/requirements for bots; see if the site you're crawling has one.
On a related note, the code in this post (Python) shows some best practices that you can use when crawling/scraping/making bot requests to a site (adding a custom user agent, limiting your request rate, etc).
Sir, I can do you a nice SEO.
Post a New Comment
Do you like having a good time?
Register an Account
Read Quality Articles
Read some quality articles. If you can manage to not get banned for like five minutes, you can even post your own articles.
Argue with People on the Internet
Use your account to explain why people are wrong on the Internet forum.
Vandalize the Wiki
Or don't. I'm not your dad.
Ask and/or Answer Questions
If someone asks a terrible question, post a LMGTFY link.
Make Some Money
Hire freelancers and/or advertise your goods and/or services. Hire people directly. We're not a middleman or your dad. Manage your own business transactions.
Answers— Read More
Find more related content below!
- How can I configure DNS server 2012?
- How to setup DHCP server?
- What TCP port is utilized by an SSH server listening for connections?
- How can I find DHCP server?
- How can you update FTB server?
- "Could not open a connection to your authentication agent"?
- Linksys Smart Wifi port forwarding setup?
- What is the difference between packet switching and circuit switching?
- How to fix "dns address could not be found"?
- How do I fix "Error 503: maximum threads for service reached"?