Gunicorn and VCSServer

Jerry Jones's Avatar

Jerry Jones

14 Sep, 2016 02:15 PM

Hey Marcin,

In our environments we've seen the VCSServer and Gunicorn processes have been using a lot of memory usage on the server. Because of it, the vcsserver is swapping heavily and is running out of memory. We plan to increase the ram from the recommended 8gb for 250 to 500 users to 16gb in attempted to mitigate whats happening. What is strange is we have only around 100 users and are encountering this problem. Any idea what is occurring or if this is normal?

  1. Support Staff 1 Posted by Marcin Kuzminsk... on 14 Sep, 2016 02:44 PM

    Marcin Kuzminski's Avatar

    Hi Jerry,

    I'd recommend you switch to http backend + async gevent based backend. We have our largest customer on such setup that runs 1500+ people on 32G machine.

    Here are the instructions: https://community.rhodecode.com/t/new-high-performance-http-backend/71

    We're planning on switching everyone to this on next release. We're happy to help you fine-tune the worker numbers and worker_connections to handle your traffic correctly.

    PS. have you tried the SSL fix posted to the community portal ?

  2. 2 Posted by Jerry Jones on 15 Sep, 2016 01:22 PM

    Jerry Jones's Avatar

    Great, we'll likely just upgrade then with the next release to utilize http backend upgrade. If not I'll post here for clarifications on installation.

    As for SSL, instead we worked to remove in SSL cert checking. Instead of using python 2.7.11 as the rhodecode web interface shows, we installed and used a version before 2.7.9 that does automatic SSL cert checking for the virtual-env. This seems to have worked for the time being.

    We are currently working on optimizing the 4.3.1 now, however when this is done I will be going back to try the solution you've given me rather then just circumventing the issue and reconfirm that all the certs we do have work as intended.

  3. Support Staff 3 Posted by Marcin Kuzminsk... on 15 Sep, 2016 01:24 PM

    Marcin Kuzminski's Avatar

    Jerry-

    Please also note that next installation/upgrade of RhodeCode will add this special header and should "automatically" fix the SSL issues. We're working on this now, and that's going to be released probably on monday/tue as 4.4.0 Release.

  4. 4 Posted by Jerry Jones on 15 Sep, 2016 01:27 PM

    Jerry Jones's Avatar

    From: Marcin Kuzminski [mailto:[email blocked]]
    Sent: Thursday, September 15, 2016 9:24 AM
    To: Jerry Jones <[email blocked]>
    Subject: Re: Gunicorn and VCSServer [Questions #33223]

    Thank you for the heads up. We’ll likely schedule an upgrade next week then to v4.4+ for the HTTP upgrade and SSL issue we’ve experienced in the past.

Reply to this discussion

Internal reply

Formatting help / Preview (switch to plain text) No formatting (switch to Markdown)

Attaching KB article:

»

Attached Files

You can attach files up to 10MB

If you don't have an account yet, we need to confirm you're human and not a machine trying to post spam.

Keyboard shortcuts

Generic

? Show this help
ESC Blurs the current field

Comment Form

r Focus the comment reply box
^ + ↩ Submit the comment

You can use Command ⌘ instead of Control ^ on Mac

Recent Discussions

23 Nov, 2017 03:02 PM
21 Nov, 2017 06:38 PM
03 Oct, 2017 08:26 PM
03 Oct, 2017 05:48 PM
28 Sep, 2017 05:55 PM