pagure-dist-git

#3 Speed up required
Closed: Fixed Opened by pingou.

Closed: Fixed
Reopen Issue

I forked a project on stg, seeing the times, I think we need some optimization: 

 started at: Jul 03 06:46:34 pkgs01.stg.phx2.fedoraproject.org celery[21556]
 finised at: Jul 03 10:55:51 pkgs01.stg.phx2.fedoraproject.org celery[21556]

Should have been fixed by #4, I'll test :)

 
Jul 04 15:17:38 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:17:38,193: INFO/MainProcess] Task pagure.lib.tasks.fork[cb32fb8a-3599-4061-9269-b499311d5dd5] succeeded in 4.38360980107s: {'repo': u'0install', 'username': u'pingou', 'endpoint': 'view_repo', 'namespace': u'rpms'}
Jul 04 15:18:14 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:14,892: INFO/MainProcess] Received task: pagure.lib.tasks.fork[0e9f63f2-8060-45e7-95b7-5f693c84b3f7]
Jul 04 15:18:14 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:14,918: INFO/Worker-3] Grabbing lock for 18735
Jul 04 15:18:14 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:14,957: INFO/Worker-3] Got lock for 18735: <pagure.lib.model.ProjectLock object at 0x6003d10>
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,701: INFO/Worker-3] Releasing lock for 18735
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,707: INFO/Worker-3] Released lock for 18735
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,708: INFO/Worker-3] Project created, refreshing auth
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,725: INFO/Worker-3] Looking for backend: distgit
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,726: DEBUG/Worker-3] Found the following installed helpers {'test_auth': EntryPoint.parse('test_auth = pagure.lib.git_auth:GitAuthTestHelper'), 'gitolite2': EntryPoint.parse('gitolite2 = pagure.lib.git_auth:Gitolite2Auth'), 'gitolite3': EntryPoint.parse('gitolite3 = pagure.lib.git_auth:Gitolite3Auth'), 'distgit': EntryPoint.parse('distgit = dist_git_auth:DistGitoliteAuth')}
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,731: DEBUG/Worker-3] Instantiating helper <class 'dist_git_auth.DistGitoliteAuth'> from backend key 'distgit'
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,731: DEBUG/Worker-3] Got helper: <dist_git_auth.DistGitoliteAuth object at 0x5f33990>
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,731: INFO/Worker-3] Refresh gitolite configuration
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,732: INFO/Worker-3] Write down the gitolite configuration file
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,732: INFO/Worker-3] Refreshing the configuration for one project
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,739: DEBUG/Worker-3]     Processing project: forks/pingou/rpms/0xFFFF
Jul 04 15:18:15 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:15,752: INFO/Worker-3] Starting new HTTPS connection (1): pdc.stg.fedoraproject.org
Jul 04 15:18:16 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:16,641: INFO/Worker-3] Reading in the current configuration
Jul 04 15:18:17 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:17,324: INFO/Worker-3] Compiling the gitolite configuration
Jul 04 15:18:17 pkgs01.stg.phx2.fedoraproject.org celery[1967]: [2017-07-04 15:18:17,471: INFO/MainProcess] Task pagure.lib.tasks.fork[0e9f63f2-8060-45e7-95b7-5f693c84b3f7] succeeded in 2.5743481461s: {'repo': u'0xFFFF', 'username': u'pingou', 'endpoint': 'view_repo', 'namespace': u'rpms'}

It's working \ó/

We just need to adjust pagure so that updating groups doesn't re-generate the entire gitolite config!

Groups update has been implemented in #5

Metadata Update from @pingou:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)
Metadata
None
None
None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.