releng

#9890 Container Base image creation failing on Koji
Closed: Fixed by kevin. Opened by nasirhm.

Closed: Fixed
Reopen Issue
  • Describe the issue

Container Base image creation tasks are failing on Koji, It seems to be an issue with the Builders. Here are the tasks that are failing:

  • https://koji.fedoraproject.org/koji/buildinfo?buildID=1656022
  • https://koji.fedoraproject.org/koji/buildinfo?buildID=1656010
  • https://koji.fedoraproject.org/koji/buildinfo?buildID=1655975

The issue seems to be the following from koji logs:

Traceback (most recent call last):
  File "/usr/lib/python3.9/site-packages/koji/daemon.py", line 1356, in runTask
    response = (handler.run(),)
  File "/usr/lib/python3.9/site-packages/koji/tasks.py", line 328, in run
    return koji.util.call_with_argcheck(self.handler, self.params, self.opts)
  File "/usr/lib/python3.9/site-packages/koji/util.py", line 271, in call_with_argcheck
    return func(*args, **kwargs)
  File "/usr/sbin/kojid", line 4372, in handler
    images = self.do_images(ks, template, inst_tree)
  File "/usr/sbin/kojid", line 3999, in do_images
    self.base_img = self._buildBase(template, params)
  File "/usr/sbin/kojid", line 4108, in _buildBase
    self._checkImageState(base)
  File "/usr/sbin/kojid", line 4055, in _checkImageState
    image.os_plugin.abort()  # forcibly tear down the VM
AttributeError: 'NoneType' object has no attribute 'abort'

for two of the failed tasks.

This is caused by upgrading the builders to f33 over the weekend, @kevin is looking into it.

Metadata Update from @mohanboddu:
- Issue assigned to kevin
- Issue tagged with: medium-gain, medium-trouble, ops

Odd. I am not sure whats causing this. Builders (except for aarch64/armv7) have moved to f33, but there is the same versions of koji / imagefactory there. ;(

builder log has: 

Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]: 2020-12-07 23:44:38,071 [INFO] {2694250} koji.
build.BaseTaskHandler:4099 dispatching a baseimg builder                                                            
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]: 2020-12-07 23:44:38,098 [WARNING] {2694250} ko
ji.TaskManager:1375 TRACEBACK: Traceback (most recent call last):                                                   
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:   File "/usr/lib/python3.9/site-packages/koji/
daemon.py", line 1356, in runTask                                                                                   
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:     response = (handler.run(),)               
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:   File "/usr/lib/python3.9/site-packages/koji/
tasks.py", line 328, in run                                                                                         
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:     return koji.util.call_with_argcheck(self.h
andler, self.params, self.opts)                                                                                     
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:   File "/usr/lib/python3.9/site-packages/koji/
util.py", line 271, in call_with_argcheck                                                                           Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:     return func(*args, **kwargs)             
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:   File "/usr/sbin/kojid", line 4372, in handler                                                                                                                   
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:     images = self.do_images(ks, template, inst_tree)                                                                                                             
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:   File "/usr/sbin/kojid", line 3999, in do_images                                                                                                                
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:     self.base_img = self._buildBase(template, params)                                                                                                             
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:   File "/usr/sbin/kojid", line 4108, in _buildBase                                                                                                                
Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:     self._checkImageState(base)               Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:   File "/usr/sbin/kojid", line 4055, in _check
ImageState                                                                                                          Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]:     image.os_plugin.abort()  # forcibly tear d
own the VM                                                                                                          Dec 07 23:44:38 buildvm-x86-31.iad2.fedoraproject.org kojid[2694250]: AttributeError: 'NoneType' object has no attri
bute 'abort'

@cverna or @tkopecek or @pbrobinson Any ideas? Is there some patch we dropped somewhere?

I've seen similar error when 'default' network was not created in libvirt. (@breilly?) + are relevant IF plugins installed there?
Edited by tkopecek

I think this was fixed a while back.

If you are still seeing it, please re-open. Thanks!

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)
Metadata

medium-gain medium-trouble ops

None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.