Bug 328003

Summary: completely default yast2 kiwi configuration (without template) creates a faulty image
Product: [openSUSE] openSUSE 10.3 Reporter: Francis Giannaros <francis>
Component: YaST2Assignee: Jiří Suchomel <jsuchome>
Status: RESOLVED FIXED QA Contact: Jiri Srain <jsrain>
Severity: Major    
Priority: P5 - None CC: ast, coolo, jsuchome, rccj
Version: RC 1Keywords: NTS_Public
Target Milestone: ---   
Hardware: Other   
OS: Other   
Whiteboard:
Found By: --- Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---
Attachments: reboot exception
y2logs
config.xml
config.xml
another config.xml
kiwi-pattern.dif

Description Francis Giannaros 2007-09-24 22:01:30 UTC
Created attachment 174467 [details]
reboot exception

It gives a rebootException, and it does have enough memory in qemu (other live CDs work fine).

opensuse:/home/francis/kiwi # rpm -qa|grep -i kiwi
kiwi-desc-livesystem-1.40-26.1
kiwi-desc-xenboot-1.64-62.1
kiwi-desc-usbboot-1.64-62.1
kiwi-desc-netboot-1.64-62.1
kiwi-pxeboot-1.64-62.1
kiwi-desc-isoboot-1.64-62.1
kiwi-1.64-62.1
kiwi-desc-vmxboot-1.64-62.1

yast2-product-creator-2.15.8-2.1
Comment 1 Francis Giannaros 2007-09-24 22:02:32 UTC
Created attachment 174468 [details]
y2logs
Comment 2 Jiří Suchomel 2007-09-25 07:04:50 UTC
Marcus, do you have an idea where could be the problem (before seeing config.xml)?
Comment 3 Jiří Suchomel 2007-09-25 07:15:55 UTC
Francis, please try to fetch your final config.xml (used by YaST) the way described in bug 327839.
Comment 4 Marcus Schaefer 2007-09-25 07:58:09 UTC
two problems here:

1) a strange image name: /cdrom/.i686-1  would be interesting to see
   the contents of the config.xml

2) the qemu instance doesn't have enough ram. call it with
   -m 128 for example, if it complains about too little ram use
   the tmpfs suggestion qemu print on the console

   
Comment 5 Jiří Suchomel 2007-09-25 08:50:11 UTC
Actually, the image was created, so you should have the configuration saved under  /var/lib/YaST2/product-creator/images
Comment 6 Francis Giannaros 2007-09-25 11:14:21 UTC
Created attachment 174583 [details]
config.xml

Marcus -- as I mentioned QEMU has enough memory; namely, -m 256 which works more than fine with all other live images.

It doesn't have a name, I presume, because no template was imported and there's no other area (seems to me) to specify the image name.
Comment 7 Francis Giannaros 2007-09-25 11:17:33 UTC
Created attachment 174586 [details]
config.xml

Woops, attached the wrong config.xml. Correct one this time...
Comment 8 Jiří Suchomel 2007-09-25 11:20:29 UTC
> It doesn't have a name, I presume, because no template was imported and there's
> no other area (seems to me) to specify the image name.

The image name could be specified in the very first entry in the first dialog - if you left it empty, it should not allow you to continue -> my fault.

Please try again without leaving the name empty.
Comment 9 Jiří Suchomel 2007-09-25 11:22:00 UTC
The entry is called "Kiwi configuration" and the help text says "Enter the name of your image configuration or Import the directory with the existing one."
Comment 10 Francis Giannaros 2007-09-25 11:30:28 UTC
Thanks. I'd suggest having something like:

Kiwi configuration
----------------------------

Image Name
----------------------------

..since I think it would make it a little clearer perhaps, but more importantly it would give you the option of changing the image name (which you should be able to do, if you just want to import a template). 

Testing a build with the name now.
Comment 11 Jiří Suchomel 2007-09-25 11:35:50 UTC
Yes - the version for SLES I was already writing about looks a bit different and closer to your proposal, so I expect a change also in openSUSE sooner or later.
Comment 12 Francis Giannaros 2007-09-25 12:58:49 UTC
Created attachment 174598 [details]
another config.xml

Even when I specify a name, the image it creates does not work (same reboot exception).
Comment 13 Francis Giannaros 2007-09-25 13:00:36 UTC
Out of interest, why do you have different SLE and openSUSE versions? Aren't you creating more work for yourself? ;-)
Comment 14 Jiří Suchomel 2007-09-25 13:25:44 UTC
Ad comment 12:

When I try the attached config.xml (just with my RC1 repo), I get the known error, that I thought was already fixed:

Sep-25 15:13 <1> : Removing smart channel(s): kiwi1-14935   done
Sep-25 15:13 <1> : Reset RPM signature check to: True   done
Sep-25 15:13 <1> : Including pattern: default   failed
Sep-25 15:16 <3> : Couldn't create image package list   failed
Sep-25 15:16 <3> : Image installation failed   failed
Sep-25 15:16 <3> : KIWI exited with error(s)   done

I have kiwi-1.64-70.1. Marcus?


Ad comment 13: Yes, I am. The way of developing for more products in parallel is a bit complicated... :-)
Comment 15 Marcus Schaefer 2007-09-25 14:04:17 UTC
I have fixed pattern download and tested right now. So if your
kiwi rpm changelog contains:
 

-------------------------------------------------------------------
Fri Sep 21 09:42:27 CEST 2007 - ms@suse.de

- pass allong $@ to init process (#327037)
- fixed remote download of pattern files (#327096)
- added updateMTAB function for all linuxrc's (#326386)

you shouldn't get that error
Comment 16 Jiří Suchomel 2007-09-25 14:15:42 UTC
My kiwi is even newer, but I get the error:

* Tue Sep 25 2007 ms@suse.de
- fixed spec file architecture build requirements
- fixed missing copy call of config-cdroot.sh

* Mon Sep 24 2007 ms@suse.de
...

* Fri Sep 21 2007 ms@suse.de
- pass allong $@ to init process (#327037)
- fixed remote download of pattern files (#327096)
- added updateMTAB function for all linuxrc's (#326386)
Comment 17 Marcus Schaefer 2007-09-25 14:19:39 UTC
than your pattern name is wrong, patterns are named for example
"default-10.3" not only "default"
Comment 18 Jiří Suchomel 2007-09-25 14:41:39 UTC
Sep-25 16:36 <1> : Including pattern: default-10.3-145   failed

Also failed for "default-10.3". I still haven't tested default-10.3-145.i586, but that seems unlikely, as architecture is another part of pattern id, besides name.
Comment 19 Marcus Schaefer 2007-09-25 14:53:29 UTC
I'm sorry I really don't understand what you are doing. I'm building images
the whole day long for SLES and SLED and 10.3 and I'm using patterns local
remotely without any problems ??? can you find your default or default-10.3
pattern within the repo-path/suse/setup/descr/... path ?
Comment 20 Marcus Schaefer 2007-09-25 15:37:39 UTC
Hey Jiri, do you use a ftp URL ? if yes I think I could imagine the bug
here. The ftp source looks different than the http source list. Will check
that
Comment 21 Marcus Schaefer 2007-09-25 18:22:49 UTC
found the bug, it depends on the title check. In case of ftp directory listing
we don't get a title page but that's not a fault. Additionally ftp listings
have different format than http listings

==> fixed

==> will submit a package in the next hour

Comment 22 Jiří Suchomel 2007-09-25 18:40:17 UTC
Yes, that was an ftp source, sorry I forgot to attach my config.xml so you could see it earlier.

Thanks for the fix, I will test it again tomorrow.
Comment 23 Francis Giannaros 2007-09-25 18:44:36 UTC
One issue, however, is that I'm not using the FTP source at all (local yast2 and local rpm-dir repositories). Does your fix cover an issue with those as well?
Comment 24 Jiří Suchomel 2007-09-25 19:08:42 UTC
That's why you were able to actually build the image :-) I don't think this fix is related to your problem with running in qemu; now when I will be able to build the image, I'll try to reproduce.

I was able to build the image on 10.2 (different source, maybe not ftp) with your config.xml and haven't any problem runnin in qemu; so let's see if 10.3 will give different result.
Comment 25 Jiří Suchomel 2007-09-26 11:44:21 UTC
> found the bug, it depends on the title check. In case of ftp directory listing
> we don't get a title page but that's not a fault. Additionally ftp listings
> have different format than http listings

Still not working :-(

My kiwi package has
 - fixed ftp:// pattern requests (#328003)
changelog entry, so I guess it's the correct one.

The problem is not in pattern name, the $content variable is empty before "
check for ftp pages next..." section of KIWIPattern.pm (it never get filled from the http requests before), so the problem is not in the regexp. And yes, the repository is functional and I can see the directory with patterns in the browser (ftp://cml.suse.cz/netboot/find/openSUSE-10.3-RC1-DVD-i386-DVD1/suse/setup/descr/).


(BTW I wonder why you have hard-written paths like setup/descr and suse/setup/descr. AFAIK the directory with those metadata can be arbitrary, the path is specified by DESCRDIR variable of content file)
Comment 26 Jiří Suchomel 2007-09-26 11:46:36 UTC
This is the dump of $response variable filled in line 212 of KIWIPattern.pm:

$VAR1 = bless( {
                 '_content' => '',
                 '_rc' => 200,
                 '_headers' => bless( {
                                        'client-date' => 'Wed, 26 Sep 2007 11:42:47 GMT',
                                        'content-type' => 'text/ftp-dir-listing',
                                        'content-length' => 0,
                                        'server' => 'Welcome to Pure-FTPd.',
                                        'client-request-num' => 1
                                      }, 'HTTP::Headers' ),
                 '_msg' => 'OK',
                 '_request' => bless( {
                                        '_content' => '',
                                        '_uri' => bless( do{\(my $o = 'ftp://10.20.3.1/netboot/find/openSUSE-10.3-RC1-DVD-i386-DVD1/suse/setup/descr')}, 'URI::ftp' ),
                                        '_headers' => bless( {
                                                               'user-agent' => 'libwww-perl/5.806'
                                                             }, 'HTTP::Headers' ),
                                        '_method' => 'GET'
                                      }, 'HTTP::Request' )
               }, 'HTTP::Response' );
Comment 27 Jiří Suchomel 2007-09-26 13:20:11 UTC
Francis: I created image (using HTTP repository) and it worked in qemu.
Comment 28 Francis Giannaros 2007-09-26 13:22:25 UTC
Interesting, I can't really test this unless I start a local apache server (if I get time to, I will), since the internet here is too slow to grab that stuff directly. Though I guess it's more obvious now where the bug lies? Local+FTP repos?
Comment 29 Marcus Schaefer 2007-09-26 13:41:42 UTC
strange it worked for me... I will check the content file now that's
a good idea
Comment 30 Marcus Schaefer 2007-09-26 14:27:47 UTC
please check the attached patch, it worked for me on all types

Thanks
Comment 31 Marcus Schaefer 2007-09-26 14:28:23 UTC
Created attachment 174865 [details]
kiwi-pattern.dif
Comment 32 Marcus Schaefer 2007-09-26 17:52:10 UTC
package submitted
Comment 33 Jiří Suchomel 2007-09-27 07:16:23 UTC
Well, your fix added the check for DESCRDIR, but the real problem was different (the path was correct, see comment 25 and 26).

I opened bug 328811 for this problem and this one will be mine and its focus is to find correct image template for Image Creator.
Comment 34 Jiří Suchomel 2007-09-27 13:01:45 UTC
Francis, please try yast2-product-creator-2.15.8.1 from 

http://download.opensuse.org/repositories/home:/jsuchome/openSUSE_10.3/noarch/

It has new template and fixes also some other bugs reported recently. I'm still experimenting with the speed problem, looks like there is no good solution.
Comment 35 Francis Giannaros 2007-09-27 23:32:07 UTC
Good news: booted just great now. Thanks Jiri :-) 

One thing: might be an idea to make sure SaX2 is on the template ISO, I think.
Comment 36 Jiří Suchomel 2007-10-01 10:58:58 UTC
I don't know what's missing to have X configured. I even tried to build the image from kiwi-desc-livesystem, but it is not better.

Do you have an idea what is missing in the template?
Comment 37 Francis Giannaros 2007-10-01 11:10:48 UTC
The template I created didn't have sax2, which it probably needs?
Comment 38 Jiří Suchomel 2007-10-01 11:16:40 UTC
I tried adding it, but it was not enough. Also, the one from kiwi-desc-livesystem has all sax2-related packages and it is the same.
Comment 46 Anja Stock 2007-10-11 14:23:02 UTC
released
Comment 47 Marcus Schaefer 2007-10-24 08:27:24 UTC
*** Bug 335141 has been marked as a duplicate of this bug. ***