Bug 995367

Summary: TW net iso "Installation System does not match your boot medium" with default repo
Product: [openSUSE] openSUSE Distribution Reporter: Michel Normand <normand>
Component: InstallationAssignee: Dominique Leuenberger <dimstar>
Status: RESOLVED WONTFIX QA Contact: Jiri Srain <jsrain>
Severity: Normal    
Priority: P2 - High CC: bg, forgotten_ny8t7SHjD_, lnussel, normand, okurz, paul, snwint
Version: Leap 42.3   
Target Milestone: ---   
Hardware: PowerPC-64   
OS: Other   
URL: https://github.com/openSUSE/osc-plugin-factory/issues/925
Whiteboard:
Found By: --- Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---
Attachments: abanc_net_install_leap42_2_failure.log
abanc_net_install_leap42_2_execvp_failure.log.gz
linuxrc.log red popup

Description Michel Normand 2016-08-24 13:58:19 UTC
Created attachment 689327 [details]
abanc_net_install_leap42_2_failure.log

Leap 42.2 ppc64le net install failure linuxrc or bad repo

I tried install of Leap 42.2 ppc64le using the net iso Build0112 from (1)

Using the default setup, linuxrc is failing with
"Please make sure your installation medium is available" as per (2)
the failing repo is (3)
Looking at the linuxrc.log the failure is a missing repo/content file.

If I choose ...repo/oss in place of .../repo
then the failure reported in linuxrc.log is a missing repo/oss/config

I do not know from those data 
if the problem is a bad repo or an error in linuxrc


(1) http://download.opensuse.org/ports/ppc/distribution/leap/42.2-Current/iso/
(2) linuxrc reporting bad installation medium
===
...
ending DHCP request to eth3...
ok, ip = 9.101.18.90/24
Please make sure your installation medium is available.
Choose the URL to retry.
0) <-- Back <--
1) ftp://9.101.18.1/pub/linux/opensuse/42.2/ppc64le/os/
2) http://download.opensuse.org/ports/ppc/distribution/leap/42.2/r
3) Enter another URL
>
===
(3) http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo
===
Comment 1 Stefan Schubert 2016-08-25 06:44:11 UTC
Rudi or Berthold could you please have a look if the repo has errors ?
Thanks !
Comment 2 Michel Normand 2016-09-02 09:04:25 UTC
Created attachment 690655 [details]
abanc_net_install_leap42_2_execvp_failure.log.gz

The initial problem description was related to a user error
(specifying in boot parameter the mounted net iso as source repo)
The consequence of this user error is triggering three successive problems
(1- 2- and 3- below) 

0- the machine has 4 ethernet interfaces (eth0 ... eth3)
   with only eth0 wired to network.

1- the all eth* network interfaces are flagged as failed
   because did not found the <repo url>/boot/ppc64le/config
   and "Automatic setup not possible" is reported in log (line 2049) 
   BUT only the last eth3 is retried when trying to access 
   the default repo http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo
   and that failed because eth3 not connectable (line 2059..2098)

2- if manually retry the url, then eth0 is correctly enabled (line 2202)
   but the repo http://download.opensuse.org/ports/ppc/distribution/leap/42.2-Current/repo
   is reporting /content file as not found (line 2218)
   Why is it failing for this url
   http://download.opensuse.org/ports/ppc/distribution/leap/42.2-Current/repo
   that is accessible in a session firefox browser.
   note that the default url
   http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo
   is converted to previous one when trying to access in a session firefox browser.

3- if manually retry with eth0 enabled and  default url
   then reported missing execvp if a SHA1 sum failure,
   as reported in new abanc_net_install_leap42_2_execvp_failure.log (line 1672)
   do we need to add execvp in initrd of net install iso ?
Comment 3 Michel Normand 2016-09-02 09:08:25 UTC
The line numbers refererenced in previous comment #2
for items 1- and 2- are related to first attachment  abanc_net_install_leap42_2_failure.log

while the line number in item 3- is related to 2nd attachment
abanc_net_install_leap42_2_execvp_failure.log.gz
Comment 4 Michel Normand 2016-10-05 08:51:45 UTC
Created attachment 695850 [details]
linuxrc.log red popup
Comment 5 Michel Normand 2016-10-05 08:54:27 UTC
(In reply to Michel Normand from comment #4)
> Created attachment 695850 [details]
> linuxrc.log red popup
This attachment is about new trial:

I tried again a net install with last iso Build0130 from (1)

the error is now reported as red popup by linuxrc:
===
  Installation system does not match your boot medium.
  Sorry, this will not work.
===

The attached console log in which I captured the linuxrc.log
is reporting errors to access some repo files as extracted in (2)

(1) http://download.opensuse.org/ports/ppc/distribution/leap/42.2-Current/iso/openSUSE-Leap-42.2-NET-ppc64le-Build0130-Media.iso

(2) extract linuxrc.log
===
07:49:21 <4>: url = http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss//part.info
07:49:21 <2>: loading http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss//part.info -> /part.info
07:49:21 <2>: error 22: The requested URL returned error: 404 Not Found
07:49:21 <4>: url = http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss//control.xml
07:49:21 <2>: loading http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss//control.xml -> /control.xml
07:49:22 <2>: sha1   f9ffa6b3f4e10f35d174db96accba9bf...
07:49:22 <2>: sha256 5db008dc6c1d42bd26470441ac4b31bd...
07:49:22 <2>: digest not checked
07:49:22 <4>: url = http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss//autoinst.xml
07:49:22 <2>: loading http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss//autoinst.xml -> /tmp/autoinst.xml
07:49:22 <2>: error 22: The requested URL returned error: 404 Not Found
07:49:22 <4>: url = http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss/driverupdate
07:49:22 <2>: loading http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss/driverupdate -> /download/file_0008
07:49:22 <2>: error 22: The requested URL returned error: 404 Not Found
07:49:22 <4>: find repo:
07:49:22 <4>:   ok = 1
07:49:22 <4>:   is.network = 1
07:49:22 <4>:   is.mountable = 0
07:49:22 <4>:   device = eth0
07:49:22 <4>:   ZyppRepoURL: http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss/
07:49:22 <4>: win on
07:49:22 <4>: exec: /usr/bin/plymouth quit = 2
07:49:22 <4>: stderr:
error: unexpectedly disconnected from boot status daemon
07:49:22 <2>: error setting kbd mode: Inappropriate ioctl for device
07:50:24 <4>: win off
===
Comment 6 Michel Normand 2016-11-07 10:03:37 UTC
Hello Dinar,
are you working on this bug assigned to you ?
if not who is supposed to work on it ?

My assumption is that this is a problem in the content of the repo
http://download.opensuse.org/ports/ppc/distribution/leap/42.2/repo/oss/

but I do not know how this repo is created from the OBS process.
Comment 7 Forgotten User ny8t7SHjD_ 2016-11-07 10:05:54 UTC
I didn't had time so far. Will look at it today
Comment 8 Michel Normand 2016-11-16 13:44:41 UTC
Seems that the root cause is to try to use a TW net iso that is more recent than the default TW oss repo content. 
http://download.opensuse.org/ports/ppc/tumbleweed/repo/oss/

For Leap 42.2 there is no more error today because
default oss repo and last iso accessible as now openQA passed.
https://openqa.opensuse.org/group_overview/21

For TW, because some openQA tests are failing the oss repo is not updated versus last iso used for tests.
https://build.opensuse.org/project/dashboard/openSUSE:Factory:PowerPC
===
Versions
    Source: 20161116
    Testing: 20161115
    Published: 20160927-ppc64
===

Is there a way to access the openqa repo http://openqa.opensuse.org/assets/repo/openSUSE-Tumbleweed-oss-ppc64_ppc64le-Snapshot20161115 outside openQA ?
Comment 9 Michel Normand 2016-12-02 12:33:07 UTC
current status:
problem when using net install on TW with default TW repo (no failure on openQA primary instance because they have their own repo)
linuxrc stops on red popup "Installation System does not match your boot medium"
Comment 10 Steffen Winterfeldt 2016-12-02 13:38:35 UTC
I thought kexec=1 is the default now in TW (see bug 990374)?
Comment 11 Michel Normand 2016-12-02 15:11:00 UTC
(In reply to Steffen Winterfeldt from comment #10)
> I thought kexec=1 is the default now in TW (see bug 990374)?

good to know for all the history of bug 990374 :)

yes the kexec=1 is already setup for net install,
but clearly not sufficient.

So I am just trying also adding instsyscomplain=0 as a bypass
and it passed the checking.

So next step is to determine what to do.
Comment 12 Steffen Winterfeldt 2016-12-02 15:32:25 UTC
> yes the kexec=1 is already setup for net install,
> but clearly not sufficient.

It sure is. Could it be missing in TW? If you see the dialog despite kexec=1 the TW install repo is inconsistent.

> So I am just trying also adding instsyscomplain=0 as a bypass

Don't!

The linuxrc message is not just for fun. It's stating a fact - you can't continue there.
Comment 13 Michel Normand 2016-12-02 15:46:26 UTC
Michal I changed the assignee from Dinar to you because as far as I understand the problem is between the checking done by linuxrc and the status of the TW repo for PowerPC.
So Dinar is not able to do anything on that.
Comment 14 Michal Suchanek 2016-12-05 10:46:50 UTC
This is a release problem.

The released FTP repo needs to be in sync with released ISO and it is not.

I am not sure who is the correct assignee for tumbleweed releases.
Comment 15 Steffen Winterfeldt 2016-12-05 11:36:58 UTC
screening team, please assign to whoever is in charge of TW releases
Comment 16 Michel Normand 2017-04-11 12:00:46 UTC
I have the same problem for Leap 42.3 with last tested Build 0045.

What is missing in the release process ?

http://download.opensuse.org/ports/ppc/distribution/leap/42.3-Current/iso/
http://download.opensuse.org/ports/ppc/distribution/leap/42.3-Current/repo/oss
Comment 17 Dominique Leuenberger 2017-05-29 17:39:31 UTC
(In reply to Michel Normand from comment #16)
> I have the same problem for Leap 42.3 with last tested Build 0045.

TW and Leap should handle that differnetly: for TW, kexec-1 should be the default (as we know the repo is supposed to change very frequently) - for Leap, this is not the case and the repo and installer is supposed to be released in sync.

The issue is most likely that we changed (quite a long time ago) to rebuild=local, which means that installation-images-openSUSE is not being rebuiilt for every snapshot - and in turn does not have the correct identifiers for the to-be-released repo.

We need more logic for some packages, where a rebuild is more needed than for others. Sounds like something for our rebuildpacs bot actualy
Comment 18 Dominique Leuenberger 2017-06-06 12:51:23 UTC
(In reply to Michel Normand from comment #13)
> Michal I changed the assignee from Dinar to you because as far as I
> understand the problem is between the checking done by linuxrc and the
> status of the TW repo for PowerPC.
> So Dinar is not able to do anything on that.

I'm a bit confused here: is the bug now about TW or 42.3? In both cases, the /net installer published is supposed to match the repo which is being tested by openQA. If this is not the case, then installation-images:openSUSE was likely not build triggered in time
Comment 19 Steffen Winterfeldt 2017-06-06 13:03:38 UTC
BTW, there used to be kexec=1 added for TW net isos - this seems no longer to be the case.
Comment 20 Dominique Leuenberger 2017-06-06 13:13:28 UTC
(In reply to Steffen Winterfeldt from comment #19)
> BTW, there used to be kexec=1 added for TW net isos - this seems no longer
> to be the case.

https://github.com/openSUSE/kiwi-instsource-plugins/blob/c86eaa0666661e21e99f31e529acc309a0ed8ee9/KIWIMiniIsoPlugin.pm#L146

Seems this broke at one point then
Comment 21 Ludwig Nussel 2017-06-07 12:30:24 UTC
see also bug 990374, can we have the popup in linuxrc finally? :)
Comment 22 Steffen Winterfeldt 2017-06-07 12:56:02 UTC
It's in the yast team's incoming board.
Comment 23 Michel Normand 2017-06-15 07:42:27 UTC
*** Bug 1041077 has been marked as a duplicate of this bug. ***
Comment 24 Michel Normand 2017-06-15 13:09:05 UTC
(In reply to Ludwig Nussel from comment #21)
> see also bug 990374, can we have the popup in linuxrc finally? :)

Ludwig, is the popup now displayed now in last Leap 42.3 Build 0089 (1) the one you were expecting ?

(1) https://openqa.opensuse.org/tests/421478#step/welcome/5
Comment 25 Ludwig Nussel 2017-06-16 05:57:15 UTC
no, that's unrelated to the issue discussed here.
Comment 26 Oliver Kurz 2017-06-17 06:38:59 UTC
See https://openqa.opensuse.org/tests/latest?test=tumbleweed-image&distri=opensuse&flavor=NET&machine=ppc64le&version=Tumbleweed&arch=ppc64le for the latest job on openSUSE Tumbleweed currently showing the same problem.
Comment 27 Ludwig Nussel 2017-06-20 14:15:03 UTC
(In reply to Oliver Kurz from comment #26)
> See
> https://openqa.opensuse.org/tests/latest?test=tumbleweed-
> image&distri=opensuse&flavor=NET&machine=ppc64le&version=Tumbleweed&arch=ppc6
> 4le for the latest job on openSUSE Tumbleweed currently showing the same
> problem.

Again. Different issue.
I don't see the bootloader typing in the install=$openqaurl parameter in that test...
Comment 28 Paul Borowicz 2018-02-07 15:02:40 UTC
(In reply to Dominique Leuenberger from comment #18)
> (In reply to Michel Normand from comment #13)
> > Michal I changed the assignee from Dinar to you because as far as I
> > understand the problem is between the checking done by linuxrc and the
> > status of the TW repo for PowerPC.
> > So Dinar is not able to do anything on that.
> 
> I'm a bit confused here: is the bug now about TW or 42.3? In both cases, the
> /net installer published is supposed to match the repo which is being tested
> by openQA. If this is not the case, then installation-images:openSUSE was
> likely not build triggered in time

I experienced this issue with both 42.3 and Tumbleweed last night.
Comment 29 Tomáš Chvátal 2019-07-11 11:05:52 UTC
This is automated batch bugzilla cleanup.

The openSUSE 42.3 changed to end-of-life (EOL [1]) status. As such
it is no longer maintained, which means that it will not receive any
further security or bug fix updates.
As a result we are closing this bug.

If you can reproduce this bug against a currently maintained version of 
openSUSE (At this moment openSUSE Leap 15.1, 15.0 and Tumbleweed) please
feel free to reopen this bug against that version (!you must update the
"Version" component in the bug fields, do not just reopen please), or
alternatively create a new ticket.

Thank you for reporting this bug and we are sorry it could not be fixed
during the lifetime of the release.

[1] https://en.opensuse.org/Lifetime