Bug 1201560

Summary: Since 15.4 getting 100's of cron *** stack smashing detected ***: terminated
Product: [openSUSE] openSUSE Distribution Reporter: Larry Rainey <llrainey15>
Component: OtherAssignee: Andreas Schwab <schwab>
Status: RESOLVED FIXED QA Contact: E-mail List <qa-bugs>
Severity: Critical    
Priority: P1 - Urgent CC: fvogt, meissner, per, screening-team-bugs
Version: Leap 15.4   
Target Milestone: ---   
Hardware: x86-64   
OS: openSUSE Leap 15.4   
Whiteboard:
Found By: --- Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---

Description Larry Rainey 2022-07-15 23:22:00 UTC
This crontab has not changed for 12 years - I have run every script as root with no errors and they all take a few thousands of a second to execute.

I just checked my Tumbleweed, Mint, Ubuntu and Manjaro Linux and they are not logging that error with the exact same crontab entries. 


Code:

Jul 15 17:49:01 VM1 cron[4521]: *** stack smashing detected ***: terminated
Jul 15 17:49:01 VM1 cron[4520]: *** stack smashing detected ***: terminated
Jul 15 17:50:01 VM1 cron[4524]: *** stack smashing detected ***: terminated
Jul 15 17:50:01 VM1 cron[4525]: *** stack smashing detected ***: terminated

Code:

# crontab -l
5 3,9,15,21 * * * /bin/bash -c /usr/bin/freshclam 1>/tmpx/freshclam 2>&1
*/15 * * * * /root/bin/fixdate 1>>/tmpx/fixdate.log 2>&1
*/1 * * * * /root/bin/fixdconf 1>>/tmpx/fixdconf.log 2>&1
*/1 * * * * /root/bin/ssh_ip_ban 1>/tmpx/ssh_ip_ban.log 2>&1
6 2 * * 0 /root/bin/mkipset 1>/tmpx/mkipset.log 2>&1
Comment 1 Marcus Meissner 2022-07-16 08:19:38 UTC
can you try to get a gdb backtrace of this?

zypper in cronie-debuginfo

gdb cron
run -f

and wait?
Comment 2 Larry Rainey 2022-07-16 12:21:05 UTC
LLR22:~ # zypper in cronie-debuginfo
Loading repository data...
Reading installed packages...
Package 'cronie-debuginfo' not found.
Resolving package dependencies...
Nothing to do.
LLR22:~ # zypper lr -d
#  | Alias                       | Name                                                                                        | Enabled | GPG Check | Refresh | Priority | Type   | URI                                                                                 | Service
---+-----------------------------+---------------------------------------------------------------------------------------------+---------+-----------+---------+----------+--------+-------------------------------------------------------------------------------------+--------
 1 | Packman                     | Packman 15.4 Repository                                                                     | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://ftp.gwdg.de/pub/linux/misc/packman/suse/openSUSE_Leap_15.4                   | 
 2 | X11_MATE_Current            | MATE openSUSE_Leap_15.4                                                                     | No      | ----      | ----    |   99     | NONE   | http://download.opensuse.org/repositories/X11:/MATE:/Current/openSUSE_Leap_15.4/    | 
 3 | adobe                       | adobe                                                                                       | No      | ----      | ----    |   99     | NONE   | http://linuxdownload.adobe.com/linux/x86_64/                                        | 
 4 | brave-browser               | brave-browser                                                                               | No      | ----      | ----    |   99     | NONE   | https://brave-browser-rpm-release.s3.brave.com/x86_64/                              | 
 5 | mozilla                     | mozilla                                                                                     | No      | ----      | ----    |   99     | NONE   | http://download.opensuse.org/repositories/mozilla/openSUSE_Leap_15.4                | 
 6 | os-repo-backports-update    | Update repository of openSUSE Backports                                                     | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://mirrorcache-us.opensuse.org/update/leap/15.4/backports/                     | 
 7 | os-repo-non-oss             | openSUSE-Leap-15.4-Non-Oss                                                                  | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://mirrorcache-us.opensuse.org/distribution/leap/15.4/repo/non-oss/            | 
 8 | os-repo-oss                 | openSUSE-Leap-15.4-Oss                                                                      | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://mirrorcache-us.opensuse.org/distribution/leap/15.4/repo/oss/                | 
 9 | os-repo-sle-update          | Update repository from SUSE Linux Enterprise 15                                             | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://mirrorcache-us.opensuse.org/update/leap/15.4/sle/                           | 
10 | os-repo-update              | openSUSE-Leap-15.4-Update                                                                   | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://mirrorcache-us.opensuse.org/update/leap/15.4/oss/                           | 
11 | os-repo-update-non-oss      | Update Repository (Non-Oss)                                                                 | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | https://mirrorcache-us.opensuse.org/update/leap/15.4/non-oss/                       | 
12 | os-repo-virtualization      | openSUSE-Leap-15.4-Virtualization                                                           | No      | ----      | ----    |   99     | NONE   | https://mirrorcache-us.opensuse.org/repositories/Virtualization/openSUSE_Leap_15.4/ | 
13 | repo-backports-debug-update | Update repository with updates for openSUSE Leap debuginfo packages from openSUSE Backports | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://download.opensuse.org/update/leap/15.4/backports_debug/                      | 
14 | repo-backports-update       | Update repository of openSUSE Backports                                                     | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://download.opensuse.org/update/leap/15.4/backports/                            | 
15 | repo-sle-debug-update       | Update repository with debuginfo for updates from SUSE Linux Enterprise 15                  | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://download.opensuse.org/debug/update/leap/15.4/sle/                            | 
16 | repo-sle-update             | Update repository with updates from SUSE Linux Enterprise 15                                | Yes     | (r ) Yes  | Yes     |   99     | rpm-md | http://download.opensuse.org/update/leap/15.4/sle/                                  | 
17 | skype-stable                | Skypeforlinux - stable                                                                      | No      | ----      | ----    |   99     | rpm-md | https://repo.skype.com/rpm/stable/                                                  | 
18 | teamviewer                  | TeamViewer - x86_64                                                                         | Yes     | (r ) Yes  | No      |   99     | rpm-md | https://linux.teamviewer.com/yum/stable/main/binary-x86_64/                         | 
LLR22:~ #
Comment 3 Larry Rainey 2022-07-16 12:23:30 UTC
I can allow you either ssh into one of the 44 computers showing this or teamviewer / anydesk into one as well.
Comment 4 Larry Rainey 2022-07-16 13:19:44 UTC
found root cause - systems were up for 36 days.
A reboot cleared the problem - It showed up after the new libc was installed.
Comment 5 Marcus Meissner 2022-07-16 14:32:48 UTC
weird. perhaps a temporary memory corruption?
Comment 6 Per Jessen 2022-07-19 12:39:36 UTC
FWIW, we are seeing the same on pontifex, ref: https://progress.opensuse.org/issues/113809, since  2022-07-16
Comment 7 Marcus Meissner 2022-07-19 12:49:32 UTC
ok, glibc regression i would say
Comment 8 Marcus Meissner 2022-07-19 14:09:51 UTC
a fixing update is on the way to QA
Comment 9 Per Jessen 2022-07-20 07:43:51 UTC
(In reply to Per Jessen from comment #6)
> FWIW, we are seeing the same on pontifex, ref:
> https://progress.opensuse.org/issues/113809, since  2022-07-16

Solved by restarting cron.
Comment 11 Swamp Workflow Management 2022-07-21 16:19:01 UTC
SUSE-RU-2022:2494-1: An update that has three recommended fixes can now be installed.

Category: recommended (important)
Bug References: 1200855,1201560,1201640
CVE References: 
JIRA References: 
Sources used:
openSUSE Leap 15.4 (src):    glibc-2.31-150300.37.1, glibc-utils-src-2.31-150300.37.1
openSUSE Leap 15.3 (src):    glibc-2.31-150300.37.1, glibc-utils-src-2.31-150300.37.1
SUSE Linux Enterprise Module for Development Tools 15-SP4 (src):    glibc-2.31-150300.37.1, glibc-utils-src-2.31-150300.37.1
SUSE Linux Enterprise Module for Development Tools 15-SP3 (src):    glibc-2.31-150300.37.1, glibc-utils-src-2.31-150300.37.1
SUSE Linux Enterprise Module for Basesystem 15-SP4 (src):    glibc-2.31-150300.37.1
SUSE Linux Enterprise Module for Basesystem 15-SP3 (src):    glibc-2.31-150300.37.1
SUSE Linux Enterprise Micro 5.2 (src):    glibc-2.31-150300.37.1
SUSE Linux Enterprise Micro 5.1 (src):    glibc-2.31-150300.37.1

NOTE: This line indicates an update has been released for the listed product(s). At times this might be only a partial fix. If you have questions please reach out to maintenance coordination.
Comment 12 Andreas Schwab 2022-07-25 09:10:46 UTC
Fixed.
Comment 13 Swamp Workflow Management 2022-09-01 15:11:23 UTC
SUSE-RU-2022:2494-2: An update that has three recommended fixes can now be installed.

Category: recommended (important)
Bug References: 1200855,1201560,1201640
CVE References: 
JIRA References: 
Sources used:
openSUSE Leap Micro 5.2 (src):    glibc-2.31-150300.37.1

NOTE: This line indicates an update has been released for the listed product(s). At times this might be only a partial fix. If you have questions please reach out to maintenance coordination.