Bug 922536

Summary: systemd-logind errors after update including assertion failure
Product: [openSUSE] openSUSE 13.1 Reporter: Archie Cobbs <archie.cobbs>
Component: BasesystemAssignee: systemd maintainers <systemd-maintainers>
Status: RESOLVED FIXED QA Contact: E-mail List <qa-bugs>
Severity: Normal    
Priority: P5 - None CC: archie.cobbs, Mathias.Homann, thomas.blume
Version: Final   
Target Milestone: ---   
Hardware: Other   
OS: openSUSE 13.1   
Whiteboard:
Found By: --- Services Priority:
Business Priority: Blocker: ---
Marketing QA Status: --- IT Deployment: ---

Description Archie Cobbs 2015-03-16 13:47:18 UTC
After a "zypper up" upgrade last week, I'm seeing these errors repeating in /var/log/warn:


Mar 16 08:34:41 test systemd-logind[1598]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 16 08:34:41 test systemd-logind[1598]: Failed to start user slice: Transaction is destructive.
Mar 16 08:34:41 test systemd-logind[1598]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 16 08:34:41 test systemd-logind[1598]: Failed to start user service: Transaction is destructive.
Mar 16 08:34:41 test systemd-logind[1598]: Assertion 's->user->slice' failed at src/login/logind-session.c:502, function session_start_scope(). Aborting.
Mar 16 08:34:52 test systemd-logind[1669]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 16 08:34:52 test systemd-logind[1669]: Failed to start user slice: Transaction is destructive.
Mar 16 08:34:52 test systemd-logind[1669]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 16 08:34:52 test systemd-logind[1669]: Failed to start user service: Transaction is destructive.
Mar 16 08:34:52 test systemd-logind[1669]: Assertion 's->user->slice' failed at src/login/logind-session.c:502, function session_start_scope(). Aborting.
Mar 16 08:35:41 test systemd-logind[1754]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 16 08:35:41 test systemd-logind[1754]: Failed to start user slice: Transaction is destructive.
Mar 16 08:35:41 test systemd-logind[1754]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 16 08:35:41 test systemd-logind[1754]: Failed to start user service: Transaction is destructive.
Mar 16 08:35:41 test systemd-logind[1754]: Assertion 's->user->slice' failed at src/login/logind-session.c:502, function session_start_scope(). Aborting.
Mar 16 08:37:28 test systemd-logind[1814]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 16 08:37:28 test systemd-logind[1814]: Failed to start user slice: Transaction is destructive.
Mar 16 08:37:28 test systemd-logind[1814]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 16 08:37:28 test systemd-logind[1814]: Failed to start user service: Transaction is destructive.
Mar 16 08:37:28 test systemd-logind[1814]: Assertion 's->user->slice' failed at src/login/logind-session.c:502, function session_start_scope(). Aborting.
Mar 16 08:38:51 test systemd-logind[1964]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 16 08:38:51 test systemd-logind[1964]: Failed to start user slice: Transaction is destructive.
Mar 16 08:38:51 test systemd-logind[1964]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 16 08:38:51 test systemd-logind[1964]: Failed to start user service: Transaction is destructive.
Mar 16 08:38:51 test systemd-logind[1964]: Assertion 's->user->slice' failed at src/login/logind-session.c:502, function session_start_scope(). Aborting.


I am also getting these errors now:


Mar 14 21:50:13 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.
Mar 14 21:50:13 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.
Mar 14 21:50:40 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.
Mar 14 21:50:40 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.
Mar 15 23:31:02 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.
Mar 15 23:31:02 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.
Mar 15 23:31:27 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.
Mar 15 23:31:28 test systemd[1]: systemd-logind.service start request repeated too quickly, refusing to start.


Here is a list (parsed out from /var/log/zypper.log) showing what got upgraded in the past couple of weeks. Note systemd update:

2015-03-04 09:53:32 | install | 2.18-4.29.1 | glibc
2015-03-04 09:53:32 | install | 2.18-4.29.1 | glibc-32bit
2015-03-04 09:54:16 | install | 20130906-10.1 | ucode-intel
2015-03-04 09:54:17 | install | 4.4.0-2.4.1 | tcpdump
2015-03-04 09:54:17 | install | 1.26-19.16.1 | tar
2015-03-04 09:54:17 | install | 5.4.20-38.1 | php5
2015-03-04 09:54:18 | install | 3.17.4-52.1 | mozilla-nss-certs
2015-03-04 09:54:18 | install | 208-32.1 | libudev1
2015-03-04 09:54:18 | install | 0.2.3-8.1 | libtirpc1
2015-03-04 09:54:18 | install | 3.17.4-52.1 | libfreebl3
2015-03-04 09:54:26 | install | 2.18-4.29.1 | glibc-locale
2015-03-04 09:54:26 | install | 2.18-4.29.1 | glibc-extra
2015-03-04 09:54:26 | install | 1.5.4-12.17.1 | cups-libs
2015-03-04 09:54:26 | install | 5.4.20-38.1 | php5-zlib
2015-03-04 09:54:26 | install | 5.4.20-38.1 | php5-xmlwriter
2015-03-04 09:54:26 | install | 5.4.20-38.1 | php5-tokenizer
2015-03-04 09:54:26 | install | 5.4.20-38.1 | php5-pdo
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-mcrypt
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-mbstring
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-json
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-iconv
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-gd
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-dom
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-ctype
2015-03-04 09:54:27 | install | 5.4.20-38.1 | php5-bz2
2015-03-04 09:54:28 | install | 5.4.20-38.1 | apache2-mod_php5
2015-03-04 09:55:02 | install | 208-32.1 | udev
2015-03-04 09:55:02 | install | 3.17.4-52.1 | libsoftokn3
2015-03-04 09:55:02 | install | 5.4.20-38.1 | php5-sqlite
2015-03-04 09:55:02 | install | 5.4.20-38.1 | php5-mysql
2015-03-04 09:55:02 | install | 5.4.20-38.1 | php5-xmlreader
2015-03-04 09:55:02 | install | 208-32.1 | libgudev-1_0-0
2015-03-04 09:55:02 | install | 1.8.16-4.36.1 | libdbus-1-3
2015-03-04 09:55:03 | install | 3.17.4-52.1 | mozilla-nss
2015-03-04 09:55:03 | install | 1.8.16-4.36.2 | dbus-1
2015-03-04 09:55:05 | install | 208-32.1 | systemd
2015-03-04 09:55:05 | install | 1.8.16-4.36.2 | dbus-1-x11
2015-03-04 09:55:05 | install | 208-32.1 | systemd-sysvinit
2015-03-04 09:55:06 | install | 4.1.17-3.30.1 | libtevent-util0
2015-03-04 09:55:06 | install | 4.1.17-3.30.1 | libdcerpc-binding0
2015-03-04 09:55:06 | install | 4.1.17-3.30.1 | libndr-nbt0
2015-03-04 09:55:06 | install | 4.1.17-3.30.1 | libgensec0
2015-03-04 09:55:06 | install | 4.1.17-3.30.1 | libsamba-credentials0
2015-03-04 09:55:07 | install | 4.1.17-3.30.1 | samba-libs
2015-03-04 09:55:07 | install | 4.1.17-3.30.1 | libsamba-util0
2015-03-04 09:55:07 | install | 4.1.17-3.30.1 | libndr0
2015-03-04 09:55:07 | install | 4.1.17-3.30.1 | libsamba-hostconfig0
2015-03-04 09:55:07 | install | 4.1.17-3.30.1 | libndr-standard0
2015-03-04 09:55:07 | install | 4.1.17-3.30.1 | libsmbconf0
2015-03-04 09:55:07 | install | 4.1.17-3.30.1 | libsamdb0
2015-03-04 09:55:08 | install | 4.1.17-3.30.1 | libwbclient0
2015-03-04 09:55:08 | install | 4.1.17-3.30.1 | libpdb0
2015-03-04 09:55:08 | install | 4.1.17-3.30.1 | libsmbclient-raw0
2015-03-04 09:55:08 | install | 4.1.17-3.30.1 | libdcerpc0
2015-03-04 09:55:08 | install | 4.1.17-3.30.1 | libndr-krb5pac0
2015-03-04 09:55:08 | install | 4.1.17-3.30.1 | libnetapi0
2015-03-04 09:55:08 | install | 4.1.17-3.30.1 | libsmbldap0
2015-03-04 09:55:09 | install | 4.1.17-3.30.1 | libsmbclient0
2015-03-10 08:37:31 | install | 4.0.3-8.4.1 | libtiff5
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-zlib
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-xmlwriter
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-tokenizer
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-pdo
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-mcrypt
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-mbstring
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-json
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-iconv
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-gd
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-dom
2015-03-10 08:37:32 | install | 5.4.20-42.1 | php5-ctype
2015-03-10 08:37:33 | install | 5.4.20-42.1 | php5-bz2
2015-03-10 08:37:33 | install | 5.4.20-42.1 | apache2-mod_php5
2015-03-10 08:37:33 | install | 5.4.20-42.1 | php5-sqlite
2015-03-10 08:37:33 | install | 5.4.20-42.1 | php5-mysql
2015-03-10 08:37:33 | install | 5.4.20-42.1 | php5-xmlreader
Comment 1 Dr. Werner Fink 2015-03-17 07:51:57 UTC
(In reply to Archie Cobbs from comment #0)

About which version of systemd we are talking about? Please specifiy the exact version:

       rpm -q systemd
       rpm -q --changelog systemd  | head

beside this I'd like to commend to use systemd-210 from the project Base:System:Legacy
Comment 2 Thomas Blume 2015-03-17 08:06:40 UTC
(In reply to Archie Cobbs from comment #0)
> After a "zypper up" upgrade last week, I'm seeing these errors repeating in
> /var/log/warn:
[...]
> 
> Mar 16 08:34:41 test systemd-logind[1598]: Assertion 's->user->slice' failed
> at src/login/logind-session.c:502, function session_start_scope(). Aborting.
[...]

Looks like:

https://bugzilla.redhat.com/show_bug.cgi?id=984152
Comment 5 Archie Cobbs 2015-03-17 13:09:30 UTC
$ rpm -q systemd
systemd-208-32.1.x86_64
$ rpm -q --changelog systemd  | head
* Thu Feb 19 2015 thomas.blume@suse.com
- systemd still crashing, reverting the patch from bsc#878853
  remove upstream-fix-hanging-ssh-sessions-at-shutdown.patch

* Wed Feb 18 2015 thomas.blume@suse.com
- call to function unit_unwatch_pid is broken in manager.c (bsc#918226)
  remove it from upstream-fix-hanging-ssh-sessions-at-shutdown.patch

* Tue Jan 27 2015 thomas.blume@suse.com
- close ssh sessions at shutdown (bsc#878853)
Comment 6 Thomas Blume 2015-03-17 13:38:45 UTC
(In reply to Archie Cobbs from comment #5)
> $ rpm -q systemd
> systemd-208-32.1.x86_64
> $ rpm -q --changelog systemd  | head
> * Thu Feb 19 2015 thomas.blume@suse.com
> - systemd still crashing, reverting the patch from bsc#878853
>   remove upstream-fix-hanging-ssh-sessions-at-shutdown.patch
> 
> * Wed Feb 18 2015 thomas.blume@suse.com
> - call to function unit_unwatch_pid is broken in manager.c (bsc#918226)
>   remove it from upstream-fix-hanging-ssh-sessions-at-shutdown.patch
> 
> * Tue Jan 27 2015 thomas.blume@suse.com
> - close ssh sessions at shutdown (bsc#878853)

That is unrelated. 
There is no systemd crash in this report and patch has been reverted anyway.
Comment 7 Thomas Blume 2015-03-18 15:52:54 UTC
Testpackages with a proposed fix are available at:

http://download.opensuse.org/repositories/home:/tsaupe:/branches:/openSUSE:/13.1:/Update:/bsc922536/standard/x86_64/

Please test and report wheter it fixes the issue.
Comment 8 Archie Cobbs 2015-03-19 02:50:42 UTC
I tested the fix and it did eliminate the assertion error in the logs, so that is an improvement, but the others remain.

Here are the errors appearing after rebooting. Note the same "Transaction is destructive" cycle.

Mar 18 21:38:25 test systemd[1752]: Failed to open private bus connection: Failed to connect to socket /run/user/1000/dbus/user_bus_socket: No such file or directory
Mar 18 21:38:26 test systemd[1]: Failed to start LSB: Configure network interfaces and set up routing.
Mar 18 21:38:41 test sudo: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Mar 18 21:38:41 test su: pam_systemd(su:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Mar 18 21:40:15 test systemd[2039]: Failed to open private bus connection: Failed to connect to socket /run/user/1000/dbus/user_bus_socket: No such file or directory
Mar 18 21:43:30 test systemd[2107]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 18 21:44:12 test systemd[2174]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 18 21:44:50 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 18 21:44:50 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 18 21:44:50 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 18 21:44:50 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 18 21:44:50 test sshd[2234]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 18 21:44:52 test sshd[2287]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 18 21:44:52 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 18 21:44:52 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 18 21:44:52 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 18 21:44:52 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 18 21:45:01 test systemd[2350]: Failed to open private bus connection: Failed to connect to socket /run/user/0/dbus/user_bus_socket: No such file or directory
Mar 18 21:45:06 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 18 21:45:06 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 18 21:45:06 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 18 21:45:06 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 18 21:45:06 test sshd[2372]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 18 21:45:42 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 18 21:45:51 test systemd[2457]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 18 21:46:31 test systemd[1]: user@0.service stopping timed out. Killing.
Mar 18 21:46:34 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 18 21:46:34 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 18 21:46:34 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 18 21:46:34 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 18 21:46:34 test sshd[2522]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 18 21:46:38 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 18 21:46:38 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 18 21:46:38 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 18 21:46:38 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 18 21:46:38 test sshd[2580]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 18 21:46:39 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 18 21:46:39 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 18 21:46:39 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 18 21:46:39 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 18 21:46:39 test sshd[2631]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 18 21:47:16 test sudo: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Mar 18 21:47:21 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 18 21:47:40 test systemd[2706]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 18 21:47:56 test systemd[2767]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory

It sure seems like systemd is having a lot of trouble!
Comment 11 Thomas Blume 2015-03-20 11:53:03 UTC
(In reply to Archie Cobbs from comment #8)
> I tested the fix and it did eliminate the assertion error in the logs, so
> that is an improvement, but the others remain.
> 
[...]
> 
> It sure seems like systemd is having a lot of trouble!

Indeed, there are multiple bugs.
I've added another patch from:

https://bugzilla.suse.com/show_bug.cgi?id=855160

which addresses this:

> Mar 18 21:38:26 test systemd[1]: Failed to start LSB: Configure network
> interfaces and set up routing.
> Mar 18 21:38:41 test sudo: pam_systemd(sudo:session): pam_putenv: delete
> non-existent entry; XDG_RUNTIME_DIR
> Mar 18 21:38:41 test su: pam_systemd(su:session): pam_putenv: delete
> non-existent entry; XDG_RUNTIME_DIR

But even with this patch, we have a session cleanup problem.
I'm torturing a test machine with permanent ssh session creation each 10 seconds.
After a few hours, I get the 'Transaction is destructive' messages.
Reason is that the user-0.slice stop job doesn't finish.
In the working case, I can see these messages for the user-0.slice stop job:

-->--
Mär 19 16:34:04 hb systemd[1]: Trying to enqueue job user-0.slice/stop/fail
Mär 19 16:34:04 hb systemd[1]: Installed new job user-0.slice/stop as 8754
Mär 19 16:34:04 hb systemd[1]: Enqueued job user-0.slice/stop as 8754
Mär 19 16:34:04 hb systemd[1]: Stopping user-0.slice.
Mär 19 16:34:04 hb systemd[1]: user-0.slice changed active -> dead
Mär 19 16:34:04 hb systemd[1]: Job user-0.slice/stop finished, result=done
Mär 19 16:34:04 hb systemd[1]: Removed slice user-0.slice.
Mär 19 16:34:04 hb systemd[1]: Collecting user-0.slice
--<--

When it starts to fail, I only see this:

Mär 19 16:34:16 hb systemd[1]: Trying to enqueue job user-0.slice/stop/fail
Mär 19 16:34:16 hb systemd[1]: Installed new job user-0.slice/stop as 8847
Mär 19 16:34:16 hb systemd[1]: Enqueued job user-0.slice/stop as 8847

So, the slice is still present.
Now, if the next job is started, it cannot create a new slice for user-0:

-->--
Mär 19 16:34:17 hb systemd[1]: Trying to enqueue job user-0.slice/start/fail
Mär 19 16:34:17 hb systemd-logind[692]: Failed to start unit user-0.slice: Transaction is destructive.
Mär 19 16:34:17 hb systemd-logind[692]: Failed to start user slice: Transaction is destructive.
Mär 19 16:34:17 hb systemd-logind[692]: Failed to start unit user@0.service: Transaction is destructive.
Mär 19 16:34:17 hb systemd-logind[692]: Failed to start user service: Transaction is destructive.
Mär 19 16:34:17 hb systemd[1]: Requested transaction contradicts existing jobs: Transaction is destructive.
Mär 19 16:34:17 hb sshd[14219]: pam_systemd(sshd:session): Failed to create session: File exists
Mär 19 16:34:17 hb systemd[1]: Got D-Bus request: org.freedesktop.systemd1.Manager.StartUnit() on /org/freedesktop/systemd1
Mär 19 16:34:17 hb systemd[1]: Trying to enqueue job user@0.service/start/fail
Mär 19 16:34:17 hb systemd[1]: user-0.slice/start would change existing job.
--<--


However, creating a new session each 10 seconds is a quite extreme load.
On your system, it rather seems that the whole session hangs and cannot be stopped:

-->--
Mar 18 21:45:42 test systemd[1]: user@1001.service stopping timed out. Killing.
[...]
Mar 18 21:46:31 test systemd[1]: user@0.service stopping timed out. Killing.
--<--

Can you please send me the output of the command:

systemctl status | grep user
Comment 12 Thomas Blume 2015-03-20 12:13:30 UTC
Even better, please send me the full output of:

systemctl status
Comment 13 Archie Cobbs 2015-03-20 14:17:59 UTC
Hi Thomas, thanks for looking at this. Below is output of "systemctl status".

FYI, this machine is being monitored via Nagios. The Nagios server runs on a separate machine and periodically SSH's into this machine to run various Nagios checks. So new incoming SSH connections happen every couple of minutes or so.  

$ systemctl status

[archie@test.cookc] 999 systemctl status
proc-sys-fs-binfmt_misc.automount -> '/org/freedesktop/systemd1/unit/proc_2dsys_2dfs_2dbinfmt_5fmisc_2eautomount'
proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point
   Loaded: loaded (/usr/lib/systemd/system/proc-sys-fs-binfmt_misc.automount; static)
   Active: active (running) since Wed 2015-03-18 21:36:35 CDT; 1 day 11h ago
    Where: /proc/sys/fs/binfmt_misc
     Docs: https://www.kernel.org/doc/Documentation/binfmt_misc.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems

sys-devices-pci0000:00-0000:00:07.1-ata1-host1-target1:0:0-1:0:0:0-block-sr0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a07_2e1_2data1_2dhost1_2dtarget1_3a0_3a0_2d1_3a0_3a0_3a0_2dblock_2dsr0_2edevice'

sys-devices-pci0000:00-0000:00:07.1-ata1-host1-target1:0:0-1:0:0:0-block-sr0.device - VMware_Virtual_IDE_CDROM_Drive
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:43 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:07.1/ata1/host1/target1:0:0/1:0:0:0/block/sr0

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda-sda1.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a10_2e0_2dhost0_2dtarget0_3a0_3a0_2d0_3a0_3a0_3a0_2dblock_2dsda_2dsda1_2edevice'

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda-sda1.device - Virtual_disk
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:10.0/host0/target0:0:0/0:0:0:0/block/sda/sda1

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a10_2e0_2dhost0_2dtarget0_3a0_3a0_2d0_3a0_3a0_3a0_2dblock_2dsda_2edevice'

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda.device - Virtual_disk
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:10.0/host0/target0:0:0/0:0:0:0/block/sda

sys-devices-pci0000:00-0000:00:11.0-0000:02:01.0-net-ens33.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a11_2e0_2d0000_3a02_3a01_2e0_2dnet_2dens33_2edevice'

sys-devices-pci0000:00-0000:00:11.0-0000:02:01.0-net-ens33.device - PRO/1000 MT Single Port Adapter
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0/net/ens33

sys-devices-platform-floppy.0-block-fd0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dfloppy_2e0_2dblock_2dfd0_2edevice'

sys-devices-platform-floppy.0-block-fd0.device - /sys/devices/platform/floppy.0/block/fd0
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/floppy.0/block/fd0

sys-devices-platform-serial8250-tty-ttyS10.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS10_2edevice'

sys-devices-platform-serial8250-tty-ttyS10.device - /sys/devices/platform/serial8250/tty/ttyS10
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS10

sys-devices-platform-serial8250-tty-ttyS11.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS11_2edevice'

sys-devices-platform-serial8250-tty-ttyS11.device - /sys/devices/platform/serial8250/tty/ttyS11
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS11

sys-devices-platform-serial8250-tty-ttyS12.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS12_2edevice'

sys-devices-platform-serial8250-tty-ttyS12.device - /sys/devices/platform/serial8250/tty/ttyS12
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS12

sys-devices-platform-serial8250-tty-ttyS13.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS13_2edevice'

sys-devices-platform-serial8250-tty-ttyS13.device - /sys/devices/platform/serial8250/tty/ttyS13
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS13

sys-devices-platform-serial8250-tty-ttyS14.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS14_2edevice'

sys-devices-platform-serial8250-tty-ttyS14.device - /sys/devices/platform/serial8250/tty/ttyS14
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS14

sys-devices-platform-serial8250-tty-ttyS15.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS15_2edevice'

sys-devices-platform-serial8250-tty-ttyS15.device - /sys/devices/platform/serial8250/tty/ttyS15
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS15

sys-devices-platform-serial8250-tty-ttyS16.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS16_2edevice'

sys-devices-platform-serial8250-tty-ttyS16.device - /sys/devices/platform/serial8250/tty/ttyS16
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS16

sys-devices-platform-serial8250-tty-ttyS17.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS17_2edevice'

sys-devices-platform-serial8250-tty-ttyS17.device - /sys/devices/platform/serial8250/tty/ttyS17
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS17

sys-devices-platform-serial8250-tty-ttyS18.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS18_2edevice'

sys-devices-platform-serial8250-tty-ttyS18.device - /sys/devices/platform/serial8250/tty/ttyS18
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS18

sys-devices-platform-serial8250-tty-ttyS19.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS19_2edevice'

sys-devices-platform-serial8250-tty-ttyS19.device - /sys/devices/platform/serial8250/tty/ttyS19
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS19

sys-devices-platform-serial8250-tty-ttyS2.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS2_2edevice'

sys-devices-platform-serial8250-tty-ttyS2.device - /sys/devices/platform/serial8250/tty/ttyS2
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS2

sys-devices-platform-serial8250-tty-ttyS20.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS20_2edevice'

sys-devices-platform-serial8250-tty-ttyS20.device - /sys/devices/platform/serial8250/tty/ttyS20
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS20

sys-devices-platform-serial8250-tty-ttyS21.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS21_2edevice'

sys-devices-platform-serial8250-tty-ttyS21.device - /sys/devices/platform/serial8250/tty/ttyS21
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS21

sys-devices-platform-serial8250-tty-ttyS22.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS22_2edevice'

sys-devices-platform-serial8250-tty-ttyS22.device - /sys/devices/platform/serial8250/tty/ttyS22
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS22

sys-devices-platform-serial8250-tty-ttyS23.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS23_2edevice'

sys-devices-platform-serial8250-tty-ttyS23.device - /sys/devices/platform/serial8250/tty/ttyS23
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS23

sys-devices-platform-serial8250-tty-ttyS24.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS24_2edevice'

sys-devices-platform-serial8250-tty-ttyS24.device - /sys/devices/platform/serial8250/tty/ttyS24
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS24

sys-devices-platform-serial8250-tty-ttyS25.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS25_2edevice'

sys-devices-platform-serial8250-tty-ttyS25.device - /sys/devices/platform/serial8250/tty/ttyS25
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS25

sys-devices-platform-serial8250-tty-ttyS26.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS26_2edevice'

sys-devices-platform-serial8250-tty-ttyS26.device - /sys/devices/platform/serial8250/tty/ttyS26
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS26

sys-devices-platform-serial8250-tty-ttyS27.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS27_2edevice'

sys-devices-platform-serial8250-tty-ttyS27.device - /sys/devices/platform/serial8250/tty/ttyS27
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS27

sys-devices-platform-serial8250-tty-ttyS28.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS28_2edevice'

sys-devices-platform-serial8250-tty-ttyS28.device - /sys/devices/platform/serial8250/tty/ttyS28
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS28

sys-devices-platform-serial8250-tty-ttyS29.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS29_2edevice'

sys-devices-platform-serial8250-tty-ttyS29.device - /sys/devices/platform/serial8250/tty/ttyS29
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS29

sys-devices-platform-serial8250-tty-ttyS3.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS3_2edevice'

sys-devices-platform-serial8250-tty-ttyS3.device - /sys/devices/platform/serial8250/tty/ttyS3
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS3

sys-devices-platform-serial8250-tty-ttyS30.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS30_2edevice'

sys-devices-platform-serial8250-tty-ttyS30.device - /sys/devices/platform/serial8250/tty/ttyS30
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS30

sys-devices-platform-serial8250-tty-ttyS31.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS31_2edevice'

sys-devices-platform-serial8250-tty-ttyS31.device - /sys/devices/platform/serial8250/tty/ttyS31
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS31

sys-devices-platform-serial8250-tty-ttyS4.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS4_2edevice'

sys-devices-platform-serial8250-tty-ttyS4.device - /sys/devices/platform/serial8250/tty/ttyS4
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS4

sys-devices-platform-serial8250-tty-ttyS5.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS5_2edevice'

sys-devices-platform-serial8250-tty-ttyS5.device - /sys/devices/platform/serial8250/tty/ttyS5
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS5

sys-devices-platform-serial8250-tty-ttyS6.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS6_2edevice'

sys-devices-platform-serial8250-tty-ttyS6.device - /sys/devices/platform/serial8250/tty/ttyS6
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS6

sys-devices-platform-serial8250-tty-ttyS7.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS7_2edevice'

sys-devices-platform-serial8250-tty-ttyS7.device - /sys/devices/platform/serial8250/tty/ttyS7
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS7

sys-devices-platform-serial8250-tty-ttyS8.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS8_2edevice'

sys-devices-platform-serial8250-tty-ttyS8.device - /sys/devices/platform/serial8250/tty/ttyS8
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS8

sys-devices-platform-serial8250-tty-ttyS9.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS9_2edevice'

sys-devices-platform-serial8250-tty-ttyS9.device - /sys/devices/platform/serial8250/tty/ttyS9
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS9

sys-devices-pnp0-00:09-tty-ttyS0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpnp0_2d00_3a09_2dtty_2dttyS0_2edevice'

sys-devices-pnp0-00:09-tty-ttyS0.device - /sys/devices/pnp0/00:09/tty/ttyS0
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/pnp0/00:09/tty/ttyS0

sys-devices-pnp0-00:0a-tty-ttyS1.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpnp0_2d00_3a0a_2dtty_2dttyS1_2edevice'

sys-devices-pnp0-00:0a-tty-ttyS1.device - /sys/devices/pnp0/00:0a/tty/ttyS1
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/pnp0/00:0a/tty/ttyS1

sys-module-fuse.device -> '/org/freedesktop/systemd1/unit/sys_2dmodule_2dfuse_2edevice'

sys-module-fuse.device - /sys/module/fuse
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:37:55 CDT; 1 day 11h ago
   Device: /sys/module/fuse

sys-subsystem-net-devices-ens33.device -> '/org/freedesktop/systemd1/unit/sys_2dsubsystem_2dnet_2ddevices_2dens33_2edevice'

sys-subsystem-net-devices-ens33.device - PRO/1000 MT Single Port Adapter
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0/net/ens33

-.mount -> '/org/freedesktop/systemd1/unit/_2d_2emount'

-.mount - /
   Loaded: loaded (/etc/fstab)
   Active: active (mounted) since Wed 2015-03-18 21:36:35 CDT; 1 day 11h ago
    Where: /
     What: /dev/sda1

dev-hugepages.mount -> '/org/freedesktop/systemd1/unit/dev_2dhugepages_2emount'

dev-hugepages.mount - Huge Pages File System
   Loaded: loaded (/usr/lib/systemd/system/dev-hugepages.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:36:36 CDT; 1 day 11h ago
    Where: /dev/hugepages
     What: hugetlbfs
     Docs: https://www.kernel.org/doc/Documentation/vm/hugetlbpage.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 201 ExecMount=/bin/mount hugetlbfs /dev/hugepages -t hugetlbfs (code=exited, status=0/SUCCESS)

dev-mqueue.mount -> '/org/freedesktop/systemd1/unit/dev_2dmqueue_2emount'

dev-mqueue.mount - POSIX Message Queue File System
   Loaded: loaded (/usr/lib/systemd/system/dev-mqueue.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:36:36 CDT; 1 day 11h ago
    Where: /dev/mqueue
     What: mqueue
     Docs: man:mq_overview(7)
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 197 ExecMount=/bin/mount mqueue /dev/mqueue -t mqueue (code=exited, status=0/SUCCESS)

proc-sys-fs-binfmt_misc.mount -> '/org/freedesktop/systemd1/unit/proc_2dsys_2dfs_2dbinfmt_5fmisc_2emount'

proc-sys-fs-binfmt_misc.mount - Arbitrary Executable File Formats File System
   Loaded: loaded (/usr/lib/systemd/system/proc-sys-fs-binfmt_misc.mount; static)
   Active: active (mounted) since Wed 2015-03-18 22:00:29 CDT; 1 day 11h ago
    Where: /proc/sys/fs/binfmt_misc
     What: binfmt_misc
     Docs: https://www.kernel.org/doc/Documentation/binfmt_misc.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 4522 ExecMount=/bin/mount binfmt_misc /proc/sys/fs/binfmt_misc -t binfmt_misc (code=exited, status=0/SUCCESS)

run-vmblock\x2dfuse.mount -> '/org/freedesktop/systemd1/unit/run_2dvmblock_5cx2dfuse_2emount'

run-vmblock\x2dfuse.mount - /run/vmblock-fuse
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:37:55 CDT; 1 day 11h ago
    Where: /run/vmblock-fuse
     What: vmware-vmblock

sys-fs-fuse-connections.mount -> '/org/freedesktop/systemd1/unit/sys_2dfs_2dfuse_2dconnections_2emount'

sys-fs-fuse-connections.mount - FUSE Control File System
   Loaded: loaded (/usr/lib/systemd/system/sys-fs-fuse-connections.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:56 CDT; 1 day 11h ago
    Where: /sys/fs/fuse/connections
     What: fusectl
     Docs: https://www.kernel.org/doc/Documentation/filesystems/fuse.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 816 ExecMount=/bin/mount fusectl /sys/fs/fuse/connections -t fusectl (code=exited, status=0/SUCCESS)

sys-kernel-debug.mount -> '/org/freedesktop/systemd1/unit/sys_2dkernel_2ddebug_2emount'

sys-kernel-debug.mount - /sys/kernel/debug
   Loaded: loaded (/etc/fstab; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
    Where: /sys/kernel/debug
     What: debugfs
  Process: 344 ExecMount=/bin/mount debugfs /sys/kernel/debug -t debugfs -o noauto (code=exited, status=0/SUCCESS)

var-lib-ntp-proc.mount -> '/org/freedesktop/systemd1/unit/var_2dlib_2dntp_2dproc_2emount'

var-lib-ntp-proc.mount - /var/lib/ntp/proc
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:38:45 CDT; 1 day 11h ago
    Where: /var/lib/ntp/proc
     What: none

var-lock.mount -> '/org/freedesktop/systemd1/unit/var_2dlock_2emount'

var-lock.mount - Lock Directory
   Loaded: loaded (/usr/lib/systemd/system/var-lock.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
    Where: /var/lock
     What: tmpfs
  Process: 343 ExecMount=/bin/mount /run/lock /var/lock -t bind -o bind (code=exited, status=0/SUCCESS)

var-run-vmblock\x2dfuse.mount -> '/org/freedesktop/systemd1/unit/var_2drun_2dvmblock_5cx2dfuse_2emount'

var-run-vmblock\x2dfuse.mount - /var/run/vmblock-fuse
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:37:55 CDT; 1 day 11h ago
    Where: /var/run/vmblock-fuse
     What: vmware-vmblock

var-run.mount -> '/org/freedesktop/systemd1/unit/var_2drun_2emount'

var-run.mount - Runtime Directory
   Loaded: loaded (/usr/lib/systemd/system/var-run.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
    Where: /var/run
     What: tmpfs
  Process: 345 ExecMount=/bin/mount /run /var/run -t bind -o bind (code=exited, status=0/SUCCESS)

systemd-ask-password-plymouth.path -> '/org/freedesktop/systemd1/unit/systemd_2dask_2dpassword_2dplymouth_2epath'

systemd-ask-password-plymouth.path - Forward Password Requests to Plymouth Directory Watch
   Loaded: loaded (/usr/lib/systemd/system/systemd-ask-password-plymouth.path; static)
   Active: active (waiting) since Wed 2015-03-18 21:36:40 CDT; 1 day 11h ago
     Docs: http://www.freedesktop.org/wiki/Software/systemd/PasswordAgents

session-3856.scope -> '/org/freedesktop/systemd1/unit/session_2d3856_2escope'

session-3856.scope - Session 3856 of user archie
   Loaded: loaded (/run/systemd/system/session-3856.scope; static)
  Drop-In: /run/systemd/system/session-3856.scope.d
           └─90-After-systemd-user-sessions\x2eservice.conf, 90-Description.conf, 90-KillMode.conf, 90-SendSIGHUP.conf, 90-Slice.conf, 90-TimeoutStopUSec.conf
   Active: active (running) since Fri 2015-03-20 09:12:57 CDT; 4s ago
   CGroup: /user.slice/user-1000.slice/session-3856.scope
           ├─22617 sshd: archie [priv]
           ├─22622 sshd: archie@pts/0
           ├─22624 -bash
           └─22679 systemctl status

after-local.service -> '/org/freedesktop/systemd1/unit/after_2dlocal_2eservice'

after-local.service - /etc/init.d/after.local Compatibility
   Loaded: loaded (/usr/lib/systemd/system/after-local.service; static)
   Active: active (exited) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
  Process: 438 ExecStart=/etc/init.d/after.local (code=exited, status=0/SUCCESS)
 Main PID: 438 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/after-local.service

apache2.service -> '/org/freedesktop/systemd1/unit/apache2_2eservice'

apache2.service - The Apache Webserver
   Loaded: loaded (/usr/lib/systemd/system/apache2.service; enabled)
   Active: active (running) since Wed 2015-03-18 21:38:06 CDT; 1 day 11h ago
 Main PID: 435 (httpd2-prefork)
   Status: "Total requests: 142; Current requests/sec: 0; Current traffic:   0 B/sec"
   CGroup: /system.slice/apache2.service
           ├─ 435 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
           ├─1621 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
           └─1622 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start

apparmor.service -> '/org/freedesktop/systemd1/unit/apparmor_2eservice'

apparmor.service - LSB: AppArmor initialization
   Loaded: loaded (/etc/init.d/boot.apparmor)
   Active: active (exited) since Wed 2015-03-18 21:37:41 CDT; 1 day 11h ago
  Process: 352 ExecStart=/etc/init.d/boot.apparmor start (code=exited, status=0/SUCCESS)

console-kit-log-system-start.service -> '/org/freedesktop/systemd1/unit/console_2dkit_2dlog_2dsystem_2dstart_2eservice'

console-kit-log-system-start.service - Console System Startup Logging
   Loaded: loaded (/usr/lib/systemd/system/console-kit-log-system-start.service; static)
   Active: active (exited) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
  Process: 318 ExecStart=/usr/sbin/ck-log-system-start (code=exited, status=0/SUCCESS)
 Main PID: 318 (code=exited, status=0/SUCCESS)

cron.service -> '/org/freedesktop/systemd1/unit/cron_2eservice'

cron.service - Command Scheduler
   Loaded: loaded (/usr/lib/systemd/system/cron.service; enabled)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
 Main PID: 424 (cron)
   CGroup: /system.slice/cron.service
           └─424 /usr/sbin/cron -n

dbus.service -> '/org/freedesktop/systemd1/unit/dbus_2eservice'

dbus.service - D-Bus System Message Bus
   Loaded: loaded (/usr/lib/systemd/system/dbus.service; static)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
     Docs: man:dbus-daemon(1)
 Main PID: 439 (dbus-daemon)
   CGroup: /system.slice/dbus.service
           └─439 /bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation

exim.service -> '/org/freedesktop/systemd1/unit/exim_2eservice'

exim.service - Exim Mail Transport Agent
   Loaded: loaded (/usr/lib/systemd/system/exim.service; enabled)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
 Main PID: 423 (exim)
   CGroup: /system.slice/exim.service
           └─423 /usr/sbin/exim -bd -q1h

fonehome.service -> '/org/freedesktop/systemd1/unit/fonehome_2eservice'

fonehome.service - LSB: Fonehome client
   Loaded: loaded (/etc/init.d/fonehome)
   Active: active (running) since Wed 2015-03-18 21:37:56 CDT; 1 day 11h ago
  Process: 399 ExecStart=/etc/init.d/fonehome start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/fonehome.service
           ├─  490 /bin/bash /usr/bin/fonehome
           └─17839 ssh -24xaTnN -oBatchMode=yes -oExitOnForwardFailure=yes -oStrictHostKeyChecking=yes -oUserKnownHostsFile=/etc/fonehome/fonehome.hosts -oServerAliveInterval=60 -oServerAliveCountMax=5 -oTCPKeepAlive=yes...

getty@tty1.service -> '/org/freedesktop/systemd1/unit/getty_40tty1_2eservice'

getty@tty1.service - Getty on tty1
   Loaded: loaded (/usr/lib/systemd/system/getty@.service; enabled)
  Drop-In: /usr/lib/systemd/system/getty@tty1.service.d
           └─noclear.conf
   Active: active (running) since Wed 2015-03-18 21:38:06 CDT; 1 day 11h ago
     Docs: man:agetty(8)
           man:systemd-getty-generator(8)
           http://0pointer.de/blog/projects/serial-console.html
 Main PID: 1623 (agetty)
   CGroup: /system.slice/system-getty.slice/getty@tty1.service
           └─1623 /sbin/agetty --noclear tty1

kmod-static-nodes.service -> '/org/freedesktop/systemd1/unit/kmod_2dstatic_2dnodes_2eservice'

kmod-static-nodes.service - Create list of required static device nodes for the current kernel
   Loaded: loaded (/usr/lib/systemd/system/kmod-static-nodes.service; static)
   Active: active (exited) since Wed 2015-03-18 21:36:37 CDT; 1 day 11h ago
  Process: 212 ExecStart=/usr/bin/kmod static-nodes --format=tmpfiles --output=/run/tmpfiles.d/kmod.conf (code=exited, status=0/SUCCESS)
  Process: 194 ExecStartPre=/usr/bin/mkdir -p /run/tmpfiles.d (code=exited, status=0/SUCCESS)
 Main PID: 212 (code=exited, status=0/SUCCESS)

md.service -> '/org/freedesktop/systemd1/unit/md_2eservice'

md.service - LSB: Multiple Device RAID
   Loaded: loaded (/etc/init.d/boot.md)
   Active: active (exited) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
  Process: 324 ExecStart=/etc/init.d/boot.md start (code=exited, status=0/SUCCESS)

mysql.service -> '/org/freedesktop/systemd1/unit/mysql_2eservice'

mysql.service - LSB: Start the MySQL database server
   Loaded: loaded (/etc/init.d/mysql)
   Active: active (running) since Wed 2015-03-18 21:38:10 CDT; 1 day 11h ago
  Process: 400 ExecStart=/etc/init.d/mysql start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/mysql.service
           ├─ 926 /bin/sh /usr/bin/mysqld_safe --mysqld=mysqld --user=mysql --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysql/mysql.sock --datadir=/var/lib/mysql
           └─1598 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/test.err --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysq...

network.service -> '/org/freedesktop/systemd1/unit/network_2eservice'

network.service - LSB: Configure network interfaces and set up routing
   Loaded: loaded (/usr/lib/systemd/system/network.service; enabled)
   Active: failed (Result: exit-code) since Wed 2015-03-18 21:38:26 CDT; 1 day 11h ago
  Process: 468 ExecStart=/etc/init.d/network start (code=exited, status=7)
 Main PID: 468 (code=exited, status=7)
   CGroup: /system.slice/network.service
Comment 14 Archie Cobbs 2015-03-20 14:28:42 UTC
Apologies. That previous "systemctl status" was run as a normal user instead of root.

Running it as root takes much longer (almost 9 minutes!! stupid un-indexed systemd journal) but yields a bit more information:

$ systemctl status
[archie@test.cookc] 1003 sudo systemctl status
proc-sys-fs-binfmt_misc.automount -> '/org/freedesktop/systemd1/unit/proc_2dsys_2dfs_2dbinfmt_5fmisc_2eautomount'
proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point
   Loaded: loaded (/usr/lib/systemd/system/proc-sys-fs-binfmt_misc.automount; static)
   Active: active (running) since Wed 2015-03-18 21:36:35 CDT; 1 day 11h ago
    Where: /proc/sys/fs/binfmt_misc
     Docs: https://www.kernel.org/doc/Documentation/binfmt_misc.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
sys-devices-pci0000:00-0000:00:07.1-ata1-host1-target1:0:0-1:0:0:0-block-sr0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a07_2e1_2data1_2dhost1_2dtarget1_3a0_3a0_2d1_3a0_3a0_3a0_2dblock_2dsr0_2edevice'

sys-devices-pci0000:00-0000:00:07.1-ata1-host1-target1:0:0-1:0:0:0-block-sr0.device - VMware_Virtual_IDE_CDROM_Drive
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:43 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:07.1/ata1/host1/target1:0:0/1:0:0:0/block/sr0

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda-sda1.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a10_2e0_2dhost0_2dtarget0_3a0_3a0_2d0_3a0_3a0_3a0_2dblock_2dsda_2dsda1_2edevice'

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda-sda1.device - Virtual_disk
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:10.0/host0/target0:0:0/0:0:0:0/block/sda/sda1

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a10_2e0_2dhost0_2dtarget0_3a0_3a0_2d0_3a0_3a0_3a0_2dblock_2dsda_2edevice'

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda.device - Virtual_disk
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:10.0/host0/target0:0:0/0:0:0:0/block/sda

sys-devices-pci0000:00-0000:00:11.0-0000:02:01.0-net-ens33.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a11_2e0_2d0000_3a02_3a01_2e0_2dnet_2dens33_2edevice'

sys-devices-pci0000:00-0000:00:11.0-0000:02:01.0-net-ens33.device - PRO/1000 MT Single Port Adapter
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0/net/ens33

sys-devices-platform-floppy.0-block-fd0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dfloppy_2e0_2dblock_2dfd0_2edevice'

sys-devices-platform-floppy.0-block-fd0.device - /sys/devices/platform/floppy.0/block/fd0
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/floppy.0/block/fd0

sys-devices-platform-serial8250-tty-ttyS10.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS10_2edevice'

sys-devices-platform-serial8250-tty-ttyS10.device - /sys/devices/platform/serial8250/tty/ttyS10
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS10

sys-devices-platform-serial8250-tty-ttyS11.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS11_2edevice'

sys-devices-platform-serial8250-tty-ttyS11.device - /sys/devices/platform/serial8250/tty/ttyS11
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS11

sys-devices-platform-serial8250-tty-ttyS12.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS12_2edevice'

sys-devices-platform-serial8250-tty-ttyS12.device - /sys/devices/platform/serial8250/tty/ttyS12
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS12

sys-devices-platform-serial8250-tty-ttyS13.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS13_2edevice'

sys-devices-platform-serial8250-tty-ttyS13.device - /sys/devices/platform/serial8250/tty/ttyS13
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS13

sys-devices-platform-serial8250-tty-ttyS14.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS14_2edevice'

sys-devices-platform-serial8250-tty-ttyS14.device - /sys/devices/platform/serial8250/tty/ttyS14
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS14

sys-devices-platform-serial8250-tty-ttyS15.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS15_2edevice'

sys-devices-platform-serial8250-tty-ttyS15.device - /sys/devices/platform/serial8250/tty/ttyS15
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS15

sys-devices-platform-serial8250-tty-ttyS16.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS16_2edevice'

sys-devices-platform-serial8250-tty-ttyS16.device - /sys/devices/platform/serial8250/tty/ttyS16
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS16

sys-devices-platform-serial8250-tty-ttyS17.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS17_2edevice'

sys-devices-platform-serial8250-tty-ttyS17.device - /sys/devices/platform/serial8250/tty/ttyS17
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS17

sys-devices-platform-serial8250-tty-ttyS18.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS18_2edevice'

sys-devices-platform-serial8250-tty-ttyS18.device - /sys/devices/platform/serial8250/tty/ttyS18
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS18

sys-devices-platform-serial8250-tty-ttyS19.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS19_2edevice'

sys-devices-platform-serial8250-tty-ttyS19.device - /sys/devices/platform/serial8250/tty/ttyS19
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS19

sys-devices-platform-serial8250-tty-ttyS2.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS2_2edevice'

sys-devices-platform-serial8250-tty-ttyS2.device - /sys/devices/platform/serial8250/tty/ttyS2
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS2

sys-devices-platform-serial8250-tty-ttyS20.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS20_2edevice'

sys-devices-platform-serial8250-tty-ttyS20.device - /sys/devices/platform/serial8250/tty/ttyS20
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS20

sys-devices-platform-serial8250-tty-ttyS21.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS21_2edevice'

sys-devices-platform-serial8250-tty-ttyS21.device - /sys/devices/platform/serial8250/tty/ttyS21
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS21

sys-devices-platform-serial8250-tty-ttyS22.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS22_2edevice'

sys-devices-platform-serial8250-tty-ttyS22.device - /sys/devices/platform/serial8250/tty/ttyS22
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS22

sys-devices-platform-serial8250-tty-ttyS23.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS23_2edevice'

sys-devices-platform-serial8250-tty-ttyS23.device - /sys/devices/platform/serial8250/tty/ttyS23
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS23

sys-devices-platform-serial8250-tty-ttyS24.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS24_2edevice'

sys-devices-platform-serial8250-tty-ttyS24.device - /sys/devices/platform/serial8250/tty/ttyS24
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS24

sys-devices-platform-serial8250-tty-ttyS25.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS25_2edevice'

sys-devices-platform-serial8250-tty-ttyS25.device - /sys/devices/platform/serial8250/tty/ttyS25
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS25

sys-devices-platform-serial8250-tty-ttyS26.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS26_2edevice'

sys-devices-platform-serial8250-tty-ttyS26.device - /sys/devices/platform/serial8250/tty/ttyS26
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS26

sys-devices-platform-serial8250-tty-ttyS27.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS27_2edevice'

sys-devices-platform-serial8250-tty-ttyS27.device - /sys/devices/platform/serial8250/tty/ttyS27
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS27

sys-devices-platform-serial8250-tty-ttyS28.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS28_2edevice'

sys-devices-platform-serial8250-tty-ttyS28.device - /sys/devices/platform/serial8250/tty/ttyS28
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS28

sys-devices-platform-serial8250-tty-ttyS29.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS29_2edevice'

sys-devices-platform-serial8250-tty-ttyS29.device - /sys/devices/platform/serial8250/tty/ttyS29
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS29

sys-devices-platform-serial8250-tty-ttyS3.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS3_2edevice'

sys-devices-platform-serial8250-tty-ttyS3.device - /sys/devices/platform/serial8250/tty/ttyS3
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS3

sys-devices-platform-serial8250-tty-ttyS30.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS30_2edevice'

sys-devices-platform-serial8250-tty-ttyS30.device - /sys/devices/platform/serial8250/tty/ttyS30
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS30

sys-devices-platform-serial8250-tty-ttyS31.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS31_2edevice'

sys-devices-platform-serial8250-tty-ttyS31.device - /sys/devices/platform/serial8250/tty/ttyS31
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS31

sys-devices-platform-serial8250-tty-ttyS4.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS4_2edevice'

sys-devices-platform-serial8250-tty-ttyS4.device - /sys/devices/platform/serial8250/tty/ttyS4
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS4

sys-devices-platform-serial8250-tty-ttyS5.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS5_2edevice'

sys-devices-platform-serial8250-tty-ttyS5.device - /sys/devices/platform/serial8250/tty/ttyS5
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS5

sys-devices-platform-serial8250-tty-ttyS6.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS6_2edevice'

sys-devices-platform-serial8250-tty-ttyS6.device - /sys/devices/platform/serial8250/tty/ttyS6
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS6

sys-devices-platform-serial8250-tty-ttyS7.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS7_2edevice'

sys-devices-platform-serial8250-tty-ttyS7.device - /sys/devices/platform/serial8250/tty/ttyS7
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS7

sys-devices-platform-serial8250-tty-ttyS8.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS8_2edevice'

sys-devices-platform-serial8250-tty-ttyS8.device - /sys/devices/platform/serial8250/tty/ttyS8
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS8

sys-devices-platform-serial8250-tty-ttyS9.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS9_2edevice'

sys-devices-platform-serial8250-tty-ttyS9.device - /sys/devices/platform/serial8250/tty/ttyS9
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/platform/serial8250/tty/ttyS9

sys-devices-pnp0-00:09-tty-ttyS0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpnp0_2d00_3a09_2dtty_2dttyS0_2edevice'

sys-devices-pnp0-00:09-tty-ttyS0.device - /sys/devices/pnp0/00:09/tty/ttyS0
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/pnp0/00:09/tty/ttyS0

sys-devices-pnp0-00:0a-tty-ttyS1.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpnp0_2d00_3a0a_2dtty_2dttyS1_2edevice'

sys-devices-pnp0-00:0a-tty-ttyS1.device - /sys/devices/pnp0/00:0a/tty/ttyS1
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:42 CDT; 1 day 11h ago
   Device: /sys/devices/pnp0/00:0a/tty/ttyS1

sys-module-fuse.device -> '/org/freedesktop/systemd1/unit/sys_2dmodule_2dfuse_2edevice'

sys-module-fuse.device - /sys/module/fuse
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:37:55 CDT; 1 day 11h ago
   Device: /sys/module/fuse

sys-subsystem-net-devices-ens33.device -> '/org/freedesktop/systemd1/unit/sys_2dsubsystem_2dnet_2ddevices_2dens33_2edevice'

sys-subsystem-net-devices-ens33.device - PRO/1000 MT Single Port Adapter
   Loaded: loaded
   Active: active (plugged) since Wed 2015-03-18 21:36:44 CDT; 1 day 11h ago
   Device: /sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0/net/ens33

-.mount -> '/org/freedesktop/systemd1/unit/_2d_2emount'

-.mount - /
   Loaded: loaded (/etc/fstab)
   Active: active (mounted) since Wed 2015-03-18 21:36:35 CDT; 1 day 11h ago
    Where: /
     What: /dev/sda1

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
dev-hugepages.mount -> '/org/freedesktop/systemd1/unit/dev_2dhugepages_2emount'

dev-hugepages.mount - Huge Pages File System
   Loaded: loaded (/usr/lib/systemd/system/dev-hugepages.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:36:36 CDT; 1 day 11h ago
    Where: /dev/hugepages
     What: hugetlbfs
     Docs: https://www.kernel.org/doc/Documentation/vm/hugetlbpage.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 201 ExecMount=/bin/mount hugetlbfs /dev/hugepages -t hugetlbfs (code=exited, status=0/SUCCESS)

Mar 18 21:36:36 test systemd[1]: Mounting Huge Pages File System...
Mar 18 21:36:36 test systemd[1]: Mounted Huge Pages File System.
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
dev-mqueue.mount -> '/org/freedesktop/systemd1/unit/dev_2dmqueue_2emount'

dev-mqueue.mount - POSIX Message Queue File System
   Loaded: loaded (/usr/lib/systemd/system/dev-mqueue.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:36:36 CDT; 1 day 11h ago
    Where: /dev/mqueue
     What: mqueue
     Docs: man:mq_overview(7)
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 197 ExecMount=/bin/mount mqueue /dev/mqueue -t mqueue (code=exited, status=0/SUCCESS)

Mar 18 21:36:36 test systemd[1]: Mounted POSIX Message Queue File System.
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
proc-sys-fs-binfmt_misc.mount -> '/org/freedesktop/systemd1/unit/proc_2dsys_2dfs_2dbinfmt_5fmisc_2emount'

proc-sys-fs-binfmt_misc.mount - Arbitrary Executable File Formats File System
   Loaded: loaded (/usr/lib/systemd/system/proc-sys-fs-binfmt_misc.mount; static)
   Active: active (mounted) since Wed 2015-03-18 22:00:29 CDT; 1 day 11h ago
    Where: /proc/sys/fs/binfmt_misc
     What: binfmt_misc
     Docs: https://www.kernel.org/doc/Documentation/binfmt_misc.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 4522 ExecMount=/bin/mount binfmt_misc /proc/sys/fs/binfmt_misc -t binfmt_misc (code=exited, status=0/SUCCESS)

Mar 18 22:00:29 test systemd[1]: Mounting Arbitrary Executable File Formats File System...
Mar 18 22:00:29 test systemd[1]: Mounted Arbitrary Executable File Formats File System.
run-vmblock\x2dfuse.mount -> '/org/freedesktop/systemd1/unit/run_2dvmblock_5cx2dfuse_2emount'

run-vmblock\x2dfuse.mount - /run/vmblock-fuse
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:37:55 CDT; 1 day 11h ago
    Where: /run/vmblock-fuse
     What: vmware-vmblock

sys-fs-fuse-connections.mount -> '/org/freedesktop/systemd1/unit/sys_2dfs_2dfuse_2dconnections_2emount'

sys-fs-fuse-connections.mount - FUSE Control File System
   Loaded: loaded (/usr/lib/systemd/system/sys-fs-fuse-connections.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:56 CDT; 1 day 11h ago
    Where: /sys/fs/fuse/connections
     What: fusectl
     Docs: https://www.kernel.org/doc/Documentation/filesystems/fuse.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems
  Process: 816 ExecMount=/bin/mount fusectl /sys/fs/fuse/connections -t fusectl (code=exited, status=0/SUCCESS)

Mar 18 21:37:56 test systemd[1]: Mounting FUSE Control File System...
Mar 18 21:37:56 test systemd[1]: Mounted FUSE Control File System.
sys-kernel-debug.mount -> '/org/freedesktop/systemd1/unit/sys_2dkernel_2ddebug_2emount'

sys-kernel-debug.mount - /sys/kernel/debug
   Loaded: loaded (/etc/fstab; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
    Where: /sys/kernel/debug
     What: debugfs
  Process: 344 ExecMount=/bin/mount debugfs /sys/kernel/debug -t debugfs -o noauto (code=exited, status=0/SUCCESS)

Mar 18 21:37:37 test systemd[1]: Mounting /sys/kernel/debug...
Mar 18 21:37:37 test systemd[1]: Mounted /sys/kernel/debug.
var-lib-ntp-proc.mount -> '/org/freedesktop/systemd1/unit/var_2dlib_2dntp_2dproc_2emount'

var-lib-ntp-proc.mount - /var/lib/ntp/proc
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:38:45 CDT; 1 day 11h ago
    Where: /var/lib/ntp/proc
     What: none

var-lock.mount -> '/org/freedesktop/systemd1/unit/var_2dlock_2emount'

var-lock.mount - Lock Directory
   Loaded: loaded (/usr/lib/systemd/system/var-lock.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
    Where: /var/lock
     What: tmpfs
  Process: 343 ExecMount=/bin/mount /run/lock /var/lock -t bind -o bind (code=exited, status=0/SUCCESS)

var-run-vmblock\x2dfuse.mount -> '/org/freedesktop/systemd1/unit/var_2drun_2dvmblock_5cx2dfuse_2emount'

var-run-vmblock\x2dfuse.mount - /var/run/vmblock-fuse
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:37:55 CDT; 1 day 11h ago
    Where: /var/run/vmblock-fuse
     What: vmware-vmblock

var-run.mount -> '/org/freedesktop/systemd1/unit/var_2drun_2emount'

var-run.mount - Runtime Directory
   Loaded: loaded (/usr/lib/systemd/system/var-run.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
    Where: /var/run
     What: tmpfs
  Process: 345 ExecMount=/bin/mount /run /var/run -t bind -o bind (code=exited, status=0/SUCCESS)

systemd-ask-password-plymouth.path -> '/org/freedesktop/systemd1/unit/systemd_2dask_2dpassword_2dplymouth_2epath'

systemd-ask-password-plymouth.path - Forward Password Requests to Plymouth Directory Watch
   Loaded: loaded (/usr/lib/systemd/system/systemd-ask-password-plymouth.path; static)
   Active: active (waiting) since Wed 2015-03-18 21:36:40 CDT; 1 day 11h ago
     Docs: http://www.freedesktop.org/wiki/Software/systemd/PasswordAgents

Mar 18 21:36:40 test systemd[1]: Starting Forward Password Requests to Plymouth Directory Watch.
Mar 18 21:36:40 test systemd[1]: Started Forward Password Requests to Plymouth Directory Watch.
session-3856.scope -> '/org/freedesktop/systemd1/unit/session_2d3856_2escope'

session-3856.scope - Session 3856 of user archie
   Loaded: loaded (/run/systemd/system/session-3856.scope; static)
  Drop-In: /run/systemd/system/session-3856.scope.d
           └─90-After-systemd-user-sessions\x2eservice.conf, 90-Description.conf, 90-KillMode.conf, 90-SendSIGHUP.conf, 90-Slice.conf, 90-TimeoutStopUSec.conf
   Active: active (running) since Fri 2015-03-20 09:12:57 CDT; 12min ago
   CGroup: /user.slice/user-1000.slice/session-3856.scope
           ├─22617 sshd: archie [priv]
           ├─22622 sshd: archie@pts/0
           ├─22624 -bash
           ├─23275 sudo systemctl status
           └─23278 systemctl status

Mar 20 09:12:57 test systemd[1]: Starting Session 3856 of user archie.
Mar 20 09:12:57 test systemd[1]: Started Session 3856 of user archie.
Mar 20 09:18:36 test sudo[23275]: archie : TTY=pts/0 ; PWD=/home/archie ; USER=root ; COMMAND=/usr/bin/systemctl status
Mar 20 09:18:36 test sudo[23275]: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
after-local.service -> '/org/freedesktop/systemd1/unit/after_2dlocal_2eservice'

after-local.service - /etc/init.d/after.local Compatibility
   Loaded: loaded (/usr/lib/systemd/system/after-local.service; static)
   Active: active (exited) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
  Process: 438 ExecStart=/etc/init.d/after.local (code=exited, status=0/SUCCESS)
 Main PID: 438 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/after-local.service

apache2.service -> '/org/freedesktop/systemd1/unit/apache2_2eservice'

apache2.service - The Apache Webserver
   Loaded: loaded (/usr/lib/systemd/system/apache2.service; enabled)
   Active: active (running) since Wed 2015-03-18 21:38:06 CDT; 1 day 11h ago
 Main PID: 435 (httpd2-prefork)
   Status: "Total requests: 143; Current requests/sec: 0; Current traffic:   0 B/sec"
   CGroup: /system.slice/apache2.service
           ├─ 435 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
           ├─1621 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
           └─1622 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start

apparmor.service -> '/org/freedesktop/systemd1/unit/apparmor_2eservice'

apparmor.service - LSB: AppArmor initialization
   Loaded: loaded (/etc/init.d/boot.apparmor)
   Active: active (exited) since Wed 2015-03-18 21:37:41 CDT; 1 day 11h ago
  Process: 352 ExecStart=/etc/init.d/boot.apparmor start (code=exited, status=0/SUCCESS)

Mar 18 21:37:38 test systemd[1]: Starting LSB: AppArmor initialization...
Mar 18 21:37:41 test systemd[1]: Started LSB: AppArmor initialization.
console-kit-log-system-start.service -> '/org/freedesktop/systemd1/unit/console_2dkit_2dlog_2dsystem_2dstart_2eservice'

console-kit-log-system-start.service - Console System Startup Logging
   Loaded: loaded (/usr/lib/systemd/system/console-kit-log-system-start.service; static)
   Active: active (exited) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
  Process: 318 ExecStart=/usr/sbin/ck-log-system-start (code=exited, status=0/SUCCESS)
 Main PID: 318 (code=exited, status=0/SUCCESS)

Mar 18 21:37:36 test systemd[1]: Starting Console System Startup Logging...
Mar 18 21:37:37 test systemd[1]: Started Console System Startup Logging.
cron.service -> '/org/freedesktop/systemd1/unit/cron_2eservice'

cron.service - Command Scheduler
   Loaded: loaded (/usr/lib/systemd/system/cron.service; enabled)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
 Main PID: 424 (cron)
   CGroup: /system.slice/cron.service
           └─424 /usr/sbin/cron -n

Mar 18 21:37:55 test /usr/sbin/cron[424]: (CRON) INFO (running with inotify support)
dbus.service -> '/org/freedesktop/systemd1/unit/dbus_2eservice'

dbus.service - D-Bus System Message Bus
   Loaded: loaded (/usr/lib/systemd/system/dbus.service; static)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
     Docs: man:dbus-daemon(1)
 Main PID: 439 (dbus-daemon)
   CGroup: /system.slice/dbus.service
           └─439 /bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation

exim.service -> '/org/freedesktop/systemd1/unit/exim_2eservice'

exim.service - Exim Mail Transport Agent
   Loaded: loaded (/usr/lib/systemd/system/exim.service; enabled)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 day 11h ago
 Main PID: 423 (exim)
   CGroup: /system.slice/exim.service
           └─423 /usr/sbin/exim -bd -q1h

fonehome.service -> '/org/freedesktop/systemd1/unit/fonehome_2eservice'

fonehome.service - LSB: Fonehome client
   Loaded: loaded (/etc/init.d/fonehome)
   Active: active (running) since Wed 2015-03-18 21:37:56 CDT; 1 day 11h ago
  Process: 399 ExecStart=/etc/init.d/fonehome start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/fonehome.service
           ├─  490 /bin/bash /usr/bin/fonehome
           └─17839 ssh -24xaTnN -oBatchMode=yes -oExitOnForwardFailure=yes -oStrictHostKeyChecking=yes -oUserKnownHostsFile=/etc/fonehome/fonehome.hosts -oServerAliveInterval=60 -oServerAliveCountMax=5 -oTCPKeepAlive=yes...

getty@tty1.service -> '/org/freedesktop/systemd1/unit/getty_40tty1_2eservice'

getty@tty1.service - Getty on tty1
   Loaded: loaded (/usr/lib/systemd/system/getty@.service; enabled)
  Drop-In: /usr/lib/systemd/system/getty@tty1.service.d
           └─noclear.conf
   Active: active (running) since Wed 2015-03-18 21:38:06 CDT; 1 day 11h ago
     Docs: man:agetty(8)
           man:systemd-getty-generator(8)
           http://0pointer.de/blog/projects/serial-console.html
 Main PID: 1623 (agetty)
   CGroup: /system.slice/system-getty.slice/getty@tty1.service
           └─1623 /sbin/agetty --noclear tty1

kmod-static-nodes.service -> '/org/freedesktop/systemd1/unit/kmod_2dstatic_2dnodes_2eservice'

kmod-static-nodes.service - Create list of required static device nodes for the current kernel
   Loaded: loaded (/usr/lib/systemd/system/kmod-static-nodes.service; static)
   Active: active (exited) since Wed 2015-03-18 21:36:37 CDT; 1 day 11h ago
  Process: 212 ExecStart=/usr/bin/kmod static-nodes --format=tmpfiles --output=/run/tmpfiles.d/kmod.conf (code=exited, status=0/SUCCESS)
  Process: 194 ExecStartPre=/usr/bin/mkdir -p /run/tmpfiles.d (code=exited, status=0/SUCCESS)
 Main PID: 212 (code=exited, status=0/SUCCESS)

Mar 18 21:36:37 test systemd[1]: Started Create list of required static device nodes for the current kernel.
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
md.service -> '/org/freedesktop/systemd1/unit/md_2eservice'

md.service - LSB: Multiple Device RAID
   Loaded: loaded (/etc/init.d/boot.md)
   Active: active (exited) since Wed 2015-03-18 21:37:37 CDT; 1 day 11h ago
  Process: 324 ExecStart=/etc/init.d/boot.md start (code=exited, status=0/SUCCESS)

Mar 18 21:37:36 test systemd[1]: Starting LSB: Multiple Device RAID...
Mar 18 21:37:37 test boot.md[324]: Starting MD RAID ..done
Mar 18 21:37:37 test systemd[1]: Started LSB: Multiple Device RAID.
mysql.service -> '/org/freedesktop/systemd1/unit/mysql_2eservice'

mysql.service - LSB: Start the MySQL database server
   Loaded: loaded (/etc/init.d/mysql)
   Active: active (running) since Wed 2015-03-18 21:38:10 CDT; 1 day 11h ago
  Process: 400 ExecStart=/etc/init.d/mysql start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/mysql.service
           ├─ 926 /bin/sh /usr/bin/mysqld_safe --mysqld=mysqld --user=mysql --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysql/mysql.sock --datadir=/var/lib/mysql
           └─1598 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/test.err --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysq...

network.service -> '/org/freedesktop/systemd1/unit/network_2eservice'

network.service - LSB: Configure network interfaces and set up routing
   Loaded: loaded (/usr/lib/systemd/system/network.service; enabled)
   Active: failed (Result: exit-code) since Wed 2015-03-18 21:38:26 CDT; 1 day 11h ago
  Process: 468 ExecStart=/etc/init.d/network start (code=exited, status=7)
 Main PID: 468 (code=exited, status=7)
   CGroup: /system.slice/network.service

Mar 18 21:37:58 test network[468]: lo
Mar 18 21:37:58 test ifup[961]: lo
Mar 18 21:37:59 test ifup[1021]: lo
Mar 18 21:37:59 test ifup[1024]: IP address: 127.0.0.1/8
Mar 18 21:37:59 test network[468]: lo        IP address: 127.0.0.1/8
Mar 18 21:37:59 test ifup[1026]: Mar 18 21:38:00 test network[468]: ..done..doneWaiting for mandatory devices:  eth0
Mar 18 21:38:26 test network[468]: 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
Mar 18 21:38:26 test network[468]: eth0                                No interface found
Mar 18 21:38:26 test network[468]: ..failedSetting up service network  .  .  .  .  .  .  .  .  .  .  .  .  ...failed
Mar 18 21:38:26 test systemd[1]: network.service: main process exited, code=exited, status=7/NOTRUNNING
Mar 18 21:38:26 test systemd[1]: Failed to start LSB: Configure network interfaces and set up routing.
Mar 18 21:38:26 test systemd[1]: Unit network.service entered failed state.
Comment 15 Thomas Blume 2015-03-26 14:04:28 UTC
(In reply to Archie Cobbs from comment #14)
> Apologies. That previous "systemctl status" was run as a normal user instead
> of root.
> 
> Running it as root takes much longer (almost 9 minutes!! stupid un-indexed
> systemd journal) but yields a bit more information:
> 

Hm, I don't see any user@X.service in these logs.
Are you sure the problem is still present on your machine?
In not can you try to reproduce the error messages and afterwards attach:

systemctl status

again?
Comment 16 Archie Cobbs 2015-03-26 14:18:34 UTC
I can assure you the problem is continuing, except for the assertion failure which was fixed by the tweaked systemd.

$ rpm -qi systemd
Name        : systemd
Version     : 208
Release     : 35.1
Architecture: x86_64
Install Date: Wed 18 Mar 2015 09:33:11 PM CDT
Group       : System/Base
Size        : 6235015
License     : LGPL-2.1+
Signature   : RSA/SHA1, Wed 18 Mar 2015 10:24:48 AM CDT, Key ID bb51e4889775fe45
Source RPM  : systemd-208-35.1.src.rpm
Build Date  : Wed 18 Mar 2015 10:22:25 AM CDT
Build Host  : build20
Relocations : (not relocatable)
Vendor      : obs://build.opensuse.org/home:tsaupe
URL         : http://www.freedesktop.org/wiki/Software/systemd
Summary     : A System and Session Manager
Description :
Systemd is a system and service manager, compatible with SysV and LSB
init scripts for Linux. systemd provides aggressive parallelization
capabilities, uses socket and D-Bus activation for starting services,
offers on-demand starting of daemons, keeps track of processes using
Linux cgroups, supports snapshotting and restoring of the system state,
maintains mount and automount points and implements an elaborate
transactional dependency-based service control logic. It can work as a
drop-in replacement for sysvinit.
Distribution: home:tsaupe:branches:openSUSE:13.1:Update:bsc922536


Here's the most recent 100 lines from /var/log/warn:


$ tail -n 100 /var/log/warn
Mar 26 08:52:49 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:52:49 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:52:49 test sshd[11123]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:53:12 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 26 08:53:36 test systemd[11182]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 08:54:33 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 08:54:33 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 08:54:33 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:54:33 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:54:33 test sshd[11245]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:54:49 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 08:54:49 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 08:54:49 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:54:49 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:54:49 test sshd[11306]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:54:54 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 08:54:54 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 08:54:54 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:54:54 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:54:55 test sshd[11388]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:55:06 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 26 08:55:37 test systemd[11444]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 08:56:19 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 08:56:19 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 08:56:19 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:56:19 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:56:19 test sshd[11505]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:56:46 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 08:56:46 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 08:56:46 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:56:46 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:56:46 test sshd[11580]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:56:52 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 08:56:52 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 08:56:52 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:56:52 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:56:52 test sshd[11631]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:57:05 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 08:57:05 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 08:57:05 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 08:57:05 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 08:57:05 test sshd[11710]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 08:57:08 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 26 08:57:14 test systemd[11774]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 08:57:47 test systemd[11842]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:00:01 test systemd[11905]: Failed to open private bus connection: Failed to connect to socket /run/user/0/dbus/user_bus_socket: No such file or directory
Mar 26 09:00:35 test systemd[11931]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:01:05 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:01:05 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:01:05 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:01:05 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:01:05 test sshd[11993]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:01:17 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:01:17 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:01:17 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:01:17 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:01:17 test sshd[12051]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:01:29 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:01:29 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:01:29 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:01:29 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:01:29 test sshd[12104]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:02:05 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 26 09:02:38 test systemd[12192]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:02:55 test systemd[12256]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:03:44 test systemd[12331]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:03:48 test systemd[12396]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:04:05 test systemd[12454]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:04:45 test systemd[12519]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:04:47 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:04:47 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:04:47 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:04:47 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:04:47 test sshd[12583]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:05:50 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:05:50 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:05:50 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:05:50 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:05:50 test sshd[12641]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:06:15 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 26 09:06:22 test systemd[12708]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:06:56 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:06:56 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:06:56 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:06:56 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:06:56 test sshd[12786]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:07:22 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:07:22 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:07:22 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:07:22 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:07:22 test sshd[12848]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:07:52 test systemd[1]: user@1001.service stopping timed out. Killing.
Mar 26 09:08:03 test systemd[12913]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:08:11 test systemd[12988]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Mar 26 09:08:24 test systemd-logind[440]: Failed to start unit user-1001.slice: Transaction is destructive.
Mar 26 09:08:24 test systemd-logind[440]: Failed to start user slice: Transaction is destructive.
Mar 26 09:08:24 test systemd-logind[440]: Failed to start unit user@1001.service: Transaction is destructive.
Mar 26 09:08:24 test systemd-logind[440]: Failed to start user service: Transaction is destructive.
Mar 26 09:08:24 test sshd[13046]: pam_systemd(sshd:session): Failed to create session: File exists
Mar 26 09:09:05 test systemd[13103]: Failed to open private bus connection: Failed to connect to socket /run/user/1000/dbus/user_bus_socket: No such file or directory


And the output from systemctl status:


$ sudo systemctl status
proc-sys-fs-binfmt_misc.automount -> '/org/freedesktop/systemd1/unit/proc_2dsys_2dfs_2dbinfmt_5fmisc_2eautomount'
proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point
   Loaded: loaded (/usr/lib/systemd/system/proc-sys-fs-binfmt_misc.automount; static)
   Active: active (running) since Wed 2015-03-18 21:36:35 CDT; 1 weeks 0 days ago
    Where: /proc/sys/fs/binfmt_misc
     Docs: https://www.kernel.org/doc/Documentation/binfmt_misc.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
sys-devices-pci0000:00-0000:00:07.1-ata1-host1-target1:0:0-1:0:0:0-block-sr0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a07_2e1_2data1_2dhost1_2dtarget1_3a0_3a0_2d1_3a0_3a0_3a0_2dblock_2dsr0_2edevice'

sys-devices-pci0000:00-0000:00:07.1-ata1-host1-target1:0:0-1:0:0:0-block-sr0.device - VMware_Virtual_IDE_CDROM_Drive
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/pci0000:00/0000:00:07.1/ata1/host1/target1:0:0/1:0:0:0/block/sr0

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda-sda1.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a10_2e0_2dhost0_2dtarget0_3a0_3a0_2d0_3a0_3a0_3a0_2dblock_2dsda_2dsda1_2edevice'

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda-sda1.device - Virtual_disk
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/pci0000:00/0000:00:10.0/host0/target0:0:0/0:0:0:0/block/sda/sda1

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a10_2e0_2dhost0_2dtarget0_3a0_3a0_2d0_3a0_3a0_3a0_2dblock_2dsda_2edevice'

sys-devices-pci0000:00-0000:00:10.0-host0-target0:0:0-0:0:0:0-block-sda.device - Virtual_disk
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/pci0000:00/0000:00:10.0/host0/target0:0:0/0:0:0:0/block/sda

sys-devices-pci0000:00-0000:00:11.0-0000:02:01.0-net-ens33.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpci0000_3a00_2d0000_3a00_3a11_2e0_2d0000_3a02_3a01_2e0_2dnet_2dens33_2edevice'

sys-devices-pci0000:00-0000:00:11.0-0000:02:01.0-net-ens33.device - PRO/1000 MT Single Port Adapter
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0/net/ens33

sys-devices-platform-floppy.0-block-fd0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dfloppy_2e0_2dblock_2dfd0_2edevice'

sys-devices-platform-floppy.0-block-fd0.device - /sys/devices/platform/floppy.0/block/fd0
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/floppy.0/block/fd0

sys-devices-platform-serial8250-tty-ttyS10.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS10_2edevice'

sys-devices-platform-serial8250-tty-ttyS10.device - /sys/devices/platform/serial8250/tty/ttyS10
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS10

sys-devices-platform-serial8250-tty-ttyS11.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS11_2edevice'

sys-devices-platform-serial8250-tty-ttyS11.device - /sys/devices/platform/serial8250/tty/ttyS11
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS11

sys-devices-platform-serial8250-tty-ttyS12.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS12_2edevice'

sys-devices-platform-serial8250-tty-ttyS12.device - /sys/devices/platform/serial8250/tty/ttyS12
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS12

sys-devices-platform-serial8250-tty-ttyS13.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS13_2edevice'

sys-devices-platform-serial8250-tty-ttyS13.device - /sys/devices/platform/serial8250/tty/ttyS13
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS13

sys-devices-platform-serial8250-tty-ttyS14.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS14_2edevice'

sys-devices-platform-serial8250-tty-ttyS14.device - /sys/devices/platform/serial8250/tty/ttyS14
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS14

sys-devices-platform-serial8250-tty-ttyS15.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS15_2edevice'

sys-devices-platform-serial8250-tty-ttyS15.device - /sys/devices/platform/serial8250/tty/ttyS15
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS15

sys-devices-platform-serial8250-tty-ttyS16.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS16_2edevice'

sys-devices-platform-serial8250-tty-ttyS16.device - /sys/devices/platform/serial8250/tty/ttyS16
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS16

sys-devices-platform-serial8250-tty-ttyS17.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS17_2edevice'

sys-devices-platform-serial8250-tty-ttyS17.device - /sys/devices/platform/serial8250/tty/ttyS17
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS17

sys-devices-platform-serial8250-tty-ttyS18.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS18_2edevice'

sys-devices-platform-serial8250-tty-ttyS18.device - /sys/devices/platform/serial8250/tty/ttyS18
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS18

sys-devices-platform-serial8250-tty-ttyS19.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS19_2edevice'

sys-devices-platform-serial8250-tty-ttyS19.device - /sys/devices/platform/serial8250/tty/ttyS19
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS19

sys-devices-platform-serial8250-tty-ttyS2.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS2_2edevice'

sys-devices-platform-serial8250-tty-ttyS2.device - /sys/devices/platform/serial8250/tty/ttyS2
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS2

sys-devices-platform-serial8250-tty-ttyS20.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS20_2edevice'

sys-devices-platform-serial8250-tty-ttyS20.device - /sys/devices/platform/serial8250/tty/ttyS20
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS20

sys-devices-platform-serial8250-tty-ttyS21.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS21_2edevice'

sys-devices-platform-serial8250-tty-ttyS21.device - /sys/devices/platform/serial8250/tty/ttyS21
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS21

sys-devices-platform-serial8250-tty-ttyS22.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS22_2edevice'

sys-devices-platform-serial8250-tty-ttyS22.device - /sys/devices/platform/serial8250/tty/ttyS22
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS22

sys-devices-platform-serial8250-tty-ttyS23.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS23_2edevice'

sys-devices-platform-serial8250-tty-ttyS23.device - /sys/devices/platform/serial8250/tty/ttyS23
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS23

sys-devices-platform-serial8250-tty-ttyS24.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS24_2edevice'

sys-devices-platform-serial8250-tty-ttyS24.device - /sys/devices/platform/serial8250/tty/ttyS24
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS24

sys-devices-platform-serial8250-tty-ttyS25.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS25_2edevice'

sys-devices-platform-serial8250-tty-ttyS25.device - /sys/devices/platform/serial8250/tty/ttyS25
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS25

sys-devices-platform-serial8250-tty-ttyS26.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS26_2edevice'

sys-devices-platform-serial8250-tty-ttyS26.device - /sys/devices/platform/serial8250/tty/ttyS26
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS26

sys-devices-platform-serial8250-tty-ttyS27.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS27_2edevice'

sys-devices-platform-serial8250-tty-ttyS27.device - /sys/devices/platform/serial8250/tty/ttyS27
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS27

sys-devices-platform-serial8250-tty-ttyS28.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS28_2edevice'

sys-devices-platform-serial8250-tty-ttyS28.device - /sys/devices/platform/serial8250/tty/ttyS28
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS28

sys-devices-platform-serial8250-tty-ttyS29.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS29_2edevice'

sys-devices-platform-serial8250-tty-ttyS29.device - /sys/devices/platform/serial8250/tty/ttyS29
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS29

sys-devices-platform-serial8250-tty-ttyS3.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS3_2edevice'

sys-devices-platform-serial8250-tty-ttyS3.device - /sys/devices/platform/serial8250/tty/ttyS3
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS3

sys-devices-platform-serial8250-tty-ttyS30.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS30_2edevice'

sys-devices-platform-serial8250-tty-ttyS30.device - /sys/devices/platform/serial8250/tty/ttyS30
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS30

sys-devices-platform-serial8250-tty-ttyS31.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS31_2edevice'

sys-devices-platform-serial8250-tty-ttyS31.device - /sys/devices/platform/serial8250/tty/ttyS31
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS31

sys-devices-platform-serial8250-tty-ttyS4.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS4_2edevice'

sys-devices-platform-serial8250-tty-ttyS4.device - /sys/devices/platform/serial8250/tty/ttyS4
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS4

sys-devices-platform-serial8250-tty-ttyS5.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS5_2edevice'

sys-devices-platform-serial8250-tty-ttyS5.device - /sys/devices/platform/serial8250/tty/ttyS5
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS5

sys-devices-platform-serial8250-tty-ttyS6.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS6_2edevice'

sys-devices-platform-serial8250-tty-ttyS6.device - /sys/devices/platform/serial8250/tty/ttyS6
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS6

sys-devices-platform-serial8250-tty-ttyS7.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS7_2edevice'

sys-devices-platform-serial8250-tty-ttyS7.device - /sys/devices/platform/serial8250/tty/ttyS7
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS7

sys-devices-platform-serial8250-tty-ttyS8.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS8_2edevice'

sys-devices-platform-serial8250-tty-ttyS8.device - /sys/devices/platform/serial8250/tty/ttyS8
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS8

sys-devices-platform-serial8250-tty-ttyS9.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dplatform_2dserial8250_2dtty_2dttyS9_2edevice'

sys-devices-platform-serial8250-tty-ttyS9.device - /sys/devices/platform/serial8250/tty/ttyS9
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/platform/serial8250/tty/ttyS9

sys-devices-pnp0-00:09-tty-ttyS0.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpnp0_2d00_3a09_2dtty_2dttyS0_2edevice'

sys-devices-pnp0-00:09-tty-ttyS0.device - /sys/devices/pnp0/00:09/tty/ttyS0
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/pnp0/00:09/tty/ttyS0

sys-devices-pnp0-00:0a-tty-ttyS1.device -> '/org/freedesktop/systemd1/unit/sys_2ddevices_2dpnp0_2d00_3a0a_2dtty_2dttyS1_2edevice'

sys-devices-pnp0-00:0a-tty-ttyS1.device - /sys/devices/pnp0/00:0a/tty/ttyS1
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/pnp0/00:0a/tty/ttyS1

sys-module-fuse.device -> '/org/freedesktop/systemd1/unit/sys_2dmodule_2dfuse_2edevice'

sys-module-fuse.device - /sys/module/fuse
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/module/fuse

sys-subsystem-net-devices-ens33.device -> '/org/freedesktop/systemd1/unit/sys_2dsubsystem_2dnet_2ddevices_2dens33_2edevice'

sys-subsystem-net-devices-ens33.device - PRO/1000 MT Single Port Adapter
   Loaded: loaded
   Active: active (plugged)
   Device: /sys/devices/pci0000:00/0000:00:11.0/0000:02:01.0/net/ens33

-.mount -> '/org/freedesktop/systemd1/unit/_2d_2emount'

-.mount - /
   Loaded: loaded (/etc/fstab)
   Active: active (mounted) since Wed 2015-03-18 21:36:35 CDT; 1 weeks 0 days ago
    Where: /
     What: /dev/sda1

Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.

Warning: Unit file changed on disk, 'systemctl daemon-reload' recommended.
dev-hugepages.mount -> '/org/freedesktop/systemd1/unit/dev_2dhugepages_2emount'

dev-hugepages.mount - Huge Pages File System
   Loaded: loaded (/usr/lib/systemd/system/dev-hugepages.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:36:36 CDT; 1 weeks 0 days ago
    Where: /dev/hugepages
     What: hugetlbfs
     Docs: https://www.kernel.org/doc/Documentation/vm/hugetlbpage.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems

Mar 18 21:36:36 test systemd[1]: Mounting Huge Pages File System...
Mar 18 21:36:36 test systemd[1]: Mounted Huge Pages File System.
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
dev-mqueue.mount -> '/org/freedesktop/systemd1/unit/dev_2dmqueue_2emount'

dev-mqueue.mount - POSIX Message Queue File System
   Loaded: loaded (/usr/lib/systemd/system/dev-mqueue.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:36:36 CDT; 1 weeks 0 days ago
    Where: /dev/mqueue
     What: mqueue
     Docs: man:mq_overview(7)
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems

Mar 18 21:36:36 test systemd[1]: Mounted POSIX Message Queue File System.
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
proc-sys-fs-binfmt_misc.mount -> '/org/freedesktop/systemd1/unit/proc_2dsys_2dfs_2dbinfmt_5fmisc_2emount'

proc-sys-fs-binfmt_misc.mount - Arbitrary Executable File Formats File System
   Loaded: loaded (/usr/lib/systemd/system/proc-sys-fs-binfmt_misc.mount; static)
   Active: active (mounted) since Wed 2015-03-18 22:00:29 CDT; 1 weeks 0 days ago
    Where: /proc/sys/fs/binfmt_misc
     What: binfmt_misc
     Docs: https://www.kernel.org/doc/Documentation/binfmt_misc.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems

Mar 18 22:00:29 test systemd[1]: Mounting Arbitrary Executable File Formats File System...
Mar 18 22:00:29 test systemd[1]: Mounted Arbitrary Executable File Formats File System.
run-vmblock\x2dfuse.mount -> '/org/freedesktop/systemd1/unit/run_2dvmblock_5cx2dfuse_2emount'

run-vmblock\x2dfuse.mount - /run/vmblock-fuse
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:37:55 CDT; 1 weeks 0 days ago
    Where: /run/vmblock-fuse
     What: vmware-vmblock

sys-fs-fuse-connections.mount -> '/org/freedesktop/systemd1/unit/sys_2dfs_2dfuse_2dconnections_2emount'

sys-fs-fuse-connections.mount - FUSE Control File System
   Loaded: loaded (/usr/lib/systemd/system/sys-fs-fuse-connections.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:56 CDT; 1 weeks 0 days ago
    Where: /sys/fs/fuse/connections
     What: fusectl
     Docs: https://www.kernel.org/doc/Documentation/filesystems/fuse.txt
           http://www.freedesktop.org/wiki/Software/systemd/APIFileSystems

Mar 18 21:37:56 test systemd[1]: Mounting FUSE Control File System...
Mar 18 21:37:56 test systemd[1]: Mounted FUSE Control File System.
sys-kernel-debug.mount -> '/org/freedesktop/systemd1/unit/sys_2dkernel_2ddebug_2emount'

sys-kernel-debug.mount - /sys/kernel/debug
   Loaded: loaded (/etc/fstab; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 weeks 0 days ago
    Where: /sys/kernel/debug
     What: debugfs

Mar 18 21:37:37 test systemd[1]: Mounting /sys/kernel/debug...
Mar 18 21:37:37 test systemd[1]: Mounted /sys/kernel/debug.

Warning: Unit file changed on disk, 'systemctl daemon-reload' recommended.
var-lib-ntp-proc.mount -> '/org/freedesktop/systemd1/unit/var_2dlib_2dntp_2dproc_2emount'

var-lib-ntp-proc.mount - /var/lib/ntp/proc
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Sat 2015-03-21 10:06:42 CDT; 4 days ago
    Where: /var/lib/ntp/proc
     What: none

var-lock.mount -> '/org/freedesktop/systemd1/unit/var_2dlock_2emount'

var-lock.mount - Lock Directory
   Loaded: loaded (/usr/lib/systemd/system/var-lock.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 weeks 0 days ago
    Where: /var/lock
     What: tmpfs

var-run-vmblock\x2dfuse.mount -> '/org/freedesktop/systemd1/unit/var_2drun_2dvmblock_5cx2dfuse_2emount'

var-run-vmblock\x2dfuse.mount - /var/run/vmblock-fuse
   Loaded: loaded (/proc/self/mountinfo)
   Active: active (mounted) since Wed 2015-03-18 21:37:55 CDT; 1 weeks 0 days ago
    Where: /var/run/vmblock-fuse
     What: vmware-vmblock

var-run.mount -> '/org/freedesktop/systemd1/unit/var_2drun_2emount'

var-run.mount - Runtime Directory
   Loaded: loaded (/usr/lib/systemd/system/var-run.mount; static)
   Active: active (mounted) since Wed 2015-03-18 21:37:37 CDT; 1 weeks 0 days ago
    Where: /var/run
     What: tmpfs

systemd-ask-password-plymouth.path -> '/org/freedesktop/systemd1/unit/systemd_2dask_2dpassword_2dplymouth_2epath'

systemd-ask-password-plymouth.path - Forward Password Requests to Plymouth Directory Watch
   Loaded: loaded (/usr/lib/systemd/system/systemd-ask-password-plymouth.path; static)
   Active: active (waiting) since Wed 2015-03-18 21:36:40 CDT; 1 weeks 0 days ago
     Docs: http://www.freedesktop.org/wiki/Software/systemd/PasswordAgents

Mar 18 21:36:40 test systemd[1]: Starting Forward Password Requests to Plymouth Directory Watch.
Mar 18 21:36:40 test systemd[1]: Started Forward Password Requests to Plymouth Directory Watch.
session-19454.scope -> '/org/freedesktop/systemd1/unit/session_2d19454_2escope'

session-19454.scope - Session 19454 of user archie
   Loaded: loaded (/run/systemd/system/session-19454.scope; static)
  Drop-In: /run/systemd/system/session-19454.scope.d
           └─90-After-systemd-user-sessions\x2eservice.conf, 90-Description.conf, 90-KillMode.conf, 90-SendSIGHUP.conf, 90-Slice.conf, 90-TimeoutStopUSec.conf
   Active: active (running) since Thu 2015-03-26 09:09:05 CDT; 6min ago
   CGroup: /user.slice/user-1000.slice/session-19454.scope
           ├─13099 sshd: archie [priv]
           ├─13104 sshd: archie@pts/0
           ├─13106 -bash
           ├─13546 sudo systemctl status
           └─13547 systemctl status

Mar 26 09:09:05 test.example.com systemd[1]: Starting Session 19454 of user archie.
Mar 26 09:09:05 test.example.com systemd[1]: Started Session 19454 of user archie.
Mar 26 09:12:21 test.example.com sudo[13546]: archie : TTY=pts/0 ; PWD=/home/archie ; USER=root ; COMMAND=/usr/bin/systemctl status
Mar 26 09:12:21 test.example.com sudo[13546]: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
after-local.service -> '/org/freedesktop/systemd1/unit/after_2dlocal_2eservice'

after-local.service - /etc/init.d/after.local Compatibility
   Loaded: loaded (/usr/lib/systemd/system/after-local.service; static)
   Active: active (exited) since Wed 2015-03-18 21:37:53 CDT; 1 weeks 0 days ago
 Main PID: 438 (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/after-local.service

apache2.service -> '/org/freedesktop/systemd1/unit/apache2_2eservice'

apache2.service - The Apache Webserver
   Loaded: loaded (/usr/lib/systemd/system/apache2.service; enabled)
   Active: active (running) since Mon 2015-03-23 16:36:32 CDT; 2 days ago
  Process: 22217 ExecStop=/usr/sbin/start_apache2 -D SYSTEMD -DFOREGROUND -k graceful-stop (code=exited, status=0/SUCCESS)
 Main PID: 22237 (httpd2-prefork)
   Status: "Total requests: 258; Current requests/sec: 0; Current traffic:   0 B/sec"
   CGroup: /system.slice/apache2.service
           ├─22237 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
           ├─22255 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
           ├─22256 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
           └─23921 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start

Mar 23 16:36:31 test.example.com systemd[1]: Starting The Apache Webserver...
Mar 23 16:36:32 test.example.com systemd[1]: Started The Apache Webserver.
apparmor.service -> '/org/freedesktop/systemd1/unit/apparmor_2eservice'

apparmor.service - LSB: AppArmor initialization
   Loaded: loaded (/etc/init.d/boot.apparmor)
   Active: active (exited) since Wed 2015-03-18 21:37:41 CDT; 1 weeks 0 days ago

Mar 18 21:37:38 test systemd[1]: Starting LSB: AppArmor initialization...
Mar 18 21:37:41 test systemd[1]: Started LSB: AppArmor initialization.
console-kit-log-system-start.service -> '/org/freedesktop/systemd1/unit/console_2dkit_2dlog_2dsystem_2dstart_2eservice'

console-kit-log-system-start.service - Console System Startup Logging
   Loaded: loaded (/usr/lib/systemd/system/console-kit-log-system-start.service; static)
   Active: active (exited) since Wed 2015-03-18 21:37:37 CDT; 1 weeks 0 days ago
 Main PID: 318 (code=exited, status=0/SUCCESS)

Mar 18 21:37:36 test systemd[1]: Starting Console System Startup Logging...
Mar 18 21:37:37 test systemd[1]: Started Console System Startup Logging.
cron.service -> '/org/freedesktop/systemd1/unit/cron_2eservice'

cron.service - Command Scheduler
   Loaded: loaded (/usr/lib/systemd/system/cron.service; enabled)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 weeks 0 days ago
 Main PID: 424 (cron)
   CGroup: /system.slice/cron.service
           └─424 /usr/sbin/cron -n

Mar 18 21:37:55 test /usr/sbin/cron[424]: (CRON) INFO (running with inotify support)
Mar 23 13:00:01 test.example.com /usr/sbin/cron[28036]: pam_systemd(crond:session): Failed to create session: File exists
dbus.service -> '/org/freedesktop/systemd1/unit/dbus_2eservice'

dbus.service - D-Bus System Message Bus
   Loaded: loaded (/usr/lib/systemd/system/dbus.service; static)
   Active: active (running) since Wed 2015-03-18 21:37:53 CDT; 1 weeks 0 days ago
     Docs: man:dbus-daemon(1)
 Main PID: 439 (dbus-daemon)
   CGroup: /system.slice/dbus.service
           └─439 /bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation

exim.service -> '/org/freedesktop/systemd1/unit/exim_2eservice'

exim.service - Exim Mail Transport Agent
   Loaded: loaded (/usr/lib/systemd/system/exim.service; enabled)
   Active: active (running) since Sat 2015-03-21 10:06:31 CDT; 4 days ago
 Main PID: 32360 (exim)
   CGroup: /system.slice/exim.service
           └─32360 /usr/sbin/exim -bd -q1h

Mar 21 10:06:31 test.example.com systemd[1]: Starting Exim Mail Transport Agent...
Mar 21 10:06:31 test.example.com systemd[1]: Started Exim Mail Transport Agent.
fonehome.service -> '/org/freedesktop/systemd1/unit/fonehome_2eservice'

fonehome.service - LSB: Fonehome client
   Loaded: loaded (/etc/init.d/fonehome)
   Active: active (running) since Mon 2015-03-23 16:37:20 CDT; 2 days ago
  Process: 22620 ExecStop=/etc/init.d/fonehome stop (code=exited, status=0/SUCCESS)
  Process: 22627 ExecStart=/etc/init.d/fonehome start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/fonehome.service
           ├─22635 /bin/bash /usr/bin/fonehome
           └─22636 ssh -24xaTnN -oBatchMode=yes -oExitOnForwardFailure=yes -oStrictHostKeyChecking=yes -oUserKnownHostsFile=/etc/fonehome/fonehome.hosts -oServerAliveInterval=60 -oServerAliveCountMax=5 -oTCPKeepAlive=yes...

Mar 23 16:37:18 test.example.com systemd[1]: Starting LSB: Fonehome client...
Mar 23 16:37:20 test.example.com fonehome[22627]: Starting fonehome: ..done
Mar 23 16:37:20 test.example.com systemd[1]: Started LSB: Fonehome client.
getty@tty1.service -> '/org/freedesktop/systemd1/unit/getty_40tty1_2eservice'

getty@tty1.service - Getty on tty1
   Loaded: loaded (/usr/lib/systemd/system/getty@.service; enabled)
  Drop-In: /usr/lib/systemd/system/getty@tty1.service.d
           └─noclear.conf
   Active: active (running) since Wed 2015-03-18 21:38:06 CDT; 1 weeks 0 days ago
     Docs: man:agetty(8)
           man:systemd-getty-generator(8)
           http://0pointer.de/blog/projects/serial-console.html
 Main PID: 1623 (agetty)
   CGroup: /system.slice/system-getty.slice/getty@tty1.service
           └─1623 /sbin/agetty --noclear tty1

kmod-static-nodes.service -> '/org/freedesktop/systemd1/unit/kmod_2dstatic_2dnodes_2eservice'

kmod-static-nodes.service - Create list of required static device nodes for the current kernel
   Loaded: loaded (/usr/lib/systemd/system/kmod-static-nodes.service; static)
   Active: active (exited) since Wed 2015-03-18 21:36:37 CDT; 1 weeks 0 days ago
 Main PID: 212 (code=exited, status=0/SUCCESS)

Mar 18 21:36:37 test systemd[1]: Started Create list of required static device nodes for the current kernel.
Warning: Journal has been rotated since unit was started. Log output is incomplete or unavailable.
md.service -> '/org/freedesktop/systemd1/unit/md_2eservice'

md.service - LSB: Multiple Device RAID
   Loaded: loaded (/etc/init.d/boot.md)
   Active: active (exited) since Wed 2015-03-18 21:37:37 CDT; 1 weeks 0 days ago

Mar 18 21:37:36 test systemd[1]: Starting LSB: Multiple Device RAID...
Mar 18 21:37:37 test boot.md[324]: Starting MD RAID ..done
Mar 18 21:37:37 test systemd[1]: Started LSB: Multiple Device RAID.
mysql.service -> '/org/freedesktop/systemd1/unit/mysql_2eservice'

mysql.service - LSB: Start the MySQL database server
   Loaded: loaded (/etc/init.d/mysql)
   Active: active (running) since Mon 2015-03-23 16:36:15 CDT; 2 days ago
  Process: 21529 ExecStop=/etc/init.d/mysql stop (code=exited, status=0/SUCCESS)
  Process: 21576 ExecStart=/etc/init.d/mysql start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/mysql.service
           ├─21647 /bin/sh /usr/bin/mysqld_safe --mysqld=mysqld --user=mysql --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysql/mysql.sock --datadir=/var/lib/mysql
           └─21994 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/test.example.com.err --pid-file=/var/run/mysql/mysqld.pid ...

Mar 23 16:36:13 test.example.com systemd[1]: Starting LSB: Start the MySQL database server...
Mar 23 16:36:15 test.example.com systemd[1]: Started LSB: Start the MySQL database server.
network.service -> '/org/freedesktop/systemd1/unit/network_2eservice'

network.service - LSB: Configure network interfaces and set up routing
   Loaded: loaded (/usr/lib/systemd/system/network.service; enabled)
   Active: failed (Result: exit-code) since Wed 2015-03-18 21:38:26 CDT; 1 weeks 0 days ago
 Main PID: 468 (code=exited, status=7)
   CGroup: /system.slice/network.service

Mar 18 21:37:58 test network[468]: lo
Mar 18 21:37:58 test ifup[961]: lo
Mar 18 21:37:59 test ifup[1021]: lo
Mar 18 21:37:59 test ifup[1024]: IP address: 127.0.0.1/8
Mar 18 21:37:59 test network[468]: lo        IP address: 127.0.0.1/8
Mar 18 21:37:59 test ifup[1026]: Mar 18 21:38:00 test network[468]: ..done..doneWaiting for mandatory devices:  eth0
Mar 18 21:38:26 test network[468]: 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
Mar 18 21:38:26 test network[468]: eth0                                No interface found
Mar 18 21:38:26 test network[468]: ..failedSetting up service network  .  .  .  .  .  .  .  .  .  .  .  .  ...failed
Mar 18 21:38:26 test systemd[1]: network.service: main process exited, code=exited, status=7/NOTRUNNING
Mar 18 21:38:26 test systemd[1]: Failed to start LSB: Configure network interfaces and set up routing.
Mar 18 21:38:26 test systemd[1]: Unit network.service entered failed state.


Some other info possibly relevant info:


$ rpm -qa | grep -E '(login|system|pam)' | sort
filesystem-13.1-3.1.2.x86_64
pam-1.1.8-6.1.x86_64
pam-config-0.86-2.1.2.x86_64
pam-modules-12.1-20.1.2.x86_64
pcom-system-1.0.3885-1.suse13.1.noarch
pexp-system-1.0.3986-1.noarch
systemd-208-35.1.x86_64
systemd-presets-branding-openSUSE-0.3.0-3.4.1.noarch
systemd-sysvinit-208-35.1.x86_64
systemtap-2.3-2.1.3.x86_64
systemtap-runtime-2.3-2.1.3.x86_64
yast2-pam-3.0.0-2.1.4.noarch
$ rpm -V `rpm -qa | grep -E '(login|system|pam)' | sort`
.M.......    /sys
.M.......    /var/lock
....L....  c /etc/pam.d/common-account
....L....  c /etc/pam.d/common-auth
....L....  c /etc/pam.d/common-password
....L....  c /etc/pam.d/common-session
$ ls -l /etc/pam.d
total 140
-rw-r--r-- 1 root root 167 Sep 27  2013 chage
-rw-r--r-- 1 root root 199 Sep 27  2013 chfn
-rw-r--r-- 1 root root 199 Sep 27  2013 chpasswd
-rw-r--r-- 1 root root 199 Sep 27  2013 chsh
lrwxrwxrwx 1 root root  17 Mar 17  2014 common-account -> common-account-pc
-rw-r--r-- 1 root root 378 Jul 15  2012 common-account.pam-config-backup
-rw-r--r-- 1 root root 446 Mar 18 21:33 common-account-pc
lrwxrwxrwx 1 root root  14 Mar 17  2014 common-auth -> common-auth-pc
-rw-r--r-- 1 root root 448 Jul 15  2012 common-auth.pam-config-backup
-rw-r--r-- 1 root root 522 Mar 18 21:33 common-auth-pc
lrwxrwxrwx 1 root root  18 Mar 17  2014 common-password -> common-password-pc
-rw-r--r-- 1 root root 855 Jul 15  2012 common-password.pam-config-backup
-rw-r--r-- 1 root root 423 Mar 18 21:33 common-password-pc
lrwxrwxrwx 1 root root  17 Mar 17  2014 common-session -> common-session-pc
-rw-r--r-- 1 root root 435 Jul 15  2012 common-session.pam-config-backup
-rw-r--r-- 1 root root 504 Mar 18 21:33 common-session-pc
-rw-r--r-- 1 root root 446 Jan 19 07:19 crond
-rw-r--r-- 1 root root 172 Sep 27  2013 groupadd
-rw-r--r-- 1 root root 172 Sep 27  2013 groupdel
-rw-r--r-- 1 root root 172 Sep 27  2013 groupmod
-rw-r--r-- 1 root root 216 Sep 27  2013 init
-rw-r--r-- 1 root root 378 Feb  7  2014 login
-rw-r--r-- 1 root root 378 Feb  7  2014 login.old
-rw-r--r-- 1 root root 172 Sep 27  2013 newusers
-rw-r--r-- 1 root root 251 Mar 14  2014 other
-rw-r--r-- 1 root root 133 Sep 27  2013 passwd
-rw-r--r-- 1 root root 165 Jan 13 05:01 polkit-1
-rw-r--r-- 1 root root 492 Mar 13 07:32 remote
-rw-r--r-- 1 root root 238 Mar 13 07:32 runuser
-rw-r--r-- 1 root root 238 Mar 13 07:32 runuser-l
-rw-r--r-- 1 root root 336 Nov  8  2013 sshd
-rw-r--r-- 1 root root 277 Mar 13 07:32 su
-rw-r--r-- 1 root root 203 Mar  9 08:59 sudo
-rw-r--r-- 1 root root 277 Mar 13 07:32 su-l
-rw-r--r-- 1 root root 187 Mar 18 10:20 systemd-user
-rw-r--r-- 1 root root 172 Sep 27  2013 useradd
-rw-r--r-- 1 root root 172 Sep 27  2013 userdel
-rw-r--r-- 1 root root 172 Sep 27  2013 usermod
-rwxr-xr-x 1 root root 297 Nov  4  2013 vmtoolsd*
Comment 17 Thomas Blume 2015-03-30 09:48:02 UTC
Hm, it seems that the cgroups for some session are still present, even though the sessions have been terminated.
Can you please attach the output of:

for i in $(find /sys/fs/cgroup/systemd/user.slice); do echo $i; cat $i; done

and 

ps aux

?
Comment 18 Thomas Blume 2015-03-30 09:56:00 UTC
Please also provide the output of:

systemd-cgls --all -l
Comment 19 Archie Cobbs 2015-03-31 00:21:41 UTC
$ for i in $(find /sys/fs/cgroup/systemd/user.slice); do echo $i; cat $i; done && ps aux && systemd-cgls --all -l --no-pager
/sys/fs/cgroup/systemd/user.slice
cat: /sys/fs/cgroup/systemd/user.slice: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1001.slice
cat: /sys/fs/cgroup/systemd/user.slice/user-1001.slice: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service
cat: /sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service
cat: /sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service/tasks
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/systemd-exit.service/cgroup.procs
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/tasks
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/user@1001.service/cgroup.procs
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/tasks
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-1001.slice/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-1001.slice/cgroup.procs
/sys/fs/cgroup/systemd/user.slice/user-0.slice
cat: /sys/fs/cgroup/systemd/user.slice/user-0.slice: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-0.slice/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-0.slice/tasks
/sys/fs/cgroup/systemd/user.slice/user-0.slice/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-0.slice/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-0.slice/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-0.slice/cgroup.procs
/sys/fs/cgroup/systemd/user.slice/user-1000.slice
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope/tasks
31687
31744
31746
32271
32274
32275
32626
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/session-30936.scope/cgroup.procs
31687
31744
31746
32271
32274
32275
32629
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service: Is a directory
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service/tasks
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/systemd-exit.service/cgroup.procs
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/tasks
31743
31745
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service/cgroup.procs
31743
31745
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/tasks
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/user-1000.slice/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/user-1000.slice/cgroup.procs
/sys/fs/cgroup/systemd/user.slice/notify_on_release
1
/sys/fs/cgroup/systemd/user.slice/tasks
/sys/fs/cgroup/systemd/user.slice/cgroup.clone_children
0
/sys/fs/cgroup/systemd/user.slice/cgroup.event_control
cat: /sys/fs/cgroup/systemd/user.slice/cgroup.event_control: Invalid argument
/sys/fs/cgroup/systemd/user.slice/cgroup.procs
USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
root         1  0.0  0.0 129272  3736 ?        Ss   Mar18   3:42 /sbin/init
root         2  0.0  0.0      0     0 ?        S    Mar18   0:00 [kthreadd]
root         3  0.0  0.0      0     0 ?        S    Mar18   3:36 [ksoftirqd/0]
root         5  0.0  0.0      0     0 ?        S<   Mar18   0:00 [kworker/0:0H]
root         7  0.0  0.0      0     0 ?        S    Mar18   0:00 [migration/0]
root         8  0.0  0.0      0     0 ?        S    Mar18   0:00 [rcu_bh]
root         9  0.0  0.0      0     0 ?        S    Mar18   0:00 [rcuob/0]
root        10  0.0  0.0      0     0 ?        S    Mar18   3:13 [rcu_sched]
root        11  0.0  0.0      0     0 ?        S    Mar18   1:50 [rcuos/0]
root        12  0.0  0.0      0     0 ?        S    Mar18   6:08 [watchdog/0]
root        13  0.0  0.0      0     0 ?        S<   Mar18   0:00 [khelper]
root        14  0.0  0.0      0     0 ?        S    Mar18   0:00 [kdevtmpfs]
root        15  0.0  0.0      0     0 ?        S<   Mar18   0:00 [netns]
root        16  0.0  0.0      0     0 ?        S<   Mar18   0:00 [writeback]
root        17  0.0  0.0      0     0 ?        S<   Mar18   0:00 [kintegrityd]
root        18  0.0  0.0      0     0 ?        S<   Mar18   0:00 [bioset]
root        19  0.0  0.0      0     0 ?        S<   Mar18   0:00 [kblockd]
root        20  0.0  0.0      0     0 ?        S<   Mar18   0:00 [ata_sff]
root        21  0.0  0.0      0     0 ?        S<   Mar18   0:00 [md]
root        23  0.0  0.0      0     0 ?        S    Mar18   0:00 [khungtaskd]
root        24  0.0  0.0      0     0 ?        S    Mar18   0:03 [kswapd0]
root        25  0.0  0.0      0     0 ?        SN   Mar18   0:00 [ksmd]
root        26  0.0  0.0      0     0 ?        SN   Mar18   0:08 [khugepaged]
root        27  0.0  0.0      0     0 ?        S    Mar18   0:00 [fsnotify_mark]
root        28  0.0  0.0      0     0 ?        S<   Mar18   0:00 [crypto]
root        33  0.0  0.0      0     0 ?        S<   Mar18   0:00 [kthrotld]
root        34  0.0  0.0      0     0 ?        S<   Mar18   0:00 [kpsmoused]
root        36  0.0  0.0      0     0 ?        S<   Mar18   0:00 [deferwq]
root        67  0.0  0.0      0     0 ?        S<   Mar18   0:00 [kmpath_rdacd]
root        89  0.0  0.0      0     0 ?        S<   Mar18   0:00 [ttm_swap]
root        91  0.0  0.0      0     0 ?        S    Mar18   0:00 [khubd]
root        92  0.0  0.0      0     0 ?        S<   Mar18   0:00 [mpt_poll_0]
root        94  0.0  0.0      0     0 ?        S<   Mar18   0:00 [mpt/0]
root        97  0.0  0.0      0     0 ?        S    Mar18   0:08 [scsi_eh_0]
root       100  0.0  0.0      0     0 ?        S<   Mar18   1:42 [kworker/0:1H]
root       161  0.0  0.0      0     0 ?        S    Mar18  13:37 [jbd2/sda1-8]
root       162  0.0  0.0      0     0 ?        S<   Mar18   0:00 [ext4-rsv-conver]
root       163  0.0  0.0      0     0 ?        S<   Mar18   0:00 [ext4-unrsv-conv]
root       199  0.0  1.0 1976032 42048 ?       Ss   Mar18   7:37 /usr/lib/systemd/systemd-journald
root       200  0.0  0.0      0     0 ?        S    Mar18   0:00 [kauditd]
root       223  0.0  0.0  46820  1680 ?        Ss   Mar18   0:00 /usr/lib/systemd/systemd-udevd
root       252  0.0  0.0      0     0 ?        S    Mar18   0:00 [scsi_eh_1]
root       253  0.0  0.0      0     0 ?        S    Mar18   0:00 [scsi_eh_2]
root       424  0.0  0.0  27032  1584 ?        Ss   Mar18   0:03 /usr/sbin/cron -n
message+   439  0.0  0.0  41728  1780 ?        Ss   Mar18   2:14 /bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
root       440  0.0  0.0  36808  1708 ?        Ss   Mar18   1:26 /usr/lib/systemd/systemd-logind
root       508  0.0  0.0 158488   436 ?        Ssl  Mar18   0:00 /usr/bin/vmware-vmblock-fuse -o subtype=vmware-vmblock,default_permissions,allow_other /var/run/vmblock-fuse
root       679  0.1  0.0  91052  3396 ?        S    Mar18  27:20 /usr/bin/vmtoolsd
root      1623  0.0  0.0  12668   840 tty1     Ss+  Mar18   0:00 /sbin/agetty --noclear tty1
root     15229  0.0  0.0      0     0 ?        S    12:11   0:00 [kworker/u2:0]
root     19620  0.0  0.0      0     0 ?        S    17:30   0:00 [kworker/u2:2]
wwwrun   21379  0.0  0.2 189104  8308 ?        S    Mar28   0:00 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
root     21647  0.0  0.0  20100  1732 ?        S    Mar23   0:00 /bin/sh /usr/bin/mysqld_safe --mysqld=mysqld --user=mysql --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysql/mysql.sock --datadir=/var/lib/mysql
mysql    21994  2.1  6.3 1184320 258340 ?      Sl   Mar23 215:58 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/test.example.com
tomcat   22098  7.1 31.3 3209600 1270212 ?     Ssl  Mar23 733:15 /etc/alternatives/jre/bin/java -Xmx2g -XX:MaxPermSize=300m -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/tomcat/ -Dnet.sf.ehcache.skipUpdateCheck=
root     22237  0.0  0.2 189000  9440 ?        Ss   Mar23   0:29 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
root     22369  0.0  0.1 211696  6020 ?        Ss   Mar23   1:07 /usr/sbin/syslog-ng -F
root     22635  0.0  0.0  19968  1572 ?        Ss   Mar23   0:00 /bin/bash /usr/bin/fonehome
root     22636  0.0  0.0  44548  3404 ?        S    Mar23   1:24 ssh -24xaTnN -oBatchMode=yes -oExitOnForwardFailure=yes -oStrictHostKeyChecking=yes -oUserKnownHostsFile=/etc/fonehome/fonehome.hosts -oServerAliveInterval=60
wwwrun   25213  0.0  0.2 189104  8308 ?        S    Mar29   0:00 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
root     29733  0.3  0.0      0     0 ?        S    18:58   0:04 [kworker/0:3]
root     31479  0.0  0.0      0     0 ?        S    19:13   0:00 [kworker/0:1]
root     31687  0.0  0.0  92976  3976 ?        Ss   19:16   0:00 sshd: archie [priv] 
archie   31743  0.0  0.0  37956  2184 ?        Ss   19:16   0:00 /usr/lib/systemd/systemd --user
archie   31744  0.0  0.0  92976  2200 ?        S    19:16   0:00 sshd: archie@pts/0  
archie   31745  0.0  0.0 148108  1684 ?        S    19:16   0:00 (sd-pam)  
archie   31746  0.0  0.0  22548  3248 pts/0    Ss   19:16   0:00 -bash
root     32187  0.0  0.0      0     0 ?        S    19:18   0:00 [kworker/0:0]
root     32271  0.0  0.0  81020  3136 pts/0    S    19:19   0:00 sudo su
root     32274  0.0  0.0  65344  1756 pts/0    S    19:19   0:00 su
root     32275  0.3  0.0  22568  3220 pts/0    S    19:19   0:00 bash
root     32343  0.0  0.0  54828  2960 ?        Ss   Mar21   0:16 /usr/sbin/sshd -D
mail     32360  0.0  0.0  47228  2560 ?        Ss   Mar21   0:00 /usr/sbin/exim -bd -q1h
ntp      32515  0.0  0.0  31428  2056 ?        Ss   Mar21   0:55 /usr/sbin/ntpd -p /var/run/ntp/ntpd.pid -g -u ntp:ntp -i /var/lib/ntp -c /etc/ntp.conf
root     32652  0.0  0.0  25400  1428 pts/0    R+   19:19   0:00 ps aux
├─user.slice
│ ├─user-1001.slice
│ │ └─user@1001.service
│ │   └─systemd-exit.service
│ ├─user-0.slice
│ └─user-1000.slice
│   ├─session-30936.scope
│   │ ├─31687 sshd: archie [priv] 
│   │ ├─31744 sshd: archie@pts/0  
│   │ ├─31746 -bash
│   │ ├─32271 sudo su
│   │ ├─32274 su
│   │ ├─32275 bash
│   │ └─32653 systemd-cgls --all -l --no-pager
│   └─user@1000.service
│     ├─31743 /usr/lib/systemd/systemd --user
│     ├─31745 (sd-pam)  
│     └─systemd-exit.service
└─system.slice
  ├─1 /sbin/init
  ├─fonehome.service
  │ ├─22635 /bin/bash /usr/bin/fonehome
  │ └─22636 ssh -24xaTnN -oBatchMode=yes -oExitOnForwardFailure=yes -oStrictHostKeyChecking=yes -oUserKnownHostsFile=/etc/fonehome/fonehome.hosts -oServerAliveInterval=60 -oServerAliveCountMax=5 -oTCPKeepAlive=yes -oCheckHostIP=no -i /etc/fonehome/fonehome.key -oCompression=yes -R10010:localhost:22 -R10011:localhost:3306 -R10012:localhost:80 -R10013:localhost:8080 -L2525:localhost:25 fonehome@ops.example.com
  ├─syslog-ng.service
  │ └─22369 /usr/sbin/syslog-ng -F
  ├─apache2.service
  │ ├─21379 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
  │ ├─22237 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
  │ └─25213 /usr/sbin/httpd2-prefork -f /etc/apache2/httpd.conf -DSSL -D SYSTEMD -DFOREGROUND -k start
  ├─mysql.service
  │ ├─21647 /bin/sh /usr/bin/mysqld_safe --mysqld=mysqld --user=mysql --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysql/mysql.sock --datadir=/var/lib/mysql
  │ └─21994 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql --log-error=/var/lib/mysql/test.cookc.example.com.err --pid-file=/var/run/mysql/mysqld.pid --socket=/var/run/mysql/mysql.sock
  ├─tomcat.service
  │ └─22098 /etc/alternatives/jre/bin/java -Xmx2g -XX:MaxPermSize=300m -XX:-HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/tomcat/ -Dnet.sf.ehcache.skipUpdateCheck=true -Djava.awt.headless=true -classpath /usr/share/tomcat/bin/bootstrap.jar:/usr/share/tomcat/bin/tomcat-juli.jar:/usr/share/java/commons-daemon.jar -Dcatalina.base=/usr/share/tomcat -Dcatalina.home=/usr/share/tomcat -Djava.endorsed.dirs= -Djava.io.tmpdir=/var/cache/tomcat/temp -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager org.apache.catalina.startup.Bootstrap start
  ├─network.service
  ├─var-lib-ntp-proc.mount
  ├─ntp.service
  │ └─32515 /usr/sbin/ntpd -p /var/run/ntp/ntpd.pid -g -u ntp:ntp -i /var/lib/ntp -c /etc/ntp.conf
  ├─exim.service
  │ └─32360 /usr/sbin/exim -bd -q1h
  ├─sshd.service
  │ └─32343 /usr/sbin/sshd -D
  ├─proc-sys-fs-binfmt_misc.mount
  ├─plymouth-quit.service
  ├─plymouth-quit-wait.service
  ├─after-local.service
  ├─system-network.slice
  ├─run-vmblock\x2dfuse.mount
  ├─var-run-vmblock\x2dfuse.mount
  ├─sys-fs-fuse-connections.mount
  ├─systemd-user-sessions.service
  ├─rc-local.service
  ├─var-run.mount
  ├─sys-kernel-debug.mount
  ├─var-lock.mount
  ├─systemd-udevd.service
  │ └─223 /usr/lib/systemd/systemd-udevd
  ├─systemd-logind.service
  │ └─440 /usr/lib/systemd/systemd-logind
  ├─dbus.socket
  ├─YaST2-Second-Stage.service
  ├─SuSEfirewall2.service
  ├─rpcbind.service
  ├─SuSEfirewall2_init.service
  ├─YaST2-Firstboot.service
  ├─-.mount
  ├─vmtoolsd.service
  │ ├─508 /usr/bin/vmware-vmblock-fuse -o subtype=vmware-vmblock,default_permissions,allow_other /var/run/vmblock-fuse
  │ └─679 /usr/bin/vmtoolsd
  ├─dbus.service
  │ └─439 /bin/dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation
  ├─cron.service
  │ └─424 /usr/sbin/cron -n
  ├─system-getty.slice
  │ └─getty@tty1.service
  │   └─1623 /sbin/agetty --noclear tty1
  ├─dev-hugepages.mount
  ├─systemd-journald.service
  │ └─199 /usr/lib/systemd/systemd-journald
  └─dev-mqueue.mount
Comment 20 Thomas Blume 2015-03-31 08:49:35 UTC
Thanks for the logs.
It shows that the exit service for user 1001 session is still present:

├─user-1001.slice
│ │ └─user@1001.service
│ │   └─systemd-exit.service


Normally, this service kills the user manager (e.g. /usr/lib/systemd/systemd --user) for the respective session.
The command is:

ExecStart=/usr/bin/kill -s 58 $MANAGERPID


I cannot see a user manager for this session anymore, but the kill apparently didn't return.
Hence the systemd-exit.service has never finished.
This prevents creating a new session for user 1001, because it conflicts with systemd-exit.service. 

Trying to reproduce this locally.
Comment 21 Thomas Blume 2015-04-02 06:47:45 UTC
Uh, upstream changed their mind about a commit:

http://cgit.freedesktop.org/systemd/systemd-stable/commit/?id=d3f2e8c826b310b7b48e8394a3726c5bd0efc8ae

The original patch had been included into systemd-208 on 13.1.
Removing it.
Comment 22 Thomas Blume 2015-04-02 08:24:33 UTC
Please try the testpackage provided at:

http://download.opensuse.org/repositories/home:/tsaupe:/branches:/openSUSE:/13.1:/Update:/bsc922536/standard/

and report wheter it fixes the issue.
Comment 23 Archie Cobbs 2015-04-02 16:49:03 UTC
That seems to have helped. Now these are the only errors I'm seeing:

Apr  2 11:30:45 test systemd[1649]: Failed to open private bus connection: Failed to connect to socket /run/user/1000/dbus/user_bus_socket: No such file or directory
Apr  2 11:34:42 test systemd[2033]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Apr  2 11:35:42 test sudo: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:35:42 test su: pam_systemd(su:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:43:59 test sudo: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:43:59 test su: pam_systemd(su:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:44:12 test sudo: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:44:12 test su: pam_systemd(su:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:44:13 test sudo: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:44:13 test su: pam_systemd(su:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:44:57 test sudo: pam_systemd(sudo:session): pam_putenv: delete non-existent entry; XDG_RUNTIME_DIR
Apr  2 11:45:02 test systemd[4542]: Failed to open private bus connection: Failed to connect to socket /run/user/0/dbus/user_bus_socket: No such file or directory


Thanks.
Comment 24 Thomas Blume 2015-04-08 15:17:30 UTC
Thanks for the feedback.
Next step is to address the XDG_RUNTIME_DIR message.
I've updated the packages at:

http://download.opensuse.org/repositories/home:/tsaupe:/branches:/openSUSE:/13.1:/Update:/bsc922536/standard/x86_64/

Can you please test and report?
Comment 25 Archie Cobbs 2015-04-08 16:44:42 UTC
Thanks. Much quieter now...


$ tail /var/log/warn
Apr  8 11:37:11 test kernel:   24.370918] LVM: Activation generator successfully completed.
Apr  8 11:37:11 test kernel:   24.943002] systemd[1]: Cannot add dependency job for unit suse-studio-custom.service, ignoring: Unit suse-studio-custom.service failed to load: No such file or directory.
Apr  8 11:37:11 test kernel:   24.943021] systemd[1]: Cannot add dependency job for unit suse-studio-firstboot.service, ignoring: Unit suse-studio-firstboot.service failed to load: No such file or directory.
Apr  8 11:37:11 test kernel: [   27.981186] ACPI: Deprecated procfs I/F for AC is loaded, please retry with CONFIG_ACPI_PROCFS_POWER cleared
Apr  8 11:37:11 test kernel: [   28.022145] piix4_smbus 0000:00:07.3: Host SMBus controller not enabled!
Apr  8 11:37:11 test kernel: [   29.053041] sr0: scsi3-mmc drive: 1x/1x writer dvd-ram cd/rw xa/form2 cdda tray
Apr  8 11:37:11 test kernel: [   53.735316] EXT4-fs (sda1): warning: mounting fs with errors, running e2fsck is recommended
Apr  8 11:37:40 test systemd[1]: Failed to start LSB: Configure network interfaces and set up routing.
Apr  8 11:37:51 test systemd[1769]: Failed to open private bus connection: Failed to connect to socket /run/user/1001/dbus/user_bus_socket: No such file or directory
Apr  8 11:39:56 test systemd[2156]: Failed to open private bus connection: Failed to connect to socket /run/user/1000/dbus/user_bus_socket: No such file or directory
Comment 26 Thomas Blume 2015-04-09 06:40:07 UTC
*** Bug 920548 has been marked as a duplicate of this bug. ***
Comment 27 Thomas Blume 2015-04-10 07:25:31 UTC
I've updated the testpackages again to address:

> Apr  8 11:39:56 test systemd[2156]: Failed to open private bus connection: 
> Failed to connect to socket /run/user/1000/dbus/user_bus_socket: No such file > or directory

All error messages reported should be gone therewith.
Please test these packages as much as you can.
I can only submit it to the update channel when they are bullet proof.
I really have to avoid another desaster like bug 918226.
Comment 28 Archie Cobbs 2015-04-10 22:09:47 UTC
Thanks. Tried it and so far so good! No warnings on that machine ("test"). I will update this issue if I see any weirdness.

However, as long as we're going through dirty logging laundry... on a DIFFERENT 13.1 machine ("portal") running a stock systemd-208-32.1.x86_64 (note: this machine does NOT have your patched systemd on it), I saw a new and different warning from systemd today:

  systemd[1]: Failed to kill control group: No such device

Here is the larger context of that log message:

  2015-04-10T14:44:56.103512-05:00 portal sudo:   nagios : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/sbin/exim -bpc
  2015-04-10T14:44:56.104157-05:00 portal sudo: pam_unix(sudo:session): session opened for user root by (uid=0)
  2015-04-10T14:44:56.105278-05:00 portal systemd[1]: Starting user-0.slice.
  2015-04-10T14:44:56.105668-05:00 portal systemd[1]: Created slice user-0.slice.
  2015-04-10T14:44:56.106193-05:00 portal systemd[1]: Starting User Manager for 0...
  2015-04-10T14:44:56.109069-05:00 portal systemd[1]: Starting Session c6 of user root.
  2015-04-10T14:44:56.109747-05:00 portal systemd[1]: Started Session c6 of user root.
  2015-04-10T14:44:56.111036-05:00 portal systemd: pam_unix(systemd-user:session): session opened for user root by (uid=0)
  2015-04-10T14:44:56.116384-05:00 portal systemd[23240]: Failed to open private bus connection: Failed to connect to socket /run/user/0/dbus/user_bus_socket: No such file or directory
  2015-04-10T14:44:56.118380-05:00 portal sudo: pam_unix(sudo:session): session closed for user root
  2015-04-10T14:44:56.152317-05:00 portal systemd[23240]: Mounted /sys/kernel/config.
  2015-04-10T14:44:56.152845-05:00 portal systemd[23240]: Startup finished in 36ms.
  2015-04-10T14:44:56.153301-05:00 portal systemd[23240]: Mounted /sys/fs/fuse/connections.
  2015-04-10T14:44:56.155477-05:00 portal systemd[1]: Started User Manager for 0.
  2015-04-10T14:44:56.156138-05:00 portal systemd[23240]: Starting Default.
  2015-04-10T14:44:56.156665-05:00 portal systemd[23240]: Reached target Default.
  2015-04-10T14:44:56.157247-05:00 portal systemd[1]: Stopping User Manager for 0...
  2015-04-10T14:44:56.157778-05:00 portal systemd[23240]: Stopping Default.
  2015-04-10T14:44:56.158260-05:00 portal systemd[23240]: Stopped target Default.
  2015-04-10T14:44:56.158982-05:00 portal systemd[23240]: Starting Shutdown.
  2015-04-10T14:44:56.159321-05:00 portal systemd[23240]: Reached target Shutdown.
  2015-04-10T14:44:56.159623-05:00 portal systemd[23240]: Starting Exit the Session...
  2015-04-10T14:44:56.159935-05:00 portal systemd[1]: Failed to kill control group: No such device
  2015-04-10T14:44:56.162374-05:00 portal systemd[1]: Stopped User Manager for 0.
  2015-04-10T14:44:56.163318-05:00 portal systemd[1]: Stopping user-0.slice.
  2015-04-10T14:44:56.163776-05:00 portal systemd[1]: Removed slice user-0.slice.

Like the original machine ("test"), this machine has periodic Nagios checks running on it (in the above example, to check the mail queue).

ALSO:

FYI technically there is a bug in 0001-pam_systemd-export-DBUS_SESSION_BUS_ADDRESS.patch: char *s is declared _cleanup_free_, and therefore will be free'd when the function returns if asprintf() fails. However, after asprintf() fails, the value of s is undefined according to the man page; therefore, it is unsafe to free() it.

In practice, asprintf() probably does not modify s on failure, but the man page at least does not guarantee this. From http://osxr.org/glibc/source/libio/vasprintf.c?v=glibc-2.15#0037 at least it appears not to.
Comment 29 Thomas Blume 2015-04-13 07:24:15 UTC
(In reply to Archie Cobbs from comment #28)
> Thanks. Tried it and so far so good! No warnings on that machine ("test"). I
> will update this issue if I see any weirdness.

Ok, thanks.

>   2015-04-10T14:44:56.159623-05:00 portal systemd[23240]: Starting Exit the
> Session...
>   2015-04-10T14:44:56.159935-05:00 portal systemd[1]: Failed to kill control
> group: No such device
>   2015-04-10T14:44:56.162374-05:00 portal systemd[1]: Stopped User Manager
> for 0.
>   2015-04-10T14:44:56.163318-05:00 portal systemd[1]: Stopping user-0.slice.
>   2015-04-10T14:44:56.163776-05:00 portal systemd[1]: Removed slice
> user-0.slice.
> 
> Like the original machine ("test"), this machine has periodic Nagios checks
> running on it (in the above example, to check the mail queue).
> 

Looks like a something has vanished from the control group without systemd getting notified.
Could you compare the output of:

systemd-cgls -l -k /sys/fs/cgroup/systemd/user.slice/

right at the start of the session and jut before it gets shutdown?
Is there any difference?
And could you please test with my patched version?
I would need to put a fix on top of the current patches anyway.


> ALSO:
> 
> FYI technically there is a bug in
> 0001-pam_systemd-export-DBUS_SESSION_BUS_ADDRESS.patch: char *s is declared
> _cleanup_free_, and therefore will be free'd when the function returns if
> asprintf() fails. However, after asprintf() fails, the value of s is
> undefined according to the man page; therefore, it is unsafe to free() it.
> 
> In practice, asprintf() probably does not modify s on failure, but the man
> page at least does not guarantee this. From
> http://osxr.org/glibc/source/libio/vasprintf.c?v=glibc-2.15#0037 at least it
> appears not to.

Hm, this is upstream code (in the latest git in src/login/pam_systemd.c).
Which means the bug would affect all systemd versions up to the latest one.
We need to discuss this with upstream.
Would you mind reporting it on the systemd-devel mailing list (lists.freedesktop.org)?
Comment 30 Archie Cobbs 2015-04-13 16:11:37 UTC
Unfortunately, I can't seem to reproduce the "Failed to kill control group" error. It only occurred once and has not happened again.

I vote for calling this issue fixed with your latest changes. If the "Failed to kill control group" error reoccurs and I can reliably reproduce it, I'll create a new issue.

Regarding asprintf() bug, I filed this bug:

  https://bugs.freedesktop.org/show_bug.cgi?id=90017

Thanks!!
Comment 31 Thomas Blume 2015-04-24 07:47:57 UTC
(In reply to Archie Cobbs from comment #30)
> Unfortunately, I can't seem to reproduce the "Failed to kill control group"
> error. It only occurred once and has not happened again.
> 
> I vote for calling this issue fixed with your latest changes. If the "Failed
> to kill control group" error reoccurs and I can reliably reproduce it, I'll
> create a new issue.
> 
> Regarding asprintf() bug, I filed this bug:
> 
>   https://bugs.freedesktop.org/show_bug.cgi?id=90017
> 
> Thanks!!

Thanks for the feedback.
I did some more internal evaluation and didn't experience any issue.
We can go for the update now.
Maintenance request submitted.
closing.
Comment 32 Bernhard Wiedemann 2015-04-24 08:00:18 UTC
This is an autogenerated message for OBS integration:
This bug (922536) was mentioned in
https://build.opensuse.org/request/show/303532 13.1 / systemd
Comment 33 Swamp Workflow Management 2015-05-06 14:05:26 UTC
openSUSE-RU-2015:0823-1: An update that has two recommended fixes can now be installed.

Category: recommended (moderate)
Bug References: 855160,922536
CVE References: 
Sources used:
openSUSE 13.1 (src):    systemd-208-35.1, systemd-mini-208-35.1, systemd-rpm-macros-2-35.1