[Bug 1020436] Re: Cannot read superblock after FC multipath failover
Steve Fisher
stefan.nicolaivic at gmail.com
Tue Jul 10 05:39:24 UTC 2012
-- lvm.conf blacklist should be fine, searches /dev but filters all
/dev/sd.*
I'll attach those files momentarily.
I didn't see any kpartx processes running at all; there wasn't anything
in an uninterruptable sleep state ('D') either.
Listing all kernel and some additional processes here (removed stuff
like apache / php processes and certain publicly identifiable stuff
that's not relevant)
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.6 0.0 23828 2064 ? Ss 14:59 0:04 /sbin/init
root 2 0.0 0.0 0 0 ? S 14:59 0:00 [kthreadd]
root 3 0.0 0.0 0 0 ? S 14:59 0:00 [migration/0]
root 4 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/0]
root 5 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/0]
root 6 0.0 0.0 0 0 ? S 14:59 0:00 [migration/1]
root 7 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/1]
root 8 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/1]
root 9 0.0 0.0 0 0 ? S 14:59 0:00 [migration/2]
root 10 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/2]
root 11 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/2]
root 12 0.0 0.0 0 0 ? S 14:59 0:00 [migration/3]
root 13 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/3]
root 14 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/3]
root 15 0.0 0.0 0 0 ? S 14:59 0:00 [migration/4]
root 16 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/4]
root 17 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/4]
root 18 0.0 0.0 0 0 ? S 14:59 0:00 [migration/5]
root 19 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/5]
root 20 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/5]
root 21 0.0 0.0 0 0 ? S 14:59 0:00 [migration/6]
root 22 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/6]
root 23 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/6]
root 24 0.0 0.0 0 0 ? S 14:59 0:00 [migration/7]
root 25 0.1 0.0 0 0 ? S 14:59 0:01 [ksoftirqd/7]
root 26 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/7]
root 27 0.0 0.0 0 0 ? S 14:59 0:00 [migration/8]
root 28 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/8]
root 29 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/8]
root 30 0.0 0.0 0 0 ? S 14:59 0:00 [migration/9]
root 31 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/9]
root 32 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/9]
root 33 0.0 0.0 0 0 ? S 14:59 0:00 [migration/10]
root 34 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/10]
root 35 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/10]
root 36 0.0 0.0 0 0 ? S 14:59 0:00 [migration/11]
root 37 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/11]
root 38 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/11]
root 39 0.0 0.0 0 0 ? S 14:59 0:00 [migration/12]
root 40 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/12]
root 41 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/12]
root 42 0.0 0.0 0 0 ? S 14:59 0:00 [migration/13]
root 43 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/13]
root 44 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/13]
root 45 0.0 0.0 0 0 ? S 14:59 0:00 [migration/14]
root 46 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/14]
root 47 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/14]
root 48 0.0 0.0 0 0 ? S 14:59 0:00 [migration/15]
root 49 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/15]
root 50 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/15]
root 51 0.0 0.0 0 0 ? S 14:59 0:00 [migration/16]
root 52 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/16]
root 53 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/16]
root 54 0.0 0.0 0 0 ? S 14:59 0:00 [migration/17]
root 55 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/17]
root 56 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/17]
root 57 0.0 0.0 0 0 ? S 14:59 0:00 [migration/18]
root 58 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/18]
root 59 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/18]
root 60 0.0 0.0 0 0 ? S 14:59 0:00 [migration/19]
root 61 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/19]
root 62 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/19]
root 63 0.0 0.0 0 0 ? S 14:59 0:00 [migration/20]
root 64 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/20]
root 65 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/20]
root 66 0.0 0.0 0 0 ? S 14:59 0:00 [migration/21]
root 67 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/21]
root 68 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/21]
root 69 0.0 0.0 0 0 ? S 14:59 0:00 [migration/22]
root 70 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/22]
root 71 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/22]
root 72 0.0 0.0 0 0 ? S 14:59 0:00 [migration/23]
root 73 0.0 0.0 0 0 ? S 14:59 0:00 [ksoftirqd/23]
root 74 0.0 0.0 0 0 ? S 14:59 0:00 [watchdog/23]
root 75 0.0 0.0 0 0 ? S 14:59 0:00 [events/0]
root 76 0.0 0.0 0 0 ? S 14:59 0:00 [events/1]
root 77 0.0 0.0 0 0 ? S 14:59 0:00 [events/2]
root 78 0.0 0.0 0 0 ? S 14:59 0:00 [events/3]
root 79 0.0 0.0 0 0 ? S 14:59 0:00 [events/4]
root 80 0.0 0.0 0 0 ? S 14:59 0:00 [events/5]
root 81 0.0 0.0 0 0 ? S 14:59 0:00 [events/6]
root 82 0.0 0.0 0 0 ? S 14:59 0:00 [events/7]
root 83 0.0 0.0 0 0 ? S 14:59 0:00 [events/8]
root 84 0.0 0.0 0 0 ? S 14:59 0:00 [events/9]
root 85 0.0 0.0 0 0 ? S 14:59 0:00 [events/10]
root 86 0.0 0.0 0 0 ? S 14:59 0:00 [events/11]
root 87 0.0 0.0 0 0 ? S 14:59 0:00 [events/12]
root 88 0.0 0.0 0 0 ? S 14:59 0:00 [events/13]
root 89 0.0 0.0 0 0 ? S 14:59 0:00 [events/14]
root 90 0.0 0.0 0 0 ? S 14:59 0:00 [events/15]
root 91 0.0 0.0 0 0 ? S 14:59 0:00 [events/16]
root 92 0.0 0.0 0 0 ? S 14:59 0:00 [events/17]
root 93 0.0 0.0 0 0 ? S 14:59 0:00 [events/18]
root 94 0.0 0.0 0 0 ? S 14:59 0:00 [events/19]
root 95 0.0 0.0 0 0 ? S 14:59 0:00 [events/20]
root 96 0.0 0.0 0 0 ? S 14:59 0:00 [events/21]
root 97 0.0 0.0 0 0 ? S 14:59 0:00 [events/22]
root 98 0.0 0.0 0 0 ? S 14:59 0:00 [events/23]
root 99 0.0 0.0 0 0 ? S 14:59 0:00 [cpuset]
root 100 0.0 0.0 0 0 ? S 14:59 0:00 [khelper]
root 101 0.0 0.0 0 0 ? S 14:59 0:00 [netns]
root 102 0.0 0.0 0 0 ? S 14:59 0:00 [async/mgr]
root 103 0.0 0.0 0 0 ? S 14:59 0:00 [pm]
root 105 0.0 0.0 0 0 ? S 14:59 0:00 [sync_supers]
root 106 0.0 0.0 0 0 ? S 14:59 0:00 [bdi-default]
root 107 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/0]
root 108 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/1]
root 109 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/2]
root 110 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/3]
root 111 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/4]
root 112 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/5]
root 113 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/6]
root 114 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/7]
root 115 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/8]
root 116 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/9]
root 117 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/10]
root 118 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/11]
root 119 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/12]
root 120 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/13]
root 121 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/14]
root 122 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/15]
root 123 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/16]
root 124 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/17]
root 125 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/18]
root 126 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/19]
root 127 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/20]
root 128 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/21]
root 129 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/22]
root 130 0.0 0.0 0 0 ? S 14:59 0:00 [kintegrityd/23]
root 131 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/0]
root 132 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/1]
root 133 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/2]
root 134 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/3]
root 135 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/4]
root 136 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/5]
root 137 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/6]
root 138 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/7]
root 139 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/8]
root 140 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/9]
root 141 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/10]
root 142 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/11]
root 143 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/12]
root 144 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/13]
root 145 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/14]
root 146 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/15]
root 147 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/16]
root 148 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/17]
root 149 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/18]
root 150 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/19]
root 151 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/20]
root 152 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/21]
root 153 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/22]
root 154 0.0 0.0 0 0 ? S 14:59 0:00 [kblockd/23]
root 155 0.0 0.0 0 0 ? S 14:59 0:00 [kacpid]
root 156 0.0 0.0 0 0 ? S 14:59 0:00 [kacpi_notify]
root 157 0.0 0.0 0 0 ? S 14:59 0:00 [kacpi_hotplug]
root 158 0.0 0.0 0 0 ? S 14:59 0:00 [ata/0]
root 159 0.0 0.0 0 0 ? S 14:59 0:00 [ata/1]
root 160 0.0 0.0 0 0 ? S 14:59 0:00 [ata/2]
root 161 0.0 0.0 0 0 ? S 14:59 0:00 [ata/3]
root 162 0.0 0.0 0 0 ? S 14:59 0:00 [ata/4]
root 163 0.0 0.0 0 0 ? S 14:59 0:00 [ata/5]
root 164 0.0 0.0 0 0 ? S 14:59 0:00 [ata/6]
root 165 0.0 0.0 0 0 ? S 14:59 0:00 [ata/7]
root 166 0.0 0.0 0 0 ? S 14:59 0:00 [ata/8]
root 167 0.0 0.0 0 0 ? S 14:59 0:00 [ata/9]
root 168 0.0 0.0 0 0 ? S 14:59 0:00 [ata/10]
root 169 0.0 0.0 0 0 ? S 14:59 0:00 [ata/11]
root 170 0.0 0.0 0 0 ? S 14:59 0:00 [ata/12]
root 171 0.0 0.0 0 0 ? S 14:59 0:00 [ata/13]
root 172 0.0 0.0 0 0 ? S 14:59 0:00 [ata/14]
root 173 0.0 0.0 0 0 ? S 14:59 0:00 [ata/15]
root 174 0.0 0.0 0 0 ? S 14:59 0:00 [ata/16]
root 175 0.0 0.0 0 0 ? S 14:59 0:00 [ata/17]
root 176 0.0 0.0 0 0 ? S 14:59 0:00 [ata/18]
root 177 0.0 0.0 0 0 ? S 14:59 0:00 [ata/19]
root 178 0.0 0.0 0 0 ? S 14:59 0:00 [ata/20]
root 179 0.0 0.0 0 0 ? S 14:59 0:00 [ata/21]
root 180 0.0 0.0 0 0 ? S 14:59 0:00 [ata/22]
root 181 0.0 0.0 0 0 ? S 14:59 0:00 [ata/23]
root 182 0.0 0.0 0 0 ? S 14:59 0:00 [ata_aux]
root 183 0.0 0.0 0 0 ? S 14:59 0:00 [ksuspend_usbd]
root 184 0.0 0.0 0 0 ? S 14:59 0:00 [khubd]
root 185 0.0 0.0 0 0 ? S 14:59 0:00 [kseriod]
root 186 0.0 0.0 0 0 ? S 14:59 0:00 [kmmcd]
root 211 0.0 0.0 0 0 ? S 14:59 0:00 [khungtaskd]
root 212 0.0 0.0 0 0 ? S 14:59 0:00 [kswapd0]
root 213 0.0 0.0 0 0 ? S 14:59 0:00 [kswapd1]
root 214 0.0 0.0 0 0 ? SN 14:59 0:00 [ksmd]
root 215 0.0 0.0 0 0 ? S 14:59 0:00 [aio/0]
root 216 0.0 0.0 0 0 ? S 14:59 0:00 [aio/1]
root 217 0.0 0.0 0 0 ? S 14:59 0:00 [aio/2]
root 218 0.0 0.0 0 0 ? S 14:59 0:00 [aio/3]
root 219 0.0 0.0 0 0 ? S 14:59 0:00 [aio/4]
root 220 0.0 0.0 0 0 ? S 14:59 0:00 [aio/5]
root 221 0.0 0.0 0 0 ? S 14:59 0:00 [aio/6]
root 222 0.0 0.0 0 0 ? S 14:59 0:00 [aio/7]
root 223 0.0 0.0 0 0 ? S 14:59 0:00 [aio/8]
root 224 0.0 0.0 0 0 ? S 14:59 0:00 [aio/9]
root 225 0.0 0.0 0 0 ? S 14:59 0:00 [aio/10]
root 226 0.0 0.0 0 0 ? S 14:59 0:00 [aio/11]
root 227 0.0 0.0 0 0 ? S 14:59 0:00 [aio/12]
root 228 0.0 0.0 0 0 ? S 14:59 0:00 [aio/13]
root 229 0.0 0.0 0 0 ? S 14:59 0:00 [aio/14]
root 230 0.0 0.0 0 0 ? S 14:59 0:00 [aio/15]
root 231 0.0 0.0 0 0 ? S 14:59 0:00 [aio/16]
root 232 0.0 0.0 0 0 ? S 14:59 0:00 [aio/17]
root 233 0.0 0.0 0 0 ? S 14:59 0:00 [aio/18]
root 234 0.0 0.0 0 0 ? S 14:59 0:00 [aio/19]
root 235 0.0 0.0 0 0 ? S 14:59 0:00 [aio/20]
root 236 0.0 0.0 0 0 ? S 14:59 0:00 [aio/21]
root 237 0.0 0.0 0 0 ? S 14:59 0:00 [aio/22]
root 238 0.0 0.0 0 0 ? S 14:59 0:00 [aio/23]
root 239 0.0 0.0 0 0 ? S 14:59 0:00 [ecryptfs-kthrea]
root 240 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/0]
root 241 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/1]
root 242 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/2]
root 243 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/3]
root 244 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/4]
root 245 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/5]
root 246 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/6]
root 247 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/7]
root 248 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/8]
root 249 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/9]
root 250 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/10]
root 251 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/11]
root 252 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/12]
root 253 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/13]
root 254 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/14]
root 255 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/15]
root 256 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/16]
root 257 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/17]
root 258 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/18]
root 259 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/19]
root 260 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/20]
root 261 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/21]
root 262 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/22]
root 263 0.0 0.0 0 0 ? S 14:59 0:00 [crypto/23]
root 266 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_eh_0]
root 267 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_eh_1]
root 268 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_eh_2]
root 271 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_eh_3]
root 274 0.0 0.0 0 0 ? S 14:59 0:00 [kstriped]
root 275 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/0]
root 276 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/1]
root 277 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/2]
root 278 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/3]
root 279 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/4]
root 280 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/5]
root 281 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/6]
root 282 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/7]
root 283 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/8]
root 284 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/9]
root 285 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/10]
root 286 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/11]
root 287 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/12]
root 288 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/13]
root 289 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/14]
root 290 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/15]
root 291 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/16]
root 292 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/17]
root 293 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/18]
root 294 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/19]
root 295 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/20]
root 296 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/21]
root 297 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/22]
root 298 0.0 0.0 0 0 ? S 14:59 0:00 [kmpathd/23]
root 299 0.0 0.0 0 0 ? S 14:59 0:00 [kmpath_handlerd]
root 300 0.0 0.0 0 0 ? S 14:59 0:00 [ksnapd]
root 301 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/0]
root 302 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/1]
root 303 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/2]
root 304 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/3]
root 305 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/4]
root 306 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/5]
root 307 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/6]
root 308 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/7]
root 309 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/8]
root 310 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/9]
root 311 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/10]
root 312 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/11]
root 313 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/12]
root 314 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/13]
root 315 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/14]
root 316 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/15]
root 317 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/16]
root 318 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/17]
root 319 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/18]
root 320 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/19]
root 321 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/20]
root 322 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/21]
root 323 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/22]
root 324 0.0 0.0 0 0 ? S 14:59 0:00 [kondemand/23]
root 325 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/0]
root 326 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 327 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/2]
root 328 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/3]
root 329 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/4]
root 330 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/5]
root 331 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/6]
root 332 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/7]
root 333 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/8]
root 334 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/9]
root 335 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 336 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 337 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 338 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 339 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 340 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 341 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 342 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 343 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 344 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/1]
root 345 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/2]
root 346 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/2]
root 347 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/2]
root 348 0.0 0.0 0 0 ? S 14:59 0:00 [kconservative/2]
root 524 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/0]
root 525 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/1]
root 526 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/2]
root 527 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/3]
root 528 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/4]
root 529 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/5]
root 530 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/6]
root 531 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/7]
root 532 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/8]
root 533 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/9]
root 534 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/10]
root 535 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/11]
root 536 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/12]
root 537 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/13]
root 538 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/14]
root 539 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/15]
root 540 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/16]
root 541 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/17]
root 543 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/18]
root 544 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/19]
root 545 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/20]
root 546 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/21]
root 547 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/22]
root 548 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_tgtd/23]
root 552 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_eh_4]
root 553 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_eh_5]
root 558 0.0 0.0 0 0 ? S< 14:59 0:00 [qla2xxx_5_dpc]
root 559 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_wq_5]
root 560 0.0 0.0 0 0 ? S 14:59 0:00 [fc_wq_5]
root 561 0.0 0.0 0 0 ? S 14:59 0:00 [fc_dl_5]
root 563 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_eh_6]
root 565 0.0 0.0 0 0 ? S< 14:59 0:00 [qla2xxx_6_dpc]
root 566 0.0 0.0 0 0 ? S 14:59 0:00 [scsi_wq_6]
root 567 0.0 0.0 0 0 ? S 14:59 0:00 [fc_wq_6]
root 568 0.0 0.0 0 0 ? S 14:59 0:00 [fc_dl_6]
root 583 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 587 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 601 0.0 0.0 0 0 ? S 14:59 0:00 [kjournald]
root 670 0.0 0.0 16904 916 ? S 14:59 0:00 upstart-udev-bridge --daemon
root 675 0.0 0.0 17076 916 ? S<s 14:59 0:00 udevd --daemon
daemon 1041 0.0 0.0 8256 564 ? Ss 14:59 0:00 portmap
statd 1265 0.0 0.0 10392 832 ? Ss 14:59 0:00 rpc.statd -L --port 4000 --outgoing-port 4001
root 1309 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 1312 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 1315 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 1335 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 1403 0.0 0.0 0 0 ? S 14:59 0:00 [jbd2/dm-3-8]
root 1404 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1405 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1406 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1407 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1408 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1409 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1410 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1411 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1412 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1413 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1414 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1415 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1416 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1417 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1418 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1419 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1420 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1421 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1422 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1423 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1424 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1425 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1426 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1427 0.0 0.0 0 0 ? S 14:59 0:00 [ext4-dio-unwrit]
root 1449 0.0 0.0 0 0 ? S 14:59 0:00 [xfs_mru_cache]
root 1450 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/0]
root 1451 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/1]
root 1452 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/2]
root 1453 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/3]
root 1454 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/4]
root 1455 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/5]
root 1456 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/6]
root 1457 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/7]
root 1458 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/8]
root 1459 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/9]
root 1460 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/10]
root 1461 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/11]
root 1462 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/12]
root 1463 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/13]
root 1464 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/14]
root 1465 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/15]
root 1466 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/16]
root 1468 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/17]
root 1469 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/18]
root 1470 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/19]
root 1471 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/20]
root 1472 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/21]
root 1473 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/22]
root 1474 0.0 0.0 0 0 ? S 14:59 0:00 [xfslogd/23]
root 1475 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/0]
root 1476 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/1]
root 1477 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/2]
root 1478 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/3]
root 1479 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/4]
root 1480 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/5]
root 1481 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/6]
root 1482 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/7]
root 1483 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/8]
root 1484 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/9]
root 1485 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/10]
root 1486 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/11]
root 1487 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/12]
root 1488 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/13]
root 1490 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/14]
root 1491 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/15]
root 1492 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/16]
root 1493 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/17]
root 1494 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/18]
root 1495 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/19]
root 1496 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/20]
root 1497 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/21]
root 1498 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/22]
root 1499 0.0 0.0 0 0 ? S 14:59 0:00 [xfsdatad/23]
root 1500 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/0]
root 1501 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/1]
root 1502 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/2]
root 1503 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/3]
root 1504 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/4]
root 1505 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/5]
root 1506 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/6]
root 1507 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/7]
root 1508 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/8]
root 1509 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/9]
root 1510 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/10]
root 1511 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/11]
root 1512 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/12]
root 1513 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/13]
root 1514 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/14]
root 1515 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/15]
root 1516 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/16]
root 1517 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/17]
root 1518 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/18]
root 1519 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/19]
root 1520 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/20]
root 1521 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/21]
root 1522 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/22]
root 1523 0.0 0.0 0 0 ? S 14:59 0:00 [xfsconvertd/23]
root 1525 0.0 0.0 0 0 ? S 14:59 0:00 [xfsbufd]
root 1528 0.0 0.0 0 0 ? S 14:59 0:00 [xfsaild]
root 1558 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 1642 0.0 0.0 0 0 ? S 14:59 0:00 [kdmflush]
root 1760 0.0 0.0 0 0 ? S 14:59 0:00 [xfssyncd]
root 1768 0.0 0.0 0 0 ? S 14:59 0:00 [xfsbufd]
root 1769 0.0 0.0 0 0 ? S 14:59 0:00 [xfsaild]
root 1770 0.0 0.0 0 0 ? S 14:59 0:00 [xfssyncd]
syslog 1808 0.0 0.0 211600 3400 ? Sl 14:59 0:00 rsyslogd -c4
root 1818 0.0 0.0 0 0 ? S 14:59 0:00 [bond0]
105 1828 0.0 0.0 23424 900 ? Ss 14:59 0:00 dbus-daemon --system --fork
root 1892 0.0 0.0 6080 660 tty4 Ss+ 14:59 0:00 /sbin/getty -8 38400 tty4
root 1896 0.0 0.0 6080 660 tty5 Ss+ 14:59 0:00 /sbin/getty -8 38400 tty5
root 1900 0.0 0.0 6080 656 tty2 Ss+ 14:59 0:00 /sbin/getty -8 38400 tty2
root 1901 0.0 0.0 6080 660 tty3 Ss+ 14:59 0:00 /sbin/getty -8 38400 tty3
root 1905 0.0 0.0 6080 656 tty6 Ss+ 14:59 0:00 /sbin/getty -8 38400 tty6
root 1915 0.0 0.0 11284 688 ? Ss 14:59 0:00 /usr/sbin/irqbalance
root 1917 0.0 0.0 21076 1076 ? Ss 14:59 0:00 cron
daemon 1918 0.0 0.0 18884 468 ? Ss 14:59 0:00 atd
root 2064 0.0 0.0 0 0 ? S 14:59 0:00 [flush-251:0]
root 2927 0.0 0.0 24536 1072 ? Ss 14:59 0:00 /usr/sbin/ntpd
ntpd 2928 0.0 0.0 20316 1068 ? S 14:59 0:00 /usr/sbin/ntpd
root 2936 0.0 0.0 49264 2588 ? Ss 14:59 0:00 /usr/sbin/sshd -D
clamav 3195 0.0 0.0 42804 1860 ? Ss 15:00 0:00 /usr/bin/freshclam -d --quiet
nobody 3200 0.0 0.0 148744 11780 ? Sl 15:00 0:00 /usr/bin/memcached -m 4096 -p 11211 -u nobody -l 127.0.0.1
ossec 3244 0.1 0.0 12804 968 ? S 15:00 0:00 /var/ossec/bin/ossec-agentd
root 3251 0.0 0.0 4244 576 ? S 15:00 0:00 /var/ossec/bin/ossec-logcollector
root 3267 0.5 0.0 5100 1608 ? S 15:00 0:03 /var/ossec/bin/ossec-syscheckd
root 3340 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/0]
root 3341 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/1]
root 3342 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/2]
root 3343 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/3]
root 3344 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/4]
root 3345 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/5]
root 3346 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/6]
root 3347 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/7]
root 3348 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/8]
root 3349 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/9]
root 3350 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/10]
root 3351 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/11]
root 3352 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/12]
root 3353 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/13]
root 3354 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/14]
root 3355 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/15]
root 3356 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/16]
root 3357 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/17]
root 3358 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/18]
root 3359 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/19]
root 3360 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/20]
root 3361 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/21]
root 3362 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/22]
root 3363 0.0 0.0 0 0 ? S 15:00 0:00 [rpciod/23]
root 3364 0.0 0.0 0 0 ? S 15:00 0:00 [nfsiod]
root 3365 0.0 0.0 0 0 ? S 15:00 0:00 [lockd]
---
root 6334 0.0 0.0 0 0 ? S 15:07 0:00 [flush-251:4]
root 6349 0.0 0.0 0 0 ? S 15:07 0:00 [flush-0:21]
root 6350 0.0 0.0 85528 3680 pts/1 SLl+ 15:07 0:00 /sbin/multipathd -d -v 255
root 6352 0.0 0.0 4340 632 pts/1 S+ 15:07 0:00 strace -o /home/user/strace_mpathd.txt -D /sbin/multipathd -d -v 255
postfix 8511 0.0 0.0 39376 2388 ? S 15:10 0:00 cleanup -z -t unix -u -c
postfix 8512 0.0 0.0 39288 2260 ? S 15:10 0:00 trivial-rewrite -n rewrite -t unix -u -c
postfix 8513 0.0 0.0 43568 2632 ? S 15:10 0:00 smtp -t unix -u -c
postfix 8516 0.0 0.0 39548 2964 ? S 15:10 0:00 local -t unix
root 8613 0.0 0.0 16868 760 ? S< 15:10 0:00 udevd --daemon
root 8695 0.0 0.0 16868 760 ? S< 15:10 0:00 udevd --daemon
root 8874 0.0 0.0 0 0 ? S 15:10 0:00 [flush-8:128]
root 8875 0.0 0.0 0 0 ? S 15:10 0:00 [flush-8:144]
root 8876 0.0 0.0 0 0 ? S 15:10 0:00 [flush-8:224]
root 8877 0.0 0.0 0 0 ? S 15:10 0:00 [flush-8:240]
root 8878 0.0 0.0 0 0 ? S 15:10 0:00 [flush-8:112]
root 8879 0.0 0.0 0 0 ? S 15:10 0:00 [flush-8:208]
--
You received this bug notification because you are a member of Ubuntu
Foundations Bugs, which is subscribed to multipath-tools in Ubuntu.
https://bugs.launchpad.net/bugs/1020436
Title:
Cannot read superblock after FC multipath failover
Status in “multipath-tools” package in Ubuntu:
Incomplete
Bug description:
This might not be multipath-tools, but it's the likeliest candidate.
If fibre channel connectivity is disrupted on an active path, I can
see the multipath daemon rejuggling active paths as expected. However
instead of utilising a new path, the server continues trying active
i/o down the same path until it fails, and the superblock on the lun
is marked unreadable.
The luns simply cannot be remounted even after the paths are
recovered. However, after a simple reboot, the luns are again
readable _regardless_ of the visible path. (Eg I shut the active FC
port then rebooted, and the storage was mountable per normal over a
different path).
I've replicated this behaviour using both xfs and ext4 filesystems, on
multiple different luns presented to the server.
The luns are visible over four FC paths, and the /dev/mapper/mpathX
identity is used as the physical volume for an LVM2 volume group, into
which the logical volume(s) and filesystem are created.
root@<host>:~# lsb_release -rd
Description: Ubuntu 10.04.3 LTS
Release: 10.04
As you can see here, the /dev/test and /dev/test2 volume groups are
both active, yet showing i/o errors after a pathing fail.
root@<host>:~# lvscan
/dev/test2/lvol0: read failed after 0 of 4096 at 0: Input/output error
/dev/test/lvol0: read failed after 0 of 4096 at 0: Input/output error
ACTIVE '/dev/test2/lvol0' [4.00 GiB] inherit
ACTIVE '/dev/test/lvol0' [4.00 GiB] inherit
ACTIVE '/dev/mvsan/san' [500.00 GiB] inherit
root@<host>:~# pvscan
/dev/test2/lvol0: read failed after 0 of 4096 at 4290707456: Input/output error
/dev/test2/lvol0: read failed after 0 of 4096 at 4290764800: Input/output error
/dev/test2/lvol0: read failed after 0 of 4096 at 0: Input/output error
/dev/test2/lvol0: read failed after 0 of 4096 at 4096: Input/output error
/dev/test2/lvol0: read failed after 0 of 4096 at 0: Input/output error
/dev/test/lvol0: read failed after 0 of 4096 at 4290707456: Input/output error
/dev/test/lvol0: read failed after 0 of 4096 at 4290764800: Input/output error
/dev/test/lvol0: read failed after 0 of 4096 at 0: Input/output error
/dev/test/lvol0: read failed after 0 of 4096 at 4096: Input/output error
/dev/test/lvol0: read failed after 0 of 4096 at 0: Input/output error
PV /dev/mapper/mpath2 VG test2 lvm2 [4.00 GiB / 0 free]
PV /dev/mapper/mpath1 VG test lvm2 [4.00 GiB / 0 free]
PV /dev/mapper/mpath0 VG mvsan lvm2 [500.00 GiB / 0 free]
root@<host>:~# multipath -ll
mpath2 (360060e80058a070000008a0700000023) dm-7 HITACHI ,OPEN-V
[size=4.0G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=4][active]
\_ 6:0:0:2 sdd 8:48 [active][ready]
\_ 6:0:1:2 sdg 8:96 [active][ready]
\_ 7:0:0:2 sdj 8:144 [active][ready]
\_ 7:0:1:2 sdp 8:240 [active][ready]
mpath1 (360060e80058a070000008a070000000e) dm-6 HITACHI ,OPEN-V
[size=4.0G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=4][active]
\_ 6:0:0:1 sdc 8:32 [active][ready]
\_ 6:0:1:1 sdf 8:80 [active][ready]
\_ 7:0:0:1 sdi 8:128 [active][ready]
\_ 7:0:1:1 sdo 8:224 [active][ready]
mpath0 (360060e80058a070000008a0700002417) dm-5 HITACHI ,OPEN-V
[size=500G][features=1 queue_if_no_path][hwhandler=0]
\_ round-robin 0 [prio=4][active]
\_ 6:0:0:0 sdb 8:16 [active][ready]
\_ 6:0:1:0 sde 8:64 [active][ready]
\_ 7:0:0:0 sdh 8:112 [active][ready]
\_ 7:0:1:0 sdk 8:160 [active][ready]
The dmesg output is very instructive, but still doesn't help with the
root cause per se. I set the scsi-timeouts nice and high (90 seconds)
to accommodate any potential delays in path failover. The path checks
(test unit ready/TUR) occur about every 20 seconds.
See below:
[ 2192.891962] qla2xxx 0000:24:00.0: LOOP DOWN detected (2 3 0).
[ 2222.820850] rport-7:0-0: blocked FC remote port time out: removing target and saving binding
[ 2222.821297] rport-7:0-1: blocked FC remote port time out: removing target and saving binding
[ 2222.827286] device-mapper: multipath: Failing path 8:112.
[ 2222.827369] device-mapper: multipath: Failing path 8:160.
So this is all as expected.
Then:
[ 2222.924665] sd 7:0:0:0: [sdh] Synchronizing SCSI cache
[ 2222.924696] sd 7:0:0:0: [sdh] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2222.926071] device-mapper: multipath: Failing path 8:160.
[ 2222.976444] sd 7:0:1:2: [sdm] Unhandled error code
[ 2222.976446] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2222.976449] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f e1 00 00 00 01 00
[ 2222.976455] end_request: I/O error, dev sdm, sector 8380672
[ 2222.980258] sd 7:0:1:2: [sdm] Unhandled error code
[ 2222.980260] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2222.980262] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f e1 70 00 00 01 00
[ 2222.980267] end_request: I/O error, dev sdm, sector 8380784
[ 2222.984139] sd 7:0:1:2: [sdm] Unhandled error code
[ 2222.984141] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2222.984142] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 80 00 00 01 00
[ 2222.984147] end_request: I/O error, dev sdm, sector 384
[ 2222.988137] sd 7:0:1:2: [sdm] Unhandled error code
[ 2222.988139] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2222.988141] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 88 00 00 01 00
[ 2222.988145] end_request: I/O error, dev sdm, sector 392
[ 2222.992274] sd 7:0:1:2: [sdm] Unhandled error code
[ 2222.992276] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2222.992278] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 80 00 00 04 00
[ 2222.992282] end_request: I/O error, dev sdm, sector 384
[ 2222.996583] sd 7:0:1:1: [sdl] Unhandled error code
[ 2222.996585] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2222.996587] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 7f e1 00 00 00 08 00
[ 2222.996592] end_request: I/O error, dev sdl, sector 8380672
[ 2223.000980] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.000983] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.000985] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 7f e1 70 00 00 08 00
[ 2223.000992] end_request: I/O error, dev sdl, sector 8380784
[ 2223.005571] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.005573] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.005576] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 01 80 00 00 08 00
[ 2223.005583] end_request: I/O error, dev sdl, sector 384
[ 2223.010258] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.010260] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.010263] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 01 88 00 00 08 00
[ 2223.010269] end_request: I/O error, dev sdl, sector 392
[ 2223.015062] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.015065] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.015068] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 01 80 00 00 08 00
[ 2223.015072] end_request: I/O error, dev sdl, sector 384
[ 2223.046324] sd 7:0:0:2: [sdj] Unhandled error code
[ 2223.046325] sd 7:0:0:2: [sdj] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.046328] sd 7:0:0:2: [sdj] CDB: Read(10): 28 00 00 7f ff 80 00 00 08 00
[ 2223.046333] end_request: I/O error, dev sdj, sector 8388480
[ 2223.051339] sd 7:0:0:2: [sdj] Unhandled error code
[ 2223.051341] sd 7:0:0:2: [sdj] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.051343] sd 7:0:0:2: [sdj] CDB: Read(10): 28 00 00 7f ff f0 00 00 08 00
[ 2223.051347] end_request: I/O error, dev sdj, sector 8388592
[ 2223.051841] sd 7:0:0:1: [sdi] Synchronizing SCSI cache
[ 2223.051868] sd 7:0:0:1: [sdi] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.056574] sd 7:0:1:0: [sdk] Unhandled error code
[ 2223.056576] sd 7:0:1:0: [sdk] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.056578] sd 7:0:1:0: [sdk] CDB: Read(10): 28 00 3e 7f ff 80 00 00 08 00
[ 2223.056583] end_request: I/O error, dev sdk, sector 1048575872
[ 2223.061961] sd 7:0:1:0: [sdk] Unhandled error code
[ 2223.061962] sd 7:0:1:0: [sdk] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.061964] sd 7:0:1:0: [sdk] CDB: Read(10): 28 00 3e 7f ff f0 00 00 08 00
[ 2223.061969] end_request: I/O error, dev sdk, sector 1048575984
[ 2223.067450] sd 7:0:1:0: [sdk] Unhandled error code
[ 2223.067453] sd 7:0:1:0: [sdk] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.067456] sd 7:0:1:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.067462] end_request: I/O error, dev sdk, sector 0
[ 2223.073081] sd 7:0:1:0: [sdk] Unhandled error code
[ 2223.073083] sd 7:0:1:0: [sdk] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.073085] sd 7:0:1:0: [sdk] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
[ 2223.073089] end_request: I/O error, dev sdk, sector 8
[ 2223.078824] sd 7:0:1:0: [sdk] Unhandled error code
[ 2223.078825] sd 7:0:1:0: [sdk] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.078827] sd 7:0:1:0: [sdk] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.078832] end_request: I/O error, dev sdk, sector 0
[ 2223.084675] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.084677] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.084679] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 7f ff 80 00 00 08 00
[ 2223.084683] end_request: I/O error, dev sdl, sector 8388480
[ 2223.090671] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.090672] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.090674] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 7f ff f0 00 00 08 00
[ 2223.090679] end_request: I/O error, dev sdl, sector 8388592
[ 2223.096830] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.096832] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.096834] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.096838] end_request: I/O error, dev sdl, sector 0
[ 2223.103075] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.103077] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.103079] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
[ 2223.103083] end_request: I/O error, dev sdl, sector 8
[ 2223.109441] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.109444] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.109446] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.109453] end_request: I/O error, dev sdl, sector 0
[ 2223.115922] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.115924] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.115926] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f ff 80 00 00 08 00
[ 2223.115930] end_request: I/O error, dev sdm, sector 8388480
[ 2223.122543] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.122545] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.122547] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f ff f0 00 00 08 00
[ 2223.122551] end_request: I/O error, dev sdm, sector 8388592
[ 2223.128957] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.128959] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.128961] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.128965] end_request: I/O error, dev sdm, sector 0
[ 2223.135176] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.135178] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.135180] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
[ 2223.135185] end_request: I/O error, dev sdm, sector 8
[ 2223.140962] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.140964] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.140965] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.140970] end_request: I/O error, dev sdm, sector 0
[ 2223.164023] sd 7:0:0:2: [sdj] Synchronizing SCSI cache
[ 2223.164050] sd 7:0:0:2: [sdj] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.178664] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.178666] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.178668] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 80 00 00 04 00
[ 2223.178673] end_request: I/O error, dev sdm, sector 384
[ 2223.183803] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.183805] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.183807] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 01 80 00 00 08 00
[ 2223.183812] end_request: I/O error, dev sdl, sector 384
[ 2223.191271] sd 7:0:1:1: [sdl] Unhandled error code
[ 2223.191273] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.191275] sd 7:0:1:1: [sdl] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.191280] end_request: I/O error, dev sdl, sector 0
[ 2223.195433] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.195435] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.195438] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.195444] end_request: I/O error, dev sdm, sector 0
[ 2223.236558] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.236560] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.236563] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f e1 00 00 00 01 00
[ 2223.236568] end_request: I/O error, dev sdm, sector 8380672
[ 2223.240754] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.240756] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.240758] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f e1 70 00 00 01 00
[ 2223.240763] end_request: I/O error, dev sdm, sector 8380784
[ 2223.241440] sd 7:0:1:0: [sdk] Synchronizing SCSI cache
[ 2223.241531] sd 7:0:1:0: [sdk] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.244982] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.244984] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.244986] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 80 00 00 01 00
[ 2223.244991] end_request: I/O error, dev sdm, sector 384
[ 2223.249170] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.249173] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.249176] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 88 00 00 01 00
[ 2223.249183] end_request: I/O error, dev sdm, sector 392
[ 2223.253313] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.253315] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.253318] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 80 00 00 04 00
[ 2223.253325] end_request: I/O error, dev sdm, sector 384
[ 2223.270352] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.270355] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.270359] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f ff 80 00 00 08 00
[ 2223.270366] end_request: I/O error, dev sdm, sector 8388480
[ 2223.274548] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.274550] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.274552] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 7f ff f0 00 00 08 00
[ 2223.274557] end_request: I/O error, dev sdm, sector 8388592
[ 2223.278653] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.278654] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.278656] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.278661] end_request: I/O error, dev sdm, sector 0
[ 2223.282759] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.282760] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.282762] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00
[ 2223.282767] end_request: I/O error, dev sdm, sector 8
[ 2223.286863] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.286865] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.286867] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00
[ 2223.286872] end_request: I/O error, dev sdm, sector 0
[ 2223.321219] sd 7:0:1:2: [sdm] Unhandled error code
[ 2223.321221] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.321223] sd 7:0:1:2: [sdm] CDB: Read(10): 28 00 00 00 01 80 00 00 04 00
[ 2223.321229] end_request: I/O error, dev sdm, sector 384
[ 2223.321231] sd 7:0:1:1: [sdl] Synchronizing SCSI cache
[ 2223.321261] sd 7:0:1:1: [sdl] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
[ 2223.443319] sd 7:0:1:2: [sdm] Synchronizing SCSI cache
[ 2223.443351] sd 7:0:1:2: [sdm] Result: hostbyte=DID_NO_CONNECT driverbyte=DRIVER_OK
And then:
[ 2241.094148] Aborting journal on device dm-3-8.
[ 2241.098327] __ratelimit: 24 callbacks suppressed
[ 2241.098330] Buffer I/O error on device dm-3, logical block 458752
[ 2241.102730] lost page write due to I/O error on dm-3
[ 2241.102743] JBD2: I/O error detected when updating journal superblock for dm-3-8.
[ 2265.843946] EXT4-fs error (device dm-3): ext4_journal_start_sb: Detected aborted journal
[ 2265.855469] EXT4-fs (dm-3): Remounting filesystem read-only
[ 2280.676139] I/O error in filesystem ("dm-2") meta-data dev dm-2 block 0x18 ("xfs_trans_read_buf") error 5 buf count 4096
This is very disturbing as it means that the multipathing is not in
fact working at all - You can see that the I/O errors are pointing at
'dm-3' rather than the mpath associated device, but thats normal as
the logical volume appears in that place.
The filesystems are healthy, when you reboot the server and check them
there are zero errors. There's something wrong with the way that the
pathing failover is being handled, but I'm not sure where I'd find the
ultimate root cause of this.
This segfault occurs after the above issues have already manifested:
[ 4057.146508] multipathd[3261]: segfault at a ip 00007f89bdce798a sp
00007fffd25c2780 error 4 in libc-2.11.1.so[7f89bdc70000+17a000].
root@<host>:~# apt-cache policy multipath-tools
multipath-tools:
Installed: 0.4.8-14ubuntu4.10.04.2
Candidate: 0.4.8-14ubuntu4.10.04.2
Version table:
*** 0.4.8-14ubuntu4.10.04.2 0
500 http://au.archive.ubuntu.com/ubuntu/ lucid-updates/main Packages
100 /var/lib/dpkg/status
0.4.8-14ubuntu4 0
500 http://au.archive.ubuntu.com/ubuntu/ lucid/main Packages
Let me know if you need further details.
ProblemType: Bug
DistroRelease: Ubuntu 10.04
Package: multipath-tools 0.4.8-14ubuntu4.10.04.2
ProcVersionSignature: Ubuntu 2.6.32-41.91-server 2.6.32.59+drm33.24
Uname: Linux 2.6.32-41-server x86_64
Architecture: amd64
Date: Tue Jul 3 15:13:23 2012
InstallationMedia: Ubuntu-Server 10.04.3 LTS "Lucid Lynx" - Release amd64 (20110719.2)
ProcEnviron:
LANG=en_AU.UTF8
SHELL=/bin/bash
SourcePackage: multipath-tools
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/multipath-tools/+bug/1020436/+subscriptions
More information about the foundations-bugs
mailing list