From bugmaster at FreeBSD.org Mon Jul 7 11:07:06 2008 From: bugmaster at FreeBSD.org (FreeBSD bugmaster) Date: Mon Jul 7 11:09:10 2008 Subject: Current problem reports assigned to freebsd-scsi@FreeBSD.org Message-ID: <200807071107.m67B75jx062167@freefall.freebsd.org> Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/39388 scsi ncr/sym drivers fail with 53c810 and more than 256MB m o kern/40895 scsi wierd kernel / device driver bug o kern/52638 scsi [panic] SCSI U320 on SMP server won't run faster than s kern/57398 scsi [mly] Current fails to install on mly(4) based RAID di o kern/60598 scsi wire down of scsi devices conflicts with config o kern/60641 scsi [sym] Sporadic SCSI bus resets with 53C810 under load s kern/61165 scsi [panic] kernel page fault after calling cam_send_ccb o kern/74627 scsi [ahc] [hang] Adaptec 2940U2W Can't boot 5.3 o kern/90282 scsi [sym] SCSI bus resets cause loss of ch device o kern/92798 scsi [ahc] SCSI problem with timeouts o kern/94838 scsi Kernel panic while mounting SD card with lock switch o o kern/99954 scsi [ahc] reading from DVD failes on 6.x [regression] o kern/110847 scsi [ahd] Tyan U320 onboard problem with more than 3 disks o kern/120247 scsi [mpt] FreeBSD 6.3 and LSI Logic 1030 = only 3.300MB/s o kern/124667 scsi [amd] [panic] FreeBSD-7 kernel page faults at amd-scsi 15 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/35234 scsi World access to /dev/pass? (for scanner) requires acce o kern/38828 scsi [dpt] [request] DPT PM2012B/90 doesn't work o kern/44587 scsi dev/dpt/dpt.h is missing defines required for DPT_HAND o kern/76178 scsi [ahd] Problem with ahd and large SCSI Raid system o kern/114597 scsi [sym] System hangs at SCSI bus reset with dual HBAs o kern/119668 scsi [cam] [patch] certain errors are too verbose comparing o kern/120487 scsi [sg] scsi_sg incompatible with scanners o sparc/121676 scsi [iscsi] iscontrol do not connect iscsi-target on sparc o kern/123666 scsi [aac] aac(4) will not work with Adaptec SAS RAID 3805 o kern/123674 scsi [ahc] ahc driver dumping 10 problems total. From andrew at accid.net Tue Jul 8 16:55:51 2008 From: andrew at accid.net (Andrew Von Cid) Date: Tue Jul 8 16:55:58 2008 Subject: HP StorageWorks U320e supported? Message-ID: <48739769.2070902@accid.net> Hi everyone, I've got a Quantum CL1102 LTO-3 tape drive that I need to hook up to a FreeBSD 7 server. As far as I'm aware, as long as I have a supported SCSI adapter, the tape drive should work fine. I'm looking into getting a HP StorageWorks U320e (AH627A) SCSI card [1], but I couldn't find any info whether it'll work with FreeBSD. Can someone confirm if it's supported or not? Alternatively, I'd be very grateful if someone could recommend a supported SCSI(Ultra160) adapter that works with FreeBSD 7. It needs to fit either PCI-e or PCI-X solts. Many thanks, Andrew. From sbruno at miralink.com Tue Jul 8 17:25:09 2008 From: sbruno at miralink.com (Sean Bruno) Date: Tue Jul 8 17:25:15 2008 Subject: HP StorageWorks U320e supported? In-Reply-To: <48739769.2070902@accid.net> References: <48739769.2070902@accid.net> Message-ID: <4873A2F4.5070501@miralink.com> Andrew Von Cid wrote: > Hi everyone, > > I've got a Quantum CL1102 LTO-3 tape drive that I need to hook up to a > FreeBSD 7 server. As far as I'm aware, as long as I have a supported > SCSI adapter, the tape drive should work fine. > > I'm looking into getting a HP StorageWorks U320e (AH627A) SCSI card > [1], but I couldn't find any info whether it'll work with FreeBSD. > Can someone confirm if it's supported or not? > > Alternatively, I'd be very grateful if someone could recommend a > supported SCSI(Ultra160) adapter that works with FreeBSD 7. It needs > to fit either PCI-e or PCI-X solts. > > > Many thanks, > > > Andrew. > > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" I'd suggest sticking with the "old standby" Adaptec 29160 board(PCI-X). If you _need_ PCI-E then I would suggest going with the 29320. -- Sean Bruno MiraLink Corporation 6015 NE 80th Ave, Ste 100 Portland, OR 97218 Phone 503-621-5143 Fax 503-621-5199 From sbruno at miralink.com Tue Jul 8 19:15:24 2008 From: sbruno at miralink.com (Sean Bruno) Date: Tue Jul 8 19:15:31 2008 Subject: share/examples/scsi_target doesn't install Message-ID: <4873BCC9.80603@miralink.com> Is the scsi_target example code supposed to install when a "make install" is invoked? [sbruno@ophelia ~/FreeBSD_RELENG_7_15APR08/src/share/examples/scsi_target]$ sudo make install install -s -o root -g wheel -m 555 scsi_target usage: install [-bCcpSsv] [-B suffix] [-f flags] [-g group] [-m mode] [-o owner] file1 file2 install [-bCcpSsv] [-B suffix] [-f flags] [-g group] [-m mode] [-o owner] file1 ... fileN directory install -d [-v] [-g group] [-m mode] [-o owner] directory ... *** Error code 64 Stop in /usr/home/sbruno/FreeBSD_RELENG_7_15APR08/src/share/examples/scsi_target. -- Sean Bruno MiraLink Corporation 6015 NE 80th Ave, Ste 100 Portland, OR 97218 Phone 503-621-5143 Fax 503-621-5199 From westr at connection.ca Thu Jul 10 19:10:54 2008 From: westr at connection.ca (Ross) Date: Thu Jul 10 19:11:39 2008 Subject: isp - error/scsi message Message-ID: <1557532186.20080710145356@connection.ca> I'm getting the following error every so often, and I'm wondering if someone else has had it and knows what it means. -= kernel: (da0:isp0:0:0:1): WRITE(10). CDB: 2a 0 1 10 eb bf 0 0 20 0 kernel: (da0:isp0:0:0:1): CAM Status: SCSI Status Error kernel: (da0:isp0:0:0:1): SCSI Status: Check Condition kernel: (da0:isp0:0:0:1): UNIT ATTENTION asc:2a,6 kernel: (da0:isp0:0:0:1): Reserved ASC/ASCQ pair kernel: (da0:isp0:0:0:1): Retrying Command (per Sense Data) -= A quick google of the ASC/ASCQ code gives the message "ASYMMETRIC ACCESS STATE CHANGED", which I'm wondering has something to do with the fact that the corresponding lun is accessible via multiple paths (4 paths - 2x isp QHM2432 adapters). If anyone can help shed some light on this, I'd be grateful! Ross. -- From sbruno at miralink.com Thu Jul 10 21:18:21 2008 From: sbruno at miralink.com (Sean Bruno) Date: Thu Jul 10 21:18:27 2008 Subject: isp - error/scsi message In-Reply-To: <1557532186.20080710145356@connection.ca> References: <1557532186.20080710145356@connection.ca> Message-ID: <48767C9B.3060804@miralink.com> Ross wrote: > I'm getting the following error every so often, and I'm wondering if > someone else has had it and knows what it means. > > -= > kernel: (da0:isp0:0:0:1): WRITE(10). CDB: 2a 0 1 10 eb bf 0 0 20 0 > kernel: (da0:isp0:0:0:1): CAM Status: SCSI Status Error > kernel: (da0:isp0:0:0:1): SCSI Status: Check Condition > kernel: (da0:isp0:0:0:1): UNIT ATTENTION asc:2a,6 > kernel: (da0:isp0:0:0:1): Reserved ASC/ASCQ pair > kernel: (da0:isp0:0:0:1): Retrying Command (per Sense Data) > -= > > A quick google of the ASC/ASCQ code gives the message "ASYMMETRIC > ACCESS STATE CHANGED", which I'm wondering has something to do with > the fact that the corresponding lun is accessible via multiple paths > (4 paths - 2x isp QHM2432 adapters). > > If anyone can help shed some light on this, I'd be grateful! > > > Ross. > > What version of FreeBSD is this related to? Sean -- Sean Bruno MiraLink Corporation 6015 NE 80th Ave, Ste 100 Portland, OR 97218 Phone 503-621-5143 Fax 503-621-5199 From westr at connection.ca Thu Jul 10 21:24:47 2008 From: westr at connection.ca (Ross) Date: Thu Jul 10 21:24:53 2008 Subject: isp - error/scsi message In-Reply-To: <48767C9B.3060804@miralink.com> References: <1557532186.20080710145356@connection.ca> <48767C9B.3060804@miralink.com> Message-ID: <477336220.20080710172453@connection.ca> >> >> -= >> kernel: (da0:isp0:0:0:1): WRITE(10). CDB: 2a 0 1 10 eb bf 0 0 20 0 >> kernel: (da0:isp0:0:0:1): CAM Status: SCSI Status Error >> kernel: (da0:isp0:0:0:1): SCSI Status: Check Condition >> kernel: (da0:isp0:0:0:1): UNIT ATTENTION asc:2a,6 >> kernel: (da0:isp0:0:0:1): Reserved ASC/ASCQ pair >> kernel: (da0:isp0:0:0:1): Retrying Command (per Sense Data) >> -= >> >> A quick google of the ASC/ASCQ code gives the message "ASYMMETRIC >> ACCESS STATE CHANGED", which I'm wondering has something to do with >> the fact that the corresponding lun is accessible via multiple paths >> (4 paths - 2x isp QHM2432 adapters). >> >> If anyone can help shed some light on this, I'd be grateful! SB> What version of FreeBSD is this related to? Sorry, forgot that details - it's running Freebsd 7.0, with the included isp driver on a custom kernel (ie: trimmed and with PAE/ULE) Biggest thing to note is that the isp firmware is 4.00.90 - which is the builtin fw for the card (newer than the OS included one). And a small correction: it's a QHM2462 card. -- From ktk at netlabs.org Fri Jul 11 13:08:22 2008 From: ktk at netlabs.org (Adrian Gschwend) Date: Fri Jul 11 13:08:29 2008 Subject: iSCSI performance Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I finally invested some time to get iSCSI to work on FreeBSD. Now I do have an iSCSI disk mounted in the system so I started doing some performance tests against an NetApp FAS3020 head with an iSCSI LUN configured for my FreeBSD 7.0-stable box. It's a rather old IBM server and I used sysbench to get some stats. The results I got were: local SCSI disk, UFS: - -- Operations performed: 5999 Read, 4001 Write, 12800 Other = 22800 Total Read 93.734Mb Written 62.516Mb Total transferred 156.25Mb (2.2672Mb/sec) 145.10 Requests/sec executed - -- NFS share on the NetApp (no tweaking, default NFS mount): - -- Operations performed: 6006 Read, 3994 Write, 12800 Other = 22800 Total Read 93.844Mb Written 62.406Mb Total transferred 156.25Mb (11.948Mb/sec) 764.69 Requests/sec executed - -- iSCSI with UFS: - -- Operations performed: 6004 Read, 3996 Write, 12800 Other = 22800 Total Read 93.812Mb Written 62.438Mb Total transferred 156.25Mb (489.41Kb/sec) 30.59 Requests/sec executed - -- which is a rather bad results for iSCSI ;) Note that I didn't want to get the real performance so I just took the default sysbench lines I found in the docs. It was just to get something to compare to. Googling a bit I found this posting here: http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003383.html Is this patch in -CURRENT by now or do I still have to compile the stuff on my own if I want to do some more tests? And is anyone actively working on iSCSI right now? I do have some proposals regarding iscontrol as well, the tool is not yet idiot proof ;) What would be the appropriate list to post feedback regarding that? next thing on my list is to try ZFS on the iSCSI share but I would like to see some better performance on UFS first :) BTW in case you wonder why I want to use iSCSI: I am running a subversion server with rather big repositories using "fsfs" on NFS and I run into very weird PROPFIND problems (Apache frontent) when importing large quantities of data and I don't have the problem doing the same on a local drive of the server. So I guess that's some NFS locking stuff I couldn't get rid of. The idea is to replace that with iSCSI and ZFS (I love NetApps snapshot feature and I want that too in the future, so ZFS) once both is declared as stable (yes, I have time :) cu Adrian -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFId1d3qpMUYrZbQBERAhjfAJ96YsvsVyLgeRY3Ah54UM1jvwHKwgCeIaoM ibhoi7c6jovvBIF/jaI5IQ8= =mr7E -----END PGP SIGNATURE----- From danny at cs.huji.ac.il Fri Jul 11 14:04:47 2008 From: danny at cs.huji.ac.il (Danny Braniss) Date: Fri Jul 11 14:04:54 2008 Subject: iSCSI performance In-Reply-To: References: Message-ID: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > I finally invested some time to get iSCSI to work on FreeBSD. Now I do > have an iSCSI disk mounted in the system so I started doing some > performance tests against an NetApp FAS3020 head with an iSCSI LUN > configured for my FreeBSD 7.0-stable box. > > It's a rather old IBM server and I used sysbench to get some stats. > > The results I got were: > > local SCSI disk, UFS: > - -- > Operations performed: 5999 Read, 4001 Write, 12800 Other = 22800 Total > Read 93.734Mb Written 62.516Mb Total transferred 156.25Mb (2.2672Mb/sec) > 145.10 Requests/sec executed > - -- > > > NFS share on the NetApp (no tweaking, default NFS mount): > - -- > Operations performed: 6006 Read, 3994 Write, 12800 Other = 22800 Total > Read 93.844Mb Written 62.406Mb Total transferred 156.25Mb (11.948Mb/sec) > 764.69 Requests/sec executed > - -- > > > iSCSI with UFS: > - -- > Operations performed: 6004 Read, 3996 Write, 12800 Other = 22800 Total > Read 93.812Mb Written 62.438Mb Total transferred 156.25Mb (489.41Kb/sec) > 30.59 Requests/sec executed > - -- > > which is a rather bad results for iSCSI ;) > > Note that I didn't want to get the real performance so I just took the > default sysbench lines I found in the docs. It was just to get something > to compare to. > > Googling a bit I found this posting here: > > http://lists.freebsd.org/pipermail/freebsd-scsi/2008-February/003383.html > > Is this patch in -CURRENT by now or do I still have to compile the stuff > on my own if I want to do some more tests? > the patches were for -STABLE, and I haven't seen them, but before the patches, try increasing the tag opening, ie camcontrol tags daX -N128 or via iscontrol (and yes it's not idiot proof, nor is is it developer proof :-) > And is anyone actively working on iSCSI right now? I do have some > proposals regarding iscontrol as well, the tool is not yet idiot proof > ;) What would be the appropriate list to post feedback regarding that? absolutely! > > next thing on my list is to try ZFS on the iSCSI share but I would like > to see some better performance on UFS first :) > > BTW in case you wonder why I want to use iSCSI: I am running a > subversion server with rather big repositories using "fsfs" on NFS and I > run into very weird PROPFIND problems (Apache frontent) when importing > large quantities of data and I don't have the problem doing the same on > a local drive of the server. So I guess that's some NFS locking stuff I > couldn't get rid of. > The idea is to replace that with iSCSI and ZFS (I love NetApps snapshot > feature and I want that too in the future, so ZFS) once both is declared > as stable (yes, I have time :) > > cu > > Adrian > > > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.6 (GNU/Linux) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > iD8DBQFId1d3qpMUYrZbQBERAhjfAJ96YsvsVyLgeRY3Ah54UM1jvwHKwgCeIaoM > ibhoi7c6jovvBIF/jaI5IQ8= > =mr7E > -----END PGP SIGNATURE----- > > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > From bugmaster at FreeBSD.org Mon Jul 14 11:07:05 2008 From: bugmaster at FreeBSD.org (FreeBSD bugmaster) Date: Mon Jul 14 11:08:50 2008 Subject: Current problem reports assigned to freebsd-scsi@FreeBSD.org Message-ID: <200807141107.m6EB7475014545@freefall.freebsd.org> Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/39388 scsi ncr/sym drivers fail with 53c810 and more than 256MB m o kern/40895 scsi wierd kernel / device driver bug o kern/52638 scsi [panic] SCSI U320 on SMP server won't run faster than s kern/57398 scsi [mly] Current fails to install on mly(4) based RAID di o kern/60598 scsi wire down of scsi devices conflicts with config o kern/60641 scsi [sym] Sporadic SCSI bus resets with 53C810 under load s kern/61165 scsi [panic] kernel page fault after calling cam_send_ccb o kern/74627 scsi [ahc] [hang] Adaptec 2940U2W Can't boot 5.3 o kern/90282 scsi [sym] SCSI bus resets cause loss of ch device o kern/92798 scsi [ahc] SCSI problem with timeouts o kern/94838 scsi Kernel panic while mounting SD card with lock switch o o kern/99954 scsi [ahc] reading from DVD failes on 6.x [regression] o kern/110847 scsi [ahd] Tyan U320 onboard problem with more than 3 disks o kern/120247 scsi [mpt] FreeBSD 6.3 and LSI Logic 1030 = only 3.300MB/s o kern/124667 scsi [amd] [panic] FreeBSD-7 kernel page faults at amd-scsi 15 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/35234 scsi World access to /dev/pass? (for scanner) requires acce o kern/38828 scsi [dpt] [request] DPT PM2012B/90 doesn't work o kern/44587 scsi dev/dpt/dpt.h is missing defines required for DPT_HAND o kern/76178 scsi [ahd] Problem with ahd and large SCSI Raid system o kern/114597 scsi [sym] System hangs at SCSI bus reset with dual HBAs o kern/119668 scsi [cam] [patch] certain errors are too verbose comparing o kern/120487 scsi [sg] scsi_sg incompatible with scanners o sparc/121676 scsi [iscsi] iscontrol do not connect iscsi-target on sparc o kern/123666 scsi [aac] aac(4) will not work with Adaptec SAS RAID 3805 o kern/123674 scsi [ahc] ahc driver dumping 10 problems total. From ktk at netlabs.org Mon Jul 14 12:33:17 2008 From: ktk at netlabs.org (Adrian Gschwend) Date: Mon Jul 14 12:33:25 2008 Subject: iSCSI performance In-Reply-To: References: Message-ID: <487B486D.3000206@netlabs.org> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Danny Braniss wrote: > the patches were for -STABLE, and I haven't seen them, but > before the patches, try increasing the tag opening, ie > camcontrol tags daX -N128 > or via iscontrol (and yes it's not idiot proof, nor is is it > developer proof :-) ok ;) Did that (camcontrol), with the following result: Operations performed: 6006 Read, 3994 Write, 12800 Other = 22800 Total Read 93.844Mb Written 62.406Mb Total transferred 156.25Mb (1.4742Mb/sec) 94.35 Requests/sec executed which is already a lot better but still below the IO of the local disk. Should I try more right now or should I wait for more progress in that? Does it make sense to switch to -CURRENT for that? cu Adrian -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIe0htqpMUYrZbQBERAvBpAJ9eTtDCdTJYcF2v1DtAr3vTSdartgCgoL1G aWEdX1ZHHl8pUZ5O87xJf2g= =EvmR -----END PGP SIGNATURE----- From danny at cs.huji.ac.il Mon Jul 14 12:45:53 2008 From: danny at cs.huji.ac.il (Danny Braniss) Date: Mon Jul 14 12:46:00 2008 Subject: (no subject) In-Reply-To: Your message of Mon, 14 Jul 2008 14:37:01 +0200 . Message-ID: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Danny Braniss wrote: > > > the patches were for -STABLE, and I haven't seen them, but > > before the patches, try increasing the tag opening, ie > > camcontrol tags daX -N128 > > or via iscontrol (and yes it's not idiot proof, nor is is it > > developer proof :-) > > ok ;) Did that (camcontrol), with the following result: > > Operations performed: 6006 Read, 3994 Write, 12800 Other = 22800 Total > Read 93.844Mb Written 62.406Mb Total transferred 156.25Mb (1.4742Mb/sec) > 94.35 Requests/sec executed > > which is already a lot better but still below the IO of the local disk. > Should I try more right now or should I wait for more progress in that? > The numbers should be close to what you get via NFS :-( a) sysctl debug.iscsi_initiator should be <= 3 b) can you send me the command line to run sysbench? > Does it make sense to switch to -CURRENT for that? no, it's runing ok on -stable and have not tried it on -current yet. > > cu > > Adrian > danny From ktk at netlabs.org Mon Jul 14 12:50:19 2008 From: ktk at netlabs.org (Adrian Gschwend) Date: Mon Jul 14 12:50:25 2008 Subject: iSCSI performance In-Reply-To: References: Message-ID: <487B4C71.9040505@netlabs.org> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Danny Braniss wrote: > The numbers should be close to what you get via NFS :-( ok so we are quite far away :) > a) sysctl debug.iscsi_initiator should be <= 3 it is "1" > b) can you send me the command line to run sysbench? sure, took it from the sample from the sysbech documentation: To generate some files: $ sysbench --num-threads=16 --test=fileio --file-total-size=3G - --file-test-mode=rndrw prepare Once this is done to run the test: $ sysbench --num-threads=16 --test=fileio --file-total-size=3G - --file-test-mode=rndrw run And cleanup would be: $ sysbench --num-threads=16 --test=fileio --file-total-size=3G - --file-test-mode=rndrw cleanup cu Adrian -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIe0xxqpMUYrZbQBERAmXwAKCu2OV8AUnzKDx9IUfMO+zN9aaPgwCeP5Zn SuDmtybu5wj3YR3FKuCoyXo= =BW0j -----END PGP SIGNATURE----- From sbruno at miralink.com Mon Jul 14 16:21:41 2008 From: sbruno at miralink.com (Sean Bruno) Date: Mon Jul 14 16:21:47 2008 Subject: isp - error/scsi message In-Reply-To: <477336220.20080710172453@connection.ca> References: <1557532186.20080710145356@connection.ca> <48767C9B.3060804@miralink.com> <477336220.20080710172453@connection.ca> Message-ID: <487B7D14.8020505@miralink.com> Ross wrote: >>> -= >>> kernel: (da0:isp0:0:0:1): WRITE(10). CDB: 2a 0 1 10 eb bf 0 0 20 0 >>> kernel: (da0:isp0:0:0:1): CAM Status: SCSI Status Error >>> kernel: (da0:isp0:0:0:1): SCSI Status: Check Condition >>> kernel: (da0:isp0:0:0:1): UNIT ATTENTION asc:2a,6 >>> kernel: (da0:isp0:0:0:1): Reserved ASC/ASCQ pair >>> kernel: (da0:isp0:0:0:1): Retrying Command (per Sense Data) >>> -= >>> >>> A quick google of the ASC/ASCQ code gives the message "ASYMMETRIC >>> ACCESS STATE CHANGED", which I'm wondering has something to do with >>> the fact that the corresponding lun is accessible via multiple paths >>> (4 paths - 2x isp QHM2432 adapters). >>> >>> If anyone can help shed some light on this, I'd be grateful! >>> > > SB> What version of FreeBSD is this related to? > > Sorry, forgot that details - it's running Freebsd 7.0, with the > included isp driver on a custom kernel (ie: trimmed and with PAE/ULE) > > Biggest thing to note is that the isp firmware is 4.00.90 - which is > the builtin fw for the card (newer than the OS included one). And a > small correction: it's a QHM2462 card. > > > Is it possible that something in one of the PATH's is failing? Moreover, is the LUN failing due to this message, or is this just a message that you are seeing now and again? Sean -- Sean Bruno MiraLink Corporation 6015 NE 80th Ave, Ste 100 Portland, OR 97218 Phone 503-621-5143 Fax 503-621-5199 From westr at connection.ca Mon Jul 14 16:31:52 2008 From: westr at connection.ca (Ross) Date: Mon Jul 14 16:31:59 2008 Subject: isp - error/scsi message In-Reply-To: <487B7D14.8020505@miralink.com> References: <1557532186.20080710145356@connection.ca> <48767C9B.3060804@miralink.com> <477336220.20080710172453@connection.ca> <487B7D14.8020505@miralink.com> Message-ID: <1511139894.20080714123128@connection.ca> SB> Ross wrote: >>>> -= >>>> kernel: (da0:isp0:0:0:1): WRITE(10). CDB: 2a 0 1 10 eb bf 0 0 20 0 >>>> kernel: (da0:isp0:0:0:1): CAM Status: SCSI Status Error >>>> kernel: (da0:isp0:0:0:1): SCSI Status: Check Condition >>>> kernel: (da0:isp0:0:0:1): UNIT ATTENTION asc:2a,6 >>>> kernel: (da0:isp0:0:0:1): Reserved ASC/ASCQ pair >>>> kernel: (da0:isp0:0:0:1): Retrying Command (per Sense Data) >>>> -= SB> Is it possible that something in one of the PATH's is failing? Might be possible, but I don't think so - everything is heavily monitored (HP c7000 blade w/brocade switch into dual controller EVA). We're also using the gmultipath geom package to handle path failure, and it hasn't triggered at all. (it fails over nicely in testing at least). SB> Moreover, is the LUN failing due to this message, or is this just a SB> message that you are seeing now and again? It's just an occasional message and doesn't seem to cause any performance degradation - I'm wondering if it's the dual active/active controller on the EVA trying to force some load balancing or something. Basically I'm just trying to find out what the actual message means or in what circumstances it would be generated, so I can do some more hunting. Cheers, Ross. -- Ross From sureshpoornam at gmail.com Wed Jul 16 08:00:32 2008 From: sureshpoornam at gmail.com (Suresh M) Date: Wed Jul 16 08:00:39 2008 Subject: Need help Message-ID: <35d53dbf0807160033l6380a537o1e4051136e9ca438@mail.gmail.com> Hello, I have a Dell machine with FreeBSD 6.2 with Seagate SCSI disk. After a prolonged time, one of the partitions got 3% of fragmentation. Can anyone help; how can we check the fragmentation level of partitions ? Is there any utility for de-fragmenting it ? Thank you. From nick-freebsd-scsi at triantos.com Fri Jul 18 05:30:34 2008 From: nick-freebsd-scsi at triantos.com (Nick Triantos) Date: Fri Jul 18 05:30:40 2008 Subject: Errors on QLogic 2200 w/ FC SAN Message-ID: <666B9AF1-FDD9-4CAE-AB8B-874494DE587B@triantos.com> Hi all, I'm seeing a huge number of errors in /var/log/messages of the form: Jul 17 20:54:14 bsd kernel: (da2:isp0:0:0:2): SYNCHRONIZE CACHE. CDB: 35 40 0 0 0 0 0 0 0 0 Jul 17 20:54:14 bsd kernel: (da2:isp0:0:0:2): CAM Status: SCSI Status Error Jul 17 20:54:14 bsd kernel: (da2:isp0:0:0:2): SCSI Status: Check Condition Jul 17 20:54:14 bsd kernel: (da2:isp0:0:0:2): ILLEGAL REQUEST asc:20,0 Jul 17 20:54:14 bsd kernel: (da2:isp0:0:0:2): Invalid command operation code Jul 17 20:54:14 bsd kernel: (da2:isp0:0:0:2): Unretryable error This is on FreeBSD 7.0 with a slightly trimmed down kernel. I'm running both the 'isp' and 'ispfw' drivers. I've got a QLogic QLA2200 card with a StorCase (Kingston) S10K102 (12-disk SATA-to-FC) SAN device attached. The second number of the "SYNCHRONIZE CACHE" line ('40' in the example above) changes between 0, 20, 40, and 60. This occurs on all 5 disks currently installed in the StorCase device. I'm using the device in NRAID (non-RAID) mode and then using FreeBSD's ZFS. The device seems to be working very well, as far as I can tell the files are being written without error, but these messages are clogging up /var/log/messages to the point where I can't see if other stuff is going wrong. Is there any straightforward way for me to fix the problem, or at least suppress these errors? I would like to know if other major errors are occurring, but these just don't appear to be useful. Any guidance welcome. thanks in advance! regards, -Nick From scottl at samsco.org Fri Jul 18 05:42:37 2008 From: scottl at samsco.org (Scott Long) Date: Fri Jul 18 05:42:44 2008 Subject: Need help In-Reply-To: <35d53dbf0807160033l6380a537o1e4051136e9ca438@mail.gmail.com> References: <35d53dbf0807160033l6380a537o1e4051136e9ca438@mail.gmail.com> Message-ID: <48802D49.5080002@samsco.org> Suresh M wrote: > Hello, > > I have a Dell machine with FreeBSD 6.2 with Seagate SCSI disk. After a > prolonged time, one of the partitions got 3% of fragmentation. > > Can anyone help; > how can we check the fragmentation level of partitions ? Is there any > utility for de-fragmenting it ? > While any fragmentation is quite undesirable in MSDOS, it's mostly normal and expected in UFS. 3% fragmentation for a large volume is not unusual or particularly bad. Scott From pfgshield-freebsd at yahoo.com Fri Jul 18 19:11:22 2008 From: pfgshield-freebsd at yahoo.com (Pedro Giffuni) Date: Fri Jul 18 19:11:29 2008 Subject: CAM bugs found in DragonFly Message-ID: <37593.67811.qm@web32702.mail.mud.yahoo.com> (I sent some private mail about this but maybe it is of more general interest) Hi; Matt Dillon has been doing some robustness "don't try this at home" experiments with his new filesystem : basically unplugging the USB cord while making use of it. Our code has diverged a lot but surely some of his enhancements would improve FreeBSD too: http://leaf.dragonflybsd.org/mailarchive/commits/2008-07/msg00242.html ___________ dillon 2008/07/17 17:07:23 PDT DragonFly src repository Modified files: sys/bus/cam cam_periph.c cam_periph.h cam_sim.c cam_sim.h cam_xpt.c sys/bus/cam/scsi scsi_cd.c scsi_ch.c scsi_da.c scsi_sa.c scsi_target.c Log: Fix multiple bugs in CAM related devices which go away unexpectedly. This fixes numerous panics when pulling a USB mass media device in the midst of heavy I/O. * The SIM lock was being unlocked via the periph->sim path after periph was unheld. periph can become free and blow up the unlock, so get the sim into a local variable first, then release periph. * The code which waits for CCB completion needs to be a while loop, not an if. It worked anyway, but wasn't very robust. * Add CAM_SIM_DEREGISTERED to flag when a sim is undergoing deregistration. * Beef up cam_dead_sim so it works more like a real sim. * Properly install &cam_dead_sim in the device and periph structures related to a SCSI bus, when deregistering the bus. * Disallow the addition of new devices when deregistering a bus. * NULL out periph->softc when freeing it. Revision Changes Path 1.41 +13 -6 src/sys/bus/cam/cam_periph.c 1.12 +1 -1 src/sys/bus/cam/cam_periph.h 1.13 +18 -4 src/sys/bus/cam/cam_sim.c 1.9 +2 -0 src/sys/bus/cam/cam_sim.h 1.67 +96 -24 src/sys/bus/cam/cam_xpt.c 1.44 +5 -11 src/sys/bus/cam/scsi/scsi_cd.c 1.28 +4 -6 src/sys/bus/cam/scsi/scsi_ch.c 1.58 +4 -5 src/sys/bus/cam/scsi/scsi_da.c 1.36 +14 -18 src/sys/bus/cam/scsi/scsi_sa.c 1.20 +1 -1 src/sys/bus/cam/scsi/scsi_target.c Posta, news, sport, oroscopo: tutto in una sola pagina. Crea l'home page che piace a te! www.yahoo.it/latuapagina From sureshpoornam at gmail.com Fri Jul 18 22:01:44 2008 From: sureshpoornam at gmail.com (Suresh M) Date: Fri Jul 18 22:01:50 2008 Subject: DNS query failed/res_mkquery failed Message-ID: <35d53dbf0807181501p365adc0v4360c897223df0b4@mail.gmail.com> We have been using FreeBSD as server last 5 years without any problems at all. My formerly beautiful NIS system is now acting strangely. I'm getting lots of res_mkquery failures, and now ypserv will often refuse to start up, giving me the message: unable to register (YPPROG, YPOLDVERS, udp) man pages don't seem to be helpful on these errors (unless I'm missing something?). Jul 18 18:13:41 ypserv[470]: res_mkquery failed for 159607157543155842159299158288157898157829 1578301553671564461556201571651578461584561575851564611601731572791552241591261584611579151603671596 64158616160527161226157327159332161840160713160382161611 type 1 Jul 18 18:13:41 ypserv[470]: DNS query failed Jul 18 18:13:41 ypserv[470]: res_mkquery failed for 159607157543155842159299158288157898157829 1578301553671564461556201571651578461584561575851564611601731572791552241591261584611579151603671596 64158616160527161226157327159332161840160713160382161611 type 1 Jul 18 18:13:41 ypserv[470]: DNS query failed Jul 18 18:13:41 ypserv[470]: res_mkquery failed for 159607157543155842159299158288157898157829 1578301553671564461556201571651578461584561575851564611601731572791552241591261584611579151603671596 64158616160527161226157327159332161840160713160382161611 type 1 DNS query failed Mine is a FreeBSD 6.2 OS. Any ideas ? The machine got stuck frequently after getting these errors in a large volume. Any ideas ? From bugmaster at FreeBSD.org Mon Jul 21 11:07:02 2008 From: bugmaster at FreeBSD.org (FreeBSD bugmaster) Date: Mon Jul 21 11:08:44 2008 Subject: Current problem reports assigned to freebsd-scsi@FreeBSD.org Message-ID: <200807211107.m6LB727r032000@freefall.freebsd.org> Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/39388 scsi ncr/sym drivers fail with 53c810 and more than 256MB m o kern/40895 scsi wierd kernel / device driver bug o kern/52638 scsi [panic] SCSI U320 on SMP server won't run faster than s kern/57398 scsi [mly] Current fails to install on mly(4) based RAID di o kern/60598 scsi wire down of scsi devices conflicts with config o kern/60641 scsi [sym] Sporadic SCSI bus resets with 53C810 under load s kern/61165 scsi [panic] kernel page fault after calling cam_send_ccb o kern/74627 scsi [ahc] [hang] Adaptec 2940U2W Can't boot 5.3 o kern/90282 scsi [sym] SCSI bus resets cause loss of ch device o kern/92798 scsi [ahc] SCSI problem with timeouts o kern/94838 scsi Kernel panic while mounting SD card with lock switch o o kern/99954 scsi [ahc] reading from DVD failes on 6.x [regression] o kern/110847 scsi [ahd] Tyan U320 onboard problem with more than 3 disks o kern/120247 scsi [mpt] FreeBSD 6.3 and LSI Logic 1030 = only 3.300MB/s o kern/124667 scsi [amd] [panic] FreeBSD-7 kernel page faults at amd-scsi 15 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/35234 scsi World access to /dev/pass? (for scanner) requires acce o kern/38828 scsi [dpt] [request] DPT PM2012B/90 doesn't work o kern/44587 scsi dev/dpt/dpt.h is missing defines required for DPT_HAND o kern/76178 scsi [ahd] Problem with ahd and large SCSI Raid system o kern/114597 scsi [sym] System hangs at SCSI bus reset with dual HBAs o kern/119668 scsi [cam] [patch] certain errors are too verbose comparing o kern/120487 scsi [sg] scsi_sg incompatible with scanners o sparc/121676 scsi [iscsi] iscontrol do not connect iscsi-target on sparc o kern/123666 scsi [aac] aac(4) will not work with Adaptec SAS RAID 3805 o kern/123674 scsi [ahc] ahc driver dumping 10 problems total. From cowens at greatbaysoftware.com Fri Jul 25 14:33:35 2008 From: cowens at greatbaysoftware.com (Charles Owens) Date: Fri Jul 25 14:33:46 2008 Subject: LSI LSLSAS1068 not detected by mpt(4) Message-ID: <4889E1DA.2070504@greatbaysoftware.com> Good day, We're trying to get FreeBSD 7.0 to fly on an Intel SR2500ALLX server, but the RAID controller isn't being detected properly. As best I can tell from reading man pages it _should_ be being handled by mpt(4) -- but the system boots with no drives detected. Also, it is probably worth pointing out that the system has been working before this just fine with Linux. With pciconf I'm getting this: mfi0@pci0:4:14:0: class=0x010400 card=0x35018086 chip=0x04111000 rev=0x00 hdr=0x00 class = mass storage subclass = RAID I saw a commit message for mpt_pci.c from last Sept (rev 1.51 & mfc) that was a fix for a device ID conflict with mfi(4). Could this same sort of thing be happening here? What is the best way forward? Is a custom kernel with mfi(4) removed a possible workaround? Any assistance greatly appreciated! Thank you, Charles -- **Charles Owens** *Great Bay Software** **|** v: *603.766.6105 *|** m: *603.866.0860 *|** f: *603.430.0713 *|** e: *cowens@GreatBaySoftware.com**** From sbruno at miralink.com Fri Jul 25 14:44:37 2008 From: sbruno at miralink.com (Sean Bruno) Date: Fri Jul 25 14:44:43 2008 Subject: LSI LSLSAS1068 not detected by mpt(4) In-Reply-To: <4889E1DA.2070504@greatbaysoftware.com> References: <4889E1DA.2070504@greatbaysoftware.com> Message-ID: <4889E6D3.8000202@miralink.com> Charles Owens wrote: > Good day, > > We're trying to get FreeBSD 7.0 to fly on an Intel SR2500ALLX server, > but the RAID controller isn't being detected properly. As best I can > tell from reading man pages it _should_ be being handled by mpt(4) -- > but the system boots with no drives detected. Also, it is probably > worth pointing out that the system has been working before this just > fine with Linux. > > With pciconf I'm getting this: > > mfi0@pci0:4:14:0: class=0x010400 card=0x35018086 chip=0x04111000 > rev=0x00 hdr=0x00 > class = mass storage > subclass = RAID > > > I saw a commit message for mpt_pci.c from last Sept (rev 1.51 & mfc) > that was a fix for a device ID conflict with mfi(4). Could this same > sort of thing be happening here? > What is the best way forward? Is a custom kernel with mfi(4) removed > a possible workaround? Any assistance greatly appreciated! > > Thank you, > > Charles > > ------------------------------------------------------------------------ > > Can you post the boot output(or at least as much as possible)? > _______________________________________________ > freebsd-scsi@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-scsi > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" > -- Sean Bruno MiraLink Corporation 6015 NE 80th Ave, Ste 100 Portland, OR 97218 Cell 503-358-6832 Phone 503-621-5143 Fax 503-621-5199 MSN: sbruno@miralink.com Google: seanwbruno@gmail.com From cowens at greatbaysoftware.com Fri Jul 25 15:54:59 2008 From: cowens at greatbaysoftware.com (Charles Owens) Date: Fri Jul 25 15:55:05 2008 Subject: LSI LSLSAS1068 not detected by mpt(4) In-Reply-To: <4889E6D3.8000202@miralink.com> References: <4889E1DA.2070504@greatbaysoftware.com> <4889E6D3.8000202@miralink.com> Message-ID: <4889F7F9.9070203@greatbaysoftware.com> Sean Bruno wrote: > Charles Owens wrote: >> Good day, >> >> We're trying to get FreeBSD 7.0 to fly on an Intel SR2500ALLX server, >> but the RAID controller isn't being detected properly. As best I can >> tell from reading man pages it _should_ be being handled by mpt(4) -- >> but the system boots with no drives detected. Also, it is probably >> worth pointing out that the system has been working before this just >> fine with Linux. >> >> With pciconf I'm getting this: >> >> mfi0@pci0:4:14:0: class=0x010400 card=0x35018086 chip=0x04111000 >> rev=0x00 hdr=0x00 >> class = mass storage >> subclass = RAID >> >> >> I saw a commit message for mpt_pci.c from last Sept (rev 1.51 & mfc) >> that was a fix for a device ID conflict with mfi(4). Could this same >> sort of thing be happening here? >> What is the best way forward? Is a custom kernel with mfi(4) removed >> a possible workaround? Any assistance greatly appreciated! >> >> Thank you, >> >> Charles >> >> ------------------------------------------------------------------------ >> > Can you post the boot output(or at least as much as possible)? > Ahem (blushing)... should have looked at the boot output before. It looks like it is being meaningfully probed by the _mfi_ driver. My very detailed Intel tech spec document very clearly says the 1068 controller... but from the boot output it would seem that this detail isn't accurate: mfi0: mem 0xb8b00000-0xb8b0ffff,0xb8900000-0xb891ffff irq 18 at device 14.0 on pci4 mfi0: Megaraid SAS driver Ver 2.00 mfi0: 946 (270205097s/0x0020/0) - Shutdown command received from host mfi0: 947 (4278190080s/0x0020/0) - PCI 0x041000 0x04411 0x048086 0x043501: Firmware initialization started (PCI ID 0411/1000/3501/8086) mfi0: 948 (4278190080s/0x0020/0) - Type 18: Firmware version 1.03.00-0211 mfi0: 949 (4278190091s/0x0008/0) - Battery temperature is normal mfi0: 950 (4278190092s/0x0008/1) - Battery requires reconditioning; please initiate a LEARN cycle mfi0: 951 (4278190092s/0x0008/0) - Battery Present mfi0: 952 (4278190137s/0x0004/0) - PD 12(e1/s255) event: Enclosure (SES) discovered on PD 0c(e1/s255) mfi0: 953 (4278190137s/0x0002/0) - PD 12(e1/s255) event: Inserted: PD 0c(e1/s255) mfi0: 954 (4278190137s/0x0002/0) - Type 29: Inserted: PD 0c(e1/s255) Info: enclPd=0c, scsiType=d, portMap=00, sasAddr=5000403d5b21a000,0000000000000000 mfi0: 955 (4278190137s/0x0002/0) - PD 08(e1/s0) event: Inserted: PD 08(e1/s0) mfi0: 956 (4278190137s/0x0002/0) - Type 29: Inserted: PD 08(e1/s0) Info: enclPd=0c, scsiType=0, portMap=01, sasAddr=5000c50008479ea5,0000000000000000 mfi0: 957 (4278190137s/0x0002/0) - PD 09(e1/s1) event: Inserted: PD 09(e1/s1) mfi0: 958 (4278190137s/0x0002/0) - Type 29: Inserted: PD 09(e1/s1) Info: enclPd=0c, scsiType=0, portMap=02, sasAddr=5000c5000847aadd,0000000000000000 mfi0: 959 (4278190137s/0x0002/0) - PD 10(e1/s2) event: Inserted: PD 0a(e1/s2) mfi0: 960 (4278190137s/0x0002/0) - Type 29: Inserted: PD 0a(e1/s2) Info: enclPd=0c, scsiType=0, portMap=04, sasAddr=5000c5000847c79d,0000000000000000 mfi0: 961 (4278190137s/0x0002/0) - PD 11(e1/s3) event: Inserted: PD 0b(e1/s3) mfi0: 962 (4278190137s/0x0002/0) - Type 29: Inserted: PD 0b(e1/s3) Info: enclPd=0c, scsiType=0, portMap=08, sasAddr=5000c50008478481,0000000000000000 mfi0: 963 (4278190138s/0x0008/1) - BBU disabled; changing WB virtual disks to WT mfi0: 964 (270290931s/0x0020/0) - Adapter ticks 270290931 elapsed 58s: Time established as 07/25/08 8:48:51; (58 seconds since power on) mfi0: [ITHREAD] ... mfid0: on mfi0 mfid0: 137328MB (281247744 sectors) RAID volume '' is optimal So... looks like there may be no issue... except the not-following-my-nose variety. Thanks, Charles **Charles Owens** *Great Bay Software** **|** v: *603.766.6105 *|** m: *603.866.0860 *|** f: *603.430.0713 *|** e: *cowens@GreatBaySoftware.com**** From cowens at greatbaysoftware.com Fri Jul 25 20:12:30 2008 From: cowens at greatbaysoftware.com (Charles Owens) Date: Fri Jul 25 20:12:36 2008 Subject: mfi_linux.ko and PAE kernels Message-ID: <488A3455.2070505@greatbaysoftware.com> Hello all, The man pages are pretty clear about not using kernel modules with PAE kernels.... I'm now trying to get mfi_linux to work with PAE but am not clear how to compile it statically in to the kernel (or even if I really should). I tried both "options MFI_LINUX" and "device mfi_linux" ... just guess work... and not surprisingly config(8) doesn't like either. So what's the secret? Am I on the right track? Or is loading it as module okay? (but if so, why not other modules?) Thanks much, Charles -- **Charles Owens** *Great Bay Software** **|** v: *603.766.6105 *|** m: *603.866.0860 *|** f: *603.430.0713 *|** e: *cowens@GreatBaySoftware.com**** From bugmaster at FreeBSD.org Mon Jul 28 11:07:04 2008 From: bugmaster at FreeBSD.org (FreeBSD bugmaster) Date: Mon Jul 28 11:08:44 2008 Subject: Current problem reports assigned to freebsd-scsi@FreeBSD.org Message-ID: <200807281107.m6SB73F6079037@freefall.freebsd.org> Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/39388 scsi ncr/sym drivers fail with 53c810 and more than 256MB m o kern/40895 scsi wierd kernel / device driver bug o kern/52638 scsi [panic] SCSI U320 on SMP server won't run faster than s kern/57398 scsi [mly] Current fails to install on mly(4) based RAID di o kern/60598 scsi wire down of scsi devices conflicts with config o kern/60641 scsi [sym] Sporadic SCSI bus resets with 53C810 under load s kern/61165 scsi [panic] kernel page fault after calling cam_send_ccb o kern/74627 scsi [ahc] [hang] Adaptec 2940U2W Can't boot 5.3 o kern/90282 scsi [sym] SCSI bus resets cause loss of ch device o kern/92798 scsi [ahc] SCSI problem with timeouts o kern/94838 scsi Kernel panic while mounting SD card with lock switch o o kern/99954 scsi [ahc] reading from DVD failes on 6.x [regression] o kern/110847 scsi [ahd] Tyan U320 onboard problem with more than 3 disks o kern/120247 scsi [mpt] FreeBSD 6.3 and LSI Logic 1030 = only 3.300MB/s o kern/124667 scsi [amd] [panic] FreeBSD-7 kernel page faults at amd-scsi 15 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/35234 scsi World access to /dev/pass? (for scanner) requires acce o kern/38828 scsi [dpt] [request] DPT PM2012B/90 doesn't work o kern/44587 scsi dev/dpt/dpt.h is missing defines required for DPT_HAND o kern/76178 scsi [ahd] Problem with ahd and large SCSI Raid system o kern/114597 scsi [sym] System hangs at SCSI bus reset with dual HBAs o kern/119668 scsi [cam] [patch] certain errors are too verbose comparing o kern/120487 scsi [sg] scsi_sg incompatible with scanners o sparc/121676 scsi [iscsi] iscontrol do not connect iscsi-target on sparc o kern/123666 scsi [aac] attach fails with Adaptec SAS RAID 3805 controll o kern/123674 scsi [ahc] ahc driver dumping 10 problems total.