Very low disk performance Highpoint 1820a

Steven Hartland killing at multiplay.co.uk
Thu Apr 28 16:00:42 PDT 2005


Scott I've sent this to you as from reading around you did the
original driver conversion and as such may have an idea
on the areas I could look at hope you dont mind.

Ok some real strange going on write performance is ~ 140MB/s:
gstat:
dT: 0.505  flag_I 500000us  sizeof 240  i -1
 L(q)  ops/s    r/s   kBps   ms/r    w/s   kBps   ms/w   %busy Name
    0   1100      4     63   13.2   1096 140313    1.2   57.8| da0
    0   1100      4     63   13.3   1096 140313    1.3   59.3| da0s1

where as read is ~42MB/s
gstat:
dT: 0.505  flag_I 500000us  sizeof 240  i -1
 L(q)  ops/s    r/s   kBps   ms/r    w/s   kBps   ms/w   %busy Name
    1    335    335  42836    2.8      0      0    0.0   93.3| da0
    1    335    335  42836    2.8      0      0    0.0   93.6| da0s1

Some updated figures:
5.4-STABLE Highpoint 1820a RAID 5 ( 5 disk )
Write:
dd if=/dev/zero of=./test.0 bs=64k count=50000
50000+0 records in
50000+0 records out
3276800000 bytes transferred in 25.088439 secs (130609959 bytes/sec)

Read:
dd if=./test.0 of=/dev/null bs=64k count=50000        
50000+0 records in
50000+0 records out
3276800000 bytes transferred in 69.765394 secs (46968845 bytes/sec)

vmstat while doing the above dd:
Read:
vmstat -w 1
 procs      memory      page                    disks     faults      cpu
 r b w     avm    fre  flt  re  pi  po  fr  sr da0 pa0   in   sy  cs us sy id
 0 1 0   56560 1840332    6   2   0   0 872 539   0   0 1625 1859 3468  1  3 96
 0 1 0   56560 1797548    3   0   0   0   3   0 331   0 1949 1449 7071  0  7 93
 0 1 0   56560 1751308    0   0   0   0   0   0 359   0 2071 1581 7600  0  7 93
 0 1 0   56560 1707516    0   0   0   0   0   0 338   0 1974 1488 7219  0  8 92
 0 1 0   56560 1663084    0   0   0   0   0   0 343   0 2003 1509 7300  0 10 90
....

Write:
vmstat -w 1
 procs      memory      page                    disks     faults      cpu
 r b w     avm    fre  flt  re  pi  po  fr  sr da0 pa0   in   sy  cs us sy id
 0 0 1   56560 1912484    6   1   0   0 804 495 1246   0 1627 1864 3454  1  3 96
 0 0 1   56560 1779912    3   0   0   0   3   0 1015   0 3606 4272 18207  0 94  6
 0 0 1   56560 1634632    0   0   0   0   0   0 1123   0 3939 4657 17973  0 51 49
 0 0 1   56560 1507016    0   0   0   0   0   0 996   0 3522 4104 15487  0 46 54
 0 0 1   56560 1367688    0   0   0   0   0   0 1075   0 3748 4469 17131  0 45 55
...

iostat while doing the above dd:
Read:
      tty             da0            pass0             cpu
 tin tout  KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
   0   61 127.66 328 40.94   0.00   0  0.00   0  0  7  1 92
   0   61 127.39 365 45.43   0.00   0  0.00   0  0  6  1 92
   0   61 127.13 383 47.56   0.00   0  0.00   0  0  8  1 91
...

Write:
      tty             da0            pass0             cpu
 tin tout  KB/t tps  MB/s   KB/t tps  MB/s  us ni sy in id
   0   62 126.26 1031 127.18   0.00   0  0.00   0  0 34 13 53
   0   63 127.67 1004 125.19   0.00   0  0.00   0  0 35 12 53
   0   63 127.57 1028 128.05   0.00   0  0.00   0  0 38 12 51
   0   63 127.57 1025 127.63   0.00   0  0.00   0  0 34 11 55

System Summary:
Dual AMD 244, 2GB ram, 5 * Seagate SATA 400GB on a
Highpoint 1820a 64Bit PCI-X @ 133Mhz RAID 5 array.

Relavent dmesg:
FreeBSD 5.4-STABLE #0: Wed Apr 27 08:10:14 UTC 2005
    root at test:/usr/src/sys/i386/compile/SMP_200HZ
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Opteron(tm) Processor 244 (1794.41-MHz 686-class CPU)
  Origin = "AuthenticAMD"  Id = 0xf5a  Stepping = 10
  Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
  AMD Features=0xe0500000<NX,AMIE,LM,DSP,3DNow!>
real memory  = 2146893824 (2047 MB)
avail memory = 2099625984 (2002 MB)
ACPI APIC Table: <PTLTD          APIC  >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
hptmv0: <RocketRAID 182x SATA Controller> mem 0xf8200000-0xf827ffff irq 25 at device 1.0 on pci9
RocketRAID 182x SATA Controller driver Version 1.1
RR182x [0,0]: channel started successfully
RR182x [0,1]: channel started successfully
RR182x [0,2]: channel started successfully
RR182x [0,3]: channel started successfully
RR182x [0,4]: channel started successfully
RR182x: RAID5 write-back enabled
Timecounters tick every 5.000 msec
da0 at hptmv0 bus 0 target 0 lun 0
da0: <RR182x RAID 5 Array 3.00> Fixed Direct Access SCSI-0 device 
da0: 1526216MB (3125690368 512 byte sectors: 255H 63S/T 194565C)

    Steve


================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. 

In the event of misdirection, illegible or incomplete transmission please telephone (023) 8024 3137
or return the E.mail to postmaster at multiplay.co.uk.



More information about the freebsd-performance mailing list