8.1 amd64 lockup (maybe zfs or disk related)

Greg Bonett greg at bonett.org
Mon Feb 7 07:50:43 UTC 2011


Thanks for the response.
I have no tunings in /boot/loader.conf
according to http://wiki.freebsd.org/ZFSTuningGuide for amd64
"FreeBSD 7.2+ has improved kernel memory allocation strategy and no
tuning may be necessary on systems with more than 2 GB of RAM. "
I have 8GB of ram.
do you think this is wrong?
  
Handbook recommends these (but says their test system has 1gb ram):
vm.kmem_size="330M"
vm.kmem_size_max="330M"
vfs.zfs.arc_max="40M"
vfs.zfs.vdev.cache.size="5M"

what do you recommend?

I think the ad0: FAILURE - READ_DMA4 errors may be from a bad sata cable
(or rather, a 12in sata cable connecting a drive that is one inch away)
I'm ordering a new drive bay to improve this, but should a bad cable
cause lockups?  

Thanks for your help.

Here's my smartctl output:

#smartctl -a /dev/ad0 
smartctl 5.40 2010-10-16 r3189 [FreeBSD 8.1-RELEASE amd64] (local build)
Copyright (C) 2002-10 by Bruce Allen,
http://smartmontools.sourceforge.net

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Caviar Green (Adv. Format) family
Device Model:     WDC WD10EARS-00Y5B1
Serial Number:    WD-WCAV55616522
Firmware Version: 80.00A80
User Capacity:    1,000,204,886,016 bytes
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   8
ATA Standard is:  Exact ATA specification draft version not indicated
Local Time is:    Sun Feb  6 23:42:17 2011 PST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x84) Offline data collection activity
                                        was suspended by an interrupting
command from host.
                                        Auto Offline Data Collection:
Enabled.
Self-test execution status:      (   0) The previous self-test routine
completed
                                        without error or no self-test
has ever 
                                        been run.
Total time to complete Offline 
data collection:                 (20460) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection
on/off support.
                                        Suspend Offline collection upon
new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.

Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging
supported.
Short self-test routine 
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        ( 236) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.
SCT capabilities:              (0x3031) SCT Status supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE
UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always
-       0
  3 Spin_Up_Time            0x0027   121   121   021    Pre-fail  Always
-       6933
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always
-       30
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always
-       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always
-       0
  9 Power_On_Hours          0x0032   097   097   000    Old_age   Always
-       2664
 10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always
-       0
 11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always
-       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always
-       28
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always
-       27
193 Load_Cycle_Count        0x0032   135   135   000    Old_age   Always
-       196151
194 Temperature_Celsius     0x0022   125   114   000    Old_age   Always
-       22
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always
-       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always
-       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age
Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always
-       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age
Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining
LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      1536
-

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute
delay.


On Sun, 2011-02-06 at 20:55 -0800, Jeremy Chadwick wrote:
> On Sun, Feb 06, 2011 at 01:01:14PM -0800, Greg Bonett wrote:
> > Hi all,
> > I am experiencing hard lockup when running 8.1-RELEASE amd64.  The last
> > two times it has happened I was running a zpool scrub (high cpu and io
> > load).  /var/log/messages has some errors looking like:
> > kernel: ad0: FAILURE - READ_DMA4
> > 
> > but these didn't seem to correspond to the exact time of the lockup.  
> > 
> > any suggestions?
> 
> Given that you're running 8.1-RELEASE, what sort of ZFS tunings are you
> using in /boot/loader.conf?  Tuning is required on this version.
> 
> The ad0 READ_DMA48 errors could indicate you have a hard disk with bad
> blocks or is going bad in a different manner.  Please install
> ports/sysutils/smartmontools and provide output of "smartctl -a
> /dev/ad0" here and I can help you determine that.
> 




More information about the freebsd-stable mailing list