From ian at bulinfo.net  Mon May 19 16:12:42 2008
From: ian at bulinfo.net (Yani Brankov)
Date: Mon May 19 16:33:20 2008
Subject: Low/Jerky performance in FreeBSD 7
Message-ID: <4831A0A5.6040808@bulinfo.net>

Hey guys,

I recently updated to FreeBSD 7 and noticed that my box started to 
perform as windows does under heavier loads. The mouse starts to be 
jerky when compiling, window updates/redraws are slow and bump the CPU 
usage up to 100%. I attributed this to the mga driver which comes with 
the distro in the beginning. However, I later noticed the same happens 
even when X has not been started. For instance, I start a kernel compile 
and the console mouse becomes jumpy. All these have never happened 
before with FreeBSD on this box. It has enough memory (1.5G) and 
relatively fast CPU (2.5GHz). I started to think this may be originating 
from kernel level (irq handling, long times in giant locked code during 
syscalls, etc).

I am wondering whether it is only me who has hit this problem or it is 
more common. It may be also related to hardware configuration, etc. I'm 
trying to figure out.

Attaching my dmesg output in case it's important.

Yani
-------------- next part --------------
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.0-RELEASE #0: Sun Feb 24 19:59:52 UTC 2008
    root@logan.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) 4 CPU 2.53GHz (2539.10-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf27  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x400<CNXT-ID>
real memory  = 1610547200 (1535 MB)
avail memory = 1564446720 (1491 MB)
ACPI APIC Table: <IntelR AWRDACPI>
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.20.3 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
hptrr: HPT RocketRAID controller driver v1.1 (Feb 24 2008 19:59:27)
acpi0: <IntelR AWRDACPI> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 5fef0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
cpu0: <ACPI CPU> on acpi0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <Intel 82845G host to AGP bridge> on hostb0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem 0xe4000000-0xe5ffffff,0xe6000000-0xe6003fff,0xe7000000-0xe77fffff irq 16 at device 0.0 on pci1
uhci0: <Intel 82801DB (ICH4) USB controller USB-A> port 0xd800-0xd81f irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
uhci0: [ITHREAD]
usb0: <Intel 82801DB (ICH4) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801DB (ICH4) USB controller USB-B> port 0xd000-0xd01f irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
uhci1: [ITHREAD]
usb1: <Intel 82801DB (ICH4) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801DB (ICH4) USB controller USB-C> port 0xd400-0xd41f irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
uhci2: [ITHREAD]
usb2: <Intel 82801DB (ICH4) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: <Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2
uhub2: 2 ports with 2 removable, self powered
ehci0: <Intel 82801DB/L/M (ICH4) USB 2.0 controller> mem 0xe9100000-0xe91003ff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb3: EHCI version 1.0
usb3: companion controllers, 2 ports each: usb0 usb1 usb2
usb3: <Intel 82801DB/L/M (ICH4) USB 2.0 controller> on ehci0
usb3: USB revision 2.0
uhub3: <Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb3
uhub3: 6 ports with 6 removable, self powered
uhub4: <vendor 0x0424 product 0x2502, class 9/0, rev 2.00/0.01, addr 2> on uhub3
uhub4: single transaction translator
uhub4: 2 ports with 1 removable, self powered
uhub5: <vendor 0x0424 product 0x2602, class 9/0, rev 2.00/0.00, addr 3> on uhub4
uhub5: multiple transaction translators
uhub5: 4 ports with 3 removable, self powered
umass0: <Generic Flash Card Reader, class 0/0, rev 2.00/4.44, addr 4> on uhub5
umass1: <Sony DRX-830UL, class 0/0, rev 2.00/4.72, addr 5> on uhub3
pcib2: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci2: <ACPI PCI bus> on pcib2
rl0: <RealTek 8139 10/100BaseTX> port 0xc000-0xc0ff mem 0xe9000000-0xe90000ff irq 18 at device 6.0 on pci2
miibus0: <MII bus> on rl0
rlphy0: <RealTek internal media interface> PHY 0 on miibus0
rlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
rl0: Ethernet address: 00:30:1b:ac:d2:33
rl0: [ITHREAD]
fwohci0: <VIA Fire II (VT6306)> port 0xc400-0xc47f mem 0xe9001000-0xe90017ff irq 19 at device 7.0 on pci2
fwohci0: [FILTER]
fwohci0: OHCI version 1.0 (ROM=1)
fwohci0: No. of Isochronous channels is 8.
fwohci0: EUI64 00:30:1b:ac:00:00:d2:97
fwohci0: Phy 1394a available S400, 3 ports.
fwohci0: Link S400, max_rec 2048 bytes.
firewire0: <IEEE1394(FireWire) bus> on fwohci0
fwe0: <Ethernet over FireWire> on firewire0
if_fwe0: Fake Ethernet address: 02:30:1b:00:d2:97
fwe0: Ethernet address: 02:30:1b:00:d2:97
fwip0: <IP over FireWire> on firewire0
fwip0: Firewire address: 00:30:1b:ac:00:00:d2:97 @ 0xfffe00000000, S400, maxrec 2048
sbp0: <SBP-2/SCSI over FireWire> on firewire0
dcons_crom0: <dcons configuration ROM> on firewire0
dcons_crom0: bus_addr 0x14b4000
fwohci0: Initiate bus reset
fwohci0: BUS reset
fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH4 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf000-0xf00f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
pcm0: <Intel ICH4 (82801DB)> port 0xe000-0xe0ff,0xe400-0xe43f mem 0xe9101000-0xe91011ff,0xe9102000-0xe91020ff irq 17 at device 31.5 on pci0
pcm0: [ITHREAD]
pcm0: <Avance Logic ALC650 AC97 Codec>
acpi_tz0: <Thermal Zone> on acpi0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0
sio1: type 16550A
sio1: [FILTER]
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: [ITHREAD]
psm0: model IntelliMouse Explorer, device ID 4
pmtimer0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc8fff,0xcc000-0xd3fff pnpid ORM0000 on isa0
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
ppbus0: [ITHREAD]
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 2539103340 Hz quality 800
Timecounters tick every 1.000 msec
hptrr: no controller detected.
firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me)
firewire0: bus manager 0 (me)
ad0: 476940MB <Seagate ST3500641A 3.AAJ> at ata0-master UDMA100
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
cd0 at umass-sim1 bus 1 target 0 lun 0
cd0: <SONY DVD RW DRU-840A SS01> Removable CD-ROM SCSI-0 device 
cd0: 40.000MB/s transfers
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
(da0:umass-sim0:0:0:0): got CAM status 0x4
(da0:umass-sim0:0:0:0): fatal error, failed to attach to device
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
da1 at umass-sim0 bus 0 target 0 lun 1
da1: <Generic Flash HS-COMBO 4.44> Removable Direct Access SCSI-0 device 
da1: 40.000MB/s transfers
da1: Attempt to query device size failed: NOT READY, Medium not present
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
umass0: BBB reset failed, IOERROR
Trying to mount root from ufs:/dev/ad0s1a
rl0: link state changed to UP
From wojtek at wojtek.tensor.gdynia.pl  Mon May 19 20:52:57 2008
From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar)
Date: Mon May 19 20:56:41 2008
Subject: Low/Jerky performance in FreeBSD 7
In-Reply-To: <4831A0A5.6040808@bulinfo.net>
References: <4831A0A5.6040808@bulinfo.net>
Message-ID: <20080519225105.C7752@wojtek.tensor.gdynia.pl>

> windows does under heavier loads. The mouse starts to be jerky when 
> compiling, window updates/redraws are slow and bump the CPU usage up to 100%.

it is especially like that when you have heavy disk I/O, with lots of 
writes.

> beginning. However, I later noticed the same happens even when X has not been 
> started. For instance, I start a kernel compile and the console mouse becomes 
> jumpy. All these have never happened before with FreeBSD on this box. It has 
> enough memory (1.5G) and relatively fast CPU (2.5GHz). I started to think

that's why i keep 6.3 everywhere.
From jhary at unsane.co.uk  Mon May 19 21:45:46 2008
From: jhary at unsane.co.uk (Vince Hoffman)
Date: Mon May 19 22:16:25 2008
Subject: Low/Jerky performance in FreeBSD 7
In-Reply-To: <4831A0A5.6040808@bulinfo.net>
References: <4831A0A5.6040808@bulinfo.net>
Message-ID: <4831F4F9.2000302@unsane.co.uk>


Yani Brankov wrote:
> Hey guys,
Hi
> 
> I recently updated to FreeBSD 7 and noticed that my box started to 
> perform as windows does under heavier loads. The mouse starts to be 
> jerky when compiling, window updates/redraws are slow and bump the CPU 
> usage up to 100%. I attributed this to the mga driver which comes with 
> the distro in the beginning. However, I later noticed the same happens 
> even when X has not been started. For instance, I start a kernel compile 
> and the console mouse becomes jumpy. All these have never happened 
> before with FreeBSD on this box. It has enough memory (1.5G) and 
> relatively fast CPU (2.5GHz). I started to think this may be originating 
> from kernel level (irq handling, long times in giant locked code during 
> syscalls, etc).
> 
> I am wondering whether it is only me who has hit this problem or it is 
> more common. It may be also related to hardware configuration, etc. I'm 
> trying to figure out.
> 
Not just you, 
http://wiki.freebsd.org/JeremyChadwick/Commonly_reported_issues

Vince


> Attaching my dmesg output in case it's important.
> 
> Yani
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> freebsd-questions@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-questions
> To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"

From Alexander at Leidinger.net  Tue May 20 09:16:34 2008
From: Alexander at Leidinger.net (Alexander Leidinger)
Date: Tue May 20 09:16:50 2008
Subject: Low/Jerky performance in FreeBSD 7
In-Reply-To: <4831F4F9.2000302@unsane.co.uk>
References: <4831A0A5.6040808@bulinfo.net> <4831F4F9.2000302@unsane.co.uk>
Message-ID: <20080520105715.18366zzylwkcqzgg@webmail.leidinger.net>

Quoting Vince Hoffman <jhary@unsane.co.uk> (from Mon, 19 May 2008  
22:45:29 +0100):

>
> Yani Brankov wrote:
>> Hey guys,
> Hi
>>
>> I recently updated to FreeBSD 7 and noticed that my box started to  
>> perform as windows does under heavier loads. The mouse starts to be

Which scheduler? ULE or BSD? Try the other one you use currently.

Bye,
Alexander.

-- 
Gleemites, n.:
	Petrified deposits of toothpaste found in sinks.
		-- Rich Hall & Friends, "Sniglets"

http://www.Leidinger.net    Alexander @ Leidinger.net: PGP ID = B0063FE7
http://www.FreeBSD.org       netchild @ FreeBSD.org  : PGP ID = 72077137
From wojtek at wojtek.tensor.gdynia.pl  Tue May 20 13:35:45 2008
From: wojtek at wojtek.tensor.gdynia.pl (Wojciech Puchar)
Date: Tue May 20 13:37:19 2008
Subject: Low/Jerky performance in FreeBSD 7
In-Reply-To: <20080520105715.18366zzylwkcqzgg@webmail.leidinger.net>
References: <4831A0A5.6040808@bulinfo.net> <4831F4F9.2000302@unsane.co.uk>
	<20080520105715.18366zzylwkcqzgg@webmail.leidinger.net>
Message-ID: <20080520153457.V16901@wojtek.tensor.gdynia.pl>

>>> I recently updated to FreeBSD 7 and noticed that my box started to perform 
>>> as windows does under heavier loads. The mouse starts to be
>
> Which scheduler? ULE or BSD? Try the other one you use currently.
with any it's slower than 6.3.


From t.pajor at kei.pl  Wed May 21 13:28:15 2008
From: t.pajor at kei.pl (t.pajor@kei.pl)
Date: Wed May 21 13:37:15 2008
Subject: mysql performance on freebsd 7
Message-ID: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>

Hello,

I'm using mysql 5.1.24-rc in 5 separate jails.

Question:

10 clients are pushing queries (10 separate machines). 2 clients to 1 mysql daemon. One client is performing an update on param_stat_short_level_1_0, second on param_stat_short_level_1_1.

Each client needs to push 150000 queries (client is spawning 15 forks to push the 150000, so each fork is pushing 10000, each fork is opening it's own mysql connection).

query to push:

INSERT INTO param_stat_short_level_1_0 SET param = '10311', object = '10311', value = '4283' ON DUPLICATE KEY UPDATE param = '10311', object = '10311', value = '4283', min = IF(4283<min,4283,min), max = IF(4283>max,4283,max), counter = counter+1;

Always a different param, and object values, value is rand(1,10000).

Stats for the operations are in http://p1.kei.pl/stats.
Stats are collected after each clients pushes 150000, 100 times.

My point here is that MySQL on Linux (p5) performs 150000 queries in an average of 18.1099, when the same queries on FreeBSD (p1) takes 28.7643.

Did I misconfigured something or this are the proper result and FreeBSD just could not give more?

My configs below, thanks for Your time.

http://p1.kei.pl/TLD
http://p1.kei.pl/dmesg
http://p1.kei.pl/boot_loader_conf
http://p1.kei.pl/sysctl_conf
http://p1.kei.pl/my_cnf
http://p1.kei.pl/stats



From phoemix at harmless.hu  Wed May 21 14:10:29 2008
From: phoemix at harmless.hu (CZUCZY Gergely)
Date: Wed May 21 14:10:59 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
Message-ID: <20080521155508.6ccfcfb5@twoflower.in.publishing.hu>

May I ask whether you are using innodb or myisam? both on freebsd and Linux.
And what filesystem are you using for mysql's data files? UFS, ZFS or anything
else?

IIRC there's some hack to reduce gettimeofday()'s precision in advance to
enhance it's performance, that could also help a bit. Have you built your mysql
with linking it against libthr?

On Wed, 21 May 2008 15:01:32 +0200
<t.pajor@kei.pl> wrote:

> Hello,
> 
> I'm using mysql 5.1.24-rc in 5 separate jails.
> 
> Question:
> 
> 10 clients are pushing queries (10 separate machines). 2 clients to 1 mysql
> daemon. One client is performing an update on param_stat_short_level_1_0,
> second on param_stat_short_level_1_1.
> 
> Each client needs to push 150000 queries (client is spawning 15 forks to push
> the 150000, so each fork is pushing 10000, each fork is opening it's own
> mysql connection).
> 
> query to push:
> 
> INSERT INTO param_stat_short_level_1_0 SET param = '10311', object = '10311',
> value = '4283' ON DUPLICATE KEY UPDATE param = '10311', object = '10311',
> value = '4283', min = IF(4283<min,4283,min), max = IF(4283>max,4283,max),
> counter = counter+1;
> 
> Always a different param, and object values, value is rand(1,10000).
> 
> Stats for the operations are in http://p1.kei.pl/stats.
> Stats are collected after each clients pushes 150000, 100 times.
> 
> My point here is that MySQL on Linux (p5) performs 150000 queries in an
> average of 18.1099, when the same queries on FreeBSD (p1) takes 28.7643.
> 
> Did I misconfigured something or this are the proper result and FreeBSD just
> could not give more?
> 
> My configs below, thanks for Your time.
> 
> http://p1.kei.pl/TLD
> http://p1.kei.pl/dmesg
> http://p1.kei.pl/boot_loader_conf
> http://p1.kei.pl/sysctl_conf
> http://p1.kei.pl/my_cnf
> http://p1.kei.pl/stats
> 
> 
> 
> _______________________________________________
> freebsd-performance@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"


-- 
?dv?lettel,

Czuczy Gergely
Harmless Digital Bt
mailto: gergely.czuczy@harmless.hu
Tel: +36-30-9702963
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 187 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-performance/attachments/20080521/8b11b9ee/signature.pgp
From _pppp at mail.ru  Wed May 21 14:22:15 2008
From: _pppp at mail.ru (Dmitriy)
Date: Wed May 21 14:22:19 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
Message-ID: <E1Jyoyg-000BBM-00._pppp-mail-ru@f191.mail.ru>

> I'm using mysql 5.1.24-rc in 5 separate jails.
> 
> Question:
> 
> 10 clients are pushing queries (10 separate machines). 2 clients to 1 mysql daemon. One client is performing an update on param_stat_short_level_1_0, second on param_stat_short_level_1_1.
> 
> Each client needs to push 150000 queries (client is spawning 15 forks to push the 150000, so each fork is pushing 10000, each fork is opening it's own mysql connection).
> 
> query to push:
> 
> INSERT INTO param_stat_short_level_1_0 SET param = '10311', object = '10311', value = '4283' ON DUPLICATE KEY UPDATE param = '10311', object = '10311', value = '4283', min = IF(4283<min,4283,min), max = IF(4283>max,4283,max), counter = counter+1;
> 
> Always a different param, and object values, value is rand(1,10000).
> 
> Stats for the operations are in http://p1.kei.pl/stats.
> Stats are collected after each clients pushes 150000, 100 times.
> 
> My point here is that MySQL on Linux (p5) performs 150000 queries in an average of 18.1099, when the same queries on FreeBSD (p1) takes 28.7643.
> 
> Did I misconfigured something or this are the proper result and FreeBSD just could not give more?

It would be very helpful if you provided I/O usage as well. I guess the FreeBSD box appears to be I/O-bound. Re-run your benchmarks with noatime mount option on the partition which holds database files (or even make that partition async as some Linux filesystems do).

I think Linux outperforms FreeBSD that much in the test because of it's variable sized disk buffer cache (vs FreeBSD's fixed sized one). You can figure out how much data has to be actually written to disk and set vfs.hibufspace, vfs.lobufspace and vfs.maxbufspace sysctls in the /boot/loader.conf appropriately. Other vfs.* sysctls can also be helpful.

Regards, Dmitriy.

> My configs below, thanks for Your time.
> 
> http://p1.kei.pl/TLD
> http://p1.kei.pl/dmesg
> http://p1.kei.pl/boot_loader_conf
> http://p1.kei.pl/sysctl_conf
> http://p1.kei.pl/my_cnf
> http://p1.kei.pl/stats

From t.pajor at kei.pl  Wed May 21 14:45:10 2008
From: t.pajor at kei.pl (t.pajor@kei.pl)
Date: Wed May 21 15:27:11 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <20080521155508.6ccfcfb5@twoflower.in.publishing.hu>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
	<20080521155508.6ccfcfb5@twoflower.in.publishing.hu>
Message-ID: <3abeb97e28be5b2107ea97e65ae88762.t.pajor@kei.pl>

> May I ask whether you are using innodb or myisam? both on freebsd and Linux.
> And what filesystem are you using for mysql's data files? UFS, ZFS or anything
> else?

MySQL engine used is MEMORY, filesystem is ufs, but it's not relevant.
 
> IIRC there's some hack to reduce gettimeofday()'s precision in advance to
> enhance it's performance, that could also help a bit.

What do You mean?

> Have you built your mysql with linking it against libthr?

It's a standard build from ports-current.

Stats are at http://p1.kei.pl/mon/



From gergely.czuczy at harmless.hu  Wed May 21 16:25:35 2008
From: gergely.czuczy at harmless.hu (CZUCZY Gergely)
Date: Wed May 21 16:25:41 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <3abeb97e28be5b2107ea97e65ae88762.t.pajor@kei.pl>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
	<20080521155508.6ccfcfb5@twoflower.in.publishing.hu>
	<3abeb97e28be5b2107ea97e65ae88762.t.pajor@kei.pl>
Message-ID: <20080521182530.23c8f787@mort.in.publishing.hu>

On Wed, 21 May 2008 16:45:07 +0200
<t.pajor@kei.pl> wrote:

> > May I ask whether you are using innodb or myisam? both on freebsd
> > and Linux. And what filesystem are you using for mysql's data
> > files? UFS, ZFS or anything else?
> 
> MySQL engine used is MEMORY, filesystem is ufs, but it's not relevant.
sure it is relevant. check my results:
http://phoemix.harmless.hu/dbtests/

 
> > IIRC there's some hack to reduce gettimeofday()'s precision in
> > advance to enhance it's performance, that could also help a bit.
> 
> What do You mean?
I mean what I've told you, no more, no less.
google://freebsd+gettimeofday+mysql+tuning

> > Have you built your mysql with linking it against libthr?
> 
> It's a standard build from ports-current.
Standard build from ports"-current" pops up a dialog called "OPTIONS",
where you can set these options. How have you set them?

> 
> Stats are at http://p1.kei.pl/mon/
> 
> 
> 
> _______________________________________________
> freebsd-performance@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to
> "freebsd-performance-unsubscribe@freebsd.org"


-- 

Sincerely,

Gergely CZUCZY,
Harmless Digital
mailto: gergely.czuczy@harmless.hu

Legacy software is software that works.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 187 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-performance/attachments/20080521/bff4f7ff/signature.pgp
From nikon at kei.pl  Wed May 21 17:03:58 2008
From: nikon at kei.pl (Tomasz Pajor)
Date: Wed May 21 17:04:03 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <20080521182530.23c8f787@mort.in.publishing.hu>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl><20080521155508.6ccfcfb5@twoflower.in.publishing.hu><3abeb97e28be5b2107ea97e65ae88762.t.pajor@kei.pl>
	<20080521182530.23c8f787@mort.in.publishing.hu>
Message-ID: <78f2745340c587cd4f000ffac8b3e85f.nikon@kei.pl>

> > > May I ask whether you are using innodb or myisam? both on freebsd
> > > and Linux. And what filesystem are you using for mysql's data
> > > files? UFS, ZFS or anything else?
> > 
> > MySQL engine used is MEMORY, filesystem is ufs, but it's not relevant.
> sure it is relevant. check my results:
> http://phoemix.harmless.hu/dbtests/

How the filesystem is relevant when tables are in memory?

> Standard build from ports"-current" pops up a dialog called "OPTIONS",
> where you can set these options. How have you set them?

env BUILD_OPTIMIZED BUILD_STATIC make install clean



From gergely.czuczy at harmless.hu  Wed May 21 17:28:48 2008
From: gergely.czuczy at harmless.hu (CZUCZY Gergely)
Date: Wed May 21 17:28:51 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <78f2745340c587cd4f000ffac8b3e85f.nikon@kei.pl>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
	<20080521155508.6ccfcfb5@twoflower.in.publishing.hu>
	<3abeb97e28be5b2107ea97e65ae88762.t.pajor@kei.pl>
	<20080521182530.23c8f787@mort.in.publishing.hu>
	<78f2745340c587cd4f000ffac8b3e85f.nikon@kei.pl>
Message-ID: <20080521192843.30ca3833@mort.in.publishing.hu>

On Wed, 21 May 2008 19:03:55 +0200
Tomasz Pajor  <nikon@kei.pl> wrote:

> > > > May I ask whether you are using innodb or myisam? both on
> > > > freebsd and Linux. And what filesystem are you using for
> > > > mysql's data files? UFS, ZFS or anything else?
> > > 
> > > MySQL engine used is MEMORY, filesystem is ufs, but it's not
> > > relevant.
> > sure it is relevant. check my results:
> > http://phoemix.harmless.hu/dbtests/
> 
> How the filesystem is relevant when tables are in memory?
first, they somehow have to be put into the memory
second, for consistency (yeah, this word is missing from toysql-users'
vocabulary) it has to write the data to the disk. otherwise you'd lose
anything on a crash


-- 

Sincerely,

Gergely CZUCZY,
Harmless Digital
mailto: gergely.czuczy@harmless.hu

Legacy software is software that works.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 187 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-performance/attachments/20080521/574be1e8/signature.pgp
From nikon at kei.pl  Wed May 21 17:33:59 2008
From: nikon at kei.pl (Tomasz Pajor)
Date: Wed May 21 17:34:04 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <20080521192843.30ca3833@mort.in.publishing.hu>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl><20080521155508.6ccfcfb5@twoflower.in.publishing.hu><3abeb97e28be5b2107ea97e65ae88762.t.pajor@kei.pl><20080521182530.23c8f787@mort.in.publishing.hu><78f2745340c587cd4f000ffac8b3e85f.nikon@kei.pl>
	<20080521192843.30ca3833@mort.in.publishing.hu>
Message-ID: <257034819c08b52542969ccbf90207fc.nikon@kei.pl>

> > How the filesystem is relevant when tables are in memory?
> first, they somehow have to be put into the memory
> second, for consistency (yeah, this word is missing from toysql-users'
> vocabulary) it has to write the data to the disk. otherwise you'd lose
> anything on a crash

http://dev.mysql.com/doc/refman/5.1/en/memory-storage-engine.html

"As indicated by the name, MEMORY tables are stored in memory. They use hash indexes by default, which makes them very fast, and very useful for creating temporary tables. However, when the server shuts down, all rows stored in MEMORY tables are lost. The tables themselves continue to exist because their definitions are stored in .frm files on disk, but they are empty when the server restarts."

so only the structure is in file not data



From gergely.czuczy at harmless.hu  Wed May 21 18:41:14 2008
From: gergely.czuczy at harmless.hu (CZUCZY Gergely)
Date: Wed May 21 18:41:18 2008
Subject: mysql performance on freebsd 7
In-Reply-To: <257034819c08b52542969ccbf90207fc.nikon@kei.pl>
References: <be8c1fa47808266f0e520175c6bbbf1e.t.pajor@kei.pl>
	<20080521155508.6ccfcfb5@twoflower.in.publishing.hu>
	<3abeb97e28be5b2107ea97e65ae88762.t.pajor@kei.pl>
	<20080521182530.23c8f787@mort.in.publishing.hu>
	<78f2745340c587cd4f000ffac8b3e85f.nikon@kei.pl>
	<20080521192843.30ca3833@mort.in.publishing.hu>
	<257034819c08b52542969ccbf90207fc.nikon@kei.pl>
Message-ID: <20080521204109.3c9e601d@mort.in.publishing.hu>

ahh, sorry. missunderstood that. i've seen many places they've put the
data into memory disks. i've thought that's being done here also.

On Wed, 21 May 2008 19:33:56 +0200
Tomasz Pajor  <nikon@kei.pl> wrote:

> > > How the filesystem is relevant when tables are in memory?  
> > first, they somehow have to be put into the memory
> > second, for consistency (yeah, this word is missing from
> > toysql-users' vocabulary) it has to write the data to the disk.
> > otherwise you'd lose anything on a crash  
> 
> http://dev.mysql.com/doc/refman/5.1/en/memory-storage-engine.html
> 
> "As indicated by the name, MEMORY tables are stored in memory. They
> use hash indexes by default, which makes them very fast, and very
> useful for creating temporary tables. However, when the server shuts
> down, all rows stored in MEMORY tables are lost. The tables
> themselves continue to exist because their definitions are stored
> in .frm files on disk, but they are empty when the server restarts."
> 
> so only the structure is in file not data


-- 

Sincerely,

Gergely CZUCZY,
Harmless Digital
mailto: gergely.czuczy@harmless.hu

Legacy software is software that works.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 187 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-performance/attachments/20080521/74466346/signature.pgp
From kris at FreeBSD.org  Tue May 27 09:45:31 2008
From: kris at FreeBSD.org (Kris Kennaway)
Date: Tue May 27 09:45:32 2008
Subject: FreeBSD 7.0-RELEASE: Can I specify the maximum number of cores
 that	kernel can recognize ?
In-Reply-To: <011501c8bfcc$a3164b40$c154140a@colors.scs.co.jp>
References: <011501c8bfcc$a3164b40$c154140a@colors.scs.co.jp>
Message-ID: <483BD839.9020804@FreeBSD.org>

Hattori, Shigehiro wrote:
> Hi,
> 
> I try to measure Bind caching name server's multi threading performance on
> FreeBSD 7 , like below.
> 
> -- 
> # of cores    query/second
> 1                 xx
> 2                 xx
> 4                 xx
> 6                 xx
> 8                 xx
> -- 
> 
> My testing machine has 8 cores. ( quad core * 2 )
> 
> I'd like to specify the maximum # of cores that kernel can recognize.
> Can I specify the maximum # of cores with boot parameters or something ?

You can disable the cores you do not want by turning off their lapic. 
Add to /boot/loader.conf:

hint.lapic.0.disabled=1 turns off lapic 0, etc.  Cross-reference against 
dmesg:

FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
  cpu0 (BSP): APIC ID:  0 <---- disables this core
  cpu1 (AP): APIC ID:  1
  cpu2 (AP): APIC ID:  2
  cpu3 (AP): APIC ID:  3
  cpu4 (AP): APIC ID:  4
  cpu5 (AP): APIC ID:  5
  cpu6 (AP): APIC ID:  6
  cpu7 (AP): APIC ID:  7

> I've already done Bind multi threading performance test on Linux ( 
> CentOS5 )
> In case of CentOS5 , I specified maximum # of cores with grub.conf? 
> "maxcpus=1
> or 2 or 4 or ..."
> 
> # cat /etc/grub.conf
> title CentOS (2.6.18-53.1.21.el5PAE)
>        root (hd0,1)
>        kernel /boot/vmlinuz-2.6.18-53.1.21.el5PAE ro root=LABEL=/ rhgb
> quiet maxcpus=6
>        initrd /boot/initrd-2.6.18-53.1.21.el5PAE.img
> #
> 
> The following is the results I did on CentOS5 ( kernel:
> 2.6.18-53.1.21.el5 ).
> 
> -- Bind 9.4.2 caching name server on CentOS5
> # of cores    query/second    CPU ( named )
> 1                 3578                99.9
> 2                 5070                196
> 4                 6608                362
> 6                 9042                527
> 8                 10552               678
> -- 
> 
> - Bind's machine spec
> 
> CPU: Intel Xeon E5346  2.3GH ( quad core * 2 )
> Memory: 4GB
> Bind 9.4.2
> Cache size: 1400MB
> Max recursive clients: 50000
> 
> - Traffic generetor: queryperf
> Query list: all queries are uniq ( that means "No answer in the cache" )

Make sure you are resolving these queries against another local server. 
  If you're querying random servers in the internet then you're mostly 
going to be benchmarking your uplink latency and the maximum query rate 
will be limited by the number of broken servers you query that do not 
respond but time out.

Those numbers are quite low even for Linux; on similar hardware I can 
achieve 60000 qps on Linux and about 105000 qps on FreeBSD:

http://people.freebsd.org/~kris/scaling/bind-pt.png

With 1gb ethernet I have to query from multiple clients to get that high 
because of request latency (with 10gbe I can saturate from a single 
client).  I was not disabling cores but limiting the number of bind 
threads, which should be approximately the same thing especially for 8 
threads.

Kris

From jeremie at le-hen.org  Wed May 28 07:37:02 2008
From: jeremie at le-hen.org (Jeremie Le Hen)
Date: Wed May 28 07:37:06 2008
Subject: Low/Jerky performance in FreeBSD 7
In-Reply-To: <4831A0A5.6040808@bulinfo.net>
References: <4831A0A5.6040808@bulinfo.net>
Message-ID: <20080528071654.GH80973@obiwan.tataz.chchile.org>

On Mon, May 19, 2008 at 08:45:41AM -0700, Yani Brankov wrote:
>  I recently updated to FreeBSD 7 and noticed that my box started to perform 
>  as windows does under heavier loads. The mouse starts to be jerky when 
>  compiling, window updates/redraws are slow and bump the CPU usage up to 
>  100%. I attributed this to the mga driver which comes with the distro in the 
>  beginning. However, I later noticed the same happens even when X has not 
>  been started. For instance, I start a kernel compile and the console mouse 
>  becomes jumpy. All these have never happened before with FreeBSD on this 
>  box. It has enough memory (1.5G) and relatively fast CPU (2.5GHz). I started 
>  to think this may be originating from kernel level (irq handling, long times 
>  in giant locked code during syscalls, etc).
> 
>  I am wondering whether it is only me who has hit this problem or it is more 
>  common. It may be also related to hardware configuration, etc. I'm trying to 
>  figure out.

Try profiling your kernel with PMC:
http://lists.freebsd.org/pipermail/freebsd-current/2006-February/061096.html

Regards,
-- 
Jeremie Le Hen
< jeremie at le-hen dot org >< ttz at chchile dot org >