Performance over network with mount_smbfs (warning large mail)

Fri Feb 13 12:53:10 PST 2004

I have a Windows 2003 machine(2) with a share mounted on a Freebsd
machine (1) via mount_smbfs

Hardware
Machine 1

FreeBSD pcmarpxy.mine.nu 4.9-STABLE FreeBSD 4.9-STABLE #1: Fri Jan 30
23:33:38 CET 2004     root at pcmarpxy.mine.nu:/usr/obj/usr/src/sys/MARK
i386
PIII 650, 392mb ram
system : ata-100 5400 disks on builtin ide
data :- 2 ata-100 disks on a promise ata card running under vinum
(software raid) raid 0
- real men always run raid 0  :-)

BSD is recently cvsupped and compiled etc... 
samba Version 3.0.1

Machine 2

Windows 2003 all patches.
PIII 500 with a promise atx raid card and a 
pair of 30gb ata-100 5400 rpm. (also raid 0)

The machines are connected via a switch running 100mb all interfaces,
ports are
manually set to 100mb full duplex, neither machine is exactly
overloaded.

I backup to machine 2 (40gb) via an smb mount to a Windows 2003 server. 

with smbfs
167604556 bytes sent in 8m.15.133  (330 Kbytes/s)

With ftp 
167604556 bytes sent in 15.06 seconds (10.62 MB/s)

With samba (from samba share on Freebsd box  to Windows 2003 box)

167604556 bytes sent in 35.06 seconds  (4.56 MB/s)

this is something of a disparity!. Anyone got any ideas....

Some other info

sysctl :-

netsmb_dev: loaded
net.local.stream.sendspace: 8192
net.local.stream.recvspace: 8192
net.local.dgram.maxdgram: 2048
net.local.dgram.recvspace: 4096
net.local.inflight: 0
net.inet.ip.portrange.lowfirst: 1023
net.inet.ip.portrange.lowlast: 600
net.inet.ip.portrange.first: 1024
net.inet.ip.portrange.last: 5000
net.inet.ip.portrange.hifirst: 49152
net.inet.ip.portrange.hilast: 65535
net.inet.ip.forwarding: 1
net.inet.ip.redirect: 1
net.inet.ip.ttl: 64
net.inet.ip.rtexpire: 1066
net.inet.ip.rtminexpire: 10
net.inet.ip.rtmaxcache: 128
net.inet.ip.sourceroute: 0
net.inet.ip.intr_queue_maxlen: 50
net.inet.ip.intr_queue_drops: 20
net.inet.ip.accept_sourceroute: 0
net.inet.ip.fastforwarding: 0
net.inet.ip.keepfaith: 0
net.inet.ip.subnets_are_local: 0
net.inet.ip.fw.enable: 1
net.inet.ip.fw.autoinc_step: 100
net.inet.ip.fw.one_pass: 1
net.inet.ip.fw.debug: 1
net.inet.ip.fw.verbose: 1
net.inet.ip.fw.verbose_limit: 0
net.inet.ip.fw.dyn_buckets: 256
net.inet.ip.fw.curr_dyn_buckets: 256
net.inet.ip.fw.dyn_count: 241
net.inet.ip.fw.dyn_max: 4096
net.inet.ip.fw.static_count: 59
net.inet.ip.fw.dyn_ack_lifetime: 300
net.inet.ip.fw.dyn_syn_lifetime: 20
net.inet.ip.fw.dyn_fin_lifetime: 1
net.inet.ip.fw.dyn_rst_lifetime: 1
net.inet.ip.fw.dyn_udp_lifetime: 10
net.inet.ip.fw.dyn_short_lifetime: 5
net.inet.ip.fw.dyn_keepalive: 1
net.inet.ip.maxfragpackets: 143
net.inet.ip.maxfragsperpacket: 16
net.inet.ip.sendsourcequench: 0
net.inet.ip.check_interface: 0
net.inet.icmp.maskrepl: 0
net.inet.icmp.icmplim: 200
net.inet.icmp.drop_redirect: 1
net.inet.icmp.log_redirect: 1
net.inet.icmp.icmplim_output: 1
net.inet.icmp.bmcastecho: 0
net.inet.tcp.rfc1323: 1
net.inet.tcp.rfc1644: 0
net.inet.tcp.mssdflt: 512
net.inet.tcp.keepidle: 7200000
net.inet.tcp.keepintvl: 75000
net.inet.tcp.sendspace: 32768
net.inet.tcp.recvspace: 57344
net.inet.tcp.keepinit: 75000
net.inet.tcp.delacktime: 100
net.inet.tcp.log_in_vain: 0
net.inet.tcp.blackhole: 2
net.inet.tcp.delayed_ack: 1
net.inet.tcp.path_mtu_discovery: 1
net.inet.tcp.slowstart_flightsize: 1
net.inet.tcp.local_slowstart_flightsize: 4
net.inet.tcp.newreno: 1
net.inet.tcp.tcbhashsize: 512
net.inet.tcp.do_tcpdrain: 1
net.inet.tcp.pcbcount: 50
net.inet.tcp.icmp_may_rst: 1
net.inet.tcp.isn_reseed_interval: 0
net.inet.tcp.inflight_enable: 0
net.inet.tcp.inflight_debug: 0
net.inet.tcp.inflight_min: 6144
net.inet.tcp.inflight_max: 1073725440
net.inet.tcp.inflight_stab: 20
net.inet.tcp.syncookies: 1
net.inet.tcp.syncache.bucketlimit: 30
net.inet.tcp.syncache.cachelimit: 15359
net.inet.tcp.syncache.count: 0
net.inet.tcp.syncache.hashsize: 512
net.inet.tcp.syncache.rexmtlimit: 3
net.inet.tcp.msl: 30000
net.inet.tcp.rexmit_min: 1000
net.inet.tcp.rexmit_slop: 200
net.inet.tcp.always_keepalive: 1
net.inet.udp.checksum: 1
net.inet.udp.maxdgram: 9216
net.inet.udp.recvspace: 41600
net.inet.udp.log_in_vain: 0
net.inet.udp.blackhole: 1
net.inet.accf.unloadable: 0
net.inet.raw.maxdgram: 8192
net.inet.raw.recvspace: 8192
net.link.generic.system.ifcount: 3
net.link.ether.inet.prune_intvl: 300
net.link.ether.inet.max_age: 1200
net.link.ether.inet.host_down_time: 20
net.link.ether.inet.maxtries: 5
net.link.ether.inet.useloopback: 1
net.link.ether.inet.proxyall: 0
net.link.ether.inet.log_arp_wrong_iface: 1
net.link.ether.inet.log_arp_movements: 1
net.link.ether.ipfw: 0
net.smb.version: 103006
net.smb.tcpsndbuf: 65535
net.smb.tcprcvbuf: 65535
netsmb_dev: loaded

A little trace

trace looks something like this :- 

Frame 229 (125 bytes on wire, 125 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126518730, Ack: 2575214210, Len: 59
NetBIOS Session Service
SMB (Server Message Block Protocol)

Frame 230 (119 bytes on wire, 119 bytes captured)
Ethernet II, Src: 00:10:4b:b6:f1:7b, Dst: 00:60:08:d0:62:2d
Internet Protocol, Src Addr: 192.168.0.4 (192.168.0.4), Dst Addr:
192.168.0.1 (192.168.0.1)
Transmission Control Protocol, Src Port: netbios-ssn (139), Dst Port:
2857 (2857), Seq: 2575214210, Ack: 1126518789, Len: 53
NetBIOS Session Service
SMB (Server Message Block Protocol)

Frame 231 (1514 bytes on wire, 1514 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126518789, Ack: 2575214263, Len: 1448
NetBIOS Session Service
SMB (Server Message Block Protocol)

Frame 232 (1514 bytes on wire, 1514 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126520237, Ack: 2575214263, Len: 1448
NetBIOS Session Service

Frame 233 (1514 bytes on wire, 1514 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126521685, Ack: 2575214263, Len: 1448
NetBIOS Session Service

Frame 234 (1514 bytes on wire, 1514 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126523133, Ack: 2575214263, Len: 1448
NetBIOS Session Service

Frame 235 (1514 bytes on wire, 1514 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126524581, Ack: 2575214263, Len: 1448
NetBIOS Session Service

Frame 236 (1514 bytes on wire, 1514 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126526029, Ack: 2575214263, Len: 1448
NetBIOS Session Service

Frame 237 (1514 bytes on wire, 1514 bytes captured)
Ethernet II, Src: 00:60:08:d0:62:2d, Dst: 00:10:4b:b6:f1:7b
Internet Protocol, Src Addr: 192.168.0.1 (192.168.0.1), Dst Addr:
192.168.0.4 (192.168.0.4)
Transmission Control Protocol, Src Port: 2857 (2857), Dst Port:
netbios-ssn (139), Seq: 1126527477, Ack: 2575214263, Len: 1448
NetBIOS Session Service