From minimarmot at gmail.com Fri Feb 1 19:52:23 2008 From: minimarmot at gmail.com (Ben Kaduk) Date: Fri Feb 1 19:52:27 2008 Subject: OpenAFS / Arla installation / configuration tutorial ... In-Reply-To: References: Message-ID: <47d0403c0802011927g13a97fd4hb1a4fe52814a9e82@mail.gmail.com> On 1/27/08, Marc G. Fournier wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > > Simple enough, does anyone have one written for FreeBSD? Someone posted on > that is for NetBSD to the Arla list, but it references files / directories that > don't match with FreeBSD ... so, if someone already has such, rather avoid > re-creating the wheel ... > Sorry to reply so late; I'm quite a bit behind on my mail. I am under the impression that OpenAFS has not worked ``out-of-the-box'' on any FreeBSD release since 4.11 . I tried building it on a 7.0-PRERELEASE system recently, and once I got past the configure stage, it still complained about some lock types -- I haven't had a chance to look at it in detail, yet. -Ben Kaduk From kyle at moffetthome.net Sun Feb 3 22:23:37 2008 From: kyle at moffetthome.net (Kyle Moffett) Date: Mon Feb 4 04:15:04 2008 Subject: [OpenAFS-devel] Re: AFS ... or equivalent ... In-Reply-To: <876FB8E38251C27B14CCCA29@atlantis.pc.cs.cmu.edu> References: <18CC5A4A2AC36D7FF57615EE@ganymede.hub.org> <478AF6BC.8050604@highperformance.net> <20080114142124.Y55696@fledge.watson.org> <876FB8E38251C27B14CCCA29@atlantis.pc.cs.cmu.edu> Message-ID: On Jan 16, 2008 1:48 PM, Jeffrey Hutzelman wrote: > The "let's just slurp everything into the main distribution so we don't > have to worry about stable interfaces" approach is really poor. It > encourages bad engineering practice among people maintaining the main > distribution, discourages innovation and extension by others, and generally > doesn't scale. It's far better to either attempt to maintain stable > external interfaces to the VFS and VM subsystems, or else admit that you > don't have the resources to do so given the relatively small number of > external users, in which case you almost certainly also don't have the > resources to keep on top of updates to something like OpenAFS. The Linux Kernel presents a very strong counter-argument-by-example. The amount of patches merged per released version has been linearly increasing over the last several years; the 2.6.23 => 2.6.24 patch was 49MB uncompressed, with a 5.7MB changelog. Of that, a significant portion were VFS changes which touched most filesystems. The various filesystem-related changes alone between 2.6.23 and 2.6.24 were 2.9MB. For reference, the *entire* OpenAFS diff between 2.4.6 and 2.5.30 is all of 8.2MB. The Linux Kernel changes include partial support for having per-process views of a single filesystem (Specifically /proc, so /proc/net can have differing contents between network namespaces). Other features which Linux supports that virtually no other OS does is multiple filesystem namespaces, where the mount-tree is selectively independent or shared between namespaces. I realize that some people are probably already aware of most of that, but I thought it should be mentioned that "slurp everything into the main distribution" actually scales very well with respect to the Linux kernel. It means that the people who are making changes (to the VFS, for example) have to go around and fix *all* the filesystems, and in addition when a bug gets fixed in one filesystem then most of the others get checked for that same bug. OpenAFS also does not benchmark very well under Linux against most of the other networked filesystems (even ones using encryption), as it does not support the fine-grained locking that Linux does. Unfortunately it isn't practical for Linux to reuse existing OpenAFS code as the licenses are partially incompatible. > In the long run, I'm guessing that the OpenAFS cache manager evolves more > quickly than FreeBSD's VFS interface, which makes pulling the CM into the > kernel tree a losing battle. If you disagree, by all means fork that part > of AFS (or get someone else to do so) and see what happens (AFS's > user/kernel and RPC interfaces are both fairly stable, so forking just the > kernel parts should be mostly feasible). As it so happens this is exactly what is happening right now in the Linux Kernel. David Howells (original author of the Linux "keyring" subsystem) has been writing a generic userspace+kernelspace FS-Cache system which can use either a block device or a mounted filesystem as storage. It presently supports NFS and the minimal in-kernel AFS client and is planned to be mostly merged into 2.6.25. The benefits of being able to share innovations in caching between AFS, NFS, and other networked filesystems is quite significant. My apologies for anything in this email that may be construed as offensive; the intent is as an honest technical discussion of development methods and practices. Cheers, Kyle Moffett From jerrymc at msu.edu Mon Feb 4 08:12:18 2008 From: jerrymc at msu.edu (Jerry McAllister) Date: Mon Feb 4 09:11:25 2008 Subject: [OpenAFS-devel] Re: AFS ... or equivalent ... In-Reply-To: References: <18CC5A4A2AC36D7FF57615EE@ganymede.hub.org> <478AF6BC.8050604@highperformance.net> <20080114142124.Y55696@fledge.watson.org> <876FB8E38251C27B14CCCA29@atlantis.pc.cs.cmu.edu> Message-ID: <20080204155842.GA7685@gizmo.acns.msu.edu> On Mon, Feb 04, 2008 at 12:58:29AM -0500, Kyle Moffett wrote: > On Jan 16, 2008 1:48 PM, Jeffrey Hutzelman wrote: > > The "let's just slurp everything into the main distribution so we don't > > have to worry about stable interfaces" approach is really poor. It > > encourages bad engineering practice among people maintaining the main > > distribution, discourages innovation and extension by others, and generally > > doesn't scale. It's far better to either attempt to maintain stable > > external interfaces to the VFS and VM subsystems, or else admit that you > > don't have the resources to do so given the relatively small number of > > external users, in which case you almost certainly also don't have the > > resources to keep on top of updates to something like OpenAFS. > > The Linux Kernel presents a very strong counter-argument-by-example. > The amount of patches merged per released version has been linearly > increasing over the last several years; the 2.6.23 => 2.6.24 patch was > 49MB uncompressed, with a 5.7MB changelog. Of that, a significant > portion were VFS changes which touched most filesystems. The various > filesystem-related changes alone between 2.6.23 and 2.6.24 were > 2.9MB. So, there are reasons why many of us prefer FreeBSD to Linux. ////jerry ........ For reference, the *entire* OpenAFS diff between 2.4.6 and > 2.5.30 is all of 8.2MB. The Linux Kernel changes include partial > support for having per-process views of a single filesystem > (Specifically /proc, so /proc/net can have differing contents between > network namespaces). Other features which Linux supports that > virtually no other OS does is multiple filesystem namespaces, where > the mount-tree is selectively independent or shared between > namespaces. > From williamrockt at gmail.com Fri Feb 8 01:41:21 2008 From: williamrockt at gmail.com (william rockt) Date: Fri Feb 8 01:41:25 2008 Subject: ON Networks Introduces ON Dating: A New Video Guide-to-Success for Online Courtship -- Internet Series, Produced by NBC Universal Digital Studios, O Message-ID: <1ff813d0802080114g188d6f7dud247b381562d2ebb@mail.gmail.com> ON Networks Introduces ON Dating: A New Video Guide-to-Success for Online Courtship -- Internet Series, Produced by NBC Universal Digital Studios, O http://www.faqinteractive.com/ 1-866-268-5588 AUSTIN, Texas (BusinessWire EON) June 13, 2007 -- The show functions as a virtual dating coach, dedicated to helping viewers navigate the sometimes treacherous terrain of online romance. Hosted by Andrea Syrtash, a certified dating coach, each ON Dating show serves as a 3-8 minute primer on how to date in the 21st century, offering viewers advice on topics ranging from how to write the perfect profile to proper online etiquette to selecting the site that's best for you. "In this information age, we all know somebody who has found love online," said Syrtash, a trained life coach who has offered advice on dating and relating in various media outlets including NPR, USA Today and NBC's Today Show. "ON Dating will show you how to stand out in the crowd and, ultimately, become successful in the virtual arena." To that end, the show juxtaposes real-life success stories with all-too-common pitfalls, featuring quick person-on-the-street testimonials as well as in-studio guests. ON Dating also examines the individuals and companies bringing people together over the Internet and evaluates the newest trends in online dating. This week's episode features an exclusive interview with Dr. Ian Kerner, a Relationship Expert with Match.com, the world's largest Internet dating site. Reminding viewers that last year alone, more than 500,000 singles found meaningful relationships through Match.com, Kerner encourages viewers to broaden their dating scope through the world of virtual romance. "Benjamin Franklin said that 'the definition of insanity is to do the same thing over and over again and expect a new result,' and I think, prior to online dating, that's what a lot of us would do when it came to romance. We'd go to the same bars and parties expecting to find Mr. or Ms. Right and would usually go home disappointed. With online dating, we now have an opportunity to do new things in new ways." ON Dating is produced for ON Networks in New York City by NBC Universal Digital Studios, a studio dedicated to creating video content specifically for digital platforms. Viewers can apply the practical advice offered on the weekly show and use ON Dating as a valuable dating resource. "This audience is very busy and very tech savvy - spending a good portion of their day online," said Matthew Evans, Vice President, Digital Media and head of NBC Universal Digital Studios. "A show like this fits their lifestyle perfectly. The expert advice is presented in a user-friendly format that is both informative and entertaining." To share the Match.com show or any other ON Dating video, simply select the desired episode at and click on the "chain" icon in the player control bar. There, you can view the embedded HTML player code, which can be copied and then pasted onto any web page. ON Dating is one of several new programs being introduced by ON Networks, Inc. (ON). The show can be watched anytime, anywhere at . There, viewers can subscribe to receive notices about new Dating episodes as well as get other program information and updates from ON. Other shows available at are: Cocktails on the Fly, Austin Connoisseur, Budget Health Nut, Dinner with the Band, Golf Tips, Stump the Chef and Zen Living. About NBC Universal Digital Studios NBC Universal Digital Studios combine NBC Universal's legacy of storytelling with technical innovation to create a wide range of content for digital media platforms. The Studios create engaging, video-based experiences, webisodes, viral videos and other video content for broadband and wireless devices. Recent programs include "Watch What Happens," a weekly, live-streaming, online program available at BravoTV.com and "A Big Life with Sissy Biggers," available on the MSN Originals platform (abiglife.msn.com). About ON Networks, Inc. ON Networks is changing the way in which television shows are created, distributed, consumed and monetized. It's a new media company for the digital generation, delivering high-definition content on-demand across the Internet and new networks like IPTV, digital cable and iTunes. With original series for every pastime and pursuit, ON's short-form, weekly videos satisfy the growing demand for relevant, smart and entertaining programming that is available when, where and how viewers want to watch it. Join the growing ON community at . From freebsd at hub.org Sat Feb 9 19:19:58 2008 From: freebsd at hub.org (Marc G. Fournier) Date: Sat Feb 9 19:20:01 2008 Subject: Anyone setup an OpenAFS server ... ? Message-ID: <07046A359F2F7D51F922C3E4@ganymede.hub.org> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 So far, been drawing a blank on some sort of tutorial / quick start guide ... had someone send me one for NetBSD, but about halfway through it, I figured out that have the places it was telling me to put files didn't have an relation to the FreeBSD system :( Before I try and 'translate' those instructions to FreeBSD, is there something else already out there? Thank you ... - ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHrmzG4QvfyHIvDvMRApFSAJwMTG+G5EAAyD5Vzbocil6Rpl3DSgCgygHd wA6CFf7Xp/i4ODyuh1duZvM= =dbKx -----END PGP SIGNATURE----- From scrappy at freebsd.org Thu Feb 14 17:23:48 2008 From: scrappy at freebsd.org (Marc G. Fournier) Date: Thu Feb 14 17:23:51 2008 Subject: Start of a FreeBSD Setup Guide for AFS (Server and Client) Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I've been meaning to get this started for awhile now, but time never is what one would like it to be: endless. Is a *very* basic start ... right now, its just a pointer to Arla (client) and OpenAFS (server) ports for FreeBSD created by Alex Koss, and a link to some NetBSD specific setup instructions. I'm going to work on FreeBSD specific ones, using that as a base, that will be on the Wiki itself ... If anyone else does start working through the NetBSD instructions and wants to submit stuff, just email me and I'll gladly add it .. kerberos, at least, is something that I've *never* setup, so I'm starting from complete ground zero on this .. - ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHtOTl4QvfyHIvDvMRAh9KAJ99t4tI2Ok3Kq94bD+z3IAxpcI17gCdFbyO jzWENbGNZu943G+hbfSPF/I= =6xcE -----END PGP SIGNATURE----- From rwatson at FreeBSD.org Fri Feb 15 14:34:13 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Fri Feb 15 14:34:18 2008 Subject: Start of a FreeBSD Setup Guide for AFS (Server and Client) In-Reply-To: References: Message-ID: <20080215223317.H51625@fledge.watson.org> On Thu, 14 Feb 2008, Marc G. Fournier wrote: > I've been meaning to get this started for awhile now, but time never is what > one would like it to be: endless. > > > > Is a *very* basic start ... right now, its just a pointer to Arla (client) > and OpenAFS (server) ports for FreeBSD created by Alex Koss, and a link to > some NetBSD specific setup instructions. I'm going to work on FreeBSD > specific ones, using that as a base, that will be on the Wiki itself ... > > If anyone else does start working through the NetBSD instructions and wants > to submit stuff, just email me and I'll gladly add it .. kerberos, at least, > is something that I've *never* setup, so I'm starting from complete ground > zero on this .. There used to be a decent chapter on setting up Kerberos in the FreeBSD Handbook, not sure if it's still there. At least if you're going to use Arla as the AFS client, you'll need to install the Heimdal port rather than use the native FreeBSD version as it's a bit newer. We should get the version of K5 in the base system upgraded though, not sure if we have a maintainer right now. Robert N M Watson Computer Laboratory University of Cambridge From rwatson at FreeBSD.org Fri Feb 15 20:30:53 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Fri Feb 15 20:31:22 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT Message-ID: <20080216035658.W93919@fledge.watson.org> Dear Arla folk, I've spent the evening getting Arla (checked out of anoncvs) up and running on FreeBSD 8-CURRENT, and have it at least minimally running (/afs mounted, some directory access, read a few files, etc), although arlad core dumped fairly quickly during use. I've not yet attempted to debug that problem though. I've attached a patch that does a few things: First, it does a few minor Arla cleanups that appear to be necessary to build on FreeBSD 8: A few general Arla ifdef fixes, etc, such as testing defined(SunOS) before using the value, likewise on __NetBSD_Version__, OpenBSD, etc. Fix two build dependency issues I ran into regarding building arlalib before dependent tools and an include that broke (at least on FreeBSD). Second, it adds new autoconf and ifdef parts to get Arla building on FreeBSD 8, such as handling VFS changes that appeared in FreeBSD 7.x and 8.x, the priv(9) kernel privilege framework, some include problems I ran into with using /usr/src/sys before /usr/include/sys (which doesn't work for generated files such as vnode_if.h), and things along those lines. Unfortunately, I'm not set up to easily build test on other platforms, and I've also not had a chance to try this on FreeBSD 7 -- my guess is some minor tweaks may be required with respect to both of those, but hopefully these are steps in the right direction and someone with a bit more Arla experience can sort out what I've done into things with keeping and things with fixing :-). I'll investigate the arlad crash tomorrow. Patch also up at: http://www.watson.org/~robert/freebsd/20080216-arla.diff Robert N M Watson Computer Laboratory University of Cambridge -------------- next part -------------- A non-text attachment was scrubbed... Name: 20080216-arla.diff Type: text/x-diff Size: 25035 bytes Desc: Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080216/c8b52bf1/20080216-arla.bin From kaj at kth.se Sun Feb 17 14:47:59 2008 From: kaj at kth.se (Rasmus Kaj) Date: Sun Feb 17 14:48:03 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080216035658.W93919@fledge.watson.org> References: <20080216035658.W93919@fledge.watson.org> Message-ID: <1203286882.16414.3.camel@heterodyne.kaj> l?r 2008-02-16 klockan 04:12 +0000 skrev Robert Watson: Hi Robert and Arla folks! > I've spent the evening getting Arla (checked out of anoncvs) [...] Everyone who got Arla out of anoncvs, please update! The anoncvs repo has been out of sync since october 1, 2007. Now it is updated -- and updating itself when new commits happen -- again. Sorry for the inconvenience! -- Rasmus Kaj From rwatson at FreeBSD.org Sun Feb 17 17:29:35 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Sun Feb 17 17:29:39 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <1203286882.16414.3.camel@heterodyne.kaj> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> Message-ID: <20080218012608.V96329@fledge.watson.org> On Sun, 17 Feb 2008, Rasmus Kaj wrote: >> I've spent the evening getting Arla (checked out of anoncvs) [...] > > Everyone who got Arla out of anoncvs, please update! > > The anoncvs repo has been out of sync since october 1, 2007. Now it is > updated -- and updating itself when new commits happen -- again. > > Sorry for the inconvenience! Indeed, all the missing changes from October through December are now there in anoncvs. Looks like the appl/lib build order fix I needed is already there, but most of the other changes haven't been bumped into by anyone else yet. I needed the one further attached change to correct a build problem resulting from the more recent work in CVS. With the updated parts, I now have Arla running on FreeBSD 8-CURRENT again. Robert N M Watson Computer Laboratory University of Cambridge http://perforce.freebsd.org/chv.cgi?CH=135612 Change 135612 by rwatson@rwatson_cinnamon_coda on 2008/02/18 01:04:20 New build fix for NetBSDism in Arla. Affected files ... .. //depot/user/rwatson/arla/porting/nnpfs/bsd/nnpfs/nnpfs_locl.h#4 edit Differences ... ==== //depot/user/rwatson/arla/porting/nnpfs/bsd/nnpfs/nnpfs_locl.h#4 (text+ko) ==== @@ -118,7 +118,7 @@ #ifdef HAVE_SYS_ATTR_H #include #endif -#if __NetBSD_Version__ >= 399001900 /* 3.99.19 */ +#if defined(__NetBSD_Version__) && __NetBSD_Version__ >= 399001900 /* 3.99.19 */ #define HAVE_SYS_KAUTH_H #endif #ifdef HAVE_SYS_KAUTH_H From alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com Fri Feb 22 13:18:50 2008 From: alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com (Alec Kloss) Date: Fri Feb 22 13:18:53 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080218012608.V96329@fledge.watson.org> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> Message-ID: <20080222125207.GD38141@hamlet.setfilepointer.com> Robert, I've been playing with your patches, etc. on 8-CURRENT. I've been having to tweak up include/config.h a little so I wonder if you missed a few autoconf things... but more important, running "ls /afs" results in: nnpfs: cdev: 0, syscall: 339 Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x26c fault code = supervisor read, page not present instruction pointer = 0x20:0xc2a7f1fc stack pointer = 0x28:0xcd412a40 frame pointer = 0x28:0xcd412a5c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 4822 (ls) [thread pid 4822 tid 100176 ] Stopped at nnpfs_getattr_common+0xc: movl 0x26c(%eax),%eax db> bt Tracing pid 4822 tid 100176 td 0xc2783440 nnpfs_getattr_common(c297b110,cd412ab4,c24f1700,c2783440,cd412aa0,...) at nnpfs_getattr_common+0xc nnpfs_getattr(cd412aa0,0,c0b10208,cd412b48,cd412b28,...) at nnpfs_getattr+0x33 VOP_GETATTR_APV(c2a854a0,cd412aa0,c0bd91a0,c297b110,cd412ab4,...) at VOP_GETATTR_APV+0xa5 vn_stat(c297b110,cd412b48,c24f1700,0,c2783440,...) at vn_stat+0x49 kern_stat(c2783440,8113138,0,cd412c18,c0c5d140,...) at kern_stat+0x81 stat(c2783440,cd412cfc,8,cd412d38,c0ba1e60,...) at stat+0x2f syscall(cd412d38) at syscall+0x2b3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (188, FreeBSD ELF32, stat), eip = 0x281a3acb, esp = 0xbfbfe54c, ebp = 0xbfbfe5d8 --- db> If I'me reading this (and nnpfs_vnodeops_common.c) right, this is probably a NULL value for (xn or perhaps vap) in *vap = xn->attr; (line 765) Any thoughts? Or tips on what I can do to help? I don't have gdb ready to go yet---but I probably can this weekend. -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080222/271e8912/attachment.pgp From alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com Fri Feb 22 13:50:52 2008 From: alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com (Alec Kloss) Date: Fri Feb 22 13:50:55 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080222125207.GD38141@hamlet.setfilepointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> Message-ID: <20080222135050.GE38141@hamlet.setfilepointer.com> On 2008-02-22 06:52, wrote: > Robert, I've been playing with your patches, etc. on 8-CURRENT. [chop] I take it back... boldly adding printf all over says: vp->v_mount is null in the NNPFS_FROM_VNODE macro. Adding if (vp->v_mount) return EDOOFUS does: ls: /afs: Programming error Attempting to umount /afs then panics most likely for the same reason (v_mount is null): Fatal trap 12: page fault while in kernel mode cpuid = 0; apic id = 00 fault virtual address = 0x26c fault code = supervisor read, page not present instruction pointer = 0x20:0xc2a26dfc stack pointer = 0x28:0xcd49bb00 frame pointer = 0x28:0xcd49bb2c code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, def32 1, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 5754 (umount) [thread pid 5754 tid 100206 ] Stopped at nnpfs_inactive_common+0xc: movl 0x26c(%eax),%eax db> bt Tracing pid 5754 tid 100206 td 0xc298e220 nnpfs_inactive_common(c2a58440,c298e220,cd49bb54,c0a68485,cd49bb6c,...) at nnpfs_inactive_common+0xc nnpfs_inactive(cd49bb6c,c2a584c8,c2a58440,c2a584c8,cd49bb84,...) at nnpfs_inactive+0x1e VOP_INACTIVE_APV(c2a2b4a0,cd49bb6c,c0afa47c,8fd,c0bd93e0,...) at VOP_INACTIVE_APV+0xa5 vinactive(c2a584c8,0,c0afa47c,86d,c253b880,...) at vinactive+0x91 vrele(c2a58440,c2a2ba70,0,c2a2800b,0,...) at vrele+0x18b nnpfs_free_all_nodes(c2a2b6e0,0,1,c2a58330,c2a2b6e0,...) at nnpfs_free_all_nodes+0xa5 nnpfs_unmount_common(c231329c,8000000,0,c298e220,cd49bc54,...) at nnpfs_unmount_common+0x4e nnpfs_unmount(c231329c,8000000,c298e220,4f0,4da,...) at nnpfs_unmount+0x49 dounmount(c231329c,8000000,c298e220,482,8,...) at dounmount+0x426 unmount(c298e220,cd49bcfc,8,3d90d,c0ba0ed0,...) at unmount+0x2e0 syscall(cd49bd38) at syscall+0x2b3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280c62db, esp = 0xbfbfe4dc, ebp = 0xbfbfe598 --- db> -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080222/3e425fd9/attachment.pgp From rwatson at FreeBSD.org Sat Feb 23 09:28:27 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Sat Feb 23 09:28:33 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080222125207.GD38141@hamlet.setfilepointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> Message-ID: <20080223092516.O23969@fledge.watson.org> On Fri, 22 Feb 2008, Alec Kloss wrote: > Robert, I've been playing with your patches, etc. on 8-CURRENT. I've been > having to tweak up include/config.h a little so I wonder if you missed a few > autoconf things... but more important, running "ls /afs" results in: This is a symptom of a failure to insmntque a vnode after creating it, a new requirement for vnodes in FreeBSD 7.x/8.x; previously, vnodes were automatically inserted on the mount vnode queue and had their mount pointer set up during getnewvnode(), but closing certain races motivated this change. The reason I know this is that I remember adding two calls to insmntque to nnpfs in my patches, so there are three possibilities: (1) I missed a call to getnewvnode, (2) the patches I posted didn't include that change, or (3) the patch didn't apply properly. I'll investigate this later today once I've given my FOSDEM talk; chances are it's an issue with the patch. Robert N M Watson Computer Laboratory University of Cambridge > > nnpfs: cdev: 0, syscall: 339 > > > Fatal trap 12: page fault while in kernel mode > cpuid = 0; apic id = 00 > fault virtual address = 0x26c > fault code = supervisor read, page not present > instruction pointer = 0x20:0xc2a7f1fc > stack pointer = 0x28:0xcd412a40 > frame pointer = 0x28:0xcd412a5c > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, def32 1, gran 1 > processor eflags = interrupt enabled, resume, IOPL = 0 > current process = 4822 (ls) > [thread pid 4822 tid 100176 ] > Stopped at nnpfs_getattr_common+0xc: movl > 0x26c(%eax),%eax > db> bt > Tracing pid 4822 tid 100176 td 0xc2783440 nnpfs_getattr_common(c297b110,cd412ab4,c24f1700,c2783440,cd412aa0,...) at nnpfs_getattr_common+0xc > nnpfs_getattr(cd412aa0,0,c0b10208,cd412b48,cd412b28,...) at nnpfs_getattr+0x33 > VOP_GETATTR_APV(c2a854a0,cd412aa0,c0bd91a0,c297b110,cd412ab4,...) at VOP_GETATTR_APV+0xa5 > vn_stat(c297b110,cd412b48,c24f1700,0,c2783440,...) at vn_stat+0x49 > kern_stat(c2783440,8113138,0,cd412c18,c0c5d140,...) at kern_stat+0x81 > stat(c2783440,cd412cfc,8,cd412d38,c0ba1e60,...) at stat+0x2f > syscall(cd412d38) at syscall+0x2b3 > Xint0x80_syscall() at Xint0x80_syscall+0x20 > --- syscall (188, FreeBSD ELF32, stat), eip = 0x281a3acb, esp = 0xbfbfe54c, ebp = 0xbfbfe5d8 --- > db> > > If I'me reading this (and nnpfs_vnodeops_common.c) right, this is > probably a NULL value for (xn or perhaps vap) in > > *vap = xn->attr; > > (line 765) Any thoughts? Or tips on what I can do to help? I > don't have gdb ready to go yet---but I probably can this weekend. > > -- > Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com > PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E > "No Bunny!" -- Simon, from Frisky Dingo > From alec-keyword-arla.4d43de at SetFilePointer.com Sat Feb 23 10:56:12 2008 From: alec-keyword-arla.4d43de at SetFilePointer.com (Alec Kloss) Date: Sat Feb 23 10:56:15 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080223092516.O23969@fledge.watson.org> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> Message-ID: <20080223102922.GF38141@hamlet.setfilepointer.com> On 2008-02-23 09:28, Robert Watson wrote: > This is a symptom of a failure to insmntque a vnode after creating it, a > new requirement for vnodes in FreeBSD 7.x/8.x; previously, vnodes were > automatically inserted on the mount vnode queue and had their mount pointer > set up during getnewvnode(), but closing certain races motivated this > change. The reason I know this is that I remember adding two calls to > insmntque to nnpfs in my patches, so there are three possibilities: (1) I > missed a call to getnewvnode, (2) the patches I posted didn't include that > change, or (3) the patch didn't apply properly. I'll investigate this > later today once I've given my FOSDEM talk; chances are it's an issue with > the patch. Check. The issue is with configure, etc. include/config.h doesn't have #define HAVE_KERNEL_INSMNTQUE 1 in it. I'll add it to my list of configure-related issues. Recompiling now... -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080223/cc397e0a/attachment.pgp From alec-keyword-arla.4d43de at SetFilePointer.com Sat Feb 23 11:05:50 2008 From: alec-keyword-arla.4d43de at SetFilePointer.com (Alec Kloss) Date: Sat Feb 23 11:05:56 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080223102922.GF38141@hamlet.setfilepointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> Message-ID: <20080223110549.GG38141@hamlet.setfilepointer.com> On 2008-02-23 04:29, Alec wrote: > > #define HAVE_KERNEL_INSMNTQUE 1 > > in it. I'll add it to my list of configure-related issues. > Recompiling now... > oldothello% uname -a FreeBSD oldothello.setfilepointer.com 8.0-CURRENT FreeBSD 8.0-CURRENT #0: Wed Feb 20 13:45:22 CST 2008 root@oldothello.setfilepointer.com:/usr/local/obj/usr/src/sys/GENERIC i386 oldothello% ls /afs andrew.cmu.edu grand.central.org openafs.org athena.mit.edu hallf.kth.se research.company.com cern.ch isk.kth.se rose-hulman.edu deek.org it.kth.se setfilepointer.com dementia.org md.kth.se stacken.kth.se dev.mit.edu mech.kth.se e.kth.se mekinok.com oldothello% Neat! Heimdal gets tokens correctly, access to private directories works. I'm running the arla test suite now; I'm up to hardlink3 with no problems. I did notice that, when umounting /afs, I get a lock order reversal: lock order reversal: 1st 0xc231329c vfslock (vfslock) @ /usr/src/sys/kern/vfs_mount.c:1242 2nd 0xc2dabaf8 syncer (syncer) @ /usr/src/sys/kern/vfs_subr.c:2156 KDB: stack backtrace: db_trace_self_wrapper(c0af1b78,cd4b3b2c,c07a1a6e,c0af3fc2,c2dabaf8,...) at db_trace_self_wrapper+0x26 kdb_backtrace(c0af3fc2,c2dabaf8,c0afad01,c0afad01,c0afa47c,...) at kdb_backtrace+0x29 witness_checkorder(c2dabaf8,9,c0afa47c,86c,c0c16cb4,...) at witness_checkorder+0x6de _lockmgr(c2dabaf8,2002,c2dabb28,c0afa47c,86c,...) at _lockmgr+0x43c vop_stdlock(cd4b3bc4,c0afa47c,c07a1338,2002,c2dabaa0,...) at vop_stdlock+0x39 VOP_LOCK1_APV(c0bb0980,cd4b3bc4,84f,cd4b3be4,c2dabb28,...) at VOP_LOCK1_APV+0xa5 _vn_lock(c2dabaa0,2002,c0afa47c,86c,0,...) at _vn_lock+0xf2 vrele(c2dabaa0,0,c0af9de1,4f0,4da,...) at vrele+0x142 dounmount(c231329c,8000000,c356b000,482,8,...) at dounmount+0x372 unmount(c356b000,cd4b3cfc,8,cd4b3d38,c0ba0ed0,...) at unmount+0x2e0 syscall(cd4b3d38) at syscall+0x2b3 Xint0x80_syscall() at Xint0x80_syscall+0x20 --- syscall (22, FreeBSD ELF32, unmount), eip = 0x280c62db, esp = 0xbfbfe4ec, ebp = 0xbfbfe5a8 --- I see a few other lock order reversals on -CURRENT right now anyway, so I'm not sure if it's cause for concern or even caused by arla. I'm going to move on to trying everything on 7.x. I know there are autoconf/etc. things that need to be fixed. Do you want me to work on that or are you likely to have it done already. I do have a tweaked version of your patch---as I recall it contains just one typo fix---at http://setfilepointer.com/pub/arla/20080218-arla.diff There's also the snapshot of the sources I used: http://setfilepointer.com/pub/arla/arla-20080118.tar.bz2 Assuming I get things working on 7.x, I'll update the port I built later today. :) -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080223/648be9f0/attachment.pgp From alec-keyword-arla.4d43de at SetFilePointer.com Sat Feb 23 16:12:51 2008 From: alec-keyword-arla.4d43de at SetFilePointer.com (Alec Kloss) Date: Sat Feb 23 16:12:58 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080223110549.GG38141@hamlet.setfilepointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> Message-ID: <20080223161249.GH38141@hamlet.setfilepointer.com> Sorry for the chatter... arla makes me excited. :) I've gotten Robert's patches compiled and running under -CURRENT, RELENG_7, and RELENG_6. A FreeBSD port and FreeBSD packages are available at http://setfilepointer.com/pub/afs/FreeBSD/ All of the heavy lifting is done in the big patch at http://setfilepointer.com/pub/arla/20080223-arla.diff This was generated by taking a current snapshot from arla's CVS, applying Robert's original patch, and then adding a handful of fixes of my own. The jist of my changes are autoconf corrections, and one test for NNPFS_DEBUG_PRIV which is undefined on -CURRENT. There's a general autoconf problem running around that a few tests require -Werror to work correctly some can't have -Werror to work correctly. I've run the "-all -fast" tests which don't cause any major issues on RELENG_7 and -CURRENT, but I do seem to be able to panic 6.x with those tests. More testers and feedback would be appreciated. Can anyone from Arla comment on the chances for incorporating these patches into Arla itself? It'd be nice to have these changes in Arla itself prior to submitting the port to FreeBSD. And, can anyone comment on need for the arla port to include 0.43, which works on FreeBSD 5.x? Robert, thanks so much for your time. I owe you (at least) a beer. -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080223/ba94c684/attachment.pgp From rwatson at FreeBSD.org Sat Feb 23 16:21:19 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Sat Feb 23 16:21:23 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080223161249.GH38141@hamlet.setfilepointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> Message-ID: <20080223161816.K45981@fledge.watson.org> On Sat, 23 Feb 2008, Alec Kloss wrote: > All of the heavy lifting is done in the big patch at > > http://setfilepointer.com/pub/arla/20080223-arla.diff > > This was generated by taking a current snapshot from arla's CVS, applying > Robert's original patch, and then adding a handful of fixes of my own. The > jist of my changes are autoconf corrections, and one test for > NNPFS_DEBUG_PRIV which is undefined on -CURRENT. There's a general autoconf > problem running around that a few tests require -Werror to work correctly > some can't have -Werror to work correctly. Sounds great, although PRIV_NNPFS_DEBUG should be defined on the most recent -CURRENT; I added it last week, so if you're running a slightly older -CURRENT, that could be why. I believe I also MFC'd to RELENG_7 but it won't make FreeBSD 7.0. > I've run the "-all -fast" tests which don't cause any major issues on > RELENG_7 and -CURRENT, but I do seem to be able to panic 6.x with those > tests. More testers and feedback would be appreciated. > > Can anyone from Arla comment on the chances for incorporating these patches > into Arla itself? It'd be nice to have these changes in Arla itself prior > to submitting the port to FreeBSD. > > And, can anyone comment on need for the arla port to include 0.43, which > works on FreeBSD 5.x? > > Robert, thanks so much for your time. I owe you (at least) a beer. No problem at all -- this is something I've been meaning to do for years, and I'm very pleased all the pieces are coming together :-). Robert N M Watson Computer Laboratory University of Cambridge From tol at stacken.kth.se Sat Feb 23 17:57:38 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Sat Feb 23 17:57:42 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080223161249.GH38141@hamlet.setfilepointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> Message-ID: <1203788012.4065.10.camel@hippo.t.nxs.se> On Sat, 2008-02-23 at 10:12 -0600, Alec Kloss wrote: > All of the heavy lifting is done in the big patch at > > http://setfilepointer.com/pub/arla/20080223-arla.diff [...] > Can anyone from Arla comment on the chances for incorporating > these patches into Arla itself? It'd be nice to have these changes > in Arla itself prior to submitting the port to FreeBSD. > Chances are good. If it looks ok it goes in. > Robert, thanks so much for your time. I owe you (at least) a beer. Methinks you're worth one too. Thanks for the great work! /t From tol at stacken.kth.se Sun Feb 24 22:56:16 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Sun Feb 24 22:56:20 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <1203788012.4065.10.camel@hippo.t.nxs.se> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> Message-ID: <1203893910.4068.14.camel@hippo.t.nxs.se> I wrote: > On Sat, 2008-02-23 at 10:12 -0600, Alec Kloss wrote: > > All of the heavy lifting is done in the big patch at > > > > http://setfilepointer.com/pub/arla/20080223-arla.diff > [...] > > Can anyone from Arla comment on the chances for incorporating > > these patches into Arla itself? It'd be nice to have these changes > > in Arla itself prior to submitting the port to FreeBSD. > > > Chances are good. If it looks ok it goes in. > Looks mostly ok, but I do have some questions. 1) appl/fs/fs_local.h: would that break `fs nnpfsdeb all`? 2) cf/try-compile-kernel.m4: why do we need /usr/include? It sounds scary given that we may want to compile using random kernel trees. Same goes for nnpfs/freebsd/FreeBSD-Makefile. I don't know much about kernel build magic. 3) cf/bsd-vop-unlock.m4: do we need it? I don't care about older versions of FreeBSD than 6.x; traditionally we try to support latest stable OS-release plus -CURRENT but maybe that's a bit limiting. Perphaps nnpfs_vfs_unlock solves part of the problem? thanks /t From girgen at FreeBSD.org Sun Feb 24 23:43:42 2008 From: girgen at FreeBSD.org (Palle Girgensohn) Date: Sun Feb 24 23:43:45 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080223161816.K45981@fledge.watson.org> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <20080223161816.K45981@fledge.watson.org> Message-ID: <14E75315C9B1A23F5ACFFD46@girgBook.local> I'm delighted to see all this chatter about arla. Any chance we can get a server working as well? I reckon that should, in principle, be easier, since it is not as much kernel involvement, right? But the best bet is OpenAFS, and it is different animal, so the KTH guys are not as deep into this code? /Palle And hi, Rasmus! :-) From alec-keyword-arla.4d43de at SetFilePointer.com Mon Feb 25 00:17:19 2008 From: alec-keyword-arla.4d43de at SetFilePointer.com (Alec Kloss) Date: Mon Feb 25 00:17:23 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <14E75315C9B1A23F5ACFFD46@girgBook.local> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <20080223161816.K45981@fledge.watson.org> <14E75315C9B1A23F5ACFFD46@girgBook.local> Message-ID: <20080225001717.GA28956@hamlet.SetFilePointer.com> On 2008-02-25 00:22, Palle Girgensohn wrote: > I'm delighted to see all this chatter about arla. Any chance we can get a > server working as well? I reckon that should, in principle, be easier, > since it is not as much kernel involvement, right? But the best bet is > OpenAFS, and it is different animal, so the KTH guys are not as deep into > this code? > > /Palle > > And hi, Rasmus! :-) > > Oh, the OpenAFS server has worked on FreeBSD forever, and I run two cells with multiple terabytes of data on FreeBSD only. The OpenAFS param files tend to be out of date but I'm planning on getting on top of that too. There's a port of OpenAFS 1.5.30 I put together available right next to the arla stuff here: http://setfilepointer.com/pub/afs/FreeBSD/ I tend to install the server everywhere I install arla because the vos and bos commands in arla in incomplete compared to their implementation in openafs. I suppose I should nag someone at OpenAFS to include the new param files I made for newer FreeBSDs (not that the new param files are particularly inspired). It'd be great if a few people would comment on this port and then I guess I'll create a PR to get it included in the ports tree at the same time as arla. Sound good? Also, who's writing the FreeBSD wiki? I'm embarrased to tell people to go look at the gentoo documentation for AFS. :) -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080225/6e4983c0/attachment.pgp From hugo at chem.leidenuniv.nl Mon Feb 25 07:09:33 2008 From: hugo at chem.leidenuniv.nl (Hugo Meiland) Date: Mon Feb 25 07:10:32 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225001717.GA28956@hamlet.SetFilePointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <20080223161816.K45981@fledge.watson.org> <14E75315C9B1A23F5ACFFD46@girgBook.local> <20080225001717.GA28956@hamlet.SetFilePointer.com> Message-ID: <47C265BF.5070500@chem.leidenuniv.nl> > > Also, who's writing the FreeBSD wiki? I'm embarrased to tell > people to go look at the gentoo documentation for AFS. :) > > I tried to create afs pages on the wiki twice; but was denied each time.... any change of opening an account to get me writing?? Hugo From rwatson at FreeBSD.org Mon Feb 25 19:59:46 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Mon Feb 25 19:59:51 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <47C265BF.5070500@chem.leidenuniv.nl> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <20080223161816.K45981@fledge.watson.org> <14E75315C9B1A23F5ACFFD46@girgBook.local> <20080225001717.GA28956@hamlet.SetFilePointer.com> <47C265BF.5070500@chem.leidenuniv.nl> Message-ID: <20080225195910.K46736@fledge.watson.org> On Mon, 25 Feb 2008, Hugo Meiland wrote: >> Also, who's writing the FreeBSD wiki? I'm embarrased to tell people to go >> look at the gentoo documentation for AFS. :) > > I tried to create afs pages on the wiki twice; but was denied each time.... > any change of opening an account to get me writing?? Getting you set up shouldn't be a problem at all -- could you e-mail me your wiki.FreeBSD.org username and I'll add you to ContributorsGroup. Robert N M Watson Computer Laboratory University of Cambridge From tol at stacken.kth.se Mon Feb 25 20:19:46 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Mon Feb 25 20:19:51 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225001717.GA28956@hamlet.SetFilePointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <20080223161816.K45981@fledge.watson.org> <14E75315C9B1A23F5ACFFD46@girgBook.local> <20080225001717.GA28956@hamlet.SetFilePointer.com> Message-ID: <1203971022.4063.7.camel@hippo.t.nxs.se> On Sun, 2008-02-24 at 18:17 -0600, Alec Kloss wrote: > I tend to install the server everywhere I install arla because the > vos and bos commands in arla in incomplete compared to their > implementation in openafs. Of course, one solution would be to nag and/or code until they get good enough in arla... Getting another vos subcommand or two to work shouldn't be all that much work. And we all love to complete skeleton patches, don't we :) /t From rwatson at FreeBSD.org Mon Feb 25 21:19:25 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Mon Feb 25 21:19:35 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <1203893910.4068.14.camel@hippo.t.nxs.se> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1203893910.4068.14.camel@hippo.t.nxs.se> Message-ID: <20080225211424.U46736@fledge.watson.org> On Sun, 24 Feb 2008, Tomas Olsson wrote: > I wrote: >> On Sat, 2008-02-23 at 10:12 -0600, Alec Kloss wrote: >>> All of the heavy lifting is done in the big patch at >>> >>> http://setfilepointer.com/pub/arla/20080223-arla.diff >> [...] >>> Can anyone from Arla comment on the chances for incorporating these >>> patches into Arla itself? It'd be nice to have these changes in Arla >>> itself prior to submitting the port to FreeBSD. >>> >> Chances are good. If it looks ok it goes in. >> > Looks mostly ok, but I do have some questions. > > 1) appl/fs/fs_local.h: would that break `fs nnpfsdeb all`? > > 2) cf/try-compile-kernel.m4: why do we need /usr/include? It sounds scary > given that we may want to compile using random kernel trees. Same goes for > nnpfs/freebsd/FreeBSD-Makefile. I don't know much about kernel build magic. > > 3) cf/bsd-vop-unlock.m4: do we need it? I don't care about older versions of > FreeBSD than 6.x; traditionally we try to support latest stable OS-release > plus -CURRENT but maybe that's a bit limiting. Perphaps nnpfs_vfs_unlock > solves part of the problem? Just back from FOSDEM, and am 3-4 days behind on e-mail, so will need to investigate (1) and (2) in a day or two. If I've done (1) correctly then, in practice, it shouldn't change things at all, except that on FreeBSD 7.x and higher, it will use the priv(9) interface to check for privilege rather than suser(9). While there are plans for further privilege semantic changes, the interface change so far is actually a syntactic change -- the policy remains the same, but information about the check is managed differently, hence the change to the interface. This is a precursor to more fine-grained privileges in the kernel. With respect to (2), I need to look at the details, but I believe this has to do with the fact that nnpfs is relying on generated files that may not be present in a kernel source tree. The more right fix may be to force generation of the files (if we can) in the nnpfs build, as we already do for vnode_if.h, but I'll have to look in more detail. With respect to (3) -- that has to do with support for 8-CURRENT, not pre-6.x. It looks like the VFS folks are in the middle of dropping unnecessary thread arguments from various locking interfaces in VFS, including lock/unlock/assert/etc (these will now all be curthread implicitly). I just saw a couple more such changes trickle in today, so I'll probably have some more patches, sadly. Robert N M Watson Computer Laboratory University of Cambridge From alec-keyword-arla.4d43de at SetFilePointer.com Mon Feb 25 22:15:34 2008 From: alec-keyword-arla.4d43de at SetFilePointer.com (Alec Kloss) Date: Mon Feb 25 22:15:38 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225211424.U46736@fledge.watson.org> References: <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1203893910.4068.14.camel@hippo.t.nxs.se> <20080225211424.U46736@fledge.watson.org> Message-ID: <20080225221533.GH28956@hamlet.SetFilePointer.com> First off, I've got a few hours to work on this tomorrow night, so if we could decide on an approach (and Robert can help me with the heavy lifting) before then, that'd be super. On 2008-02-25 21:19, Robert Watson wrote: > On Sun, 24 Feb 2008, Tomas Olsson wrote: > > >Looks mostly ok, but I do have some questions. > > > >1) appl/fs/fs_local.h: would that break `fs nnpfsdeb all`? > > > >2) cf/try-compile-kernel.m4: why do we need /usr/include? It sounds scary > >given that we may want to compile using random kernel trees. Same goes for > >nnpfs/freebsd/FreeBSD-Makefile. I don't know much about kernel build magic. > > > >3) cf/bsd-vop-unlock.m4: do we need it? I don't care about older versions > >of FreeBSD than 6.x; traditionally we try to support latest stable > >OS-release plus -CURRENT but maybe that's a bit limiting. Perphaps > >nnpfs_vfs_unlock solves part of the problem? > > Just back from FOSDEM, and am 3-4 days behind on e-mail, so will need to > investigate (1) and (2) in a day or two. > > If I've done (1) correctly then, in practice, it shouldn't change things at > all, except that on FreeBSD 7.x and higher, it will use the priv(9) > interface to check for privilege rather than suser(9). While there are > plans for further privilege semantic changes, the interface change so far > is actually a syntactic change -- the policy remains the same, but > information about the check is managed differently, hence the change to the > interface. This is a precursor to more fine-grained privileges in the > kernel. I can shed a little light. It's definitely broken now as fs nnpfsdeb almost-all has no effect. I added the check for PRIV_NNPFS_DEBUG in nnpfs_common-bsd.c: +#elif defined(HAVE_KERNEL_PRIV_CHECK) && defined(PRIV_NNPFS_DEBUG) because on my -current box PRIV_NNPFS_DEBUG isn't defined. I thought it might be an OpenBSD-ism. Regardless, I would think it *should* fall back to checking with suser() but apparently it doesn't. I can investigate a bit more, but removing nnpfs_deb.h must have broader impact than we though. Robert, any thoughts about what PRIV_NNPFS_DEBUG should be? > With respect to (2), I need to look at the details, but I believe this has > to do with the fact that nnpfs is relying on generated files that may not > be present in a kernel source tree. The more right fix may be to force > generation of the files (if we can) in the nnpfs build, as we already do > for vnode_if.h, but I'll have to look in more detail. I think this is correct too. Things like machine/endian.h aren't in the kernel tree. I should be able to autoconf this for just FreeBSD if that's how we want to approach this. If you want to have configure generate these headers like vnode_if.h, I'll probably need a few hints, but I'll do what I can. > With respect to (3) -- that has to do with support for 8-CURRENT, not > pre-6.x. It looks like the VFS folks are in the middle of dropping > unnecessary thread arguments from various locking interfaces in VFS, > including lock/unlock/assert/etc (these will now all be curthread > implicitly). I just saw a couple more such changes trickle in today, so > I'll probably have some more patches, sadly. And I added the cf check... I found HAVE_THREE_ARGUMENT_VOP_UNLOCK was undefined in ./nnpfs/bsd/nnpfs_vnodeops-common.c and figured it's smarter to just add the check than assume something about VOP_UNLOCK from the VOP_LOCK macros. -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080225/9b41770b/attachment.pgp From rwatson at FreeBSD.org Mon Feb 25 22:22:26 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Mon Feb 25 22:22:30 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225221533.GH28956@hamlet.SetFilePointer.com> References: <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1203893910.4068.14.camel@hippo.t.nxs.se> <20080225211424.U46736@fledge.watson.org> <20080225221533.GH28956@hamlet.SetFilePointer.com> Message-ID: <20080225221920.A46736@fledge.watson.org> On Mon, 25 Feb 2008, Alec Kloss wrote: > I can shed a little light. It's definitely broken now as fs nnpfsdeb > almost-all has no effect. I added the check for PRIV_NNPFS_DEBUG in > nnpfs_common-bsd.c: > > +#elif defined(HAVE_KERNEL_PRIV_CHECK) && defined(PRIV_NNPFS_DEBUG) > > because on my -current box PRIV_NNPFS_DEBUG isn't defined. I thought it > might be an OpenBSD-ism. Regardless, I would think it *should* fall back to > checking with suser() but apparently it doesn't. I can investigate a bit > more, but removing nnpfs_deb.h must have broader impact than we though. > Robert, any thoughts about what PRIV_NNPFS_DEBUG should be? PRIV_NNPFS_DEBUG is a definition that will appear in FreeBSD 7.1, but 7.0 was already in final freeze when I added it to 8.x + 7.x. The reason I didn't have a specific check for PRIV_NNPFS_DEBUG is that I adapted nnpfs for 8.x, but not 7.0. If priv(9) is present but not PRIV_NNPFS_DEBUG, we should use PRIV_ROOT for now. >> With respect to (2), I need to look at the details, but I believe this has >> to do with the fact that nnpfs is relying on generated files that may not >> be present in a kernel source tree. The more right fix may be to force >> generation of the files (if we can) in the nnpfs build, as we already do >> for vnode_if.h, but I'll have to look in more detail. > > I think this is correct too. Things like machine/endian.h aren't in the > kernel tree. I should be able to autoconf this for just FreeBSD if that's > how we want to approach this. If you want to have configure generate these > headers like vnode_if.h, I'll probably need a few hints, but I'll do what I > can. Indeed, it was machine/endian.h that did it. Robert N M Watson Computer Laboratory University of Cambridge From girgen at FreeBSD.org Tue Feb 26 01:21:07 2008 From: girgen at FreeBSD.org (Palle Girgensohn) Date: Tue Feb 26 01:21:11 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225001717.GA28956@hamlet.SetFilePointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <20080223161816.K45981@fledge.watson.org> <14E75315C9B1A23F5ACFFD46@girgBook.local> <20080225001717.GA28956@hamlet.SetFilePointer.com> Message-ID: <20C9FA49CAF5C2B89F267B11@girgBook.local> --On s?ndag, s? 24 feb 2008 18.17.17 -0600 Alec Kloss wrote: > On 2008-02-25 00:22, Palle Girgensohn wrote: >> I'm delighted to see all this chatter about arla. Any chance we can get >> a server working as well? I reckon that should, in principle, be >> easier, since it is not as much kernel involvement, right? But the best >> bet is OpenAFS, and it is different animal, so the KTH guys are not as >> deep into this code? >> >> /Palle >> >> And hi, Rasmus! :-) >> >> > > Oh, the OpenAFS server has worked on FreeBSD forever, and I run two > cells with multiple terabytes of data on FreeBSD only. The OpenAFS > param files tend to be out of date but I'm planning on getting > on top of that too. There's a port of OpenAFS 1.5.30 I put together > available right next to the arla stuff here: > > http://setfilepointer.com/pub/afs/FreeBSD/ I'll be darned. I'll need to find some time to check it out, I guess! > I tend to install the server everywhere I install arla because the > vos and bos commands in arla in incomplete compared to their > implementation in openafs. I suppose I should nag someone at > OpenAFS to include the new param files I made for newer FreeBSDs > (not that the new param files are particularly inspired). It'd be > great if a few people would comment on this port and then I guess > I'll create a PR to get it included in the ports tree at the same > time as arla. > > Sound good? Cool. Very cool :-) Did you get i working on amd64 as well? Cc me on the PR and you'll get a fast lane into the ports tree. ;-) /Palle From scrappy at hub.org Tue Feb 26 01:56:52 2008 From: scrappy at hub.org (Marc G. Fournier) Date: Tue Feb 26 01:56:57 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080223161249.GH38141@hamlet.setfilepointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> Message-ID: <90334B40754BEDC2991E0147@ganymede.hub.org> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Can we commit these patches to ports itself, maybe with the make file setup so 6.x is marked BROKEN while dealing with the problems there? Might get more testers involved ... ? - --On Saturday, February 23, 2008 10:12:49 -0600 Alec Kloss wrote: > Sorry for the chatter... arla makes me excited. :) > > I've gotten Robert's patches compiled and running under -CURRENT, > RELENG_7, and RELENG_6. A FreeBSD port and FreeBSD packages are > available at > > http://setfilepointer.com/pub/afs/FreeBSD/ > > All of the heavy lifting is done in the big patch at > > http://setfilepointer.com/pub/arla/20080223-arla.diff > > This was generated by taking a current snapshot from arla's CVS, > applying Robert's original patch, and then adding a handful of > fixes of my own. The jist of my changes are autoconf corrections, > and one test for NNPFS_DEBUG_PRIV which is undefined on -CURRENT. > There's a general autoconf problem running around that a few tests > require -Werror to work correctly some can't have -Werror to work > correctly. > > I've run the "-all -fast" tests which don't cause any major issues > on RELENG_7 and -CURRENT, but I do seem to be able to panic 6.x > with those tests. More testers and feedback would be appreciated. > > Can anyone from Arla comment on the chances for incorporating > these patches into Arla itself? It'd be nice to have these changes > in Arla itself prior to submitting the port to FreeBSD. > > And, can anyone comment on need for the arla port to include 0.43, > which works on FreeBSD 5.x? > > Robert, thanks so much for your time. I owe you (at least) a beer. > > -- > Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com > PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E > "No Bunny!" -- Simon, from Frisky Dingo - ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . scrappy@hub.org MSN . scrappy@hub.org Yahoo . yscrappy Skype: hub.org ICQ . 7615664 -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHw2164QvfyHIvDvMRAv9bAJ9vhlUnwGfl/rlfJDOMxDv1Gj0ChACg1HN1 ne4+JXXgSFA2npCFrQQwuJI= =DM+U -----END PGP SIGNATURE----- From gad at FreeBSD.org Tue Feb 26 04:28:09 2008 From: gad at FreeBSD.org (Garance A Drosehn) Date: Tue Feb 26 04:28:12 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <90334B40754BEDC2991E0147@ganymede.hub.org> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <90334B40754BEDC2991E0147@ganymede.hub.org> Message-ID: At 9:38 PM -0400 2/25/08, Marc G. Fournier wrote: >-----BEGIN PGP SIGNED MESSAGE----- >Hash: SHA1 > >Can we commit these patches to ports itself, maybe with the make >file setup so 6.x is marked BROKEN while dealing with the problems >there? Might get more testers involved ... ? Or create a new port, "arla8", or "arla-dev". -- Garance Alistair Drosehn = drosehn@rpi.edu Senior Systems Programmer or gad@FreeBSD.org Rensselaer Polytechnic Institute; Troy, NY; USA From alec-keyword-arla.4d43de at SetFilePointer.com Tue Feb 26 06:11:41 2008 From: alec-keyword-arla.4d43de at SetFilePointer.com (Alec Kloss) Date: Tue Feb 26 06:11:42 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <90334B40754BEDC2991E0147@ganymede.hub.org> Message-ID: <20080226061140.GI28956@hamlet.SetFilePointer.com> On 2008-02-25 22:23, Garance A Drosehn wrote: > At 9:38 PM -0400 2/25/08, Marc G. Fournier wrote: > >-----BEGIN PGP SIGNED MESSAGE----- > >Hash: SHA1 > > > >Can we commit these patches to ports itself, maybe with the make > >file setup so 6.x is marked BROKEN while dealing with the problems > >there? Might get more testers involved ... ? > > Or create a new port, "arla8", or "arla-dev". To the best of my knowledge, the port I made (http;//setfilepointer.com/pub/afs/FreeBSD) works for 6.3, 7.0 and -current, except maybe for changes in the last few days in -current which may have broken the port. If there's sufficient interest, I'll add 5.x support (via arla 0.43) to the port as well, but I was hoping to avoid that, as it's a lot of overhead and arla's newish block-by-block cache (thanks Thomas) which isn't available in arla 0.43 makes arla highly competitive with the OpenAFS client available elsewhere. As for getting the port into the ports tree, I think everyone's all for it, but Thomas is volunteering to help merge our patch into the arla sources which I'd prefer over maintaining a jumbo patch like what we have now. I'm optimistic that we can probably have everything ready by/after the weekend. So, please do test the port, and whine at me and/or Robert about issues with it. I'm trying to shelter him from the details as long as he shelters me from VFS. :) -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080226/7dfe8b26/attachment.pgp From tol at stacken.kth.se Tue Feb 26 06:40:50 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Tue Feb 26 06:40:53 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225211424.U46736@fledge.watson.org> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1203893910.4068.14.camel@hippo.t.nxs.se> <20080225211424.U46736@fledge.watson.org> Message-ID: <1204008010.4017.6.camel@hippo.t.nxs.se> On Mon, 2008-02-25 at 21:19 +0000, Robert Watson wrote: > On Sun, 24 Feb 2008, Tomas Olsson wrote: > > 1) appl/fs/fs_local.h: would that break `fs nnpfsdeb all`? > > [...] > If I've done (1) correctly then, in practice, it shouldn't change things at > all, except that on FreeBSD 7.x and higher, it will use the priv(9) interface > to check for privilege rather than suser(9). While there are plans for > further privilege semantic changes, the interface change so far is actually a > syntactic change -- the policy remains the same, but information about the > check is managed differently, hence the change to the interface. This is a > precursor to more fine-grained privileges in the kernel. > Actually, I was thinking of the userland side; I do hope fs_local.h isn't included in the kernel things. fs_nnpfsdebug.c seems to rely on HAVE_XDEBDEV etc, but perhaps that should be changed anyway. /t From tol at stacken.kth.se Tue Feb 26 21:42:49 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Tue Feb 26 21:42:54 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225221920.A46736@fledge.watson.org> References: <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1203893910.4068.14.camel@hippo.t.nxs.se> <20080225211424.U46736@fledge.watson.org> <20080225221533.GH28956@hamlet.SetFilePointer.com> <20080225221920.A46736@fledge.watson.org> Message-ID: <1204062204.4007.7.camel@hippo.t.nxs.se> On Mon, 2008-02-25 at 22:22 +0000, Robert Watson wrote: > On Mon, 25 Feb 2008, Alec Kloss wrote: > > I think this is correct too. Things like machine/endian.h aren't in the > > kernel tree. I should be able to autoconf this for just FreeBSD if that's > > how we want to approach this. If you want to have configure generate these > > headers like vnode_if.h, I'll probably need a few hints, but I'll do what I > > can. > > Indeed, it was machine/endian.h that did it. > What do we need it for? /t From tol at stacken.kth.se Tue Feb 26 22:29:41 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Tue Feb 26 22:29:46 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <1203788012.4065.10.camel@hippo.t.nxs.se> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> Message-ID: <1204065013.4007.17.camel@hippo.t.nxs.se> On Sat, 2008-02-23 at 18:33 +0100, I wrote: > On Sat, 2008-02-23 at 10:12 -0600, Alec Kloss wrote: > > All of the heavy lifting is done in the big patch at > > > > http://setfilepointer.com/pub/arla/20080223-arla.diff > [...] > > Can anyone from Arla comment on the chances for incorporating > > these patches into Arla itself? It'd be nice to have these changes > > in Arla itself prior to submitting the port to FreeBSD. > > > Chances are good. If it looks ok it goes in. Ok, most of it is in. Still missing is fs_local.h and the include path things, until I can figure out what I want. Feel free to help me :) thanks /t (ought to set up some test boxes) From hugo at chem.leidenuniv.nl Tue Feb 26 22:38:27 2008 From: hugo at chem.leidenuniv.nl (Hugo Meiland) Date: Tue Feb 26 22:38:30 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080225001717.GA28956@hamlet.SetFilePointer.com> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <20080223161816.K45981@fledge.watson.org> <14E75315C9B1A23F5ACFFD46@girgBook.local> <20080225001717.GA28956@hamlet.SetFilePointer.com> Message-ID: <47C494D6.7040203@chem.leidenuniv.nl> > Also, who's writing the FreeBSD wiki? I'm embarrased to tell > people to go look at the gentoo documentation for AFS. :) > > First draft is at http://wiki.freebsd.org/afs , includes small intro and howto for alec's port on FreeBSD-7.0-RC3.... still needs a link from the frontpage though.... Hugo Meiland From alec-dated-1204500068.19bc63 at SetFilePointer.com Tue Feb 26 23:47:50 2008 From: alec-dated-1204500068.19bc63 at SetFilePointer.com (Alec Kloss) Date: Tue Feb 26 23:47:53 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <1204065013.4007.17.camel@hippo.t.nxs.se> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1204065013.4007.17.camel@hippo.t.nxs.se> Message-ID: <20080226232108.GL28956@hamlet.SetFilePointer.com> On 2008-02-26 23:30, Tomas Olsson wrote: > Ok, most of it is in. Still missing is fs_local.h and the include path > things, until I can figure out what I want. Feel free to help me :) > > thanks K. Tonight's not looking so good anymore for arla time :(. Thursday night should work though. -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080226/e8d12c2b/attachment.pgp From rwatson at FreeBSD.org Wed Feb 27 00:16:00 2008 From: rwatson at FreeBSD.org (Robert Watson) Date: Wed Feb 27 00:16:05 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <1204065013.4007.17.camel@hippo.t.nxs.se> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1204065013.4007.17.camel@hippo.t.nxs.se> Message-ID: <20080227001442.M19847@fledge.watson.org> On Tue, 26 Feb 2008, Tomas Olsson wrote: > On Sat, 2008-02-23 at 18:33 +0100, I wrote: >> On Sat, 2008-02-23 at 10:12 -0600, Alec Kloss wrote: >>> All of the heavy lifting is done in the big patch at >>> >>> http://setfilepointer.com/pub/arla/20080223-arla.diff >> [...] >>> Can anyone from Arla comment on the chances for incorporating these >>> patches into Arla itself? It'd be nice to have these changes in Arla >>> itself prior to submitting the port to FreeBSD. >>> >> Chances are good. If it looks ok it goes in. > > Ok, most of it is in. Still missing is fs_local.h and the include path > things, until I can figure out what I want. Feel free to help me :) The fs_local.h change was to address this: Making all in fs gcc -DHAVE_CONFIG_H -I. -I../../include -I../../include -I/usr/local/include -I./../../include -I/usr/local/include -I./../.. -I./../lib -I../../include -I/usr/local/include -I../../rxdef -I. -I./../../nnpfs/include -I./../../arlad -I./../../rxkad -I/usr/local/include -DINET6 -g -Wall -Wmissing-prototypes -Wpointer-arith -Wmissing-declarations -Wnested-externs -c -o fs-fs.o `test -f 'fs.c' || echo './'`fs.c In file included from fs.c:34: fs_local.h:46:29: error: nnpfs/nnpfs_deb.h: No such file or directory *** Error code 1 The underlying problem is presumably an include path issue, but since nnpfs_deb.h wasn't required anyway by fs.c, removing the include seemed the simplest solution and didn't appear to cause any other problems. Robert N M Watson Computer Laboratory University of Cambridge From tol at stacken.kth.se Wed Feb 27 22:34:09 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Wed Feb 27 22:34:16 2008 Subject: Patches to get Arla running on FreeBSD 8-CURRENT In-Reply-To: <20080227001442.M19847@fledge.watson.org> References: <20080216035658.W93919@fledge.watson.org> <1203286882.16414.3.camel@heterodyne.kaj> <20080218012608.V96329@fledge.watson.org> <20080222125207.GD38141@hamlet.setfilepointer.com> <20080223092516.O23969@fledge.watson.org> <20080223102922.GF38141@hamlet.setfilepointer.com> <20080223110549.GG38141@hamlet.setfilepointer.com> <20080223161249.GH38141@hamlet.setfilepointer.com> <1203788012.4065.10.camel@hippo.t.nxs.se> <1204065013.4007.17.camel@hippo.t.nxs.se> <20080227001442.M19847@fledge.watson.org> Message-ID: <1204151807.4068.8.camel@hippo.t.nxs.se> On Wed, 2008-02-27 at 00:15 +0000, Robert Watson wrote: > The fs_local.h change was to address this: > > Making all in fs > gcc -DHAVE_CONFIG_H -I. -I../../include -I../../include -I/usr/local/include > -I./../../include -I/usr/local/include -I./../.. -I./../lib > -I../../include -I/usr/local/include -I../../rxdef -I. > -I./../../nnpfs/include -I./../../arlad -I./../../rxkad > -I/usr/local/include -DINET6 -g -Wall -Wmissing-prototypes -Wpointer-arith > -Wmissing-declarations -Wnested-externs -c -o fs-fs.o `test -f 'fs.c' || echo > './'`fs.c Hm. What happened to $(KERNEL_INCLUDE)? > The underlying problem is presumably an include path issue, but since > nnpfs_deb.h wasn't required anyway by fs.c, removing the include seemed the > simplest solution and didn't appear to cause any other problems. I may be wrong here, but to me it looks like 'fs nnpfsdebug all' etc will always send a zero mask to kernel with the proposed patch. I tend to use that command... thanks /t From alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com Fri Feb 29 04:17:08 2008 From: alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com (Alec Kloss) Date: Fri Feb 29 04:17:11 2008 Subject: PERFORCE change 136345 for review (fwd) In-Reply-To: <20080227115148.W61020@fledge.watson.org> References: <20080227115148.W61020@fledge.watson.org> Message-ID: <20080229041706.GA67238@hamlet.SetFilePointer.com> On 2008-02-27 11:54, Robert Watson wrote: > > Tomas, > > Following a CVS update from the Arla anoncvs, I needed the attached patch > to build on FreeBSD. I still have the following further local changes in > my tree still: > > - Remove nnpfs_deb.h include from fs_local.h. > > - Add /usr/include to various paths so that machine/whatever.h includes > properly. > > - #ifdef NNPFS_DEBUG around local variables in nnpfs_lk_info to avoid unused > variables warning/error. I've been playing with this some tonight. My current thought about dealing with the "machine/whatever.h" includes is to copy the pertinent headers out of the kernel sources (via $SYS) at the same time configure generates vnode_if.h. Any thoughts about that approach? It's kinda unfortunate that these headers aren't inside a machine/ directory in /sys; then we could -I these directly from /sys. Does anyone have any idea how this used to work? I haven't loked at the NNPFS_DEBUG related issues yet, but I will. -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080229/efc1d30f/attachment.pgp From alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com Fri Feb 29 05:02:23 2008 From: alec-keyword-freebsd.org.a6e2e4 at SetFilePointer.com (Alec Kloss) Date: Fri Feb 29 05:02:26 2008 Subject: PERFORCE change 136345 for review (fwd) In-Reply-To: <20080229041706.GA67238@hamlet.SetFilePointer.com> References: <20080227115148.W61020@fledge.watson.org> <20080229041706.GA67238@hamlet.SetFilePointer.com> Message-ID: <20080229050221.GB67238@hamlet.SetFilePointer.com> On 2008-02-28 22:17, wrote: > On 2008-02-27 11:54, Robert Watson wrote: > > > > Tomas, > > > > Following a CVS update from the Arla anoncvs, I needed the attached patch > > to build on FreeBSD. I still have the following further local changes in > > my tree still: > > > > - Remove nnpfs_deb.h include from fs_local.h. > > > > - Add /usr/include to various paths so that machine/whatever.h includes > > properly. > > > > - #ifdef NNPFS_DEBUG around local variables in nnpfs_lk_info to avoid unused > > variables warning/error. > > I've been playing with this some tonight. My current thought about > dealing with the "machine/whatever.h" includes is to copy the > pertinent headers out of the kernel sources (via $SYS) at the same > time configure generates vnode_if.h. Any thoughts about that > approach? It's kinda unfortunate that these headers aren't inside > a machine/ directory in /sys; then we could -I these directly from > /sys. Does anyone have any idea how this used to work? > > I haven't loked at the NNPFS_DEBUG related issues yet, but I will. Hrm. I didn't have any problems building arla on -CURRENT after creating my machine/ hack. I suppose a symlink would be more appropriate than a copy for that. Robert, did you need your other changes to get Arla to compile, or were there just warnings you were itching to fix? It's time to shovel snow, but I'll be back at this tomorrow evening. If we can come to an agreement on the machine includes and the nnpfs_debug stuff, tomorrow night I should be able to implement whatever we decide on and update the ports accordingly. After that, I guess it's send-pr time for arla and the ports maintainers. :) (Oh yeah, my change is just this: oldothello% diff -u cf/*.orig cf/bsd-header-vnode-if-h.m4 --- cf/bsd-header-vnode-if-h.m4.orig 2008-02-28 23:01:01.000000000 -0600 +++ cf/bsd-header-vnode-if-h.m4 2008-02-28 22:42:32.000000000 -0600 @@ -25,6 +25,7 @@ awk -f $SYS/tools/vnode_if.awk $SYS/kern/vnode_if.src -h awk -f $SYS/tools/vnode_if.awk $SYS/kern/vnode_if.src -p awk -f $SYS/tools/vnode_if.awk $SYS/kern/vnode_if.src -q + ln -sf $SYS/$(uname -m)/include machine else AC_MSG_ERROR(unable to find any vnode_if script) fi oldothello% ) -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080229/f30f612c/attachment.pgp From tol at stacken.kth.se Fri Feb 29 07:08:37 2008 From: tol at stacken.kth.se (Tomas Olsson) Date: Fri Feb 29 07:08:41 2008 Subject: PERFORCE change 136345 for review (fwd) In-Reply-To: <20080229050221.GB67238@hamlet.SetFilePointer.com> References: <20080227115148.W61020@fledge.watson.org> <20080229041706.GA67238@hamlet.SetFilePointer.com> <20080229050221.GB67238@hamlet.SetFilePointer.com> Message-ID: <1204268915.4369.13.camel@hippo.t.nxs.se> On Thu, 2008-02-28 at 23:02 -0600, Alec Kloss wrote: > +++ cf/bsd-header-vnode-if-h.m4 2008-02-28 22:42:32.000000000 -0600 > @@ -25,6 +25,7 @@ > awk -f $SYS/tools/vnode_if.awk $SYS/kern/vnode_if.src -h > awk -f $SYS/tools/vnode_if.awk $SYS/kern/vnode_if.src -p > awk -f $SYS/tools/vnode_if.awk $SYS/kern/vnode_if.src -q > + ln -sf $SYS/$(uname -m)/include machine > else > AC_MSG_ERROR(unable to find any vnode_if script) > fi Good idea, maybe an odd place to put it -- unexpected side effect given the file/macro name. On the other hand, I have no idea where I would put it. The beautiful long term solution may be adding some kind of lightweight 'generate headers' target for the kernel build so external projects don't need to reinvent the wheel? Or maybe arla is just a very strange one. NNPFS_DEBUG is (hopefully) taken care of. /t From alec-dated-1204721446.ad1d16 at SetFilePointer.com Fri Feb 29 13:17:29 2008 From: alec-dated-1204721446.ad1d16 at SetFilePointer.com (Alec Kloss) Date: Fri Feb 29 13:17:44 2008 Subject: PERFORCE change 136345 for review (fwd) In-Reply-To: <1204268915.4369.13.camel@hippo.t.nxs.se> References: <20080227115148.W61020@fledge.watson.org> <20080229041706.GA67238@hamlet.SetFilePointer.com> <20080229050221.GB67238@hamlet.SetFilePointer.com> <1204268915.4369.13.camel@hippo.t.nxs.se> Message-ID: <20080229125045.GC67238@hamlet.SetFilePointer.com> On 2008-02-29 08:08, Tomas Olsson wrote: > Good idea, maybe an odd place to put it -- unexpected side effect given > the file/macro name. On the other hand, I have no idea where I would put > it. Putting it next to vnode_if.h seems to make sense. Having vnode_if.h where it is in arla seems a little odd. I guess I'd consider moving both down to somewhere like nnpfs/sys or nnpfs/kernel or something. But that's all pretty much just cosmetics. > The beautiful long term solution may be adding some kind of lightweight > 'generate headers' target for the kernel build so external projects > don't need to reinvent the wheel? Or maybe arla is just a very strange > one. Yeah, glancing at the kernel build itself, there's bold symlink just like what I did; lrwxr-xr-x 1 root wheel 25 Jan 25 18:43 machine -> /usr/src/sys/i386/include It would be nice if either the kernel sources would have /usr/src/sys/i386/machine or /usr/src/sys/i386/include/machine instead of ending in include *or* as you suggest a make-kernel-headers in the kernel itself would be nice and it could do the symlinking, vnode_if.awk'ing, etc. for people. But if this works for you, and Robert doesn't object, let's go with it. Robert, any thoughts? And do you want me to take a whack at merging nnpfs into the kernel build this weekend? I'd be jumping right into the deep end, but that's how you learn to swim, right? -- Alec Kloss alec@SetFilePointer.com IM: angryspamhater@yahoo.com PGP key at http://pgp.mit.edu:11371/pks/lookup?op=get&search=0xA241980E "No Bunny!" -- Simon, from Frisky Dingo -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: not available Url : http://lists.freebsd.org/pipermail/freebsd-afs/attachments/20080229/3acc32a8/attachment.pgp