Removal of old/outdated files from www.FreeBSD.org site

[Glen Barber]

On Sat, Jul 28, 2012 at 10:14:11PM +0100, Simon L. B. Nielsen wrote:
> As a reference, the build script is at:
> http://svnweb.freebsd.org/doc/head/share/tools/webupdate
> 
> So anyone wanting to try and fix that can start reading that. The
> simple brute force solution would e.g. be a weekly install to a
> separate dir and then check which files should not be in the dir
> we serve www.freebsd.org off.
> 

Or, we can force a reinstall regardless of mtime.

> Another solution might be to make the weekly full build install
> to a different dir and switch the clean and the old dir... but I
> slightly worry that any error in the script will result in no content
> on www.

Agreed.

> > I will look into this for a permanent solution then.  It is
> > difficult to spot unless local changes are made though.  But, 'make
> > clean' followed by 'svn stat' will reveal these edge cases.
> 
> Hmm, how is it difficult to spot? A build of a document should
> never ever produce an xNNNNN.html file. If it does, a sect1 is
> missing an id.
> 
> Or am I missing something here?
> 

They are edge-cases.  A few of which have taken me a few days to track
the cause.

It is not necessarily a problem with the build scripts, etc., but
changes are that introduced as a result of workflow.  I am still unsure
of the exact chain of events that causes the duplicate, yet
differently-named files, but it seems to follow in this pattern:

 o make changes to a chapter, rebuild the doc tree
 o make changes to a different section, rebuild the tree
 o run 'make clean', and xNNNN.html file from first change is not
   removed

It has been highly inconsistently reproducible for me.

Again, I am not saying there is a problem.  I just want to avoid users
finding outdated/wrong/bad/evil information from N years ago that would
do very bad things to a system today.

Glen

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 488 bytes
Desc: not available
Url : http://lists.freebsd.org/pipermail/freebsd-www/attachments/20120729/e8cf6fdd/attachment.pgp