1.port new lustre_lcfg structure from b1_4 to HEAD
2.some fix on test scripts for WB cache

 - clean more files at clean time

 * remote uid/gid handling
 * various gss fixes
 * fix broken local ACL

that is unsigned long too.
- expanding all ->valid fields to 64bit, as it is exhaused and there is no free bits.

 - add a flag in lustre_msg which indicate message type
 - add a security descriptor into most of messages send to MDSs, which
   include the uid, supplementary groups array etc.
 - add group hash
 - MDS retrive local groups database through upcall, and set/merge with
   which sent from client based on policies (here not totally finished)
 - move root_squash test into separate sanity-sec.sh

r=adilger

 - obd_connect() gets one more arg: connect flags
 - client_connect_import() puts this flag in imp_connect_flags
 - ptlrpc_connect_import() sends this flag to peer
 - mds_lmv_connect() passes OBD_OPT_MDS_CONNECTION when connects to MDS
 - mds_connect() looks for OBD_OPT_MDS_CONNECTION and treats
   connection with this flag as MDS-to-MDS and doesn't try
   to connect to own LMV

 this way connection to LMV gets delayed and MDS reconnects to LMV
 after recovery abort

Handle server recovery in a new thread, instead of tying up request
processing threads. Centralizes the recovery management, including the
abort recovery checking.

- b1_4 is basically the parent of HEAD, because that's the direction
  that changes flow, as strange as that sounds.  so there's a
  HEAD_BASE tag which sits on b1_4

b_cmobd_merge should not be used for any further development or testing!

cMD_PRE_CMD_SMASH are the relevant tags.

The pre-smashing contents of HEAD will be committed by yury into b_cmd as a
merge of the two branches.  These will be stabilized on b_cmd and eventually
landed onto HEAD.

b=2912/2922, b=3145 too

b=3116, b=3064, b=3107, b=3122, b=1519, 2.6 kernel fixes, group lock fixes

b=3057, 2947, 2925, 3050, 3041, 2849, 1662

r=phil

land b_cray_portals_merge on HEAD.  This consists of four families of changes:

1) Eric's work to change some APIs in Lustre's portals to come into line with
   Cray's portals and the spec.

2) add --with-cray-portals= to the build and use it to cut up the build
   when we're building lustre against external includes for Cray's portals.

3) Move some facilities from portals.o into libcfs.o so that Lustre can
   consume them when it is running against Cray's portals.o.

4) Fix up the liblustre build.  These changes have also made it to
   b_cray_delivery recently.

The principal change here is ptlrpc_connect_import and recovery are
merged and are now asynchronous and are run on ptlrpcd.

This branch also includes fixes for

  2477 (this was the initial bug)

  2355 recover for initial connections

  1934 (b_1934 was merged directly to b_recovery)

  1901 block all file creations until orphan recovery completes

  2423 client remove rq_connection from request struct

  2640 conf-sanity test_5, and proper cleanup in umount when
       cleanup log is not availale.

  2670 recovery timer race

  2532 mdc_close recovey bug

And few others that werent' filed.

have cascading failures.  Server bulk timeout is 1/4 of the client timeout.
Also fix /proc variables to be int, as that is what the functions expect.
b=1845

 - dozens and dozens of fixes for working with 2.6 kernels
 - new 2.4 kernel APIs
 - uncountable bug fixes

- remove extN/ files

- client-side I/O cache
- O_DIRECT fixes for IA64
- liblustre improvements
- various small bug fixes

* bug fixes
 - Fix ldlm_lock_match on the MDS to avoid matching remote locks (592)
 - Fix fsfilt_extN_readpage() to read a full page of directory
   entries, or fake the remainder if PAGE_SIZE != blocksize (500)
 - Avoid extra mdc_getattr() in ll_intent_lock when possible (534, 604)
 - Fix imbalanced LOV object allocation and out-of-bound access (469)
 - Most intent operations were removed, in favour of a new RPC mode
   that does a single RPC to the server and bypasses most of the VFS
 - All LDLM resource ID arrays were removed in favour of ldlm_res_id
 - Aggressively cancel local locks on DLM servers
 - mds_reint_unlink sends EA to the client if it's the last nlink.
   client uses that EA to unlink OST objects.
 - mds_reint_{rename,unlink,link} were rewritten to take ordered locks
 - recursive symlinks were fixed (440)
 - fixed NULL deref in DEBUG_REQ
 - filter_update_lastobjid no longer calls sync, which annoyed extN
 - fixed multi-client small-writes to a single file problem (445)
 - fixed mtime updates during file writes (607)
 - fixed vector writes on obdfilter causing problems when ENOSPC (670)
 - fixed bug in obd_brw_read/write() (under guise of testing 367)
 - fixed Linux OST size reporting problem (444, 656)
 - OST now updates object mtime with writes or setattr (607, 619)
 - client verifies file size before zeroing page past EOF (445)
 - OST now writes last allocated objid to disk with allocation (108)
 - LOV on echo now works (409)
 * protocol changes
 - mds_reint_unlink sends a new buffer, with the EA included.  this
   buffer is only valid if body->valid & OBD_MD_FLEASIZE, which is only
   set if a regular file was being unlinked, and it was the last link
 - use PtlGet from the target for bulk writes (315)
 - OST now updates object mtime with writes or setattr (607, 619)
 - LDLM now has a grant-time callback to revalidate locked items, if
   necessary (604)
 - Many MDS operations were reorganized to combat race conditions
* other changes
 - Merge b_intel branch (updated lprocfs code) - now at /proc/fs/lustre
 - configure check to avoid gcc version 2.96 20000731-2.96-98 (606)

Fixes a _huge_ number of bugs:
  - Fully reactivate OST imports after reconnection (512, others)
  - Make sure client sees our -ENOTCONN from mds_handle (513 - partial)
  - More graceful error handling for truncating on dead OST (515)
  - Don't error out unless we're actually accessing dead stripes (474)
  - Fix garbage sizes when stripes are missing (410)
  - LRU counters were broken, causing constant lock purge (433, 432)
  - garbage on read from stripes with failed OSTs (441)
  - mark OSCs as active before reconnecting during recovery (438)
  - lov_enqueue and lov_cancel need to handle inactive OSTs (403)
  - lfind did not preserve OST order in output (443)
  - symlinks cause hung clients, incorrect data (439)
  - stop dereferencing request after dropping refcount (457)
  - don't LASSERT(spin_is_locked) on non-SMP (455)
  - fixes for many rename() bugs
  - fstat didn't correctly synchronize attributes (399)
  - server must handle lock cancellation during blocking AST prep (487)
  - bulk descriptors were free()d too soon (511)
  - fix paths in lconf, which would load incorrect modules (451, 507)
  - fix confusing lconf 'host not found' error message (386)
  - fix lock order deadlock on OST (O/R i_sem before journal ops, 478)
  - fix race condition in mdc_blocking_ast() for inode access (526)
  - fix lov_unpackmd() unpacking wrong number of stripes (537)
  - fix lov_set_osc_active() marking wrong OSC inactive (440)
  - fix bad lstripe lov_unpackmd() assertion (fix layering too) (527)
  - fix multiple writes of stripe MD to MDS (358, maybe 519)
  - fix lstripe in several ways (kernel side) (527)
  - fix request leak in ldlm_cli_enqueue (262)
  - incorrect OSC was marked inactive after OST failure
  - call mds_fs_cleanup before unmounting filesystem (524)
  - fix races between taking ns_lock and ldlm_lock_change_resource
  - fix races updating LOV export open file list
  - fix lov_enqueue error path, avoid decref-ing bad lock handle
  - fix recovery NULL deref in ldlm_cli_cancel_unused
  - fix some DLM races by using new hash table for lock handles (419)
  - permit the client to specify desired inodes, at replay
  - duplicate requests when we queue them for replay reintegration
  - fix last_rcvd offset calculation
  - sync after each recovered transaction, so we always make progress
  - never, not always, ERESTART requests without transnos
  - store the lov_desc in the MDS, so we don't depend on getlovinfo to set it
  - skip replay if the MDS says that the client is already connected
  - don't check for a recovery-enabled export to match lctl's UUID
  - don't INC_USE_COUNT for phantom exports
  - don't crash when cleaning up phantom exports (567)
  - don't double-finish or set replay data for errored mdc_open requests
  - abort requests when they time out, so we don't get old replies
  - send/receive replies for AST messages again
  - if the client says that it doesn't have the lock, cancel it on the server
  - if we timeout during I/O, don't try to cancel an in-use lock; instead
    mark it as destroyed, it will all work out when decref is called
  - fix module use counts (22, 581)
 * protocol changes
  - ASTs now expect a reply (server cancels lock on error reply)