b_cmobd_merge should not be used for any further development or testing!

cMD_PRE_CMD_SMASH are the relevant tags.

The pre-smashing contents of HEAD will be committed by yury into b_cmd as a
merge of the two branches.  These will be stabilized on b_cmd and eventually
landed onto HEAD.

b=2094, b=3138, b=3335, b=3274, b=3293, b=2862, b=3147, b=2350, b=3313
b=3265, b=3315, b=3301, b=3325, b=3329, b=3125, b=3098

b=3284, b=3285, b=3043, b=3236, revert liblustre group changes

 - use real uid/gid instead of simply be as root
 - set group info
 - set capability info

b=3043, b=3258, b=3219, b=2410

b=2912/2922, b=3145 too

b=3116, b=3064, b=3107, b=3122, b=1519, 2.6 kernel fixes, group lock fixes

b=3057, 2947, 2925, 3050, 3041, 2849, 1662

b=2947, b=2543, b=1557, b=2009

b=2733, b=2773, b=2529, b=2730, b=2819, b=2814, b=2822, b=1450, b=2676, b=2681
b=2817, b=2706, b=2816, b=1987, b=2884, b=1191, b=2809, b=2765, b=2805, b=1972

*  Fixed obdecho persistent object size at 1 MByte.

*  Changed test_brw data verification tests to work on a fixed 4k block
   rather than on page size to allow different page sized servers and
   clients.

land b_size on HEAD for 1.2

Adds support for client-side write cache accounting via OST write credits
(grants).  There is not yet a "correction" algorithm for grants if they
get out of sync between the client and OST (OST can handle clients who think
they have grant but do not).  Peter had previously suggested that grants
should decay over time (faster on the clients than on the OSTs) so idle
nodes do not consume space they aren't using.

Use /proc/fs/lustre/osc/OSC*/cur_grant_bytes (and existing cur_dirty_bytes)
to check client-side cache values.

Includes lustre-side changes for lfsck support (create files with
specific objids, create specific objids on OSTs).

Also includes some changes to the testing scripts (local.sh, lov.sh, acc-sm)
so that they include a "client nid '*'" client and can be used for sanityN.sh
testing.  This has been put into the main acceptance-small.sh loop so that
sanityN.sh will be run on both single and multi-OST setups.

b=974 b=2349
r=shaver

The principal change here is ptlrpc_connect_import and recovery are
merged and are now asynchronous and are run on ptlrpcd.

This branch also includes fixes for

  2477 (this was the initial bug)

  2355 recover for initial connections

  1934 (b_1934 was merged directly to b_recovery)

  1901 block all file creations until orphan recovery completes

  2423 client remove rq_connection from request struct

  2640 conf-sanity test_5, and proper cleanup in umount when
       cleanup log is not availale.

  2670 recovery timer race

  2532 mdc_close recovey bug

And few others that werent' filed.

In the echo_client's prep/commit test ioo_bufcnt could be out of
sync with the npages given to obd_{prep,commit}rw.

Approved by Andreas Dilger.

Fix for bug 974, Also adds a test to check for OOM (modified script from
bug 1135), fixes to sanity.sh's test 45 to obtain a grant (closes 2387).

r=eeb
This patch fixes the LBUG by clearing the bits that indicate that the
OST/echo_server is sending valid cache grant information.

Li Zongliang tested this patch but was unable to check it in.

 - dozens and dozens of fixes for working with 2.6 kernels
 - new 2.4 kernel APIs
 - uncountable bug fixes

- remove extN/ files

- client-side I/O cache
- O_DIRECT fixes for IA64
- liblustre improvements
- various small bug fixes

* bug fixes
 - Fix ldlm_lock_match on the MDS to avoid matching remote locks (592)
 - Fix fsfilt_extN_readpage() to read a full page of directory
   entries, or fake the remainder if PAGE_SIZE != blocksize (500)
 - Avoid extra mdc_getattr() in ll_intent_lock when possible (534, 604)
 - Fix imbalanced LOV object allocation and out-of-bound access (469)
 - Most intent operations were removed, in favour of a new RPC mode
   that does a single RPC to the server and bypasses most of the VFS
 - All LDLM resource ID arrays were removed in favour of ldlm_res_id
 - Aggressively cancel local locks on DLM servers
 - mds_reint_unlink sends EA to the client if it's the last nlink.
   client uses that EA to unlink OST objects.
 - mds_reint_{rename,unlink,link} were rewritten to take ordered locks
 - recursive symlinks were fixed (440)
 - fixed NULL deref in DEBUG_REQ
 - filter_update_lastobjid no longer calls sync, which annoyed extN
 - fixed multi-client small-writes to a single file problem (445)
 - fixed mtime updates during file writes (607)
 - fixed vector writes on obdfilter causing problems when ENOSPC (670)
 - fixed bug in obd_brw_read/write() (under guise of testing 367)
 - fixed Linux OST size reporting problem (444, 656)
 - OST now updates object mtime with writes or setattr (607, 619)
 - client verifies file size before zeroing page past EOF (445)
 - OST now writes last allocated objid to disk with allocation (108)
 - LOV on echo now works (409)
 * protocol changes
 - mds_reint_unlink sends a new buffer, with the EA included.  this
   buffer is only valid if body->valid & OBD_MD_FLEASIZE, which is only
   set if a regular file was being unlinked, and it was the last link
 - use PtlGet from the target for bulk writes (315)
 - OST now updates object mtime with writes or setattr (607, 619)
 - LDLM now has a grant-time callback to revalidate locked items, if
   necessary (604)
 - Many MDS operations were reorganized to combat race conditions
* other changes
 - Merge b_intel branch (updated lprocfs code) - now at /proc/fs/lustre
 - configure check to avoid gcc version 2.96 20000731-2.96-98 (606)

Fixes a _huge_ number of bugs:
  - Fully reactivate OST imports after reconnection (512, others)
  - Make sure client sees our -ENOTCONN from mds_handle (513 - partial)
  - More graceful error handling for truncating on dead OST (515)
  - Don't error out unless we're actually accessing dead stripes (474)
  - Fix garbage sizes when stripes are missing (410)
  - LRU counters were broken, causing constant lock purge (433, 432)
  - garbage on read from stripes with failed OSTs (441)
  - mark OSCs as active before reconnecting during recovery (438)
  - lov_enqueue and lov_cancel need to handle inactive OSTs (403)
  - lfind did not preserve OST order in output (443)
  - symlinks cause hung clients, incorrect data (439)
  - stop dereferencing request after dropping refcount (457)
  - don't LASSERT(spin_is_locked) on non-SMP (455)
  - fixes for many rename() bugs
  - fstat didn't correctly synchronize attributes (399)
  - server must handle lock cancellation during blocking AST prep (487)
  - bulk descriptors were free()d too soon (511)
  - fix paths in lconf, which would load incorrect modules (451, 507)
  - fix confusing lconf 'host not found' error message (386)
  - fix lock order deadlock on OST (O/R i_sem before journal ops, 478)
  - fix race condition in mdc_blocking_ast() for inode access (526)
  - fix lov_unpackmd() unpacking wrong number of stripes (537)
  - fix lov_set_osc_active() marking wrong OSC inactive (440)
  - fix bad lstripe lov_unpackmd() assertion (fix layering too) (527)
  - fix multiple writes of stripe MD to MDS (358, maybe 519)
  - fix lstripe in several ways (kernel side) (527)
  - fix request leak in ldlm_cli_enqueue (262)
  - incorrect OSC was marked inactive after OST failure
  - call mds_fs_cleanup before unmounting filesystem (524)
  - fix races between taking ns_lock and ldlm_lock_change_resource
  - fix races updating LOV export open file list
  - fix lov_enqueue error path, avoid decref-ing bad lock handle
  - fix recovery NULL deref in ldlm_cli_cancel_unused
  - fix some DLM races by using new hash table for lock handles (419)
  - permit the client to specify desired inodes, at replay
  - duplicate requests when we queue them for replay reintegration
  - fix last_rcvd offset calculation
  - sync after each recovered transaction, so we always make progress
  - never, not always, ERESTART requests without transnos
  - store the lov_desc in the MDS, so we don't depend on getlovinfo to set it
  - skip replay if the MDS says that the client is already connected
  - don't check for a recovery-enabled export to match lctl's UUID
  - don't INC_USE_COUNT for phantom exports
  - don't crash when cleaning up phantom exports (567)
  - don't double-finish or set replay data for errored mdc_open requests
  - abort requests when they time out, so we don't get old replies
  - send/receive replies for AST messages again
  - if the client says that it doesn't have the lock, cancel it on the server
  - if we timeout during I/O, don't try to cancel an in-use lock; instead
    mark it as destroyed, it will all work out when decref is called
  - fix module use counts (22, 581)
 * protocol changes
  - ASTs now expect a reply (server cancels lock on error reply)

 - fstat didn't correctly synchronize attributes (399)
 - server must handle lock cancellation during blocking AST prep (487)
 - bulk descriptors were free()d too soon (511)
 - fix paths in lconf, which would load incorrect modules (451, 507)
 - fix confusing lconf 'host not found' error message (386)

 - LRU counters were broken, causing constant lock purge (433, 432)
 - the first part of the fixes for the ldlm_handle2lock race (419)
 - cleanup unused ll_inode_info field (442)
 - keep ioctl semaphore from serializing test_getattr/brw

- fixes of many metadata bugs:
  - multiple client file opens
  - missing/extra intent releases
  - symlink fixes
- OST/MDS server threads clobbering each other
  - dbench 2 works mostly
- many others too numerous to mention here (ChangeLog is a good record)

b=214
b=306
b=385
landing b_brw, which _includes_ all fixes from b_lov.

Roughly, this fixes bugs in 3 general areas:

- OSC was locking one byte too many; fixed.

- several LOV bug fixes, to support adding LOVs and striping over fewer
  than the maximum number

- the brw code was rewritten

See the bugs listed above for more details.  This will be immediately
tagged as 0.5.17.

of conflicts.

   to insert two devices with the same ID in a router configuration.
2. Added LDLM counters into /proc/lustre hierarchy
3. Fixes for Andreas's comments in Bug #357.
4. Bug #332 fixed, num_devices replaced with num_refs
5. Removed file proc_lustre.c, which was dead code.

can go "in the hole" for at most one maximum-sized request, to avoid
deadlocking when the clients have consumed all of the kmapping reservations.

The server can then complete the request and both the server and client will
release their reservations, allowing further progress to be made.

- reserve highmem pages before we start doing kmaps to avoid deadlocks
  with multiple threads reserving vectors of pages

2. Removed typedef
3. lproc-snmp back in.