ChangeLog



To find the state of this project's repository at the time of any of these versions, check out the tags.
tbd
       * version v0_8
       * bug fixes
        - orphans are moved into the PENDING directory for possible recovery
        - replayed opens now open by fid for orphan/rename safety (1042)
        - last close of an orphan inode generates a transno (683)
	- chdir() and mount() now pin the directory entry (1020)
	- avoid CERROR in normal ll_setattr_raw() error case (1500)
	- discard very old requests without processing them (1502)
	- remove some common, well-understood CERRORs (1505)
	- require O_DIRECT I/O to be page-sized to workaround IA64 crash (1609)
	- clear "grant" flags in OST replies until OST grant code lands (1644)
	- fix read performance by not clobbering i_blksize on client (1598)
	- fix __ldlm_handle2lock oops by not dereferencing lock after PUT (1625)
	- make LRU size a /proc tunable, clears locks when reduced (707)
	- fix some lprocfs rot that prevented ptlbd from loading (1732)
	- server locks take references on exports now (1558)
	- build fixes for 2.4.20-rh trees (1663)
	- return an error from lov_create if all OSCs are inactive (1751)
	- fix import levels when a reconnect happens without a timeout (1597)
	- exit early from mds_open if we get a lookup error (1749)
	- partial page read at EOF wouldn't wait for disk before sending (1642)
	- avoid NULL deref in obdfilter when reading page past EOF (1592)

2003-06-15  Phil Schwan  <phil@clusterfs.com>
       * version v0_7
       * bug fixes
	- imports and exports cleanup too early, need refcounts (349, 879, 1045)
	- per-import/export recovery handling (958, 931, 959)
	- multiple last-rcvd slots, for serving multiple FSes (949)
	- connections are again shared between multiple imp/exports (963, 964)
	- "umount -f" would hang if any requests needed to be sent (393, 978)
	- avoid pinning large req buffer by copying for queued messages (989)
	- add "uuid" to "lctl device" command to help upcalls (991)
	- "open" RPCs with transnos would confuse recovery counters (1037)
	- do proper endian conversion of all wire messages (288, 340, 891)
	- remove OST bulk get LBUGs, fix ost_brw_write cleanup (1126)
	- call waiting locks callback from LDLM recovery thread (1127, 1151)
	- fix ptlrpc_connection leak in target_handle_connect (1174)
	- fix import refcounting bug in OST and MDS cleanup (1134)
	- if an invalid-at-open-time OSC returned before close(), LBUG (1150)
	- fix very unlikely obd_types race condition (501)
	- remove osc_open hack for echo_client (1187)
	- we leaked exports/dlmimps for forcibly disconnected clients (1143)
	- a failure in read_inode2 leads to deadlock (1139)
	- cancel ack-locks as soon as transaction is committed (1072)
	- fix major leaks and crashes in the bulk I/O path (937, 1057)
	- make sure to commitrw after any preprw to avoid deadlock (1162)
	- failing to execute a file in a lustre FS would lock inode (1203)
	- small DEBUG_REQ fix to avoid dereferencing a NULL (1227)
	- don't ASSERT while cleaning up an incompletely-setup obd (1248)
	- obd_uuid2tgt would walk off the end of the list (1255)
	- on IA64 the osc would give portals incorrect bulk size (1258)
	- fix debug daemon ioctl interface; allows daemon on ia64 (1274)
	- fix lock inversion caused by new llite matching code (1282)
	- limit the number of dirty pages on a client to 10MB (1286)
	- timed out locks were not being corrected cancelled (1289)
	- fix O_DIRECT above 4GB on IA-32 (1292)
       * major user-visible changes
	- fail out/fail over policy now controlled by the upcall (993)
       * protocol changes
	- add OBD_PING to check server availability and failure (954)
	- lustre messages are now sent in sending host order (288, 340, 891)
	- add eadatalen to MDS getattr reply (340)
	- OST read replies may contain second buffer, with per-page status (593)

2003-03-11  Phil Schwan  <phil@clusterfs.com>
       * version v0_6
       * bug fixes
	- LDLM_DEBUG macro fix, for gcc 3.2 (850)
	- failed open()s could cause deadlock; fixed (867, 869)
	- stop cancelling OST locks when files are closed (481)
	- overlapping XID spaces caused network corruption (851, 853)
	- fix unsafe fsfilt counter arithmetic; change to atomic_t
	- setattr_raw added, to do single-RPC, server-side setattrs
	- lmc/lconf syntax change for OST UUIDs
	- fix crashy race condition between ptlrpc_free_req and osc_close
	- don't use request in mdc_enqueue if we hit a timeout (889)
	- don't set the inode i_size for regular files from the MDS (896)
	- handle out of order completion AST (842)
	- don't LBUG if a lock request times out after receiving AST (913)
	- avoid d_rehash race in ll_find_alias by rehashing inside dcache_lock
	- if a bad lock AST arrives, send an error instead of dropping entirely
	- return 0 from revalidate2 if ll_intent_lock returns -EINTR (912)
	- fix leak in bulk IO when only partially completed (899, 900, 926)
	- fix O_DIRECT for ia64 (55)
        - (almost) eliminate Lustre-kernel-thread effects on load average (722)
	- C-z after timeout could hang a process forever; fixed (977)
       * Features
	- client-side I/O cache (678, 924, 929, 941, 970)
       * protocol changes
	- READPAGE and SETATTRs which don't take server-side locks get
	  their own portal

2003-02-11  Phil Schwan  <phil@clusterfs.com>
	* version v0_5_20
	* bug fixes
	 - Fix ldlm_lock_match on the MDS to avoid matching remote locks (592)
	 - Fix fsfilt_extN_readpage() to read a full page of directory
	   entries, or fake the remainder if PAGE_SIZE != blocksize (500)
         - Avoid extra mdc_getattr() in ll_intent_lock when possible (534, 604)
	 - Fix imbalanced LOV object allocation and out-of-bound access (469)
	 - Most intent operations were removed, in favour of a new RPC mode
	   that does a single RPC to the server and bypasses most of the VFS
	 - All LDLM resource ID arrays were removed in favour of ldlm_res_id
	 - Aggressively cancel local locks on DLM servers
	 - mds_reint_unlink sends EA to the client if it's the last nlink.
	   client uses that EA to unlink OST objects.
	 - mds_reint_{rename,unlink,link} were rewritten to take ordered locks
	 - recursive symlinks were fixed (439)
	 - fixed NULL deref in DEBUG_REQ
	 - filter_update_lastobjid no longer calls sync, which annoyed extN
	 - fixed multi-client small-writes to a single file problem (445)
	 - fixed mtime updates during file writes (607)
	 - fixed vector writes on obdfilter causing problems when ENOSPC (670)
	 - fixed bug in obd_brw_read/write() (under guise of testing 367)
	 - fixed Linux OST size reporting problem (444, 656)
	 - OST now updates object mtime with writes or setattr (607, 619)
	 - client verifies file size before zeroing page past EOF (445)
	 - OST now writes last allocated objid to disk with allocation (108)
	 - LOV on echo now works (409)
	* protocol changes
	 - mds_reint_unlink sends a new buffer, with the EA included.  this
	   buffer is only valid if body->valid & OBD_MD_FLEASIZE, which is only
	   set if a regular file was being unlinked, and it was the last link
	 - use PtlGet from the target for bulk writes (315)
	 - OST now updates object mtime with writes or setattr (607, 619)
	 - LDLM now has a grant-time callback to revalidate locked items, if
	   necessary (604)
	 - Many MDS operations were reorganized to combat race conditions
	* other changes
	 - Merge b_intel branch (updated lprocfs code) - now at /proc/fs/lustre
	 - configure check to avoid gcc version 2.96 20000731-2.96-98) (606)

2003-01-06  Andreas Dilger  <adilger@clusterfs.com>
	* version v0_5_19
	* bug fixes
	 - Fully reactivate OST imports after reconnection (512, others)
	 - Make sure client sees our -ENOTCONN from mds_handle (513 - partial)
	 - More graceful error handling for truncating on dead OST (515)
	 - Don't error out unless we're actually accessing dead stripes (474)
	 - Fix garbage sizes when stripes are missing (410)
	 - LRU counters were broken, causing constant lock purge (433, 432)
	 - garbage on read from stripes with failed OSTs (441)
	 - mark OSCs as active before reconnecting during recovery (438)
	 - lov_enqueue and lov_cancel need to handle inactive OSTs (403)
	 - lfind did not preserve OST order in output (443)
	 - symlinks cause hung clients, incorrect data (439)
	 - stop dereferencing request after dropping refcount (457)
	 - don't LASSERT(spin_is_locked) on non-SMP (455)
	 - fixes for many rename() bugs
	 - fstat didn't correctly synchronize attributes (399)
	 - server must handle lock cancellation during blocking AST prep (487)
	 - bulk descriptors were free()d too soon (511)
	 - fix paths in lconf, which would load incorrect modules (451, 507)
	 - fix confusing lconf 'host not found' error message (386)
	 - fix lock order deadlock on OST (O/R i_sem before journal ops, 478)
	 - fix race condition in mdc_blocking_ast() for inode access (526)
	 - fix lov_unpackmd() unpacking wrong number of stripes (537)
	 - fix lov_set_osc_active() marking wrong OSC inactive (440)
	 - fix bad lstripe lov_unpackmd() assertion (fix layering too) (527)
	 - fix multiple writes of stripe MD to MDS (358, maybe 519)
	 - fix lstripe in several ways (kernel side) (527)
	 - fix request leak in ldlm_cli_enqueue (262)
	 - incorrect OSC was marked inactive after OST failure
	 - call mds_fs_cleanup before unmounting filesystem (524)
	 - fix races between taking ns_lock and ldlm_lock_change_resource
	 - fix races updating LOV export open file list
	 - fix lov_enqueue error path, avoid decref-ing bad lock handle
	 - fix recovery NULL deref in ldlm_cli_cancel_unused
	 - fix some DLM races by using new hash table for lock handles (419)
	 - permit the client to specify desired inodes, at replay
	 - duplicate requests when we queue them for replay reintegration
	 - fix last_rcvd offset calculation
	 - sync after each recovered transaction, so we always make progress
	 - never, not always, ERESTART requests without transnos
	 - store the lov_desc in the MDS, so we don't depend on getlovinfo to
	   set it
	 - skip replay if the MDS says that the client is already connected
	 - don't check for a recovery-enabled export to match lctl's UUID
	 - don't INC_USE_COUNT for phantom exports
	 - don't crash when cleaning up phantom exports (567)
	 - don't double-finish or set replay data for errored mdc_open requests
	 - abort requests when they time out, so we don't get old replies
	 - send/receive replies for AST messages again
	 - if the client says that it doesn't have the lock, cancel it on the
	   server
	 - if we timeout during I/O, don't try to cancel an in-use lock; instead
	   mark it as destroyed, it will all work out when decref is called
	 - fix module use counts (22, 581)
	* protocol changes
	 - ASTs now expect a reply (server cancels lock on error reply)

2002-12-02  Andreas Dilger  <adilger@clusterfs.com>
	* version v0_5_18
	* bug fixes
	  - fix many simultaneous client startup (392)
	  - fix dentry->d_it clobbering
	  - credentials weren't being shipped for readdir/getattr operations
	  - remove invalid assertions triggered during some concurrent MD
	    updates
	  - proper Lustre versions added (336, 389)
	  - fix memory leak for create error case (398)
	  - fix LOV locking bug that would get cli/srv out of sync
	  - fix echo client over LOV (409)
	  - fix dbench 2, extN refcount problem (170, 258, 356, 418)
	  - fix double-O_EXCL intent crash (424)
	  - avoid sending multiple lock CANCELs (352)
	* Features 
	  - MDS can do multi-client recovery (modulo bugs in new code)
	* Documentation 
	  - many updates, edits, cleanups

2002-11-18  Phil Schwan  <phil@clusterfs.com>
	* version v0_5_17
	* bug fixes
	  - fix null d_it dereference (346)
	  - fix full OST/dbench hang (333)
	  - fix permission problem with file removal (286)
	  - fix removal of OSCs from LOV when they fail
	  - fix NULL deref during bulk timeout (214)
	  - fix problems related to multiple filesystems on one MDS (241)
	  - fixed serious subtle metadata locking bugs
	  - free locks on clients when inodes are removed due to memory
	    pressure (201)
	  - fix inode pointer in lock data (285)
	  - partial support for multiple MDS on a single host (241)
	  - data locks weren't cancelled at clear_inode time (290, 311)
	  - intent locks could lead to unbounded lock growth (205)
	  - added a maximum lock count, an LRU list, and a flusher
	  - fix multiple rename (365)
	  - properly abstracted the echo client
	  - OSC locked 1 byte too many; fixed
	  - rewrote brw callback code:
	    - fixed recovery bugs related to LOVs (306)
	    - fixed too-many-pages-in-one-write crash (191)
	    - fixed (again) crash in sync_io_timeout (214)
	    - probably fixed callback-related race (385)
	* protocol change
          - Add capability to MDS protocol
	  - LDLM cancellations and callbacks on different portals

2002-10-28  Andreas Dilger  <adilger@clusterfs.com>
	* version v0_5_16
	* bug fixes:
	  - limit client IOV size to PTL_MD_MAX_IOV (611336, 191)
	  - defer open object destruction to close time (601981, 138)
	  - open/close OST file handle in obdo (OBD_MD_FLHANDLE) (601981, 138)
	  - move LDLM_ENQUEUE/CONVERT back to MDS portal (625069)
	  - abstract ll_lookup2, fix ll_revalidate2 to use abstraction (256)
	  - don't call obd_setattr in ll_file_release for destroyed objects
	* protocol change to lustre_msg: move |version| and add |flags|
	* protocol change to osc_punch: "start" in "o_size", "end" in "o_blocks"
	* lock replay: for LDLM_FL_REPLAY trust client to do right thing
	* added replay of create, unlink, link and rename operations during
	  MDS failover; recovery should be much more robust now
	* remove failed OSCs from LOVs (only lov_create uses this so far)
	* the lustre-HOWTO was brought (more) up to date (582544)

2002-10-23  Phil Schwan  <phil@clusterfs.com>
	* version v0_5_15
	* bug fixes:
	  - in-use dentries weren't being reused properly (617851)
	  - prevent multiple LDLM setup (599178)
	  - fix LOV size calculations for truncate (617853)
	  - fix client handling of MDS intent errors (POSIX)
	  - fix permission bug in lovstripe.c test (624321)
	  - fix MDS thread deadlock - move LDLM handler to DLM portal (625069)
	  - truncate past end of file could corrupt data
	  - proper cleanup after timeouts, crashes, etc (592524, 550815)
	  - a race in recovery could return ETIMEDOUT to apps (623947)
	  - building outside the source directory was fixed
	* the lustre-HOWTO was brought (more) up to date (582544)
	* major progress was made on recovery functionality

2002-10-10  Phil Schwan  <phil@clusterfs.com>
	* version v0_5_14
	* bug fixes:
	  - recovery deadlock fix
	  - rm -rf causes LBUG fix (617817)
	  - file open by multiple tasks fix (618962)
	  - directory permissions bugs (602707 and 620007)
	  - journal_stop fixed with locking (611313)
	  - O_APPEND failures resolved (618273, perhaps 614459)
	  - lconf PATH fix (619770)
	  - IA64 build fix (621450)
	  - RPC buffer sizes scale with amount of memory

2002-10-01  Phil Schwan  <phil@clusterfs.com>
	* version v0_5_13
	* bug fixes:
	  - locks would be cancelled without throwing away data pages,
	    resulting in inconsistent data (605627)
	  - inode attributes were not always being refreshed (605627, 612449)
	  - lconf now continues to cleanup after lctl reports an error
	  - MDS now enforces user permissions (602707)
	  - lprocfs cleanup fixed, but not yet enabled (614157)
	  - fixed infinite server hang, should a client not respond to an AST
	  - avoid going into recovery if user calls readlink() with a buffer
	    that's too small (613941)
	  - AST RPCs no longer require replies (614867) -- this may be changed
	  - don't crash server if client sends an IOV that's too big (611336)
	  - fixed lock conversion deadlock (611892)
	  - fixed the following of symlinks (614622)
	* recovery: the server can remove locks from a client that dies, other
	  clients can make progress
	* more extN patch fixes
	* compile-time configurable ptlrpc buffer allocations
	* documentation
	  - collaborative read cache document
	  - Lustre Lite Performance CDR document-in-progress

2002-09-20  Andreas Dilger  <adilger@clusterfs.com>
	* version v0_5_12
	* bug fix
	  - fix typo in patch-2.4.18

2002-09-20  Andreas Dilger  <adilger@clusterfs.com>
	* version v0_5_11
	* bug fixes
	  - clear ptlrpc request each time in handle_incoming_request()
	  - unlink of files now destroys the object on the OST

2002-09-19  Peter Braam  <braam@clusterfs.com>
	* version 0_5_10
	* add hard link support
	* change obdfile creation method
	* kernel patch changed
	
2002-09-19  Peter Braam  <braam@clusterfs.com>
	* version 0_5_9
	* bug fix
	  - stack overflow bug in extN fixed

2002-09-18  Andreas Dilger  <adilger@clusterfs.com>
	* version 0_5_8
	* documentation updates
	  - add man pages for config tools
	  - update tests/README to describe testing with new config tools
	  - finish metadata API descriptions
	* bug fixes and cleanups
	  - statfs workaround for 16TB limit
	  - LOV stripe allocation improved, can stripe on subset of OSTs
	  - LOV file size/IO offset was wrong for files > 4GB in size
	  - object EA data was being dropped, caused files to be unreadable
	  - memory overflow with non-LOV OST caused memory corruption
	  - fixed regression tests to work with new config tools, obdfilter
	  - fixed bug when directory size became larger than 1 block
	  - fixed bug (for single client case) when PWD was deleted
	  - invalidate local directory pages when doing intent-based ops
	  - avoid LDLM oops when lock callback contained bad data

2002-09-09  Andreas Dilger  <adilger@clusterfs.com>
	* version 0_5_7
	* documentation updates
	* bug fixes and cleanups
	  - configuration tools
	  - LOV
	  - imports/exports
	  - 64-bit compile warnings
	  - 64-bit internal statfs data
	  - many more
	* test_brw on persistent OST devices
	* MDS recovery
	* lprocfs (disabled)

2002-09-04  Andreas Dilger  <adilger@clusterfs.com>
	* version 0_5_6
	* documentation updates
	* bug fixes and cleanups
	* configuration tools

2002-08-30  Peter J. Braam  <braam@clusterfs.com>

	* version v0_5_5
	* many small fixes to 0_5_4
	* io/network handling
	* thinkos in MDS operations

2002-08-24  Peter J. Braam  <braam@clusterfs.com>

	* version v0_5_4
	* crucial basic fixes to 0.5.3
	* IOR, Iozone work over Elan
	* EOF locks added

2002-08-07  Phil Schwan  <phil@clusterfs.com>
	* version 0_5_3, our first alpha
	* we use the new Portals iovs
	* documentation updates
	* bug fixes and cleanups
	* small changes in the DLM wire protocol

2002-07-25  Peter J. Braam  <braam@clusterfs.com>
	* version 0_5_1 with some initial stability, 
	* locking on MD and file I/O. 
	* documentation updates
	* several bug fixes since 0.5.0
	* small changes in wire protocol

2002-07-18  Phil Schwan  <phil@clusterfs.com>
	* version v0_4_5
	* delivered as Lustre Light Alpha
	* fixed a crash after handling invalid MDS requests
	* fixed directory pages for architectures with non-4k pages sizes

2002-07-11  Andreas Dilger  <adilger@clusterfs.com>
	* release version v0_4_4
	* Moves TCP acceptor to be on port 2432 (unused Coda port) instead
	  of 1234.
	* Fixes a number of interruption problems with OST operations.
	* Update documentation for portals header changes
	* Move all wire protocol structs/defines to lustre_idl.h
	* Fixes symlink length bug.
	* Add tcpdump to repository.

2002-07-05  Andreas Dilger  <adilger@clusterfs.com>
	* release version v0_4_3
	* Fixes statfs for inodes on extN.
	* Fixes bug in runtests which would delete /etc/hosts.
	* Use 64-bit object IDs wherever possible (not into VFS though)
	  Remove ost_get_info, which is unused by lustre, and out of date.

2002-07-03  Peter Braam  <braam@clusterfs.com>
	* release version v0_4_2   Fixes a lookup error (type not passed)
	* move forward to head of Portals
	* move forward to latest Lustre kernel

2002-06-25  Peter Braam  <braam@clusterfs.com>
	* release version v0_4_1.  Hopefully stable on single node use.