a SicW@s dZddlZddlZddlmZddlmZmZddlm Z m Z ddl m Z dd l mZmZmZmZmZmZdd l mZejZejZejZejdd Zd Zeejkrd ZejejdZe dde!DZ"edkre#ej$ej%de"#ej$dej%diedkr$r)r r )v108v110rr)r Zv112)r rZv114cKs:ts tdddl}|d|j|jfi|dS)z-Set file access property list for mpio driverz9h5py was built without MPI support, can't use mpio driverrNinfo)mpi ValueErrorZ mpi4py.MPI setdefaultMPIInfoZ set_fapl_mpio)plistkwargsZmpi4pyrrr_set_fapl_mpio2s r*cKs|tj|ddS)z@Set the Python file object driver in a file access property listfileobjN)set_fileobj_driverrfileobj_drivergetr(r)rrr_set_fapl_fileobj<sr0cKs|jfi|Sr) set_fapl_sec2r/rrrBrr2cKs|jfi|Sr)set_fapl_stdior/rrrr2CrcKs|jfi|Sr) set_fapl_corer/rrrr2DrcKs|jfd|i|S)N memb_fapl)set_fapl_familycopyr/rrrr2EscKs|jfi|Sr)set_fapl_splitr/rrrr2Kr)sec2stdiocorefamilympior+splitcKs|jfi|Sr)Z set_fapl_ros3r/rrrr2Orros3cKs|jfi|Sr)Zset_fapl_directr/rrrr2RrdirectcCs |t|<dS)zRegister a custom driver. Parameters ---------- name : str The name of the driver. set_fapl : callable[PropFAID, **kwargs] -> NoneType The function to set the fapl to use your custom driver. N_drivers)nameset_faplrrrregister_driverUs rEcCs t|=dS)znUnregister a custom driver. Parameters ---------- name : str The name of the driver. NrA)rCrrrunregister_driverbsrFcCsttS)zFReturn a frozenset of the names of all of the registered drivers. ) frozensetrBrrrrregistered_driversmsrHc Ksttj} |dur@|tvr,t|} tj}qNdd|D\} }ntjtj} }| | || | | t | }|dur||d<|dur||d<|dur||d<| j ||r| t |t |t ||dur`tdkrtdddkstdd krtd |d vr| jd d d nB|dvr8| jdd d n(|dkrR| jddd ntd||dus|dkrtjdkr| rdjtt| d}t|| Sz t|}Wn tytd|Yn0|| fi| | S)z$ Set up a file access property list Ncss|]}t|VqdSr) libver_dictrrrrrr~rzmake_fapl..rr rr rrrzDHDF version >= 1.12.1 or 1.10.x >= 1.10.7 required for file locking.)falseFF)ignore_when_disabled)trueTTz best-effortzUnsupported locking value: windowswin32z8'{key}' is an invalid keyword argument for this function)keyzUnknown driver type "%s")r create FILE_ACCESSrIr LIBVER_LATESTLIBVER_EARLIESTset_libver_bounds set_alignmentlist get_cache set_cacheset_page_buffer_sizeint hdf5_versionr$set_file_lockingsysplatformformatnextiter TypeErrorrBKeyError)driverlibver rdcc_nslots rdcc_nbytesrdcc_w0locking page_buf_size min_meta_keep min_raw_keepalignment_thresholdalignment_intervalkwdsr(lowhighZcache_settingsmsgrDrrr make_faplss\      (      rxcCs|s|rttj}|r<|tjtjB|tjtjB|rtjtj tj tj d}| |d}|dkrrt d|||||r|dkr|t|nd}|S)z& Set up a file creation property list )Zfsmpage aggregatenonez Invalid file space strategy typeryN)r rU FILE_CREATEset_link_creation_orderCRT_ORDER_TRACKEDCRT_ORDER_INDEXEDset_attr_creation_orderr FSPACE_STRATEGY_FSM_AGGRFSPACE_STRATEGY_PAGEFSPACE_STRATEGY_AGGRFSPACE_STRATEGY_NONEr.r$set_file_space_strategyset_file_space_page_sizer_) track_order fs_strategy fs_persist fs_threshold fs_page_sizer(Z strategiesZ fs_strat_numrrr make_fcpls.     rc Cs|durb|dvrtdz t|}WnttfyBtdYn0|durXttj}|||dkrtj}|rt r|tj O}tj |||d}n|dkrtj |tj |d}n|dvrtj|tj ||d }n|d krtj|tj||d }n|d krvztj |tj |d}Wnf|tjtr&tjnd tjtjtjtr@tjnd fvrNtntyrtj|tj ||d }Yn0ntd z8|dur|}||krtd||fWn2ty} z|| WYd} ~ n d} ~ 00|S)zR Get a new FileID by opening or creating a file. Also validates mode argument.N)rr+z5User block may only be specified when creating a filez"User block size must be an integerr)faplr)w-r)rfcplwar|z/Invalid mode; must be one of r, r+, w, w-, x, azGRequested userblock size (%d) does not match that of existing file (%d))r$r_rgr rUr} set_userblockr ACC_RDONLY swmr_support ACC_SWMR_READopenACC_RDWRACC_EXCL ACC_TRUNC get_driverrSEC2 direct_vfdDIRECTFAMILYWINDOWSr-r?ROS3DFileNotFoundErrorOSErrorget_create_plist get_userblock Exceptionclose) rCmodeuserblock_sizerrswmrflagsfidZ existing_fcplerrrmake_fidsZ        rcseZdZdZeddZeeddZeeddZeedd Z eed d Z eed d Z e re dkreeddZejeddZeeddZejeddZd&fdd ZddZddZed d!Zed"d#Zed$d%ZZS)'Filez& Represents an HDF5 file. cCsBddlm}t||dWdS1s40YdS)z$ Attributes attached to this object r)attrs/N)rrAttributeManager)selfrrrrrs z File.attrscCstt|jS)zFile name on disk)rr get_nameidrrrrfilenamesz File.filenamecCsftjdtjdtjdtjdtjdtjdtjdtjdi}t rBd |tj <t rPd |tj <| |jd S) z,Low-level HDF5 file driver used to open filer9r:r;r<rRr=Zmpiposixr+r?r@unknown)rrSTDIOCORErrMPIOMPIPOSIXr-r?rrrr.rget_access_plistr)rZdriversrrrri!s  z File.drivercCs*tj}tr|tjO}|j|@r&dSdS)z Python mode used to open file rr)r rrACC_SWMR_WRITEr get_intent)rZ write_intentrrrr3s z File.modecCs |j}tdd|DS)z/File format version bounds (2-tuple: low, high)css|]}t|VqdSr) libver_dict_rrJrrrrArzFile.libver..)rrget_libver_boundstuple)rboundsrrrrj<sz File.libvercCs|j}|S)z User block size (in bytes) )rrr)rrrrrrCs zFile.userblock_size)r cCs |jS)z( Set/get MPI-IO atomic mode )rZget_mpi_atomicityrrrratomicLsz File.atomiccCs|j|dSr)rZset_mpi_atomicityrvaluerrrrSscCstot|jtjtjB@S)z- Controls single-writer multiple-reader mode )rboolrrr rrrrrr swmr_modeYszFile.swmr_modecCs0tr|r|jq,tdntdjtdS)Nz4It is not possible to forcibly switch SWMR mode off.z7SWMR support is not available in HDF5 version {}.{}.{}.)rrstart_swmr_writer$ RuntimeErrorrdr`rrrrr_s   rNFrrc s | s|rtdkrtd|r(ts(td|dkr= 1.12.1 or 1.10.x >= 1.10.7. alignment_threshold Together with ``alignment_interval``, this property ensures that any file object greater than or equal in size to the alignement threshold (in bytes) will be aligned on an address which is a multiple of alignment interval. alignment_interval This property should be used in conjunction with ``alignment_threshold``. See the description above. For more details, see https://portal.hdfgroup.org/display/HDF5/H5P_SET_ALIGNMENT Additional keywords Passed on to the selected file driver. )rrrzYHDF version 1.10.1 or greater required for file space strategy or page buffering support.zEThe SWMR feature is not available in this version of the HDF5 libraryr?z:h5py was built without ROS3 support, can't use ros3 driverNrKr rMrNzLHDF version >= 1.12.1 or 1.10.x >= 1.10.7 required for file locking options.z5Unable to set file space strategy of an existing filereadseek)Nr+z;Driver must be 'fileobj' for file-like object if specified.r+zQInvalid value of 'fileobj' argument; must equal to file-like object if specified.)r+ASCIIreplace)rrrrzkswmr=True only affects read ('r') mode. For swmr write mode, set f.swmr_mode = True after opening the file.) stacklevel)rrrs)rrrrr)rr)r`r$rr? isinstancerObjectIDrr get_file_idhasattrr.updatereprencoderr get_configrrrxrrrZ_libversuper__init__)rrCrrirjrrrkrlrmrrrrrrorprqrnrrrsrtrrr __class__rrrksns   ,    4  z File.__init__cCsltT|jjrJ|jtjtjB|jtjtjB|jt Wdn1s^0YdS)z2 Close the file. All open objects become invalid N) rrvalid_close_open_objectsr OBJ_LOCALOBJ_FILErrnonlocal_closerrrrrs  z File.closecCs4tt|jWdn1s&0YdS)z5 Tell the HDF5 library to flush its buffers. N)rr flushrrrrrr-sz File.flushcCs|Srrrrrr __enter__3szFile.__enter__cGs|jr|dSr)rr)rargsrrr__exit__7sz File.__exit__cCsH|js d}n8|j}t|tr(|dd}dtj|d|jd}|S)Nzutf8rz ) rrrbytesdecodeospathbasenamer)rrrrrr__repr__<s  z File.__repr__)rNNNFNNNNNFrNNrrNrr)__name__ __module__ __qualname____doc__propertyrrrrirrjrr#r`rsetterrrrrrrr __classcell__rrrrr s\           4  r)FNFrN)NF)2rrbrwarningsrcompatrrbaserrgrouprrr r r r rrrrr#r?rhdf5_version_tupler`rswmr_min_hdf5_versionrXrWrIdictitemsrr LIBVER_V18 LIBVER_V110 LIBVER_V112Z LIBVER_V114r*r0rBrErFrHrxrrrrrrr sb                >  >