a lc&@s(dZddlmZdZzddlmZWneyBddlmZYn0ddlZddl Z ddl Z zddl m Z WneyddlZ Yn0z ddlZWneyddlZYn0ddlZddlZejddkrefZneefZddZeZGd d d e jZGd d d Zd dZedkr$edS)a PickleShare - a small 'shelve' like datastore with concurrency support Like shelve, a PickleShareDB object acts like a normal dictionary. Unlike shelve, many processes can access the database simultaneously. Changing a value in database is immediately visible to other processes accessing the same database. Concurrency is possible because the values are stored in separate files. Hence the "database" is a directory where *all* files are governed by PickleShare. Example usage:: from pickleshare import * db = PickleShareDB('~/testpickleshare') db.clear() print "Should be empty:",db.items() db['hello'] = 15 db['aku ankka'] = [1,2,313] db['paths/are/ok/key'] = [1,(5,46)] print db.keys() del db['aku ankka'] This module is certainly not ZODB, but can be used for low-load (non-mission-critical) situations where tiny code size trumps the advanced features of a "real" object database. Installation guide: pip install pickleshare Author: Ville Vainio License: MIT open source license. )print_functionz0.7.5)PathNcCsdtt|dddS)Nz%02x)abshash)keyr G/var/www/html/django/DPS/env/lib/python3.9/site-packages/pickleshare.py gethashfile@sr c@seZdZdZddZddZddZdd Zed fd d Z d dZ ddZ ddZ ddZ d%ddZddZddZddZd&dd Zd!d"Zd#d$ZdS)' PickleShareDBz7 The main 'connection' object for PickleShare database c Cst|tst|}tjtj|}t||_|j sz|jj ddWn2t y~}z|j t j krjWYd}~n d}~00i|_dS)z: Return a db object that will manage the specied directoryTparentsN) isinstance string_typesstrospathabspath expanduserrrootis_dirmkdirOSErrorerrnoEEXISTcache)selfrer r r __init__Gs    zPickleShareDB.__init__cCs|j|}z|tj}Wnty6t|Yn0||jvrb||j|dkrb|j|dSz<|d}t| }Wdn1s0YWnt|Yn0||f|j|<|S)z db['key'] reading rrbN) rstatST_MTIMErKeyErrorropenpickleloadsread)rr filmtimefobjr r r __getitem__Ys   0zPickleShareDB.__getitem__c Cs|j|}|j}|r(|s(|jdd|d }tj||ddWdn1sX0Yz||jf|j |<Wn2t y}z|j t j krWYd}~n d}~00dS)z db['key'] = 5 Trwb)protocolN) rparentrrr&r'dumpr#st_mtimerrrENOENT)rr valuer*r2r,rr r r __setitem__ms    . zPickleShareDB.__setitem__cCsL|j|}|s||t|}||i}|||i|||<dS)z hashed set N)rrrr getupdate)rhashrootr r6hroothfiledr r r hset}s   zPickleShareDB.hsetTcCsX|j|}|t|}||t}|turL|rB|tur>t||S||}|||S)z hashed get )rr r8 _sentinelr%hdict)rr:r defaultZ fast_onlyr;r<r=r r r hgets    zPickleShareDB.hgetc Cs||d}|t|r&|dp(d}|drF|g|dd}i}|D]F}z|||Wn$tytd|d||=Yn0||qN|S)z> Get all data contained in hashed category 'hashroot' as dict /*xxNZCorruptz!deleted - hset is not threadsafe!)keyssortlenendswithr9r%printuncache)rr:hfileslastallr,r r r r@s     zPickleShareDB.hdictcCsl||d}i}|D]}|||||q|||d<|D]"}|j|}|jdkr^qD|qDdS)z Compress category 'hashroot', so hset is fast again hget will fail if fast_only is True for compressed items (that were hset before hcompress). rCz/xxrFN)rGr9rLrnameunlink)rr:rMrOr,pr r r hcompresss    zPickleShareDB.hcompresscCs<|j|}|j|dz |Wnty6Yn0dS)z del db["key"] N)rrpoprQr)rr r*r r r __delitem__s    zPickleShareDB.__delitem__cCst||jddS)z% Make a key suitable for user's eyes \/)r relative_torreplace)rrRr r r _normalizedszPickleShareDB._normalizedNcs4|durjd}n j|}fdd|DS)z, All keys in DB, or all keys matching a globN*csg|]}|r|qSr )is_filerZ).0rRrr r z&PickleShareDB.keys..)rrglobglob)rZglobpatfilesr r^r rGs zPickleShareDB.keyscCs t|SN)iterrGr^r r r __iter__szPickleShareDB.__iter__cCs t|Srd)rIrGr^r r r __len__szPickleShareDB.__len__cGs&|s i|_|D]}|j|dqdS)z Removes all, or specified items from cache Use this after reading a large amount of large objects to free up memory, when you won't be needing the objects for a while. N)rrT)ritemsitr r r rLszPickleShareDB.uncache<cCsdgddgddg}d}d}z||}|WStyBYn0||krTt|t|||||7}|t|dkr"|d7}q"dS)a Wait (poll) for a key to get a value Will wait for `maxwaittime` seconds before raising a KeyError. The call exits normally if the `key` field in db gets a value within the timeout period. Use this for synchronizing different processes or for ensuring that an unfortunately timed "db['key'] = newvalue" operation in another process (which causes all 'get' operation to cause a KeyError for the duration of pickling) won't screw up your program logic. g?rg?r0r!rN)r%timesleeprI)rr Z maxwaittimeZwtimestriesZwaitedvalr r r waitgets  zPickleShareDB.waitgetcCs t||S)z, Get a convenient link for accessing items )PickleShareLink)rfolderr r r getlinkszPickleShareDB.getlinkcCs d|jS)NzPickleShareDB('%s'))rr^r r r __repr__szPickleShareDB.__repr__)N)rj)__name__ __module__ __qualname____doc__r r.r7r>r?rBr@rSrUrZrGrfrgrLrorrrsr r r r r Es"    r c@s0eZdZdZddZddZddZdd Zd S) rpz A shortdand for accessing nested PickleShare data conveniently. Created through PickleShareDB.getlink(), example:: lnk = db.getlink('myobjects/test') lnk.foo = 2 lnk.bar = lnk.foo + 5 cCs|jtdSrd)__dict__r9locals)rdbkeydirr r r r (szPickleShareLink.__init__cCs|jd|jdd|S)Nrzr{rW)rx)rr r r r __getattr__+szPickleShareLink.__getattr__cCs||j|jd|<dS)NrW)rzr{)rr rnr r r __setattr__-szPickleShareLink.__setattr__cCs@|jd}||jdd}d|jdddd|DfS)Nrzr{rCz;cSsg|]}t|qSr )rbasename)r]kr r r r_4r`z,PickleShareLink.__repr__..)rxrGjoin)rrzrGr r r rs/s  zPickleShareLink.__repr__N)rtrurvrwr r|r}rsr r r r rps  rpc Csddl}|d}t}ddl}t|jdkr8t|dS|jd}|jdd}|dkr|sbdg}||d}ddl}||n|dkr|j }||d}t |} | |D]\} } | || <qnB|dkr||d}| t| d n|d krttdS) Nrz pickleshare - manage PickleShare databases Usage: pickleshare dump /path/to/db > dump.txt pickleshare load /path/to/db < dump.txt pickleshare test /path/to/db r0r!r3.loadZtestwaitZ250test)textwrapdedentr sysrIargvrKpprintrhstdinr)evalclearrorZstress) rusageZDBrcmdargsrzrcontdatarvr r r main6s8         r__main__)rw __future__r __version__pathlibr ImportErrorZpathlib2rr#rkcollections.abcabccollections_abc collectionscPickler'rr version_inforrunicoder objectr?MutableMappingr rprrtr r r r s8!     Z'