q&fVi&dZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZddlmZddlmZd Zed zZd Zej@d;d Z!ddZ,d>dZ-dZ.dZ/dZ0dZ1dZ2dZ3d?d Z4d!Z5d"Z6d#Z7d$Z8d%Z9d&Z:d'Z;d(Zd+Z?d,Z@d-ZAd.ZBd/ZCGd0d1eDZEd2ZFd3ZGd4ZHd5ZId6ZJd7ZKGd8d9ZLd?d:ZMy)@zGlargefiles utility code: must not import other modules in this package.N)_)hex)open) dirstateencodingerrorhttpconnectionmatchpycompat requirementsscmutilsparseutilvfs)hashutil) timestamps.hglf/ largefilesc#dKt|dd}||_ d||_y#||_wxYww)NlfstatusF)getattrr)repovalueoldvalues 9/usr/lib/python3/dist-packages/hgext/largefiles/lfutil.pyrr+s1tZ/HDM!    s0$0 -0c|}|s|r|jtd|}|r t|}|t j t d|S#t$r"t j t d|zwxYw)Nsminsize)defaults)largefiles: size must be number (not %s) s-minimum size for largefiles must be specified)configlongnamefloat ValueErrorrAbortr)ui assumelfilesoptrlfsizes r getminsizer'5s F l8ZA  6]F ~kk!LMNN M  ++?@6I  s A+A:c tjtjj | tj ||y#t $rt|d5}tj|5}tj|D]}|j| dddn #1swYnxYwdddn #1swYnxYwtj|tj|jYywxYw)z@Try to create hardlink - if that fails, efficiently make a copy.rbN)rmakedirsospathdirnameoslinkOSErrorratomictempfile filechunkiterwritechmodstatst_mode)srcdestsrcfdstfchunks rlinkr;EsMM"''//$'(- C - #u  "t':':4'@ "D++D1 " 5! " " " " " " " rwws|++, -sAA D C6,B,# C,B5 1C8 DC :DDcTtjjt||S)zReturn the correct location in the "global" largefiles cache for a file with the given hash. This cache is used for sharing of largefiles across repositories - both to preserve download bandwidth and storage space.)r+r,join _usercachedir)r#hashs r usercachepathr@Rs 77<< b)4 00c|j|d}|r|Sd}tjrrtjj dtjj d}|r t jj||Stddd|fz}n8tjrTtjj d}|r"t jj|dd|Std d|fz}ntjrtjj d }|r t jj||Stjj d}|r!t jj|d |Stdd d|fz}n/tjtd tjztjtd |z|)z5Return the location of the "global" largefiles cache.s usercacheNs LOCALAPPDATAsAPPDATAs7define %s or %s in the environment, or set %s.usercachesHOMEsLibrarysCachess1define %s in the environment, or set %s.usercachesXDG_CACHE_HOMEs.cachesunknown operating system: %s sunknown %s usercache location)hint) configpathr iswindowsrenvirongetr+r,r=risdarwinisposixrr"osname)r#namer,rCappdatahomes rr>r>Zs ==| ,D  D""&& X--11*=  77<<. .KL   P     ##G, 77<<j)TB BEF  J     ##$56 77<<d+ +##G, 77<<i6 6KL   P   kk / 08?? B   ++a89D@t LLrAcXt||}tjj|SN)r@r+r,exists)r#r?r,s r inusercacherQs! T "D 77>>$ rAcNt||\}}|r)|jjtd|z|St |j|rU|jjtd|zt ||}t t|j|||Sy)zReturn store path of the largefile with the specified hash. As a side effect, the file might be linked from user cache. Return None if the file can't be found locally.sfound %s in store sfound %s in system cache N) findstorepathr#noterrQ storepathr;r@)rr?r,rPs rfindfilerVs!t,LD&   Q-.56 TWWd #  Q45<=t$ ]477D )40 rAceZdZdZdZfdZfdZfdZdfd ZfdZ fdZ fd Z fd Z fd Z d Zfd ZxZS)largefilesdirstateTs -large-filesc<tt| t|SrO)superrX __getitem__unixpath)selfkey __class__s rr[zlargefilesdirstate.__getitem__s':8C=IIrAc<tt| t|SrO)rZrX set_trackedr\r]fr_s rrazlargefilesdirstate.set_trackeds':8A;GGrAc<tt| t|SrO)rZrX set_untrackedr\rbs rrez largefilesdirstate.set_untrackeds'z openlfdirstate..st$rAsdirstateF)waitsubreposunknownignoredrT) p1_tracked wc_trackedpossibly_dirty)rrrrvfsmodr=r DIRSTATE_V2_REQUIREMENTrXroot _validate nodeconstantsrPwlockchanging_filesgetstandinmatcherwalklenr* splitstandinhacky_extension_update_filer LockError) r#rcreate sub_dirstater lfstorediropeneruse_dirstate_v2 lfdirstaterstandinsstandinlfiles ` ropenlfdirstaters4==/4@L ((CJ ZZ, -F"::d>O>OOO#   $ Jcjj*k!BC ' )B)B4)H +D1==--b%.x=1$LL,'G(1E::#'#''+ ;  , :-   ,       sIF!F3A1E9%F-F9F >FF FFF)(F)c@|d}tj}|j|gddd\}}}|j|j}}|d} |D]} |t | } | r&t| t|j| k7r|j| L|j| | | j} | j} | j}tj| |}|| ||f}|j!| ||S#t $rd} YwxYw)N.Frrcleanr)matchmodalwaysstatusmodifiedrr LookupError readasstandinhashfilewjoinappendlstatr5st_sizerreliable_mtime_of set_clean)rrpctxr unsuresmtime_boundaryrrwctxrfctxstmodesizemtime cache_datas rlfdirstatestatusrs( :D OO E * 1 1 E!2!FA~jj!''eH :D8 'D}T*htzz%7H.II OOE " LL e""$B::D::D//NCE "D%0 $$UJ78 H D sD DDc| t|}||j|Dcgc]4}|%|jj|jr t |6c}Scc}w)zNreturn a list of largefiles in the working copy or the specified changeset)rrr get_entry any_trackedr)rrevrrcs r listlfilesr sb#D) c(  ?dmm55a8DD Q  s9A cVtjjt|||S)zBReturn true if a largefile with the given hash exists in the store)r+r,rPrUrr? forcelocals rinstorer/s 77>>)D$ ; < c8X 67rAcDt|j|r+tt|j|t ||yt j tjjt ||t|d5}t jt |||jj5}t j|D]}|j| ddddddt!||y#1swYxYw#1swY"xYw)Nr)) createmode)rQr#r;r@rUrr*r+r,r-rr0storerr1r2linktousercache)rrr?r8r9r:s rrrs477D! ]477D )9T4+@A bggooid&;<= $  &$$$$%$**2G2G &!//5&EJJu%& & & d#  & & & &s$ 6D,D -D D DDc\t|j|}tt|||y)zRLink / copy the largefile with the specified hash from the store to the cache.N)r@r#r;rUrs rrrs% $ 'D4 %rAcp|j}t}d}|rn|js^|jDcgc]}|j ||}}|s|j |g}t j |d||}|St j |d|j |g|}|Scc}w)zDReturn a match object that applies rmatcher to the standin directorycyrOrv)rcmsgs rrz#getstandinmatcher..rAN)badfn)r shortnamerrr=r r )rrmatcherr standindirrpatpatsr s rrrs 99DJ E)6>nn6FGs *c*GGIIj)*D d4j$e< L d4j499Z+@*AO LHsB3cTt|}|jfd}||_|S)zReturn a matcher that accepts standins corresponding to the files accepted by rmatcher. Pass the list of files in the matcher as the paths specified by the user.cL|xrjt|SrO)matchfnr)rc isstandinrs rcomposedmatchfnz.composestandinmatcher..composedmatchfns!|A 0 0a AArA)rr)rrsmatcherrrs ` @rcomposestandinmatcherrs1!x0H  IB'H OrAc:ttj|zS)zLReturn the repo-relative path to the standin for the specified big file.)shortnameslashrpconvertrs rrrs DMM(3 33rAc,|jtS)zsReturn true if filename is a big file standin. filename must be in Mercurial's internal form (slash-separated).) startswithrrs rrrs   ~ ..rActj|jdd}t|dk(r|dtk(r|dSy)Nrr)rrsplitrr)rbitss rrrsA == " ( (q 1D 4yA~$q'Y.AwrAc|j|}|jj|r%t|}t |}t ||||yt jtd|z)zRe-calculate hash value of lfile and write it into standin This assumes that "lfutil.standin(lfile) == standin", for efficiency. s%s: file not found!N) rrrPr getexecutable writestandinrr"r)rrrrr? executables r updatestandinr s_ ::e D yy~"4( T7D*5kk!23e;<|jjS)zxread hex hash from given filectx of standin file This encapsulates how "standin" data is stored into storage layer.)datastrip)rs rrrs 99;   rAc@|j||dz|xrdxsdy)z#write hash to / xrAN)wwrite)rrr?r s rr r s KKz':d'AcBrActjd}|D]$}|j||j|&t |j S)zRead bytes from instream (iterable) and write them to outfile, computing the SHA-1 hash of the data along the way. Return the hash.rA)rsha1updater2rdigest)instreamoutfilehasherrs rrrsL]]3 F d d v}} rActjj|syt|d5}t |cdddS#1swYyxYw)NrAr))r+r,rPrhexsha1)rfds rrrs= 77>>$  dE br{s AA ctj|j}|tjzxr(|tjzxr|tj zSrO)r+r4r5S_IXUSRS_IXGRPS_IXOTH)rrs rr r sI 778  $ $D   " DLL  " DLL rAc>d}|||}|D] }|||} |S)Ncd|jds|dz }|jdr|dd}||zS)Nrr)endswithr)leftrights rr=zurljoin..join s:}}T" DLD   D !!"IEe|rArv)firstsecondargr=urlas rurljoinr-s4 uf C 3l JrActj}tj|D]}|j |t |j S)zUhexsha1 returns the hex-encoded sha1 sum of the data in the file-like object data)rrrr1rrr)fileobjhr:s rrrsD  A##G,  qxxz?rAc0tj||dS)Nr))r httpsendfile)r#rs rr2r2s  & &r8U ;;rAcftjtjj |S)z@Return a version of path normalized for use with the lfdirstate.)rrr+r,normpath)r,s rr\r\#s ==))$/ 00rAcd|jvr@|jjD]#}|jst|j vs#yt t|j|dS)z,Return true if the repo is a largefile repo.rTF) r r data_entries is_revlogr target_idanyrr#)rentrys r islfilesrepor;(s[)))ZZ,,. E>U__#D  ~dggtU3 44rAceZdZdZy)storeprotonotcapablec||_yrO) storetypes)r]r?s r__init__zstoreprotonotcapable.__init__3s $rAN)r|r}r~r@rvrArr=r=2s%rAr=cg}t|}|d}|jj|gddD]/}t|} t ||}|j ||f1|S#t $rd}Y$wxYw)NFr)rrrrrIOErrorr)rrrrrrr?s rgetstandinsstaterC7sH%G :D==%%"eU&'W%  g/D  &' O D sA&& A43A4ct|}||jvr|j|ddy|jj|}|j||j|j |j dy)NF)rrT)rrp2_infor)rrrrtrackedrrE)rrrrs lfstandinr:s rsynclfdirstaterHGsyI %..  /  '' 2.. }}''MM / rAc<|j}|jj|5||t|j|}|j D]}t |}|t|||d  dddt||y#1swYxYwru) rrchanging_parentsrr#rrrHr)origrrrrrcrs r markcommittedrLZs 88:D  ' ' -? T $DGGT2  ?A OE tZ> ??041??s?B,BBct|jt|}g}|D]}|d|vs |j|d |S)Nr)setsymmetric_differencer) oldstandins newstandinschangedstandinsfilelistrcs rgetlfilestoupdaterTxsS+&;;C .matchfns q>F? "= rA)r#rrrrunning_statusrrraddedremovedrrrrPr  _subdirlfsr_filesrrrrrFcopyrsortedrr)rr r# dirtymatchrrrr modifiedfilesrrr actualfilesrcrrkrlrs @@@rupdatestandinsbymatchrws B  }  __& ]] ) )$ / 'D1J(2(9(9 ):) %FA~ +agg5 A D! =E %"5>99##H-yy''.%dE8< =  F??5;;=&9EL%T51H}}!!2ue"H   D)J1X&    & . . $x 01 IIe E--K  LLF8$$LK \\1: ;(h.==**84<<}}..q199]],,Q/;;1EL! EM Ls  s 'J66KceZdZdZdZdZy)automatedcommithookaStateful hook to update standins at the 1st commit of resuming For efficiency, updating standins in the working directory should be avoided while automated committing (like rebase, transplant and so on), because they should be updated before committing. But the 1st commit of resuming automated committing (e.g. ``rebase --continue``) should update them, because largefiles may be modified manually. c||_yrO)resuming)r]r{s rr@zautomatedcommithook.__init__s   rAcD|jrd|_t||S|Sru)r{rw)r]rr s r__call__zautomatedcommithook.__call__ s" ==!DM(u5 5LrAN)r|r}r~__doc__r@r}rvrArryrys !rAryc^|t|dr|jdS|r |jSdS)a)Return the function to write largefiles specific status out If ``forcibly`` is ``None``, this returns the last element of ``repo._lfstatuswriters`` as "default" writer function. Otherwise, this returns the function to always write out (or ignore if ``not forcibly``) status. _largefilesenabledcyrOrv)roptss rrz!getstatuswriter..7rrA)hasattr_lfstatuswritersr)r#rforciblys rgetstatuswriterr(s8GD*>?$$R(( 99 , ,rA)T) )NN)FrO)Nr~ contextlibrrr+r4mercurial.i18nrmercurial.nodermercurial.pycompatr mercurialrrrr r rr r r rrrrmercurial.utilsrmercurial.dirstateutilsrrrrcontextmanagerrr'r;r@r>rQrVrXrrrrrUrSrrrrrrrrrrr rr rrr r-rr2r\r; Exceptionr=rCrHrLrTrhrwryrrvrArrsgN #    %-  T!   !!  -1$/Md  *4***4Z4n 6 = )$2  7 $&&  4/  =C   <1 5%9%   &<8Bl^.-rA