SrSSKrSSKJr SSKJr SSKJr SSKJr SSK J r SSK J r S r "S S \R5r\RR S \RR"S \RR$S\RR&S\RR(S\RR*S0rSrSSjrSrSr\\SSSS4SjrSrSr"SS5rg)z3Used to collect anonymous transfer-related metrics.N) storage_url) task_util)metrics) properties)files) platformsc~[RRRR 5(a[RR R R5RSS5n[RR[RR R US5 gg)a;Transform the user agent when the gsutil shim is used to run gcloud. This transforms `gcloud.storage.command` to `gcloud.gsutil.command`. This needs to be called by every command, so the best place to put this is likely surface/storage/__init__.py, but if there's a better place it could be called there instead. zgcloud.storage.zgcloud.gslibshim.N) rVALUESstoragerun_by_gsutil_shimGetBoolr command_nameGetreplaceSetInvocationValue)command_path_strings 6lib/googlecloudsdk/command_lib/storage/metrics_util.pyfix_user_agent_for_gsutil_shimrs1199;;$++33@@DDFNN.0((!!..0CTK<c\rSrSrSrSrSrg)ParallelismStrategy,N)__name__ __module__ __qualname____firstlineno__ SEQUENTIALPARALLEL__static_attributes__rrrrr,s * (rrrrc[RRRR 5n[R "USU-U5 g)zCommon code for processing an event. Args: metric (str): The metric being recorded. value (mixed): The value being recorded. zStorage-N)rr rrrCustomKeyValue)metricvaluers r_record_storage_eventr+>s;""**77;;=, zF':EBrc[R"5(a[RR$[R R$N)rshould_use_parallelismrr!r*r rrr_get_parallelism_strategyr/Is5%%''  ' ' - --  ' ' - --rcx[RRRR 5(aS$S$)Nrr)rr r r r rrr_get_run_by_gsutil_shimr1Os-''::BBDDK!Krc[S[55 [S[55 [SU5 [SU5 [SU5 [SU5 [SU5 [SU5 g ) aReports metrics for a transfer. Args: source_scheme (int): The source scheme, i.e. 'gs' or 's3'. destination_scheme (int): The destination scheme i.e. 'gs' or 's3'. num_files (int): The number of files transferred. size (int): The size of the files transferred, in bytes. avg_speed (int): The average throughput of a transfer in bytes/sec. disk_io_time (int): The time spent on disk of a transfer in ms. rRunByGsutilShim SourceSchemeDestinationScheme NumberOfFilesSizeOfFilesBytesAverageSpeedBytesPerSec DiskIoTimeMsN)r+r/r1 source_schemedestination_scheme num_filessize avg_speed disk_io_times rreportrASsb-/H/JK)+B+DE 6+-?@3*D119= 5rcZ/n[R"S5nUR5SSnUHBnUR5u pEUSR 5(dM1UR U5 MD SSS5 U$!,(df  U$=f![R a U$f=f)zYRetrieves a list of disk partitions. Returns: An array of partition names as strings. z/proc/partitionsrN)r FileReader readlinessplitisdigitappendError) partitionsflinesline_names r_get_partitionsrPis *    , -kkmABe$ 1a 8       D ! .  . -     s5BAB!B6B B BBB*)B*c Sn[5n0n[R"S5nUR5nUHunUR 5SSnUu pxppppX;dM&[ U 5U-n [ U 5U-n [ U 5n [ U 5n [ U 5n [ U5nXXX4X('Mw SSS5 U$!,(df  U$=f![R a U$f=f)aRetrieves disk I/O statistics for all disks. Adapted from the psutil module's psutil._pslinux.disk_io_counters: http://code.google.com/p/psutil/source/browse/trunk/psutil/_pslinux.py Originally distributed under under a BSD license. Original Copyright (c) 2009, Jay Loden, Dave Daeschler, Giampaolo Rodola. Returns: A dictionary containing disk names mapped to the disk counters from /disk/diskstats. iz/proc/diskstatsN )rPrrDrErFintrI) sector_sizerJretdictrKrLrMvaluesrNrOreadsrbytesrtimewriteswbyteswtimes rget_disk_countersr]s + * '   + ,kkme$cr"HNE1EfV  v;,&v;,&e*%v;&e*%e*% &%G'- -$ .% - ,$ .   . s5C5B<AB<2C< C C CC&%C&c6\rSrSrSrSrSrSrSrSr Sr g ) MetricsReporterz9Mix-in for tracking metrics during task status reporting.cN[Ul[Ul[5Ulgr-)UNSET_source_scheme_destination_schemer]_disk_counters_start)selfs r__init__MetricsReporter.__init__sD$D 1 3DrcBU(a[UR$[$)z;Extracts the scheme as an integer value from a storage_url.)PROVIDER_PREFIX_TO_METRICS_KEYschemerb)rfurls r_get_scheme_value!MetricsReporter._get_scheme_values +CJJ 77 LrcUR[:Xa URUR5UlUR[:Xa!URUR 5Ulgg)ztSets source and destination schemes, if available. Args: status_message (thread_messages.*): Message to process. N)rcrbrm source_urlrddestination_url)rfstatus_messages r#_set_source_and_destination_schemes3MetricsReporter._set_source_and_destination_schemessZ  e# 22>3L3LMd 5(!%!7!7  ( ("*d)rc [RR5nU[RR:Xa{URn[ 5n[ UR5Vs/sH oDSUS-PM sn5[ UR5Vs/sH oDSUS-PM sn5- $[$s snfs snf)z&Calculate deltas of time spent on I/O.r$r%) rOperatingSystemCurrentLINUXrer]sumrVrb)rf current_os disk_startdisk_endstats r_calculate_disk_io"MetricsReporter._calculate_disk_ios**224JY..444,,j"$h1BC1B7T!W$1BCD1B1B1DE1D7T!W$1DEFGH LDEs *B>C c [[U5[U5- 5n[URURUUUUR 5S9 g)zReports back all tracked events via report method. Args: total_bytes (int): Amount of data transferred in bytes. time_delta (int): Time elapsed during the transfer in seconds. num_files (int): Number of files processed r:N)roundfloatrArcrdr~)rf total_bytes time_deltar=r?s r_report_metricsMetricsReporter._report_metricssLeK(5+<<=I ))33 ,,. 0r)rdrercN) rrrr__doc__rgrmrsr~rr"rrrr_r_sA4 * 0rr_)r)renum"googlecloudsdk.command_lib.storager(googlecloudsdk.command_lib.storage.tasksrgooglecloudsdk.corerrgooglecloudsdk.core.utilrrrEnumrProviderPrefixFILEGCSHTTPHTTPSPOSIXS3rjrbr+r/r1rArPr]r_rrrrs: :>'**. K $)) ##Q""A##Q$$a$$a!!1 " C. L5AQQ6,.(V7070r