$SrSSKrSSKrSSKrSSKrSSKrSSKJr SSKJ r SSK J r SSK J r SSK Jr SSKJr SS KJr SSKrSS KJr S S /rS rSrSrSSjrSrSr"SS\5rSrSrSr g)zEUtility methods to upload source to GCS and call Cloud Build service.N)encoding)cloudbuild_util) storage_api)log) properties)files)times)filter Dockerfile .dockerignorec6[RRU5n[R"SUS9n[ U5H2n[RR XF5nURXvSS9 M4 [R"U5Hzup[R"U R55n [R"US9n [U R55U lUR#XS9 U R%5 M| UR%5 g)aCreate tarfile for upload to GCS. The third-party code closes the tarfile after creating, which does not allow us to write generated files after calling docker.utils.tar since gzipped tarfiles can't be opened in append mode. Args: upload_dir: the directory to be archived gen_files: Generated files to write to the tar paths: allowed paths in the tarfile gz: gzipped tarfile object wmodefileobjF)arcname recursive)name)rN)ospathabspathtarfileopensortedjoinaddsix iteritemsioBytesIOencodeTarInfolengetvaluesizeaddfileclose) upload_dir gen_filespathsgzroottr full_pathrcontents genfileobjtar_infos -lib/googlecloudsdk/api_lib/app/cloud_build.py _CreateTarr3+s  $$ llR(!Umd T(IEE)UE3 i0ndHOO-.JD)H ++-.HMIIhI+ 1 '')cv[RRUS5n[5nSn[RR U5(a[ R "U5nOURS5nU(a9[[[UR555nU[[5-nU$)aHelper function to read the .dockerignore on disk or in generated files. Args: upload_dir: the path to the root directory. gen_files: dict of filename to contents of generated files. Returns: Set of exclusion expressions from the dockerignore file. r N) rrrsetexistsrReadFileContentsgetr bool splitlinesBLOCKLISTED_DOCKERIGNORE_PATHS)r(r) dockerignoreexcludeignore_contentss r2_GetDockerignoreExclusionsr@Fsj/:, E'/WW^^L!!,,\:OmmO4O&99;<=G s122G .r4cSSKn[RRU5nURR U[ U55nURU5 U$)aHelper function to filter paths in root using dockerignore and skip_files. We iterate separately to filter on skip_files in order to preserve expected behavior (standard deployment skips directories if they contain only files ignored by skip_files). Args: upload_dir: the path to the root directory. source_files: [str], relative paths to upload. exclude: the .dockerignore file exclusions. Returns: Set of paths (relative to upload_dir) to include. rN)dockerrrrutils exclude_pathslistintersection_update)r( source_filesr>rBr,r*s r2_GetIncludedPathsrH_sH"  $$ ,, $ $T4= 9%L) ,r4cU=(d 0n[X5n[XU5n[R"5n[R"[ R RUS55n[R"SUS9n[XXX5 SSS5 UR5 [R"5n U RURU5 SSS5 g!,(df  NX=f!,(df  g=f)aUpload a gzipped tarball of the source directory to GCS. Note: To provide parity with docker's behavior, we must respect .dockerignore. Args: upload_dir: the directory to be archived. source_files: [str], relative paths to upload. object_ref: storage_util.ObjectReference, the Cloud Storage location to upload the source tarball to. gen_files: dict of filename to (str) contents of generated config and source context files. zsrc.tgzwbrN)r@rHrTemporaryDirectoryBinaryFileWriterrrrgzipGzipFiler3r'r StorageClient CopyFileToGCSr) r(rG object_refr)dockerignore_contentsincluded_pathstemp_dirfr+storage_clients r2 UploadSourcerW{so2)4ZK$ 57. !X rww||Hi@AA D! ,; -GGI ..0N  4 "! , ,"!s%A C2 C!A C2! C/ +C22 Dc^Ucg[R"USS9n[UR5$)zAReturns the service timeout in seconds given the duration string.Ns)default_suffix)r ParseDurationint total_seconds)timeout_property_strbuild_timeout_durations r2GetServiceTimeoutSecondsr`s5!  ../C>AC # 1 1 22r4cRUcg[U5n[R"U5S-$)zAReturns the service timeout duration string with suffix appended.NrY)r`r text_type)r^build_timeout_secss r2GetServiceTimeoutStringrds,! /0DE ) *S 00r4c,^\rSrSrSrU4SjrSrU=r$)InvalidBuildErrorzFError indicating that ExecuteCloudBuild was given a bad Build message.cJ>[[U] SRU55 g)NzeField [{}] was provided, but should not have been. You may be using an improper Cloud Build pipeline.)superrf__init__format)selffield __class__s r2rjInvalidBuildError.__init__s" T+ ==CVE]Lr4)__name__ __module__ __qualname____firstlineno____doc__rj__static_attributes__ __classcell__)rns@r2rfrfsNLLr4rfcFUHn[XS5cM[U5e g)zDValidates that a Build message doesn't have fields that we populate.N)getattrrf)buildfieldsrms r2_ValidateBuildFieldsr|s$euT". e $$r4c "[R"5n[RRR R 5n[R"SRU55 URURUSSUS/S9/U/S9$)aGet the default build for this runtime. This build just uses the latest docker builder image (location pulled from the app/container_builder_image property) to run a `docker build` with the given tag. Args: output_image: GCR location for the output docker image (e.g. `gcr.io/test-gae/hardcoded-output-tag`) Returns: Build, a CloudBuild Build message with the given steps (ready to be given to FixUpBuild). zUsing builder image: [{0}]rzz-t.)rargs)stepsimages) rGetMessagesModulerVALUESappcontainer_builder_imageGetrdebugrkBuild BuildStep) output_imagemessagesbuilders r2GetDefaultBuildrs . . 0(    ! ! 9 9 = = ?')) ( / / 89    W&-t\3%G I J^  r4c[R"5n[R"U5nUR(a7URR R [R"S5S9 [US5 [[RRRR55UlUR"UlUR'UR)UR"UR*S9S9UlU$)aReturn a modified Build object with run-time values populated. Specifically: - `source` is pulled from the given object_ref - `timeout` comes from the app/cloud_build_timeout property - `logsBucket` uses the bucket from object_ref Args: build: cloudbuild Build message. The Build to modify. Fields 'timeout', 'source', and 'logsBucket' will be added and may not be given. object_ref: storage_util.ObjectReference, the Cloud Storage location of the source tarball. Returns: Build, (copy) of the given Build message with the specified fields populated. Raises: InvalidBuildError: if the Build message had one of the fields this function sets pre-populated key)r)sourcetimeout logsBucket)bucketobject) storageSource)rrrCopyProtoMessage substitutionsadditionalPropertiessortoperator attrgetterr|rdrrrcloud_build_timeoutrrrrSource StorageSourcerr)rzrQrs r2 FixUpBuildrs, . . 0(  # #E *%  ,,11    &2(uAB)//3357%-&&%**""+!%, ,r4)N)!rurMrrrrapitools.base.pyr!googlecloudsdk.api_lib.cloudbuildrgooglecloudsdk.api_lib.storagergooglecloudsdk.corerrgooglecloudsdk.core.utilrr r six.movesr r<r3r@rHrWr`rd ValueErrorrfr|rrrpr4r2rs"L  %=6#***  #/!@ 6285@31L L%0-r4