a ==ic*ã@sPddlZddlmZddlmZddlmZddlmZm Z Gdd„deƒZ dS)éN)Úcore)ÚDBFileReader)Úpipe)ÚClusterÚ TaskGroupcs<eZdZdZd‡fdd„ Zdd „Zdd d„Zdd „Z‡ZS)ÚCachedReaderZ cached_readerÚLevelDBNédFcs2|dusJdƒ‚||_tt|ƒ |||||¡dS)Nzoriginal_reader can't be None)Úoriginal_readerÚsuperrÚ__init__)Úselfr Údb_pathÚdb_typeÚnameÚ batch_sizeZ loop_over©Ú __class__©úl/home/droni/.local/share/virtualenvs/DPS-5Je3_V2c/lib/python3.9/site-packages/caffe2/python/cached_reader.pyr>s ûzCachedReader.__init__cOs|jjS)zÛPrepare the reader schema. Since an original reader is given, use it's schema as ground truth. Returns: schema: schema.Struct. Used in Reader.__init__(...). )r Ú_schema)r ÚargsÚkwargsrrrÚ_init_reader_schemaRs z CachedReader._init_reader_schemac Csòtj |j¡r|st dg¡St d¡}| |¡tƒ„t |j ¡Xtƒ2}t|j |j ¡dd| ¡ ¡}Wdƒn1s†0YWdƒn1s¤0YWdƒn1sÂ0Yt d¡}| |¡t d|||g¡S)aBuild a step for generating cache DB file. If self.db_path exists and not overwritting, build an empty step. Overwise, build a step as follows. Pipe original reader to the _DatasetWriter, so that dataset field blobs are populated. Then save these blobs into a file. Args: overwrite: bool. If true, ignore the existing file and build a new one overwritting the existing one anyway. Returns: build_cache_step: ExecutionStep. The step to be run for building a cache DB file. Z build_stepÚinité)Znum_threadsNÚsaveZbuild_cache)ÚosÚpathÚexistsrrZexecution_stepZNetZ_init_field_blobs_as_emptyrZ NameScoperrrr ÚdsÚwriterZto_taskZget_stepÚ_save_field_blobs_to_db_file)r Ú overwriteZinit_netZcopy_tgZ copy_stepZsave_netrrrÚbuild_cache_step]s f zCachedReader.build_cache_stepcCs*|j|j ¡g|j|j|j ¡dddS)z0Save dataset field blobs to a DB file at db_pathT)ÚdbrZblob_name_overridesZ absolute_pathN)ZSaver Z get_blobsrrÚfield_names)r Únetrrrr"|súz)CachedReader._save_field_blobs_to_db_file)rNr F)F) Ú__name__Ú __module__Ú__qualname__Zdefault_name_suffixrrr$r"Ú __classcell__rrrrrs0ù r)rZ caffe2.pythonrZcaffe2.python.db_file_readerrZcaffe2.python.pipelinerZcaffe2.python.taskrrrrrrrÚs