a +=ic@sdZddlZddlmmZddlmZddl m Z ddl m Z dZGdddejjejZd d Zd d Zd dZddZddZddZdS)z&Keras utilities for DTensor unit test.N) parameterized)api)contextcs<eZdZdZefddZfddZeddZZ S)DTensorBaseTestz8Provides comparison helper for dtensor vs local results.cstt|dSN)superr setUpClass)cls __class__h/home/droni/.local/share/virtualenvs/DPS-5Je3_V2c/lib/python3.9/site-packages/keras/dtensor/test_util.pyr szDTensorBaseTest.setUpClasscstttdSr)rtearDownrZ async_wait reset_dtensor)selfr r rr#s zDTensorBaseTest.tearDowncshtfdd}d}tjdr@|d}tdt|n|d}tdt|t |S)aConfigs corresponding mesh given test context. If runs on a CPU mesh, set virtual device on CPU. If runs on a GPU mesh, sets virtual device on GPU with proper memory limits. if runs on a TPU mesh, initializes TPU system. Args: device_type_mesh_map: A dictionary containing device_type -> mesh mapping. Returns: A properly configured mesh for use in test. cs(|d}|dur$td||f|S)Nz%Requires a %s mesh to run test on %s.)get ValueError) device_typemeshdevice_type_mesh_mapr rget_mesh>s z0DTensorBaseTest.configTestMesh..get_meshNGPUCPU) reset_contexttfconfiglist_physical_devicesreset_logical_devicesnpprodshaperZensure_initialized)rrrr rrconfigTestMesh,s  zDTensorBaseTest.configTestMesh) __name__ __module__ __qualname____doc__ classmethodr r staticmethodr# __classcell__r r r rrs  rcs,t|}tfddt|D|S)Ncsg|]}tjd|dqS)zlocalhost/replica:0/task:0)ZjobrZ device_index)rZ DeviceSpec).0irr r Vs z'create_device_array..)r r!Zasarrayrangereshape)r"r device_countr r-rcreate_device_arraySs   r2cCst||}t|Sr)r2r Zraveltolist)r"rdevicesr r rcreate_device_listas r5cCst|}t||Sr)r r!Zaranger0)r"r1r r rcreate_device_ids_arrayfs r6cCs tdSr)rZ_reset_contextr r r rrksrcCs~ttj|}|dkr>tj|dtjg|n<|dkrntj|dtjjtdg|n td|dS)aVResets logical devices for CPU/GPU. Logical devices can only be instantiated once on a particular context. For now, context re-use is triggering some function duplication errors, so we reset the context on each call. Args: device_type: The device_type to reset. count: numbers of virtual device to reset to. rrr)Z memory_limitz;resetting logical device for non-supported device type : %sN) rrrrupperZ set_logical_device_configurationZLogicalDeviceConfiguration_DEFAULT_GPU_MEMORY_LIMITr)rcountr4r r rros2     rcCs tdSr) dtensor_api_resetr r r rrsr)r'numpyr Ztensorflow.compat.v2compatv2rZ absl.testingrZtensorflow.dtensor.pythonrr:Ztensorflow.python.eagerrr8testZTestCaserr2r5r6rrrr r r rs   7&