Skip to content

Index

Module superwise.utils.storage

Sub-modules

  • superwise.utils.storage.azure_storage
  • superwise.utils.storage.dataframe
  • superwise.utils.storage.gcs
  • superwise.utils.storage.internal_storage
  • superwise.utils.storage.local
  • superwise.utils.storage.s3

Functions

extract_directory(url: str) Description:

extract given url of gcs to bucket name and prefix

Args:

url: the url to extract

Return:

a tuple of bucket and prefix

validate_file_size(file_path, file_size)

validate_files_size(filenames: Union[list, str], size: int)