tabsdata.AzureSource#

class AzureSource(uri: str | List[str], credentials: dict | AzureCredentials, format: str | dict | FileFormat = None, initial_last_modified: str | datetime = None)[source]#

Bases: Input

Class for managing the configuration of Azure-file-based data inputs.

format#

The format of the file. If not provided, it will be inferred from the file extension of the data.

Type:

FileFormat

uri#

The URI of the files with format: ‘az://path/to/files’. It can be a single URI or a list of URIs.

Type:

str | List[str]

credentials#

The credentials required to access Azure.

Type:

AzureCredentials

initial_last_modified#

If provided, only the files modified after this date and time will be considered.

Type:

str | datetime.datetime

to_dict()[source]#

Converts the AzureSource object to a dictionary.

__init__(uri: str | List[str], credentials: dict | AzureCredentials, format: str | dict | FileFormat = None, initial_last_modified: str | datetime = None)[source]#
Initializes the AzureSource with the given URI and the credentials required to

access Azure, and optionally a format and date and time after which the files were modified.

Parameters:

  • uri (str | List[str]) – The URI of the files with format: ‘az://path/to/files’. It can be a single URI or a list of URIs.

  • credentials (dict | AzureCredentials) – The credentials required to access Azure. Can be a dictionary or a AzureCredentials object.

  • format (str | dict | FileFormat, optional) – The format of the file. If not provided, it will be inferred from the file extension of the data. Can be either a string with the format, a FileFormat object or a dictionary with the format as the ‘type’ key and any additional format-specific information. Currently supported formats are ‘csv’, ‘parquet’, ‘ndjson’, ‘jsonl’ and ‘log’.

  • initial_last_modified (str | datetime.datetime, optional) – If provided, only the files modified after this date and time will be considered. The date and time can be provided as a string in [ISO 8601 format](https://en.wikipedia.org/wiki/ISO_8601) or as a datetime object. If no timezone is provided, UTC will be assumed.

Raises:

  • InputConfigurationError –

  • FormatConfigurationError –

Methods

__init__(uri, credentials[, format, ...])

Initializes the AzureSource with the given URI and the credentials required to

Attributes

credentials

The credentials required to access Azure.

format

The format of the file.

initial_last_modified

The date and time after which the files were modified.

uri

'az://path/to/files'.