Skip to main content

dataframe_source

Module containing DataFrameSource class.

DataFrameSource class handles loading data stored in memory in a pandas dataframe.

Classes

DataFrameSource

class DataFrameSource(    *args: Any,    data_splitter: Optional[DatasetSplitter] = None,    seed: Optional[int] = None,    modifiers: Optional[Dict[str, DataPathModifiers]] = None,    ignore_cols: Optional[Union[str, Sequence[str]]] = None,    **kwargs: Any,):

Data source for loading dataframes.

Arguments

  • data: The dataframe to be loaded.

Methods


def get_data(self, **kwargs: Any)> pandas.core.frame.DataFrame:

Loads and returns datafrom DataFrame dataset.

Returns A DataFrame-type object which contains the data.

def get_values(self, col_names: List[str], **kwargs: Any)> Dict[str, Iterable[Any]]:

Get distinct values from columns in DataFrame dataset.

Arguments

  • col_names: The list of the columns whose distinct values should be returned.

Returns The distinct values of the requested column as a mapping from col name to a series of distinct values.

Variables

  • multi_table : bool - Attribute to specify whether the datasource is multi table.