openaq_engine.src.utils package

Submodules

openaq_engine.src.utils.utils module

openaq_engine.src.utils.utils.api_response_to_df(url)

openaq_engine.src.utils.utils.ee_array_to_df(arr, list_of_bands)

Transforms client-side ee.Image.getRegion array to pandas.DataFrame.

openaq_engine.src.utils.utils.get_categorical_feature_indices(df: DataFrame) → List[int]

openaq_engine.src.utils.utils.get_data(query)

Pulls data from the db based on the query.

Parameters:

query (str) – SQL query from the database

Returns:

Dump of Query into a DataFrame

Return type:

pd.DataFrame

openaq_engine.src.utils.utils.get_s3_file_path_list(resource, bucket, folder)

openaq_engine.src.utils.utils.json_provider(file_path, cmd_name)

openaq_engine.src.utils.utils.parametrized(dec)

openaq_engine.src.utils.utils.query_results_from_api(headers, url)

openaq_engine.src.utils.utils.query_results_from_aws(params, query, wait=True)

openaq_engine.src.utils.utils.read_csv(path: str, **kwargs: Any) → DataFrame

Read csv ensuring that nan’s are not parsed

openaq_engine.src.utils.utils.write_csv(df: DataFrame, path: str, **kwargs: Any) → None

Write csv to provided path ensuring that the correct encoding and escape characters are applied.

Needed when csv’s have text with html tags in it and lists inside cells.

openaq_engine.src.utils.utils.write_dataclass(dclass: object, path: str) → None

Write a dataclass to the provided path as a json

openaq_engine.src.utils.utils.write_to_db(df, engine, table_name, schema_name, table_behaviour, index=False, **kwargs)

Module contents