msgpack_caching

Module Contents

Functions

benchmark(→ pandas.DataFrame)	Benchmarks loading speed of the driver_types over num_epochs epochs.
time_epoch(→ float)	Creates iterator and returns time to fetch all shards.

Attributes

ax
df
driver_types
remote_path
so

msgpack_caching.ax

msgpack_caching.df

msgpack_caching.driver_types

msgpack_caching.remote_path = gs://your-bucket/msgpack-cache-demo-data

msgpack_caching.so

msgpack_caching.benchmark(driver_types: Dict[str, Any], num_epochs: int = 10) → pandas.DataFrame

Benchmarks loading speed of the driver_types over num_epochs epochs.

msgpack_caching.time_epoch(driver_init: Callable[], squirrel.driver.MessagepackDriver]) → float

Creates iterator and returns time to fetch all shards.