caoscrawler.stores module

class caoscrawler.stores.Store

Bases: object

Base class for record store and general store which act as storages for records and values used during crawling.

update(other: dict)

get_storage()

create_scoped_copy()

get_dict_copied(): Only for debugging.

get_internal_id(key): Only for debugging.

class caoscrawler.stores.GeneralStore: Bases: Store

class caoscrawler.stores.RecordStore

Bases: Store

get_names_current_scope(): Return the names of all records that were created in the current scope.

get_records_current_scope(): Return all records that were created in the current scope.