caoscrawler.transformer_functions module

Defnition of default transformer functions.

caoscrawler.transformer_functions.replace(in_value: Any, in_parameters: dict)

calls the string ‘replace’ function on the first argument and uses the value of the keys ‘remove’ and ‘insert’ stored in the second argument

caoscrawler.transformer_functions.split(in_value: Any, in_parameters: dict)

calls the string ‘split’ function on the first argument and uses the value of the key ‘marker’ stored in the second argument

caoscrawler.transformer_functions.submatch(in_value: Any, in_parameters: dict)

Substitute the variable if it matches the regexp stored in “match”.

Returns the “in” value if it does NOT match the reg exp of ‘match’. Otherwise (if it matches) the value of ‘then’ stored in the second argument is returned.