Filters

Filters remove some lines from the flux.

class rdc.etl.transform.filter.Filter(filter=None)[source]

Filter out hashes from the stream depending on the filter callable return value, when called with the current hash as parameter.

Can be used as a decorator on a filter callable.

filter[source]

A callable used to filter the hashes. If return value is True for a given hash, then the hash will be yield to output. Otherwise, it will be burnt.

Example:

>>> from rdc.etl.transform.filter import Filter
>>> from rdc.etl.hash import Hash

>>> @Filter
... def my_filter(hash, channel):
...     return hash['keepme'] == True

>>> list(my_filter(
...         (('foo', 'bar'), ('keepme', True), ),
...         (('foo', 'baz'), ('keepme', False), ),
...     ))
[H{'foo': 'bar', 'keepme': True}]