[pipebase] is a [tokio] based runtime library for data integration app. It provides basic [pipe]s implemented with rust standard library.

Basic Pipes

list of basic pipes built in pipebase | pipe type | implementation | example | | --------- | -------------- | ------- | | Exporter | Printer | [printer] | | Poller | Timer | [timer] | | Listener | LocalFilePathVisitor | [file_path] | | Streamer | FileLineReader | [stateless_word_count] | | Streamer | IteratorReader | [stateless_word_count] | | Mapper | FieldVisit | [field_filter] | | Mapper | FilterMap | [field_filter] | | Mapper | StringSplitter | [stateless_word_count] | | Mapper | Projection | [project_file] | | Mapper | FileReader | [project_file] | | Mapper | FileWriter | [convert_csv] | | Mapper | Conversion | [convert_csv] | | Selector | RandomSelector | [ingest_redis_parallel] | | Collector | TextCollector | [ingest_elasticsearch] | | Collector | InMemoryWindowCollector | [moving_average] |