We provide expert installation service for this software. Our team will install, configure, and secure Spark Data Pipeline on your server. plans start at just $30.
A simplified, lightweight ETL Framework based on Apache Spark
Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pipelines.
A light Kafka to HDFS/S3 ETL library based on Apache Spark
Resilient data pipeline framework running on Apache Spark
Apache-Spark based Data Flow(ETL) Framework which supports multiple read, write destinations of different types and also support multiple categories of transformation rules.
A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml
i) Download the Elasticsearch 6.3.0 or latest version and unzip it.
ii) Run the following command.
$ bin/elasticsearch
Clone and run in local mode:
$ git clone [email protected]:techmonad/spark-data-pipeline.git
$ cd spark-data-pipeline
$ sbt run