Does Dataflow Runner replace EmrEtlRunner

As stated in the RFC, the goal in the long run is to have two components:

  • dataflow runner which will actually spin up a cluster and run the pipeline
  • snowplow ctl which will be in charge of generating configuration files ready to be fed to dataflow runner from “the old config.yml”
1 Like