0 votes
1 view
in Azure by (17.6k points)

I am considering Google DataFlow as an option for running a pipeline that involves steps like:

  1. Downloading images from the web;
  2. Processing images.

I like that DataFlow manages the lifetime of VMs required to complete the job, so I don't need to start or stop them myself, but all examples I came across use it for data mining kind of tasks. I wonder if it is a viable option for other batch tasks like image processing and crawling.

Please log in or register to answer this question.

Welcome to Intellipaat Community. Get your technical queries answered by top developers !