I’m currently looking into a way to run a .NET DAG of jobs(scenario simulations) on a cluster using Hadoop or Spark. In both cases i ran into problems concerning the code language.
What if found is that Spark supports code written in: Scala, Python, Java and R but not in .NET.
And Hadoop does support writing jobs in .NET, however i didn’t found a DAG implementation for Hadoop on .NET.
Is there a way to implement a DAG of jobs on a cluster/cloud using .NET programming language?