Have you ever pondered how we QA Alteryx? With over 70 processing tools that support hundreds of functions, just about any file type, field types, and infinite combinations of configurations it may seem like a daunting task, but Alteryx minimizes the pain.
We run 2 single modules for each build of Alteryx that consist of about a hundred Macros. We have a macro module for each tool that tests (via the Test tool) every possible configuration of that tool, and ensures that the expected value is returned. Any time we add functionality or uncover an obscure bug, it is a simple update/fix to the macro module and the Master test module never has to be touched.
Another beauty of approaching the problem this way is that we have control of which Macro gets run in what order. When you design a Master module that will run individual Macro modules, the order in which you bring in the macros is the order in which they run, in sequence, in the same order each and every time.
With the Scheduler and Event controls, Alteryx obediently takes care of itself, minimizing pain and improving quality of life.
Tara