* Include delete kernel to the DataXSchemaAndQueryJob Scenario steps
(cherry picked from commit 59add3286d95a209cb50076d151ed4c2f5a3c239)
* The endpoint to delete a kernel input changed, and this PR addresses the new input change
(cherry picked from commit 9ccbc2885db923d95d99101e759f95a7c20ee153)
* Add comments to the new DeleteKernelJson method in Helper class
* Remove dataBricks token from Context
* Make SSL verification from client side configurable on http requests
* Make server certificate validation parameter a more explicit description and naming. Add comments on its definition at context and AppConfig classes.
* Finish refactoring of previous commit
* The endpoint to delete a kernel input changed, and this PR addresses the new input change
(cherry picked from commit 9ccbc2885db923d95d99101e759f95a7c20ee153)
* Include delete kernel to the DataXSchemaAndQueryJob Scenario steps
(cherry picked from commit 59add3286d95a209cb50076d151ed4c2f5a3c239)
* Add comments to the new DeleteKernelJson method in Helper class
* Remove dataBricks token from Context
* Make SSL verification from client side configurable on http requests
* Make server certificate validation parameter a more explicit description and naming. Add comments on its definition at context and AppConfig classes.
* Finish refactoring of previous commit
* Refactor Scenario classes + refactoring how those classes makes http requests using the scenario context object
* Improve and isolate internal context variable so it can be used in a more consistent way through the helper functions
* Simplify url generation
* Avoid over-engineering
* Refactor get access token method to be consistent with the proposed refactor
* Enable scenario tester tests
* Add unit tests + making some refactor based on that: we need to explicitly cast to the desired type when using the dynamic parsed json result
* Add license header, avoid using magic values in uris in the tests, remove blank lines
* Make some refactor as result of manual testing
* Code clean up given code review
* Address PR comments
* Adding steps for a new JobRunner job calling into ScenarioTester. These steps are essentially calling into and testing the apis within InteractiveQueryService, LiveDataService and SchemaGeneratorService. Also adding support for running the JobRunner on both DataBricks and HDInsight clusters.
* Updating the code per PR feedback. Essentially updating one of the parameters' names. Removing some redundant code
* Refactoring the code a little to create a helper class and a helper mehtod for constructing Initialization Kernel json object
* Adding JobRunner Service and the first DataX mainline job that calls into the ScenarioTester. All sensitive info is in the KeyVault
* Refactoring the storage utility files to be part of DataX.Utility.Blob project and updating the gitignore file to include the appsettings.Development.json
* Removing duplicate code for InstanceExportDescriptorProvider. Creating a new utility project: DataX.Utility.Composition.
* Updating the method GetExportDescriptors. Also updating the namespace for the storage utility classes.
Jose Zavala
atuli
Kwangje Cho
Anupama Tuli
Shibani Basava