Adding new MetricRepository to read and write data via REST

[cmachgodaddy]

Issue #, if available:

Description of changes:

Adding new MetricRepository to read and write data via REST

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[cmachgodaddy]

@shehzad-qureshi @eycho-am @sseb @sseb Can you review this PR?

[rdsharma26]

Thank you for the pull request. Can you please share more details about your use case? Can you also attach any testing evidence that showcases how the changes work?

[rdsharma26]

@cmachgodaddy Can you provide an update on my comment above?

[cmachgodaddy]

Hi @rdsharma26 , sorry for the late response. My use case was as bellow:
I have a Dynamo DB table, which has a metric table, which contains all of the metric values output from the Deeque so far. And those metrics written by our API to the Dynamo. So, I added this repo as REST, instead of a direct Dynamo ingression.

Another reason it has to be API is our existing metric has its own schema which is not compatible with the schema that Deequ's Anomaly Detection expected. So providing this API as a abstraction layer has the flexibility to convert the schema from one format to another.

I have used this REST repo for a while now, and in production, and it works quite well. Here is how I used it

    val ENDPOINT = apiHelper.get.dlmsURL
    val PATH = s"/v1/accounts/${getAccountId()}/databases/${config.database}/tables/${config.table}/xxx"
    val headers = Map(
      "Content-Type" -> "application/json",
      "Authorization" -> s"sso-jwt xxx"
    )

    val writeRequest = new DefaultRequest[Void]("execute-api")
    writeRequest.setHttpMethod(HttpMethodName.POST)
    writeRequest.setEndpoint(URI.create(ENDPOINT))
    writeRequest.setResourcePath(PATH)
    writeRequest.setHeaders(headers.asJava)

    val readRequest = new DefaultRequest[Void]("execute-api")
    readRequest.setHttpMethod(HttpMethodName.GET)
    readRequest.setEndpoint(URI.create(ENDPOINT))
    readRequest.setResourcePath(PATH)
    readRequest.setHeaders(headers.asJava)
    val repo = new RestMetricsRepository(readRequest, writeRequest)

And, here is how I run the Anomaly Detection job, and send data to Dynamo

      val verificationResult = VerificationSuite()
        .onData(dataDF)
        .useRepository(repo)
        .saveOrAppendResult(todaysKey)
        .addAnomalyCheck(strategyObj, metricObj)
        .run()

These should be in the PR, btw.

I can't snapshot the results in my Dynamo, since it contains some sensitive data. But, the changes in this PR should be very straightforward? it based off the existing patterns of the FileSystem and the InMemory repos.

Let me know if you need anything else to get this PR in?