Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alternative for UserMetricsSystem into l4jv2 branch? #235

Open
mastermin opened this issue Feb 23, 2024 · 0 comments
Open

Alternative for UserMetricsSystem into l4jv2 branch? #235

mastermin opened this issue Feb 23, 2024 · 0 comments

Comments

@mastermin
Copy link

mastermin commented Feb 23, 2024

We would like to upgrade our Databricks Runtime.
Currently we are on 10.4 and using UserMetricsSystem to create customer specific counter metrics.

Like this one:

import org.apache.spark.metrics.UserMetricsSystems

private final val metrics = UserMetricsSystems.getMetricSystem(
identifier,
builder => {
for (m <- metricTypes) {
builder.registerCounter(m.toString())
}
}
)

Branch l4jv2 doesn't contain the UserMetricsSystems class anymore.

README told me:
"
Databricks has contributed an updated version to support Azure Databricks Runtimes 11.0 (Spark 3.3.x) and above on the l4jv2 branch at: https://github.com/mspnp/spark-monitoring/tree/l4jv2.
Be sure to use the correct branch and version for your Databricks Runtime.
"

What I have to do to create/register/enable custom specific metrics (aka counter)?

Thanks for advice.

BR,
Markus

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant