-
Notifications
You must be signed in to change notification settings - Fork 163
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Revert "Bias to incubation (#1449)" rebase, then reapply as a merge. #1495
Merged
openshift-merge-robot
merged 25 commits into
opendatahub-io:incubation
from
alexcreasy:incubation-revert-bias
Jul 11, 2023
Merged
Revert "Bias to incubation (#1449)" rebase, then reapply as a merge. #1495
openshift-merge-robot
merged 25 commits into
opendatahub-io:incubation
from
alexcreasy:incubation-revert-bias
Jul 11, 2023
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Rework Inference Metrics & Add Runtime Metrics (invalid quieries) * Add stacked line chart functionality
* Explainability: Fairness and Bias Metrics (Phase 0) (opendatahub-io#1001) (opendatahub-io#1006) (opendatahub-io#1007) (opendatahub-io#1008) - Initial feature set for TrustyAI related UI functionality - Adds tab based navigation to modelServing screen - Adds a bias metrics tab with charts for visualising SPD and DIR metrics - Enhances prometheus query features for accessing TrustyAI data - Enhacements to MetricsChart component making it more configurable * Update key of request name to match trusty backend * Remove unnecessary div and inline style from tooltip * Remove 15 minutes refresh option * Prefer optional prop to type union with undefined * Move function definitions inline * Prefer narrowing over type conversion * Inline tab change handler * Remove toolbar option from ApplicationsPage * Inline domain calculator functions * Move defaultDomainCalculator to utils * Return null instead of undefined * Use threshold label instead of index for key * Add enum for tab keys * Remove magic numbers from domain calculations * Make ResponsePredicate mandatory and add predicate to useQueryRangeResourceData
* Add support for insecure http requests in development mode * Adds low level API client for TrustyAI service * Adds TrustyAI high level API and contexts * Get scheme of TrustyAI route from k8s data
* Add model bias configuration table * rebase and remove mock data
* Add configuration modal * address comments * get rid of some TODOs and refine the route
…datahub-io#1349) * Enhancements to model bias screen * Display of multiple bias charts simultaneously * Multi-select component, allowing free text, or select-from-list selection of chartst to display * Ability to collapse / expand individual charts * User selectable refresh rates of chart data * Chart selection and open / closed status is persisted to session cache for life of user's browser session Display user defined threshold values on charts (opendatahub-io#1163) * Clean up of bias chart logic * Displays thresholds chosen by user, or defaults if none. * Improves domain and threshold calculation based on user values or defaults
* Fix metrics submission issue and handle errors * fix lint issue * use error handler on GET functions
…and set feature flag (opendatahub-io#1390) * Default and restrict threshold, add tooltips, default duplicate name and set feature flag * fix lint * add tooltips and dropdown descriptions * clear data when closing configuration modal * really solve deleting issue, make empty table view a common component and apply it everywhere * address comments
…o#1399) * Adds refresh interval options that match openshift observability dashboard * Show first chart from list, if none selected when user first navigates to bias tab * Use search icon instead of plus for nothing selected empty state * Fix error with calculation of 30 days constant * Deleted charts are removed from session storage
…ahub-io#1403) (opendatahub-io#1404) * Refactor prometheus queries to remove duplication * Fix graph not refreshing issue * Add code review suggestions
opendatahub-io#1413) * Add performance metrics feature flag, refactor runtime server route and solve layout issues * revert some style changes
* Adds support for TrustyAI Operator (opendatahub-io#1276) * Changes from feedback
…datahub-io#1473) * Retrieve bias metrics from thanos querier (opendatahub-io#1472) * Implement review feedback
This reverts commit bb8e2c5.
alexcreasy
requested review from
andrewballantyne
and removed request for
DaoDaoNoCode
July 10, 2023 15:06
alexcreasy
changed the title
Revert "Bias to incubation (#1449)"
Revert "Bias to incubation (#1449)" rebase, then reapply as a merge.
Jul 10, 2023
alexcreasy
changed the title
Revert "Bias to incubation (#1449)" rebase, then reapply as a merge.
WIP Revert "Bias to incubation (#1449)" rebase, then reapply as a merge.
Jul 10, 2023
alexcreasy
changed the title
WIP Revert "Bias to incubation (#1449)" rebase, then reapply as a merge.
Revert "Bias to incubation (#1449)" rebase, then reapply as a merge.
Jul 10, 2023
openshift-ci
bot
removed
the
do-not-merge/work-in-progress
This PR is in WIP state
label
Jul 10, 2023
[APPROVALNOTIFIER] This PR is APPROVED Approval requirements bypassed by manually added approval. This pull-request has been approved by: The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
openshift-merge-robot
merged commit Jul 11, 2023
2e7d6e2
into
opendatahub-io:incubation
3 checks passed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This reverts commit bb8e2c5 and merge's f/mserving-metrics into incubation.
Description
How Has This Been Tested?
Test Impact
Request review criteria:
Self checklist (all need to be checked):
If you have UI changes:
After the PR is posted & before it merges:
main