Update incontext to latest#48

Open

cfunk1210 wants to merge 666 commits intodev/incontextfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Dec 19, 2024

Merge pull request #156 from ITM-Kitware/dev/relevance
jadie1
authored

Commits on Dec 20, 2024

Log true relevance for comp reg

eveenhuis
authored and
dmjoy
committed
Adding cumulative KDE alignment with or without relevance for hybrid kaleido ADM

jadie1
authored and
dmjoy
committed
Fixing relevance keys

jadie1
authored and
dmjoy
committed
Update CHANGELOG.md

jadie1
authored and
dmjoy
committed
Fix relevance to be float rather than list

jadie1
authored and
dmjoy
committed
Change choice_history default arg to None
dmjoy
committed
Adding mulit-kdma configs

jadie1
authored and
dmjoy
committed
Fixing name typo for consistency

jadie1
authored and
dmjoy
committed

Commits on Jan 30, 2025

Single heuristic treatment bugfix

eveenhuis
authored and
dmjoy
committed

Commits on Feb 7, 2025

Commits on Feb 21, 2025

Commits on Feb 26, 2025

Update Phase1 SoarTech group targets to their server convention
dmjoy
committed

Commits on Mar 18, 2025

Add NAACL24 dataset files with adm, alignment, experiment configs

barry-ravichandran
authored and
dmjoy
committed
Move naacl24 kdmas to new yaml file and add baseline adm config

barry-ravichandran
authored and
dmjoy
committed
Fix low-high kdma prompt selection range

barry-ravichandran
authored and
dmjoy
committed

Commits on Apr 2, 2025

Fix dataset validation errors

PaulHax
authored and
dmjoy
committed
Add demo related args to outlines_adm

PaulHax
authored and
dmjoy
committed
Factor get_dialogs to static method in outlines_adm

PaulHax
authored and
dmjoy
committed
Update CHANGELOG and version for 0.5.7 release
dmjoy
committed

Commits on Apr 4, 2025

Update package versions and integration test expected outputs
dmjoy
committed

Commits on Apr 9, 2025

Updated poetry lockfile

barry-ravichandran
authored and
dmjoy
committed

Commits on Apr 14, 2025

Commits on May 2, 2025

Commits on May 23, 2025

Add new KDMAs for Ph2 June collab
dmjoy
committed
Hacks to get ph2 scenarios working with update TA3 server
dmjoy
committed
Clean up tweaks for Ph2 TA3 server/client changes
dmjoy
committed
Adding phase2 zeroshot comp reg adm

jadie1
authored and
dmjoy
committed
Adding step for post-hoc rule based regression value correction

jadie1
authored and
dmjoy
committed
Adding logging for rule based regression correction

jadie1
authored and
dmjoy
committed
Updating attribute templates to version 2.

jadie1
authored and
dmjoy
committed
Initial medical urgency alignment function

eveenhuis
authored and
dmjoy
committed
Flip attribute delta computation

eveenhuis
authored and
dmjoy
committed
Implicit prediction length check

eveenhuis
authored and
dmjoy
committed
Updating KDMA names to match Adept yamls

jadie1
authored and
dmjoy
committed
Fixing kdma names to match Adept

jadie1
authored and
dmjoy
committed
Update alignment targets and kaleido pipeline for june2025 eval
dmjoy
committed
Updating zeroshot ADM to run on server

jadie1
authored and
dmjoy
committed
Adding phase2 pipeline oracle adm

jadie1
authored and
dmjoy
committed
Tweaks for june2025 pipeline baseline
dmjoy
committed

Commits on May 26, 2025

Adding phase2 fewshot ADM

jadie1
authored and
dmjoy
committed
Updating ICL files

jadie1
authored and
dmjoy
committed
Add state_hydration_domain option to ICL and input/output interface

eveenhuis
authored and
dmjoy
committed
Add missing outlines prompt decorator

eveenhuis
authored and
dmjoy
committed

Commits on May 27, 2025

Add unit testing for medical urgency midpoint alignment function

eveenhuis
authored and
dmjoy
committed
Add relevance to midpoint alignment function

eveenhuis
authored and
dmjoy
committed
Voting based midpoint alignment for multi-kdma with relevance

eveenhuis
authored and
dmjoy
committed
Add multi-kdma/relevance alignment function testing

eveenhuis
authored and
dmjoy
committed
Improve alignment voting log messages

eveenhuis
authored and
dmjoy
committed
Change random component imports to use local enums
dmjoy
committed
Add option to override target attribute names in comp reg component
dmjoy
committed
Dedicated phase2_kaleido regression component config
dmjoy
committed
Add Kaleido "mashup" ADM
dmjoy
committed
Update ICL component for `target_attribute_names_override`
dmjoy
committed
Rename kaleido_mashup to kaleido_zeroshot_mashup
dmjoy
committed
Correct target_attribute_names_override ordering (medical first)
dmjoy
committed
Add pipeline relevance oracle

eveenhuis
authored and
dmjoy
committed
Updating ICL files for new search vs stay train

jadie1
authored and
dmjoy
committed
Add relevance aggregation misc component
dmjoy
committed
Adding llm most relevant attribute prediction step

jadie1
authored and
dmjoy
committed
Adding check for single attribute targets

jadie1
authored and
dmjoy
committed
Add medical only alignment function

eveenhuis
authored and
dmjoy
committed
Update correction rules

eveenhuis
authored and
dmjoy
committed

Commits on Jun 2, 2025

Updating ICL for new PS annotations

jadie1
authored and
dmjoy
committed
Adding fewshot comp reg and kaleido relevance mashup ADM

jadie1
authored and
dmjoy
committed

Commits on Jun 4, 2025

Add least_similar_examples ICL option for validation simulation

eveenhuis
authored and
dmjoy
committed
Adding ICL bert similarity based relevance prediction ADM

jadie1
authored and
dmjoy
committed
Adding LOO setting

jadie1
authored and
dmjoy
committed
Updating merit focus to merit for improved regression

jadie1
authored and
dmjoy
committed
Fixing score scale factor lookup for merit

jadie1
authored and
dmjoy
committed

Commits on Jun 5, 2025

Commits on Jun 7, 2025

Prepend the scenario unstructured to the scene/probe unstructured
dmjoy
committed

Commits on Jun 13, 2025

Commits on Jul 12, 2025

Add ALIGN App link to README

barry-ravichandran
authored and
dmjoy
committed

Commits on Jul 15, 2025

Commits on Jul 16, 2025

Adding aligned ADM config with updated ICL and weighted alignment function

jadie1
authored and
dmjoy
committed

Commits on Jul 25, 2025

Add evaluation configs for Ph2 July collab RQ1 eval
dmjoy
committed
Instructions for hugging face token cache

DennisMelamedKitware
authored and
dmjoy
committed
moved new instr to README

DennisMelamedKitware
authored and
dmjoy
committed
remove newline

DennisMelamedKitware
authored and
dmjoy
committed
Moved HuggingFace token info to new section

DennisMelamedKitware
authored and
dmjoy
committed
remove newline

DennisMelamedKitware
authored and
dmjoy
committed
Reduce code duplication between medical urgency alignment functions

eveenhuis
authored and
dmjoy
committed

Commits on Aug 4, 2025

Add ICL examples to pipeline choice_info output

PaulHax
authored and
dmjoy
committed
Remove non-determinism from midpoint alignment functions

eveenhuis
authored and
dmjoy
committed

Commits on Aug 13, 2025

Make comparative regression reasoning length configurable

PaulHax
authored and
dmjoy
committed
Add similarity score to ICL examples in choice info

PaulHax
authored and
dmjoy
committed
Factor out ICL similarity strategies

PaulHax
authored and
dmjoy
committed
Remove possible double-reversal bug in incontext setting

PaulHax
authored and
dmjoy
committed
Refactor ICL selection strategies to reduce code duplication

PaulHax
authored and
dmjoy
committed
Bring back least_similar_examples

PaulHax
authored and
dmjoy
committed

Commits on Aug 14, 2025

Adding configs for July2025 RQ2 eval
dmjoy
committed
Add more rq2 evaluation configs
dmjoy
committed
Add medical only configs

eveenhuis
authored and
dmjoy
committed

Commits on Aug 15, 2025

Update to latest TA3 client version
dmjoy
committed

Commits on Aug 26, 2025

Zeroshot tagging configs

eveenhuis
authored and
dmjoy
committed
Fewshot tagging configs

eveenhuis
authored and
dmjoy
committed
Prompt and config updates

eveenhuis
authored and
dmjoy
committed
Parameterize scenario description for baseline ICL

eveenhuis
authored and
dmjoy
committed

Commits on Sep 4, 2025

Commits on Sep 9, 2025

Add ICL examples to repository

PaulHax
authored and
dmjoy
committed

Commits on Sep 11, 2025

Update dict check to cover omegaconf's DictConfig
dmjoy
committed

Commits on Oct 3, 2025

Add alignment info to choice_info
eveenhuis
committed

Commits on Oct 8, 2025

Commits on Oct 10, 2025

DecisionFlow integration (#223)
barry-ravichandran
authored

Commits on Oct 22, 2025

Commits on Oct 24, 2025

Commits on Oct 31, 2025

DecisionFlow: Added unstructured objective function json parsing and json retry util functions

barry-ravichandran
authored and
dmjoy
committed

Commits on Nov 3, 2025

Simple update to add per-step timing info for pipeline ADM
dmjoy
committed

Commits on Nov 4, 2025

Add SceneSkipException for DecisionFlow implementation

barry-ravichandran
authored and
dmjoy
committed

Commits on Dec 3, 2025

Commits on Dec 12, 2025

Inference engine for spectrum tuned llms

jadie1
authored and
dmjoy
committed
Updating changelog

jadie1
authored and
dmjoy
committed
Removing unused import

jadie1
authored and
dmjoy
committed
Fixing name

jadie1
authored and
dmjoy
committed

Commits on Dec 15, 2025

Commits on Dec 16, 2025

Commits on Dec 17, 2025

DecisionFlow: Added fine-grained value prompts for Attribute and MathReason stages

barry-ravichandran
authored and
dmjoy
committed
DecisionFlow: Refactor outlines prompts to a dedicated script

barry-ravichandran
authored and
dmjoy
committed
Fix attribute filtering stage to pass correct information to objective function

barry-ravichandran
authored and
dmjoy
committed
Remove inference call from Objective Stage to match original implementation

barry-ravichandran
authored and
dmjoy
committed
Refine fine-grained prompts for KDMA-specific examples and improve inference speed

barry-ravichandran
authored and
dmjoy
committed
Refine Express stage prompt for faster inference and reduced JSON errors

barry-ravichandran
authored and
dmjoy
committed
Add TA3 eval server info to experiment config

barry-ravichandran
authored and
dmjoy
committed
Refine math_reason prompt to match closer to the source implementation

barry-ravichandran
authored and
dmjoy
committed
Refine math_reason prompt and add in-context KDMA examples

barry-ravichandran
authored and
dmjoy
committed
Constrain attribute stage output for high/low pipeline

barry-ravichandran
authored and
dmjoy
committed
Update Express Stage to use positive-negative alignment info

barry-ravichandran
authored and
dmjoy
committed
Fix redundant system prompt definitions in experiment config

barry-ravichandran
authored and
dmjoy
committed

Commits on Dec 19, 2025

Add choice index X ADM

eveenhuis
authored and
dmjoy
committed

Commits on Feb 4, 2026

Fix variable scope in phase 1 driver

eveenhuis
authored and
dmjoy
committed