Skip to content

[WIP] Unified Attention - partial batch persistence #400

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 18 commits into
base: main
Choose a base branch
from
Draft

[WIP] Unified Attention - partial batch persistence #400

wants to merge 18 commits into from
+499 −95

Conversation

kzawora-intel
Copy link
Collaborator

yea this will speed up stuff by like a lot

adobrzyn and others added 13 commits October 9, 2025 09:03
@adobrzyn
Initial
372c26e 
Signed-off-by: Agata Dobrzyniewicz <[email protected]>
@michalkuligowski
Merge branch 'main' into adobrzyn/unified_fix
8c18e13
@adobrzyn
Everything warmed up
2fc802b 
Signed-off-by: Agata Dobrzyniewicz <[email protected]>
@adobrzyn
Merge branch 'main' into adobrzyn/unified_fix
3e55f21
@adobrzyn
Remove prints
a98fc12 
Signed-off-by: Agata Dobrzyniewicz <[email protected]>
@adobrzyn
Precommit
5339500 
Signed-off-by: Agata Dobrzyniewicz <[email protected]>
@adobrzyn
Merge branch 'main' into adobrzyn/unified_fix
609dfe5
@kzawora-intel
Fix UA acc
e03269c 
Signed-off-by: Konrad Zawora <[email protected]>
@kzawora-intel
Add granite UA tests
2f65235 
Signed-off-by: Konrad Zawora <[email protected]>
@kzawora-intel
remove fpdb
1d5177f 
Signed-off-by: Konrad Zawora <[email protected]>
@kzawora-intel
Merge remote-tracking branch 'origin/adobrzyn/unified_fix' into priva…
8d788ac 
…te/kzawora/ua_acc
@kzawora-intel
Add high level profiler to unified attention execution
328232c 
Signed-off-by: Konrad Zawora <[email protected]>
@kzawora-intel
[WIP] Unified Attention - partial batch persistence
0554307 
Signed-off-by: Konrad Zawora <[email protected]>
@github-actions GitHub Actions
Copy link

🚧 CI Blocked

The main CI workflow was not started for the following reason:

Your branch is behind the base branch. Please merge or rebase to get the latest changes.

@kzawora-intel kzawora-intel marked this pull request as draft October 13, 2025 16:21
@kzawora-intel
more persistant biases
4f7f1ea 
Signed-off-by: Konrad Zawora <[email protected]>
@github-actions GitHub Actions
Copy link

🚧 CI Blocked

The main CI workflow was not started for the following reason:

This is a Draft PR. Please mark it as 'Ready for Review' to trigger the CI.

@kzawora-intel
add numpy batch creation
0c5786f 
Signed-off-by: Konrad Zawora <[email protected]>
@github-actions GitHub Actions
Copy link

🚧 CI Blocked

The main CI workflow was not started for the following reason:

This is a Draft PR. Please mark it as 'Ready for Review' to trigger the CI.

@github-actions GitHub Actions
Copy link

🚧 CI Blocked

The main CI workflow was not started for the following reason:

This is a Draft PR. Please mark it as 'Ready for Review' to trigger the CI.

@github-actions GitHub Actions
Copy link

🚧 CI Blocked

The main CI workflow was not started for the following reason:

This is a Draft PR. Please mark it as 'Ready for Review' to trigger the CI.

@kzawora-intel
defrag WA
989e88c 
Signed-off-by: Konrad Zawora <[email protected]>
@github-actions GitHub Actions
Copy link

🚧 CI Blocked

The main CI workflow was not started for the following reason:

This is a Draft PR. Please mark it as 'Ready for Review' to trigger the CI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@xuechendi xuechendi Awaiting requested review from xuechendi xuechendi is a code owner

@mswiniarsk mswiniarsk Awaiting requested review from mswiniarsk mswiniarsk is a code owner

@adobrzyn adobrzyn Awaiting requested review from adobrzyn adobrzyn is a code owner

@mgawarkiewicz-intel mgawarkiewicz-intel Awaiting requested review from mgawarkiewicz-intel mgawarkiewicz-intel is a code owner

@vivekgoe vivekgoe Awaiting requested review from vivekgoe vivekgoe is a code owner

@afierka-intel afierka-intel Awaiting requested review from afierka-intel afierka-intel is a code owner

@michalkuligowski michalkuligowski Awaiting requested review from michalkuligowski michalkuligowski is a code owner

@iboiko-habana iboiko-habana Awaiting requested review from iboiko-habana iboiko-habana will be requested when the pull request is marked ready for review iboiko-habana is a code owner

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@kzawora-intel @adobrzyn @michalkuligowski