[FEATURE] Add Streaming Response Support

[soumojit-D48]

---

name: Feature request
about: Suggest an idea for AI Council Orchestrator
title: '[FEATURE] Add Streaming Response Support'
labels: 'enhancement', 'OSCG26'
assignees: ''

Is your feature request related to a problem? Please describe.
Current implementation returns complete responses only after all models finish processing, causing delays for long-running requests. Users must wait for the entire pipeline to complete before seeing any results.

Describe the solution you'd like
Implement async streaming to yield partial results as models complete. This allows users to see intermediate results while other models are still processing.

Describe alternatives you've considered

• Polling for status (less efficient)
• WebSocket-based streaming (more complex)
• Server-Sent Events (SSE) for HTTP (future enhancement)

Use case

• Real-time feedback for long-running requests
• Progressive UI updates showing model completion
• Better user experience for complex queries requiring multiple models

Implementation ideas

• Added StreamingChunk dataclass in ai_council/core/models.py
• Added process_request_streaming() to OrchestrationLayer interface
• Implemented streaming in ai_council/orchestration/layer.py
• Added public API in ai_council/main.py

Additional context

• Chunk types: PROGRESS, SUBTASK_START, SUBTASK_COMPLETE, MODEL_COMPLETE, FINAL, ERROR
• Each chunk includes progress percentage, model used, confidence score
• Compatible with existing execution modes (fast, balanced, best_quality)

Would you be willing to contribute this feature?

• Yes, I'd like to work on this
• I can help with testing
• I can help with documentation
• I'd prefer someone else implement this

[github-actions]

🎯 Issue Auto-Assigned!

Hey @soumojit-D48! This issue has been automatically assigned to you.

✨ Next Steps:

• Review the issue details carefully
• Check CONTRIBUTING.md for guidelines
• Start working on a solution
• Create a PR when ready and link it to this issue

Happy coding! 🚀

[github-actions]

🙏 Thank you for raising this issue!

We'll review it as soon as possible. We truly appreciate your contributions! ✨

📚 Before you start working:

• ✅ Make sure you've read the README.md
• ✅ Review CONTRIBUTING.md for guidelines
• ✅ Familiarize yourself with CODE_OF_CONDUCT.md

⚠️ Important: Please do NOT create a PR until this issue has been assigned to you.

💡 Want to work on this? Comment "assign me" or "I want to work on this" to get assigned!

[github-actions]

👋 Gentle Reminder

Hey @soumojit-D48! This issue was assigned to you 24 hours ago.

⏰ Timeline:

• ✅ 24 hours: Reminder (now)

📋 What to do:

• Create a PR and link it to this issue (mention [FEATURE] Add Streaming Response Support #220 in PR description)
• If you need more time, comment here to let us know
• If you can't work on this, let us know so we can reassign

💡 Tip: Even a draft PR shows progress!

Thanks for contributing! 🚀