Skip to content

Releases: ConsciousEnergy/ProjectRawHorse

Project RawHorse v0.4.1Beta - Public Testing

12 Nov 02:27
@ConsciousEnergy ConsciousEnergy
v0.4.0
198f924

Choose a tag to compare

View all tags
Project RawHorse v0.4.1Beta - Public Testing Pre-release
Pre-release

Changelog - Project RawHorse v0.4.1 Beta
Release Date: February 2026
Branch: PRH_v0.4.1Beta
Status: Ready for PR into main
Repository: https://github.com/ConsciousEnergy/ProjectRawHorse

Overview
This release delivers the Intelligence Stack Pyramid overhaul: a hierarchical visualization of entities by intel stack level (L1–L6), with chain-of-command tracing, entity detail panels, and full-width layout. It also fixes federal flows loading, expands L6 program data, and adds backend search enhancements (multi-word/alias expansion, amount-aware queries, and fuzzy matching with rapidfuzz).
UI/UX retro cyber-punk aesthetics.

New Features
Intelligence Stack Pyramid
Dedicated Pyramid page at /analysis/pyramid with trapezoid-tier visualization (L1 narrow top → L6 wide bottom).
Entity nodes per tier: top 8 shown with type-colored circles, “+N more” for overflow.
Flow lines between tiers: gradient bands with width proportional to money flow; hover tooltips for breakdown.
Search: Debounced entity search with autocomplete; results link to pyramid and detail.
Level filter: Toggle L1–L6 visibility via Intelligence Stack filter and legend.
Help overlay: “?” button with keyboard shortcuts (e.g. / focus search, Escape close).
Trace Chain of Command
Checkbox “Trace chain of command” to highlight an entity’s hierarchy (up to L1, down to L6, plus lateral).
Chain badge: When tracing, shows “(N)” for number of entities in the chain.
Entity-driven: Chain is computed from the selected entity (pyramid click or search); includes lateral connections from API.
Empty-state hint: When trace is on and no entity selected, placeholder text explains to select an entity.
Entity Detail (under search)
Detail block moved from right sidebar to under the “Search entities (/)” input in the main column.
Empty state: “Select an entity from the pyramid or search to view details and chain of command” (or trace-specific text when chain mode is on).
EntityDetailPanel: Slide-in content with entity info, chain of command (up/down), relationships by type, money/material flows, links to Network Graph and Browse.
Expandable height: When an entity is selected, detail section grows (max 400px / 45vh) for readability.
Layout
No right sidebar: Removed aside.pyramid-page-aside; all content is in a single column.
Top block: Page header (title, subtitle, search, search results dropdown) plus detail/empty section directly below search.
Full-width pyramid: Controls and pyramid visualization use full content width below the top block.
Data & Backend
Intel Stack & Hierarchy
intel_stack_levels.csv: Expanded so all entities (entities_master, transcript entities, NRO partners, reference) are assigned L1–L6 where applicable.
hierarchy_relationships.csv: New file with org links (reports_to, subordinate_to, part_of, operates_under, etc.); loaded after entity_relationships.
entity_descriptions.csv: Short descriptions for L1–L2 and selected L3–L4 entities; used by pyramid and entity-detail API (not stored in DB).
L6 Programs
intel_stack_levels.csv: Added/confirmed L6 entries for program datasets, including:
X-37B Orbital Test Vehicle, Guardian Angel Program, Yankee Black (display_name variants for correct matching).
Existing L6 entries: Immaculate Constellation, Hidden Wing, TR-3B, Kona Blue, B-21 Raider, X-37B, Project Blue Book, (Program) NRO CSPO Commercial Foundation, etc.
Backend search enhancements (routers/search.py)
Multi-word and alias expansion: entity_aliases.csv plus AGENCY_ACRONYMS from data_loader; expand_query() returns original + alias terms so e.g. "National Geospatial" matches NGA. All search_* endpoints filter on expanded terms (entities, money_flows, awards).
Amount-aware search: parse_amount_query() supports "223", "223M", "1.8B"; search_money_flows and search_awards apply numeric range filters when the query is amount-like.
Fuzzy matching (rapidfuzz): calculate_relevance() uses fuzz.token_sort_ratio when appropriate (score ≥70). When ilike returns fewer than limit results, a second pass uses rapidfuzz.process.extract on entity names / flow source–target / award recipient and merges results with dedupe by id.
API
GET /analysis/intel-stack/pyramid: Enriched with per-entity description, relationship_count, money_flow_total_usd, key_connections, hierarchy_parent; single-pass aggregation.
GET /analysis/intel-stack/hierarchy?entity_id=: Returns chain of command (target, chain_up, chain_down, lateral).
GET /analysis/intel-stack/entity/{id}/detail: Full entity detail for drill-down panel.
GET /analysis/intel-stack/search?q=: In-pyramid entity search for the search bar.
Bug Fixes
Federal Flows Loader (data_loader.py)
UNIQUE constraint on money_flows.edge_id: Multiple rows (e.g. different HHS agencies) truncated to the same agency[:15] and produced duplicate edge_ids.
Fix: Deduplicate in memory by (agency, recipient, fiscal_year); build unique edge_id with row index: ffr_{idx}{agency[:20]}{recipient[:20]}{fy} (sanitized). Cap length to 255 chars; fallback to ffr{idx} if needed.
Frontend
PyramidTooltip.tsx: Removed unused PADDING constant to fix TypeScript build.
Runtime / dependencies
ModuleNotFoundError: rapidfuzz: RUN.bat now runs pip install -r backend\requirements.txt (quiet) after activating the venv and before starting the server, so new backend dependencies (e.g. rapidfuzz) are installed automatically when launching via the batch script.
Files Changed (Summary)
New
data/entities/entity_descriptions.csv
data/entities/entity_aliases.csv (canonical/alias pairs for search expansion)
data/entities/hierarchy_relationships.csv (if not already present)
frontend/src/components/PyramidTooltip.tsx, PyramidTooltip.css
frontend/src/components/EntityDetailPanel.tsx, EntityDetailPanel.css
docs/development/SEARCH_UX_ENHANCEMENTS_4_6_PLAN.md (frontend search UX plan; not implemented in this release)
test_search_enhancements.py (manual test script for backend search; run from project root)
Modified
Backend: data_loader.py (federal flows edge_id, hierarchy load), routers/analysis.py (pyramid, hierarchy, entity detail, search, entity descriptions), routers/search.py (alias expansion, amount parsing, rapidfuzz fuzzy fallback), models/schemas.py (pyramid/hierarchy schemas), requirements.txt (rapidfuzz>=3.0.0).
Frontend: PyramidPage.tsx, PyramidPage.css, PyramidVisualization.tsx, PyramidVisualization.css, About.tsx (GitHub repo link).
Data: data/entities/intel_stack_levels.csv (L6 program display_name variants and coverage).
Root: RUN.bat (ensure backend deps installed before start).
Docs: CHANGELOG_v0.3.2Beta.md, GIT_PUSH_COMMANDS.md (branch/PR steps for PRH_v0.3.2Beta).

What's Changed

  • V0.3.0 dev by @ConsciousEnergy in #3
  • PRH_v0.3.0-alpha by @ConsciousEnergy in #5
  • feat: Add advanced search, logo integration, and Issue #6 fixes by @ConsciousEnergy in #7
  • Prh v0.3.0 beta by @ConsciousEnergy in #8
  • Release v0.3.1 Beta - Enhanced Browse Page and Federal Contract Research by @ConsciousEnergy in #9
  • feat: Intelligence Stack Pyramid overhaul, layout, L6 programs, federal flows fix (v0.3.2 Beta) by @ConsciousEnergy in #10
    *feat: Improving Pull Request: Advanced Search + Logo Integration + Issue #6 Fixes, (Canceled Merge) #11
    *feat+bug: Pull Request: Advanced Search + Logo Integration + Issue #6 Fixes #12
    *feat: FOIA Targets page at /analysis/foia with ScoreBadge, filters, pagination
    ScoreBadge, TableSkeleton, EmptyState, ErrorBoundary components
    Loading spinners on NetworkGraph and SankeyDiagram
    Dashboard stat cards click-through; Export FOIA CSV
    Cyberpunk neon UI: dark blue-black theme, card/sidebar/tab glows, glitch hover, scanlines
    Fixes: Browse tab URL init, FOIA table columns, light contrast, search dropdown, network min-width
    Docs: CHANGELOG, RELEASE_NOTES, FEATURES, FEATURE_ROADMAP updated
    Screenshots directory and README relative paths #13

New Contributors

Full Changelog: v0.1.0-alpha...v0.4.0

Contributors

ConsciousEnergy
Loading

Project RawHorse v0.1.0-alpha - Initial Release

12 Nov 02:14
@ConsciousEnergy ConsciousEnergy
v0.1.0-alpha
88f443b

Choose a tag to compare

View all tags
Project RawHorse v0.1.0-alpha - Initial Release Pre-release
Pre-release

🎉 Project RawHorse - Initial Alpha Release

Open-source UAP/UFO research data explorer now available!

✨ Features

Core Functionality

  • 🗄️ SQLite Database - Fast, local data storage (prh.db)
  • 🚀 FastAPI Backend - High-performance REST API
  • ⚛️ React Frontend - Modern, responsive UI with TypeScript
  • 🌓 Light/Dark Mode - Purple & gold themed interface
  • 📊 Data Visualization - Entity relationships and financial flows

Data Coverage

  • Entities: 9 organizations tracked
  • Money Flows: 28 financial relationships
  • Federal Awards: 3 major contracts
  • FOIA Targets: 5 prioritized requests
  • Date Range: 2004 - 2023
  • Total Spending: $33.29M tracked

Installation

  • ✅ 1-Click Install - Automated setup for Windows, macOS, Linux
  • ✅ Quick Launch - RUN.bat / RUN.sh scripts
  • ✅ Cross-Platform - Works on all major operating systems

📦 Installation

Requirements

  • Python 3.10+
  • Node.js 18+
  • Git with Git LFS

Quick Start

Windows:
git clone https://github.com/ConsciousEnergy/ProjectRawHorse.git
cd ProjectRawHorse
install.batmacOS/Linux:
git clone https://github.com/ConsciousEnergy/ProjectRawHorse.git
cd ProjectRawHorse
chmod +x install.sh && ./install.shAfter installation, use RUN.bat (Windows) or RUN.sh (macOS/Linux) for quick launch.

📖 Documentation

🐛 Known Issues

  • Award contribution backend endpoint not yet implemented
  • FOIA Target contribution backend endpoint not yet implemented
  • Network visualizations pending (D3.js integration planned)
  • Test suite to be added in next release

🚀 Roadmap

v0.2.0 (Next Release)

  • Complete contribution workflow for all data types
  • Basic network visualization with D3.js
  • Enhanced search and filtering
  • Statistical charts

v1.0.0 (Future)

  • Comprehensive test suite
  • Cross-platform executables
  • Advanced visualizations
  • Community contributions integrated

💝 Support This Project

If you find this project valuable, please consider supporting:

🤝 Contributing

We welcome contributions! See CONTRIBUTING.md for:

  • Data contributions via GitHub PRs
  • Bug reports and feature requests
  • Code contributions
  • Documentation improvements

📜 License

GNU AGPL v3 - See LICENSE

🙏 Acknowledgments

  • Data sourced from USASpending.gov, FOIA requests, and public records
  • Built with FastAPI, React, SQLite
  • Committed to transparency and open research

📞 Contact

⚠️ ALPHA RELEASE DISCLAIMER

This is an alpha release for research purposes. Features may change, data may be incomplete. See DISCLAIMER.md for full legal notice.

Loading