ollama suport

[manojmanivannan]

I noticed when setting up a project, that i need ANTHROPIC key, which i dont have. could the framework support connection to ollama ?

[unshDee]

Where are you being asked for the Anthropic key? because the solution would depend on that... it could be at:

• custom domain generation
• running the generated chat agent

or something else?

[manojmanivannan]

i was setting up a demo using self-hosted option.
Note: i redacted some lines.

~/D/projects $ uvx create-context-graph my-app --domain healthcare --framework pydanticai --demo-data --self-hosted
⠋ Project generated!

Generating demo data...
⠋ [1/4] Seeded 60 entities
⠋ [2/4] Created 112 relationships
⠋ [3/4] Generated 25 documents
⠋ [4/4] Created 10 decision traces

  Generated: 60 entities, 112 relationships, 25 documents, 10 decision traces
  Written to: /home/manoj/Documents/projects/my-app/data/fixtures.json

Done! Your Healthcare context graph app is ready.

  cd my-app
  make install      # Install dependencies
  make docker-up    # Start Neo4j
  make seed         # Apply schema + seed sample data
  make start        # Start backend + frontend

  Backend:  http://localhost:8000
  Frontend: http://localhost:3000

~/D/projects $ cd my-app/
~/D/p/my-app $ make install && make docker-up && make seed && make start
cd backend && uv sync --extra dev
Using CPython 3.13.12
Creating virtual environment at: .venv
Resolved 228 packages in 83ms
      Built my-app-backend @ file:///home/manoj/Documents/projects/my-app/backend
Prepared 1 package in 157ms
Installed 213 packages in 646ms
 + ag-ui-protocol==0.1.19
 + aiofile==3.11.1
 + aiohappyeyeballs==2.6.2
...
 + websockets==16.0
 + wrapt==1.17.3
 + xai-sdk==1.17.0
 + yarl==1.24.2
 + zipp==4.1.0
Resolved 1 package in 68ms
Installed 1 package in 3ms
 + en-core-web-sm==3.8.0 (from https://github.com/explosion/spacy-models/releases/download/en_core_web_sm-3.8.0/en_core_web_sm-3.8.0-py3-none-any.whl)
✔ Download and installation successful
You can now load the package via spacy.load('en_core_web_sm')
cd frontend && npm install

added 612 packages, and audited 613 packages in 7s

227 packages are looking for funding
  run `npm fund` for details

5 high severity vulnerabilities

To address issues that do not require attention, run:
  npm audit fix

To address all issues (including breaking changes), run:
  npm audit fix --force

Run `npm audit` for details.
docker compose up -d
[+] up 1/1
 ✔ Container my-app-neo4j-1 Running                                                                                                                      0.0s
cd backend && uv run python scripts/generate_data.py
Seeding Healthcare context graph...

[1/4] Applying schema...
  Applied: CREATE INDEX organization_name IF NOT EXISTS FOR (n:Organiza...
  Applied: CREATE INDEX location_name IF NOT EXISTS FOR (n:Location) ON...
  Applied: CREATE INDEX event_name IF NOT EXISTS FOR (n:Event) ON (n.na...
 ....
  Applied: CREATE INDEX section_heading_level IF NOT EXISTS FOR (n:Sect...
  Applied: CREATE INDEX section_loaded_at IF NOT EXISTS FOR (n:Section)...
  Warning: {neo4j_code: Neo.ClientError.Statement.SyntaxError} {message: Invalid input 'dimensions': expected 'FOREACH', 'ALTER', 'ORDER BY', 'CALL', 'USING PERIODIC COMMIT', 'CREATE', 'LOAD CSV', 'START DATABASE', 'STOP DATABASE', 'DEALLOCATE', 'DELETE', 'DENY', 'DETACH', 'DROP', 'DRYRUN', 'FINISH', 'GRANT', 'INSERT', 'LIMIT', 'MATCH', 'MERGE', 'NODETACH', 'OFFSET', 'OPTIONAL', 'REALLOCATE', 'REMOVE', 'RENAME', 'RETURN', 'REVOKE', 'ENABLE SERVER', 'SET', 'SHOW', 'SKIP', 'TERMINATE', 'UNWIND', 'USE' or 'WITH' (line 1, column 1 (offset: 0))
"dimensions must match your embed model."
 ^} {gql_status: 50N42} {gql_status_description: error: general processing exception - unexpected error. Unexpected error has occurred. See debug log for details.}

[2/4] Loading entities and relationships...
  Created 5 Person nodes
  Created 5 Organization nodes
...
  Created 112 relationships

[3/4] Loading documents...
  Created 25 Document nodes
  Created 105 MENTIONS relationships

[4/4] Loading decision traces...
  Created 10 DecisionTrace nodes with steps

Done! Your Healthcare context graph is ready.
Starting Healthcare Context Graph...
make[1]: Entering directory '/home/manoj/Documents/projects/my-app'
cd backend && uv run uvicorn app.main:app --reload --port ${BACKEND_PORT:-8000}
make[1]: Entering directory '/home/manoj/Documents/projects/my-app'
cd frontend && NEXT_PUBLIC_API_URL=http://localhost:${BACKEND_PORT:-8000}/api npm run dev -- --port ${FRONTEND_PORT:-3000}

> my-app-frontend@0.1.0 dev
> next dev --port 3000 --port 3000

INFO:     Will watch for changes in these directories: ['/home/manoj/Documents/projects/my-app/backend']
   ▲ Next.js 15.5.19
   - Local:        http://localhost:3000
   - Network:      http://192.168.1.192:3000
   - Experiments (use with caution):
     · optimizePackageImports

 ✓ Starting...

   We detected TypeScript in your project and reconfigured your tsconfig.json file for you.
   The following suggested values were added to your tsconfig.json. These values can be changed to fit your project's needs:

   	- include was updated to add '.next/types/**/*.ts'

 ✓ Ready in 1006ms
Traceback (most recent call last):
  File "/home/manoj/Documents/projects/my-app/backend/.venv/bin/uvicorn", line 10, in <module>
    sys.exit(main())
             ~~~~^^
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/click/core.py", line 1524, in __call__
    return self.main(*args, **kwargs)
           ~~~~~~~~~^^^^^^^^^^^^^^^^^
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/click/core.py", line 1445, in main
    rv = self.invoke(ctx)
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/click/core.py", line 1308, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/click/core.py", line 877, in invoke
    return callback(*args, **kwargs)
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/uvicorn/main.py", line 441, in main
    run(
    ~~~^
        app,
        ^^^^
    ...<48 lines>...
        reset_contextvars=reset_contextvars,
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    )
    ^
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/uvicorn/main.py", line 609, in run
    config.load_app()
    ~~~~~~~~~~~~~~~^^
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/uvicorn/config.py", line 415, in load_app
    return import_from_string(self.app)
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/uvicorn/importer.py", line 19, in import_from_string
    module = importlib.import_module(module_str)
  File "/home/manoj/.local/share/uv/python/cpython-3.13.12-linux-x86_64-gnu/lib/python3.13/importlib/__init__.py", line 88, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 1023, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/manoj/Documents/projects/my-app/backend/app/main.py", line 20, in <module>
    from app.routes import router
  File "/home/manoj/Documents/projects/my-app/backend/app/routes.py", line 13, in <module>
    from app.agent import handle_message
  File "/home/manoj/Documents/projects/my-app/backend/app/agent.py", line 64, in <module>
    agent = Agent(
        "anthropic:claude-sonnet-4-20250514",
    ...<2 lines>...
        retries=2,
    )
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/pydantic_ai/agent/__init__.py", line 415, in __init__
    self._model = models.infer_model(model)
                  ~~~~~~~~~~~~~~~~~~^^^^^^^
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/pydantic_ai/models/__init__.py", line 1080, in infer_model
    provider = provider_factory(provider_name)
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/pydantic_ai/providers/__init__.py", line 304, in infer_provider
    return provider_class()
  File "/home/manoj/Documents/projects/my-app/backend/.venv/lib/python3.13/site-packages/pydantic_ai/providers/anthropic.py", line 105, in __init__
    raise UserError(
    ...<2 lines>...
    )
pydantic_ai.exceptions.UserError: Set the `ANTHROPIC_API_KEY` environment variable or pass it via `AnthropicProvider(api_key=...)` to use the Anthropic provider.
make[1]: *** [Makefile:21: dev-backend] Error 1
make[1]: Leaving directory '/home/manoj/Documents/projects/my-app'