Error while creating Project

[Jufyer]

Describe the bug

Hi when I want to create a new Project with ./make_project --db_passwd foobar99 --url_base http://<myIp> test I get an error. Here is the error:

boincadm@boincadm:~/boinc/tools$ ./make_project --db_passwd foobar99 --url_base http://<myIp> test
Traceback (most recent call last):
  File "/home/boincadm/boinc/tools/./make_project", line 7, in <module>
    from Boinc.setup_project import *
  File "/home/boincadm/boinc/py/Boinc/setup_project.py", line 8, in <module>
    from Boinc import database, db_mid, configxml, tools
  File "/home/boincadm/boinc/py/Boinc/database.py", line 33, in <module>
    from Boinc.db_base import *
  File "/home/boincadm/boinc/py/Boinc/db_base.py", line 12, in <module>
    import MySQLdb, MySQLdb.cursors
ModuleNotFoundError: No module named 'MySQLdb'

What can I do to fix this?

[AenBleidd]

@Jufyer, have you installed mysqlclient using

sudo apt install python3-mysqlclient

?

[Jufyer]

@AenBleidd
When I do this I get this error:

boincadm@boincadm:~$ sudo apt install python3-mysqlclient
Error: Unable to locate package python3-mysqlclient

And when I want to install it with pip install mysqlclient I get this info:

boincadm@boincadm:~$ pip install mysqlclient
Requirement already satisfied: mysqlclient in ./.local/share/pipx/venvs/pip/lib/python3.12/site-packages (2.2.7)

[AenBleidd]

@Jufyer, ok try this:

sudo apt-get install python3-dev default-libmysqlclient-dev
pip install mysqlclient

It would be also good if you can specify the OS you are running this on, otherwise it's quite hard to guess since that almost every flavor of Linux has their own solutions for the same issue.

[AenBleidd]

@Jufyer, also check that you don't have both python2 and python3 installed on your system.

[Jufyer]

@AenBleidd I am using Ubuntu 24.10 and I have both installed

[Jufyer]

You can see it here:

boincadm@boincadm:~$ python2 -V
Python 2.7.18
boincadm@boincadm:~$ python3 -V
Python 3.12.7
boincadm@boincadm:~$ cd ~/boinc/tools
boincadm@boincadm:~/boinc/tools$ ./make_project --db_passwd foobar99 --url_base http://<myIP> test
Traceback (most recent call last):
  File "./make_project", line 7, in <module>
    from Boinc.setup_project import *
  File "/home/boincadm/boinc/py/Boinc/setup_project.py", line 8, in <module>
    from Boinc import database, db_mid, configxml, tools
  File "/home/boincadm/boinc/py/Boinc/database.py", line 33, in <module>
    from Boinc.db_base import *
  File "/home/boincadm/boinc/py/Boinc/db_base.py", line 12, in <module>
    import MySQLdb, MySQLdb.cursors
ImportError: No module named MySQLdb

[AenBleidd]

This looks very strange. There are some missing components but they should not be mandatory.
Just in case, try to install all these packages:

sudo apt-get install -y autopoint libftgl-dev freeglut3-dev libcurl4-openssl-dev libxmu-dev libxi-dev libfcgi-dev libxss-dev libnotify-dev libxcb-util0-dev libgtk-3-dev libsecret-1-dev libgcrypt20-dev libsystemd-dev libwebkit2gtk-4.1-dev p7zip-full libxxf86vm-dev ocl-icd-opencl-dev zip libltdl-dev

[Jufyer]

This also doesn't work. I set up a completely new vm and did everything again. And I realised I get an Error already before. You can see it here:

boincadm@boincadm:~$ pip install mysqlclient
error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
    python3-xyz, where xyz is the package you are trying to
    install.
    
    If you wish to install a non-Debian-packaged Python package,
    create a virtual environment using python3 -m venv path/to/venv.
    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    sure you have python3-full installed.
    
    If you wish to install a non-Debian packaged Python application,
    it may be easiest to use pipx install xyz, which will manage a
    virtual environment for you. Make sure you have pipx installed.
    
    See /usr/share/doc/python3.12/README.venv for more information.

note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.

[Jufyer]

I don't think it is helpful but you can see the whole setup process here: https://pastebin.com/f9W1HK4m

[AenBleidd]

We are using Ubuntu 24.04 for CI (and this is also recommended via the documentation).
According to your log, you are using Ubuntu 24.10 on your VM.
Try to use Ubuntu 24.04 (that is LTS, and in general it's always recommended to use LTS release).

[Jufyer]

Ok I now did everything with Ubuntu 24.04 but I still get the same Error like at the begging. You can see my log here:
https://pastebin.com/2NhVtW1A

[davidpanderson]

To get the Python MySQL library:

pip install mysqlclient

See:
https://github.com/BOINC/boinc/wiki/Create-a-BOINC-server-(cookbook)

[Jufyer]

I cant do this:

boincadm@boinc:~/boinc$ pip install mysqlclient
error: externally-managed-environment

× This environment is externally managed
╰─> To install Python packages system-wide, try apt install
    python3-xyz, where xyz is the package you are trying to
    install.
    
    If you wish to install a non-Debian-packaged Python package,
    create a virtual environment using python3 -m venv path/to/venv.
    Then use path/to/venv/bin/python and path/to/venv/bin/pip. Make
    sure you have python3-full installed.
    
    If you wish to install a non-Debian packaged Python application,
    it may be easiest to use pipx install xyz, which will manage a
    virtual environment for you. Make sure you have pipx installed.
    
    See /usr/share/doc/python3.12/README.venv for more information.

note: If you believe this is a mistake, please contact your Python installation or OS distribution provider. You can override this, at the risk of breaking your Python installation or OS, by passing --break-system-packages.
hint: See PEP 668 for the detailed specification.

[Jufyer]

I now re-installed Virtual Box and then it worked.

[davidpanderson]

You need to do this as root, i.e.
sudo pip install mysqlclient

BTW, when you get an error message
(like 'This environment is externally managed' or 'ImportError: No module named MySQLdb')
Googling it usually shows a solution.

[Jufyer]

I already tried this and it didn't work. I now re-installed Virtual Box and then it worked.