[Bug]: enabling external storage on 28.0.2 generates error during `occ files:scan`

[nfguide]

⚠️ This issue respects the following points: ⚠️

• This is a bug, not a question or a configuration/webserver/proxy issue.
• This issue is not already reported on Github OR Nextcloud Community Forum (I've searched it).
• Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
• I agree to follow Nextcloud's Code of Conduct.

Bug description

New / fresh installation of Nextcloud 28.0.2

Steps to reproduce

1. Fresh install of 28.0.2
2. Enable external storage
3. Configure S3 object storage
4. Add user with access to S3 storage
5. Run nocc-cldtst01 files:scan timv (alias to below)

alias nocc-cldtst01="sudo -u www-data php /var/www/cldtst01.site1.com/html/occ"

Expected behavior

Output
root@X.X.X.X:$ nocc-cldtst01-site1 files:scan --all
Starting scan for user 1 out of 1 (admin)
Error during scan: Array to string conversion
Error during scan: Array to string conversion
....................
Error during scan: Array to string conversion
Error during scan: Array to string conversion
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 49 | 218 | 0 | 1 | 0 | 84 | 00:00:01 |
+---------+-------+-----+---------+---------+--------+--------------+
root@X.X.X.X:$

Installation method

Community Manual installation with Archive

Nextcloud Server version

28

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.2

Web server

Nginx

Database engine version

MariaDB

Is this bug present after an update or on a fresh install?

Fresh Nextcloud Server install

Are you using the Nextcloud Server Encryption module?

Encryption is Disabled

What user-backends are you using?

• Default user-backend (database)
• LDAP/ Active Directory
• SSO - SAML
• Other

Configuration report

root@X.X.X.X:~$ nocc-cldtst01-site1 config:list system
{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "vmi1517.site1.com",
            "cldtst01.site1.com",
            "X.X.X.X"
        ],
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "28.0.2.5",
        "overwrite.cli.url": "https:\/\/cldtst01.site1.com",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "overwritehost": "cldtst01.site1.com",
        "activity_expire_days": 14,
        "allow_local_remote_servers": true,
        "auth.bruteforce.protection.enabled": true,
        "blacklisted_files": [
            ".htaccess",
            "Thumbs.db",
            "thumbs.db"
        ],
        "cron_log": true,
        "default_phone_region": "US",
        "enable_previews": true,
        "enabledPreviewProviders": [
            "OC\\Preview\\PNG",
            "OC\\Preview\\JPEG",
            "OC\\Preview\\GIF",
            "OC\\Preview\\BMP",
            "OC\\Preview\\XBitmap",
            "OC\\Preview\\Movie",
            "OC\\Preview\\PDF",
            "OC\\Preview\\MP3",
            "OC\\Preview\\TXT",
            "OC\\Preview\\MarkDown"
        ],
        "filesystem_check_changes": 0,
        "filelocking.enabled": "true",
        "htaccess.RewriteBase": "\/",
        "integrity.check.disabled": false,
        "knowledgebaseenabled": false,
        "log_rotate_size": "104857600",
        "logfile": "\/var\/log\/nextcloud\/cldtst01-site1.log",
        "loglevel": 2,
        "logtimezone": "America\/Los_Angeles",
        "memcache.local": "\\OC\\Memcache\\APCu",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "overwriteprotocol": "https",
        "preview_max_x": 1024,
        "preview_max_y": 768,
        "preview_max_scale_factor": 1,
        "profile.enabled": false,
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "password": "***REMOVED SENSITIVE VALUE***",
            "timeout": 0.5,
            "dbindex": 1
        },
        "quota_include_external_storage": false,
        "share_folder": "\/StorageShare",
        "skeletondirectory": "",
        "trashbin_retention_obligation": "auto, 7"
    }
}
root@X.X.X.X:~$

List of activated Apps

root@X.X.X.X:~$ nocc-cldtst01-site1 app:list
Enabled:
  - activity: 2.20.0
  - admin_audit: 1.18.0
  - cloud_federation_api: 1.11.0
  - dav: 1.29.1
  - federatedfilesharing: 1.18.0
  - files: 2.0.0
  - files_external: 1.20.0
  - files_pdfviewer: 2.9.0
  - files_sharing: 1.20.0
  - files_trashbin: 1.18.0
  - files_versions: 1.21.0
  - logreader: 2.13.0
  - lookup_server_connector: 1.16.0
  - oauth2: 1.16.3
  - password_policy: 1.18.0
  - photos: 2.4.0
  - privacy: 1.12.0
  - provisioning_api: 1.18.0
  - serverinfo: 1.18.0
  - settings: 1.10.1
  - sharebymail: 1.18.0
  - text: 3.9.1
  - theming: 2.3.0
  - twofactor_backupcodes: 1.17.0
  - updatenotification: 1.18.0
  - viewer: 2.2.0
  - workflowengine: 2.10.0
Disabled:
  - bruteforcesettings: 2.8.0
  - circles: 28.0.0-dev (installed 28.0.0-dev)
  - comments: 1.18.0 (installed 1.18.0)
  - contactsinteraction: 1.9.0 (installed 1.9.0)
  - dashboard: 7.8.0 (installed 7.8.0)
  - encryption: 2.16.0
  - federation: 1.18.0 (installed 1.18.0)
  - files_reminders: 1.1.0 (installed 1.1.0)
  - firstrunwizard: 2.17.0 (installed 2.17.0)
  - nextcloud_announcements: 1.17.0 (installed 1.17.0)
  - notifications: 2.16.0 (installed 2.16.0)
  - recommendations: 2.0.0 (installed 2.0.0)
  - related_resources: 1.3.0 (installed 1.3.0)
  - support: 1.11.0 (installed 1.11.0)
  - survey_client: 1.16.0 (installed 1.16.0)
  - suspicious_login: 6.0.0
  - systemtags: 1.18.0 (installed 1.18.0)
  - twofactor_totp: 10.0.0-beta.2
  - user_ldap: 1.19.0
  - user_status: 1.8.1 (installed 1.8.1)
  - weather_status: 1.8.0 (installed 1.8.0)
root@X.X.X.X:~$

Nextcloud Signing status

No errors have been found.

Nextcloud Logs

root@X.X.X.X:/var/log/nextcloud$ tail -f cldtst01-site1.log
{"reqId":"BsKXnLgxxgk9OrTCg4dN","level":2,"time":"2024-02-06T13:25:37-08:00","remoteAddr":"Z.Z.Z.Z","user":"--","app":"no app in context","method":"POST","url":"/login","message":"Login failed: timv (Remote IP: Z.Z.Z.Z3)","userAgent":"Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36","version":"28.0.2.5","data":[]}

Additional info

No response

[joshtrichards]

Unable to reproduce. Tried both without and with files in the bucket. Can you please:

• run the scan with verbose mode -vvv to see what files/folders it is hitting these errors
• provide the output occ files_external:list --output=json_pretty (remove any secrets/info you deem confidential)

For the record, what S3 back-end (or provider) are you using?

[nfguide]

• run the scan with verbose mode -vvv to see what files/folders it is hitting these errors

Here is a snippet of the scan:

Error during scan: Array to string conversion
#0 /var/www/cldtst01.secursrv.com/html/apps/files/lib/Command/Scan.php(268): OCA\Files\Command\Scan->exceptionErrorHandler()
#1 [internal function]: OCA\Files\Command\Scan->OCA\Files\Command\{closure}()
#2 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(222): array_diff_assoc()
#3 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(460): OC\Files\Cache\Scanner->scanFile()
#4 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(397): OC\Files\Cache\Scanner->handleChildren()
#5 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(400): OC\Files\Cache\Scanner->scanChildren()
#6 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(400): OC\Files\Cache\Scanner->scanChildren()
#7 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(347): OC\Files\Cache\Scanner->scanChildren()
#8 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Utils/Scanner.php(273): OC\Files\Cache\Scanner->scan()
#9 /var/www/cldtst01.secursrv.com/html/apps/files/lib/Command/Scan.php(180): OC\Files\Utils\Scanner->scan()
#10 /var/www/cldtst01.secursrv.com/html/apps/files/lib/Command/Scan.php(241): OCA\Files\Command\Scan->scanFiles()
#11 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Command/Command.php(298): OCA\Files\Command\Scan->execute()
#12 /var/www/cldtst01.secursrv.com/html/core/Command/Base.php(177): Symfony\Component\Console\Command\Command->run()
#13 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Application.php(1040): OC\Core\Command\Base->run()
#14 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Application.php(301): Symfony\Component\Console\Application->doRunCommand()
#15 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Application.php(171): Symfony\Component\Console\Application->doRun()
#16 /var/www/cldtst01.secursrv.com/html/lib/private/Console/Application.php(206): Symfony\Component\Console\Application->run()
#17 /var/www/cldtst01.secursrv.com/html/console.php(100): OC\Console\Application->run()
#18 /var/www/cldtst01.secursrv.com/html/occ(11): require_once('...')
#19 {main}
Error during scan: Array to string conversion
#0 /var/www/cldtst01.secursrv.com/html/apps/files/lib/Command/Scan.php(268): OCA\Files\Command\Scan->exceptionErrorHandler()
#1 [internal function]: OCA\Files\Command\Scan->OCA\Files\Command\{closure}()
#2 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(222): array_diff_assoc()
#3 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(460): OC\Files\Cache\Scanner->scanFile()
#4 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(397): OC\Files\Cache\Scanner->handleChildren()
#5 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(400): OC\Files\Cache\Scanner->scanChildren()
#6 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(400): OC\Files\Cache\Scanner->scanChildren()
#7 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Cache/Scanner.php(347): OC\Files\Cache\Scanner->scanChildren()
#8 /var/www/cldtst01.secursrv.com/html/lib/private/Files/Utils/Scanner.php(273): OC\Files\Cache\Scanner->scan()
#9 /var/www/cldtst01.secursrv.com/html/apps/files/lib/Command/Scan.php(180): OC\Files\Utils\Scanner->scan()
#10 /var/www/cldtst01.secursrv.com/html/apps/files/lib/Command/Scan.php(241): OCA\Files\Command\Scan->scanFiles()
#11 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Command/Command.php(298): OCA\Files\Command\Scan->execute()
#12 /var/www/cldtst01.secursrv.com/html/core/Command/Base.php(177): Symfony\Component\Console\Command\Command->run()
#13 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Application.php(1040): OC\Core\Command\Base->run()
#14 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Application.php(301): Symfony\Component\Console\Application->doRunCommand()
#15 /var/www/cldtst01.secursrv.com/html/3rdparty/symfony/console/Application.php(171): Symfony\Component\Console\Application->doRun()
#16 /var/www/cldtst01.secursrv.com/html/lib/private/Console/Application.php(206): Symfony\Component\Console\Application->run()
#17 /var/www/cldtst01.secursrv.com/html/console.php(100): OC\Console\Application->run()
#18 /var/www/cldtst01.secursrv.com/html/occ(11): require_once('...')
#19 {main}
+---------+-------+-----+---------+---------+--------+--------------+
| Folders | Files | New | Updated | Removed | Errors | Elapsed time |
+---------+-------+-----+---------+---------+--------+--------------+
| 95      | 392   | 0   | 219     | 0       | 84     | 00:00:02     |
+---------+-------+-----+---------+---------+--------+--------------+

• provide the output occ files_external:list --output=json_pretty (remove any secrets/info you deem confidential)

root@site1:~$ nocc-cldtst01-site1 files_external:list --output=json_pretty
[
    {
        "mount_id": 1,
        "mount_point": "\/CS1-S3",
        "storage": "\\OCA\\Files_External\\Lib\\Storage\\AmazonS3",
        "authentication_type": "amazons3::accesskey",
        "configuration": {
            "bucket": "cs1.secursrv",
            "hostname": "usc1.contabostorage.com",
            "port": "443",
            "region": "",
            "storageClass": "",
            "use_ssl": true,
            "use_path_style": true,
            "legacy_auth": false,
            "key": "ZZZ",
            "secret": "XXX"
        },
        "options": {
            "encrypt": true,
            "previews": true,
            "enable_sharing": false,
            "filesystem_check_changes": 1,
            "encoding_compatibility": false,
            "readonly": false
        },
        "applicable_users": [],
        "applicable_groups": []
    }
]

• S3 storage is from Contabo

Thanks for taking the time to review. There is another config with 27.1.6 connecting to the same object storage, and the scan works correctly, with no errors.

[mhzawadi]

Can confirm this is a bug with S3 like buckets, I have the same issue. I am using Backblaze B2 as the bucket

Error during scan: Array to string conversion
#0 /srv/www/horwood-nextcloud/apps/files/lib/Command/Scan.php(268): OCA\Files\Command\Scan->exceptionErrorHandler()
#1 [internal function]: OCA\Files\Command\Scan->OCA\Files\Command\{closure}()
#2 /srv/www/horwood-nextcloud/lib/private/Files/Cache/Scanner.php(222): array_diff_assoc()
#3 /srv/www/horwood-nextcloud/lib/private/Files/Cache/Scanner.php(460): OC\Files\Cache\Scanner->scanFile()
#4 /srv/www/horwood-nextcloud/lib/private/Files/Cache/Scanner.php(397): OC\Files\Cache\Scanner->handleChildren()
#5 /srv/www/horwood-nextcloud/lib/private/Files/Cache/Scanner.php(400): OC\Files\Cache\Scanner->scanChildren()
#6 /srv/www/horwood-nextcloud/lib/private/Files/Cache/Scanner.php(347): OC\Files\Cache\Scanner->scanChildren()
#7 /srv/www/horwood-nextcloud/lib/private/Files/Utils/Scanner.php(273): OC\Files\Cache\Scanner->scan()
#8 /srv/www/horwood-nextcloud/apps/files/lib/Command/Scan.php(180): OC\Files\Utils\Scanner->scan()
#9 /srv/www/horwood-nextcloud/apps/files/lib/Command/Scan.php(241): OCA\Files\Command\Scan->scanFiles()
#10 /srv/www/horwood-nextcloud/3rdparty/symfony/console/Command/Command.php(298): OCA\Files\Command\Scan->execute()
#11 /srv/www/horwood-nextcloud/core/Command/Base.php(177): Symfony\Component\Console\Command\Command->run()
#12 /srv/www/horwood-nextcloud/3rdparty/symfony/console/Application.php(1040): OC\Core\Command\Base->run()
#13 /srv/www/horwood-nextcloud/3rdparty/symfony/console/Application.php(301): Symfony\Component\Console\Application->doRunCommand()
#14 /srv/www/horwood-nextcloud/3rdparty/symfony/console/Application.php(171): Symfony\Component\Console\Application->doRun()
#15 /srv/www/horwood-nextcloud/lib/private/Console/Application.php(206): Symfony\Component\Console\Application->run()
#16 /srv/www/horwood-nextcloud/console.php(100): OC\Console\Application->run()
#17 /srv/www/horwood-nextcloud/occ(11): require_once('...')
#18 {main}

[amcguire10]

I am also confirming this issue with S3. Using Dreamhost's DreamObjects. "Identical" error list as above except for the line(s) with "Scanner.php(400)". Those are not included. This occurred after updating Nextcloud from 25.0.2.3 to 28.0.2.5 (mutiple upgrade steps) and php from 8.0 to 8.2.

The log seems to indicate that the issue started after the core upgrade from 27.1.6.2 to 28.0.2.5.

[nfguide]

I am also confirming this issue with S3. Using Dreamhost's DreamObjects. "Identical" error list as above except for the line(s) with "Scanner.php(400)". Those are not included. This occurred after updating Nextcloud from 25.0.2.3 to 28.0.2.5 (mutiple upgrade steps) and php from 8.0 to 8.2.

The log seems to indicate that the issue started after the core upgrade from 27.1.6.2 to 28.0.2.5.

I concur the started "after the core upgrade from 27.1.6.2 to 28.0.2.5", as the error is not present on a test config running 27.1.6.

[Benance]

hello
I can reproduce this error when I launch occ files:scan with an smb external storage too

[stratacorps]

Not sure if it helps to add another voice, but am tracking this. Exact same issue as OP so not posting any new details unless it helps.