upload of file bigger than 13MO is not working, despite max_document_size increased

[dummys]

Hi,
Couchdb version: {"couchdb":"Welcome","version":"3.1.0","git_sha":"ff0feea20","uuid":"75cd56376f4cc829406aacaeec491e36","features":["access-ready","partitioned","pluggable-storage-engines","reshard","scheduler"],"vendor":{"name":"The Apache Software Foundation"}}
We are using openemr with couchdb to store the file as document. We have a weird behavior on server running couchdb 3.x. It was working without any change on coucchdb 2.x.
Our web server are configured with upload_max_filesize and post_max_size and we tried to setup in couchdb in a ini file under local.d the following:

[couchdb]
max_document_size = 20000000 ; bytes

[httpd]
max_http_request_size = 4294967296 ; 4 GB

But when looking in the couchdb.log file we seen this:

[notice] 2020-08-18T15:01:36.998852Z [email protected] <0.774.0> 18ff2b5c26 couchdb.openemr.local 10.10.10.10 undefined PUT /couchdb/1imgpsh_fullsize_anim.png10_2020-_08-_18_11_01_35 413 ok 1336

So if I understand correctly, couchdb is returning a 413, Request Entity Too Large, but we still don't understand how to debug further and what to adjust to make it works.

[wohali]

How big of an attachment are you trying to add?

[wohali]

Remember that your binary file is being transcoded into the json document. This results in an increase in storage size required for binary attachments.

Try bumping max_document_size to 40000000 for instance, and see if that works for you.

[dummys]

ok. It's not an attachment, its directly inside the document. This is how openemr coded the things. My test file is 16MB, but tried also with 13MB file and it did not work.

[wohali]

If you can test this via curl direct into CouchDB we'd appreciate it. Others are not running into this same limitation, so something must be amiss.

You can also do a GET /_node/_local/_config to confirm that your max_document_size change is being applied. If not, permissions on your .ini file may be wrong, or you've named your file not ending in .ini. You'll need to supply admin-level credentials to retrieve this information.

[dummys]

{
    "uuids": {
        "algorithm": "sequential",
        "max_count": "1000"
    },
    "cluster": {
        "n": "1",
        "q": "2"
    },
    "cors": {
        "credentials": "false"
    },
    "chttpd": {
        "backlog": "512",
        "bind_address": "0.0.0.0",
        "max_db_number_for_dbs_info_req": "100",
        "port": "5984",
        "prefer_minimal": "Cache-Control, Content-Length, Content-Range, Content-Type, ETag, Server, Transfer-Encoding, Vary",
        "require_valid_user": "false",
        "server_options": "[{recbuf, undefined}]",
        "socket_options": "[{sndbuf, 262144}, {nodelay, true}]"
    },
    "attachments": {
        "compressible_types": "text/*, application/javascript, application/json, application/xml",
        "compression_level": "8"
    },
    "admins": {
        "admin": "},"
        query_server_config ":{"
        os_process_limit ":"
        100 ","
        reduce_limit ":"
        true "},"
        vendor ":{"
        name ":"
        The Apache Software Foundation "},"
        feature_flags ":{"
        partitioned || * ":"
        true "},"
        replicator ":{"
        connection_timeout ":"
        30000 ","
        http_connections ":"
        20 ","
        interval ":"
        60000 ","
        max_churn ":"
        20 ","
        max_jobs ":"
        500 ","
        retries_per_request ":"
        5 ","
        socket_options ":" [{
            keepalive,
            true
        }, {
            nodelay,
            false
        }]
        ","
        ssl_certificate_max_depth ":"
        3 ","
        ssl_trusted_certificates_file ":" / opt / couchdb / ca.crt ","
        startup_jitter ":"
        5000 ","
        verify_ssl_certificates ":"
        true ","
        worker_batch_size ":"
        500 ","
        worker_processes ":"
        4 "},"
        ssl ":{"
        cacert_file ":" / opt / couchdb / ca.crt ","
        cert_file ":" / opt / couchdb / couch.crt ","
        key_file ":" / opt / couchdb / couch.key ","
        port ":"
        6984 "},"
        log ":{"
        file ":" /
        var / log / couchdb / couchdb.log ","
        level ":"
        debug ","
        writer ":"
        file "},"
        indexers ":{"
        couch_mrview ":"
        true "},"
        daemons ":{"
        httpsd ":" {
            chttpd,
            start_link,
            [https]
        }
        "},"
        couch_peruser ":{"
        database_prefix ":"
        userdb - ","
        delete_dbs ":"
        false ","
        enable ":"
        false "},"
        httpd ":{"
        allow_jsonp ":"
        false ","
        authentication_handlers ":" {
            couch_httpd_auth,
            cookie_authentication_handler
        },
        {
            couch_httpd_auth,
            default_authentication_handler
        }
        ","
        bind_address ":"
        127.0 .0 .1 ","
        enable_cors ":"
        false ","
        enable_xframe_options ":"
        false ","
        max_http_request_size ":"
        4294967296 ","
        port ":"
        5986 ","
        secure_rewrites ":"
        true ","
        socket_options ":" [{
            sndbuf,
            262144
        }]
        "},"
        ioq.bypass ":{"
        compaction ":"
        false ","
        os_process ":"
        true ","
        read ":"
        true ","
        shard_sync ":"
        false ","
        view_update ":"
        true ","
        write ":"
        true "},"
        ioq ":{"
        concurrency ":"
        10 ","
        ratio ":"
        0.01 "},"
        csp ":{"
        enable ":"
        true "},"
        couch_httpd_auth ":{"
        allow_persistent_cookies ":"
        true ","
        auth_cache_size ":"
        50 ","
        authentication_db ":"
        _users ","
        authentication_redirect ":" / _utils / session.html ","
        iterations ":"
        10 ","
        require_valid_user ":"
        false ","
        secret ":"
        ","
        timeout ":"
        600 "},"
        couchdb_engines ":{"
        couch ":"
        couch_bt_engine "},"
        couchdb ":{"
        attachment_stream_buffer_size ":"
        4096 ","
        changes_doc_ids_optimization_threshold ":"
        100 ","
        database_dir ":". / data ","
        default_engine ":"
        couch ","
        default_security ":"
        admin_only ","
        file_compression ":"
        snappy ","
        max_attachment_chunk_size ":"
        4294967296 ","
        max_dbs_open ":"
        500 ","
        max_document_size ":"
        20000000 ","
        os_process_timeout ":"
        5000 ","
        users_db_security_editable ":"
        false ","
        uuid ":"
        ","
        view_index_dir ":". / data "}}

Here is the result of the _config command

[wohali]

Try bumping your document size as recommended, and test again, please.

[dummys]

ok that fix the problem, thanks.