Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Repetitive error with large shops #36

Open
kurkop opened this issue May 25, 2019 · 0 comments
Open

Repetitive error with large shops #36

kurkop opened this issue May 25, 2019 · 0 comments

Comments

@kurkop
Copy link

kurkop commented May 25, 2019

Hi, I was using tap-shopify for some months, but I've had problems for some days. I have a large shop (it has more than 1000 orders per day), I saw a lot of times this error:

INFO Filtered paths list: ['admin_graphql_api_id', 'app_id', 'billing_address', 'browser_ip', 'buyer_accepts_marketing', 'cancel_reason', 'cancelled_at', 'cart_token', 'checkout_id', 'checkout_token', 'client_details', 'closed_at', 'confirmed', 'contact_email', 'currency', 'customer_locale', 'device_id', 'discount_applications', 'discount_codes', 'financial_status', 'fulfillment_status', 'fulfillments', 'gateway', 'landing_site', 'landing_site_ref', 'location_id', 'note', 'note_attributes', 'number', 'order_status_url', 'payment_gateway_names', 'phone', 'presentment_currency', 'processed_at', 'processing_method', 'reference', 'referring_site', 'refunds', 'shipping_lines', 'source_identifier', 'source_name', 'source_url', 'subtotal_price', 'subtotal_price_set', 'tags', 'tax_lines', 'taxes_included', 'test', 'token', 'total_discounts_set', 'total_line_items_price', 'total_line_items_price_set', 'total_price', 'total_price_set', 'total_shipping_price_set', 'total_tax', 'total_tax_set', 'total_tip_received', 'total_weight', 'user_id']
WARNING Removed 2 paths during transforms:
	customer.accepts_marketing_updated_at
	customer.marketing_opt_in_level
WARNING Removed paths list: ['customer.accepts_marketing_updated_at', 'customer.marketing_opt_in_level']
CRITICAL IncompleteRead(1896442 bytes read)
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/http/client.py", line 546, in _get_chunk_left
    chunk_left = self._read_next_chunk_size()
  File "/usr/local/lib/python3.6/http/client.py", line 513, in _read_next_chunk_size
    return int(line, 16)
ValueError: invalid literal for int() with base 16: b''

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/http/client.py", line 563, in _readall_chunked
    chunk_left = self._get_chunk_left()
  File "/usr/local/lib/python3.6/http/client.py", line 548, in _get_chunk_left
    raise IncompleteRead(b'')
http.client.IncompleteRead: IncompleteRead(0 bytes read)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/src/app/venv_etl/vtap_shopify/bin/tap-shopify", line 11, in <module>
    load_entry_point('tap-shopify', 'console_scripts', 'tap-shopify')()
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/singer/utils.py", line 192, in wrapped
    return fnc(*args, **kwargs)
  File "/usr/src/app/etl/tools/tap-shopify/tap_shopify/__init__.py", line 191, in main
    sync()
  File "/usr/src/app/etl/tools/tap-shopify/tap_shopify/__init__.py", line 153, in sync
    for rec in stream.sync():
  File "/usr/src/app/etl/tools/tap-shopify/tap_shopify/streams/base.py", line 191, in sync
    for obj in self.get_objects():
  File "/usr/src/app/etl/tools/tap-shopify/tap_shopify/streams/base.py", line 152, in get_objects
    objects = self.call_api(query_params)
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/backoff.py", line 286, in retry
    ret = target(*args, **kwargs)
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/backoff.py", line 286, in retry
    ret = target(*args, **kwargs)
  File "/usr/src/app/etl/tools/tap-shopify/tap_shopify/streams/base.py", line 67, in wrapper
    return fnc(*args, **kwargs)
  File "/usr/src/app/etl/tools/tap-shopify/tap_shopify/streams/base.py", line 119, in call_api
    return self.replication_object.find(**query_params)
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/pyactiveresource/activeresource.py", line 385, in find
    return cls._find_every(from_=from_, **kwargs)
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/pyactiveresource/activeresource.py", line 523, in _find_every
    return cls._build_list(cls.connection.get(path, cls.headers),
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/pyactiveresource/connection.py", line 329, in get
    return self.format.decode(self._open('GET', path, headers=headers).body)
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/shopify/base.py", line 23, in _open
    self.response = super(ShopifyConnection, self)._open(*args, **kwargs)
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/pyactiveresource/connection.py", line 291, in _open
    response = Response.from_httpresponse(http_response)
  File "/usr/src/app/venv_etl/vtap_shopify/lib/python3.6/site-packages/pyactiveresource/connection.py", line 184, in from_httpresponse
    return cls(response.code, response.read(),
  File "/usr/local/lib/python3.6/http/client.py", line 456, in read
    return self._readall_chunked()
  File "/usr/local/lib/python3.6/http/client.py", line 570, in _readall_chunked
    raise IncompleteRead(b''.join(value))
http.client.IncompleteRead: IncompleteRead(1896442 bytes read)

Do you have any idea?. Thank you so much for reading me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant