Skip to content

KeyError: 'access_token' upon uploading large amounts of subjects #164

@khufkens

Description

@khufkens

Upon uploading a large amount of data to a subject set the upload would halt on this error. Subsequently an yaml error file was generated but I had to restart the upload to continue.

This consistently happens around the 40K values mark, despite not exceeding subject upload limits.

Traceback (most recent call last):
  File "/home/khufkens/venv/bin/panoptes", line 8, in <module>
    sys.exit(cli())
  File "/home/khufkens/venv/lib/python3.5/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/home/khufkens/venv/lib/python3.5/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/home/khufkens/venv/lib/python3.5/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/khufkens/venv/lib/python3.5/site-packages/click/core.py", line 1137, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/home/khufkens/venv/lib/python3.5/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/home/khufkens/venv/lib/python3.5/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_cli/commands/subject_set.py", line 401, in upload_subjects
    move_created(MAX_PENDING_SUBJECTS)
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_cli/commands/subject_set.py", line 372, in move_created
    if subject.async_save_result:
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_client/subject.py", line 203, in async_save_result
    self._async_future.result()
  File "/usr/lib/python3.5/concurrent/futures/_base.py", line 398, in result
    return self.__get_result()
  File "/usr/lib/python3.5/concurrent/futures/_base.py", line 357, in __get_result
    raise self._exception
  File "/usr/lib/python3.5/concurrent/futures/thread.py", line 55, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_client/subject.py", line 143, in save
    log_args=False,
  File "/home/khufkens/venv/lib/python3.5/site-packages/redo/__init__.py", line 185, in retry
    return action(*args, **kwargs)
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_client/panoptes.py", line 815, in save
    etag=self.etag
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_client/panoptes.py", line 404, in post
    retry=retry,
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_client/panoptes.py", line 267, in json_request
    retry=retry,
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_client/panoptes.py", line 191, in http_request
    token = self.get_bearer_token()
  File "/home/khufkens/venv/lib/python3.5/site-packages/panoptes_client/panoptes.py", line 557, in get_bearer_token
    self.bearer_token = token_response['access_token']
KeyError: 'access_token'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions