[Mediagoblin-devel] Fw: Sqlite/Sqlalchemy Kombu Issue?

[andrew . dudash]

Hi all,

I'm following the HackingHowTo and trying to get the tests to pass, but there 
seems to be an issue with the 'kombu' dependency. About ~30 tests get an error 
like the following.

Traceback (most recent call last):
  File "/home/media-goblin/mediagoblin/mediagoblin/tests/test_submission.py", 
line 462, in test_processing
    **self.upload_data(BIG_BLUE))
  File "/home/media-goblin/mediagoblin/mediagoblin/tests/test_submission.py", 
line 161, in do_post
    response = self.test_app.post(url, data, **kwargs)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/WebTest-2.0.33-py3.5.egg/webtest/app.py",
 line 382, in post
    content_type=content_type)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/WebTest-2.0.33-py3.5.egg/webtest/app.py",
 line 758, in _gen_request
    expect_errors=expect_errors)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/WebTest-2.0.33-py3.5.egg/webtest/app.py",
 line 628, in do_request
    res = req.get_response(app, catch_exc_info=True)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/WebOb-1.8.5-py3.5.egg/webob/request.py",
 line 1310, in send
    application, catch_exc_info=True)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/WebOb-1.8.5-py3.5.egg/webob/request.py",
 line 1278, in call_application
    app_iter = application(self.environ, start_response)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/WebTest-2.0.33-py3.5.egg/webtest/lint.py",
 line 201, in lint_app
    iterator = application(environ, start_response_wrapper)
  File "/home/media-goblin/mediagoblin/mediagoblin/app.py", line 342, in 
__call__
    return self.call_backend(environ, start_response)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/Werkzeug-0.16.0-py3.5.egg/werkzeug/middleware/shared_data.py",
 line 220, in __call__
    return self.app(environ, start_response)
  File "/home/media-goblin/mediagoblin/mediagoblin/app.py", line 276, in 
call_backend
    return self._finish_call_backend(request, environ, start_response)
  File "/home/media-goblin/mediagoblin/mediagoblin/app.py", line 318, in 
_finish_call_backend
    response = controller(request)
  File "/home/media-goblin/mediagoblin/mediagoblin/decorators.py", line 47, in 
wrapper
    return controller(request, *args, **kwargs)
  File "/home/media-goblin/mediagoblin/mediagoblin/decorators.py", line 74, in 
new_controller_func
    return controller(request, *args, **kwargs)
  File "/home/media-goblin/mediagoblin/mediagoblin/decorators.py", line 47, in 
wrapper
    return controller(request, *args, **kwargs)
  File "/home/media-goblin/mediagoblin/mediagoblin/decorators.py", line 74, in 
new_controller_func
    return controller(request, *args, **kwargs)
  File "/home/media-goblin/mediagoblin/mediagoblin/decorators.py", line 103, in 
wrapper
    return controller(request, *args, **kwargs)
  File "/home/media-goblin/mediagoblin/mediagoblin/submit/views.py", line 79, 
in submit_start
    urlgen=request.urlgen)
  File "/home/media-goblin/mediagoblin/mediagoblin/submit/lib.py", line 221, in 
submit_media
    run_process_media(entry, feed_url)
  File "/home/media-goblin/mediagoblin/mediagoblin/submit/lib.py", line 275, in 
run_process_media
    task_id=entry.queued_task_id)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/celery/app/task.py",
 line 536, in apply_async
    with app.producer_or_acquire(producer) as eager_producer:
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/celery/app/base.py",
 line 887, in producer_or_acquire
    producer, self.producer_pool.acquire, block=True,
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/celery/app/base.py",
 line 1257, in producer_pool
    return self.amqp.producer_pool
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/celery/app/amqp.py",
 line 612, in producer_pool
    self.app.connection_for_write()]
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/celery/app/base.py",
 line 784, in connection_for_write
    return self._connection(url or self.conf.broker_write_url, **kwargs)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/celery/app/base.py",
 line 852, in _connection
    'broker_connection_timeout', connect_timeout
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/kombu/connection.py",
 line 189, in __init__
    if not get_transport_cls(transport).can_parse_url:
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/kombu/transport/__init__.py",
 line 87, in get_transport_cls
    _transport_cache[transport] = resolve_transport(transport)
  File 
"/home/media-goblin/mediagoblin/lib/python3.5/site-packages/kombu/transport/__init__.py",
 line 67, in resolve_transport
    transport, alt))
KeyError: 'No such transport: sqlite.  Did you mean sqla?'

Kombu expects to see 'sqla' or 'sqlalchemy' but it's being given 'sqlite'. 
There's no transport entry for 'sqlite'.

I can fix this by editing 'kombu/transport/init.py' so that there's a 
`'sqlite': 'kombu.transport.sqlalchemy:Transport'` key value pair in 
'TRANSPORT_ALIASES'. The tests pass, but this is a bad hack.

Is there anyway to change this on the mediagoblin side? I've been fighting with 
'grep', 'mediagoblin.ini', and the test '.ini' files, but I can't seem to fix 
the problem.

I am on the latest commit of master, e34916ee8bc3860c41eca5292a6d49a6dbdc8dea.

Please help,
Drew