EDP does not accept Swift container as collection of job binaries
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Sahara |
Invalid
|
Undecided
|
Unassigned |
Bug Description
We have code which accepts Swift container as a storage of job binaries, here:
https:/
It is expected that we will take all the files inside container as job binaries. But the code does not work. The following exception occurs at a later stage:
2014-04-11 13:33:39.680 61774 TRACE sahara.context Traceback (most recent call last):
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context func(*args, **kwargs)
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context upload_
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context hdfs_user)
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context r.write_
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context self._run_
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context return self._run_
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context return self._run(func, *args, **kwargs)
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context return procutils.
2014-04-11 13:33:39.680 61774 TRACE sahara.context File "/Users/
2014-04-11 13:33:39.680 61774 TRACE sahara.context raise SubprocessExcep
2014-04-11 13:33:39.680 61774 TRACE sahara.context SubprocessExcep
I think we should consider enhancing getting binaries from container to allow getting all binaries with some prefix.
Duplicate of https:/ /bugs.launchpad .net/sahara/ +bug/1306505