Large object uploads should validate the -S option
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
python-swiftclient |
In Progress
|
Undecided
|
pei ran wu |
Bug Description
swift info has all the deets on min_segment_size:
Additional middleware: slo
Options:
max_manifest_
max_manifest_
min_segment_size: 1048576
But when you try to upload a SLO with too small segments - we *first* upload all the segments - then we fail to create the manifest and return an incomplete and uninformative error (and also orphan the segments):
vagrant@
testme.builder segment 0
testme.builder segment 1
testme.builder segment 2
testme.builder segment 6
testme.builder segment 3
testme.builder segment 4
testme.builder segment 5
testme.builder segment 7
testme.builder segment 9
testme.builder segment 10
testme.builder segment 8
testme.builder segment 11
testme.builder segment 12
testme.builder segment 13
testme.builder segment 14
testme.builder segment 15
testme.builder segment 16
testme.builder segment 19
testme.builder segment 17
testme.builder segment 20
testme.builder segment 18
testme.builder segment 21
Object PUT failed: http://
We should check /info before we start to upload the segments, and provide a useful error early (before uploading anything) if the inevitable manifest creation will fail.
Changed in python-swiftclient: | |
status: | New → Confirmed |
Changed in python-swiftclient: | |
assignee: | nobody → pei ran wu (wupeiran) |
Changed in python-swiftclient: | |
status: | Confirmed → In Progress |
Related bad stuff in lp bug #1680083 if we upload with --use-slo to a cluster that doesn't have SLO in the pipeline at all.